CCRL 40/4
Downloads and Statistics
November 14, 2019
Testing summary:
Total: 2'129'428 games
played by 2'486 programs
28790 CPU days (X2 4600+)

White wins: 825'928 (38.8%)
Black wins: 667'489 (31.3%)
Draws: 636'011 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 12 engines!
12 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 14, 2019 with Bayeselo based on 2'129'428 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Thinker 5.4c Inert 64-bit 4CPU2952+9−942.7%+50.134.8%5132 
100.0%
 Thinker 5.4a Inert 64-bit 4CPU2927+13−1350.9%−11.335.3%2096
65.8%
 Thinker 5.3b Inert 64-bit 4CPU2923+15−1545.9%+27.838.1%1468
68.7%
 Thinker 5.4d Inert 64-bit 4CPU2897+98−10045.3%+31.034.4%32
58.8%
 Thinker 5.4d Inert 64-bit2886+8−848.2%+13.036.0%6065
68.0%
 Thinker 5.4c Inert 64-bit2883+9−952.9%−19.935.2%5054
54.9%
 Thinker 5.4a Inert 64-bit2882+14−1445.1%+35.036.8%1740
85.1%
 Thinker 5.3b Inert 64-bit2868+23−2351.4%−8.537.1%609
99.7%
 Thinker 5.3b Passive 64-bit2820+26−2647.3%+22.435.4%500
94.4%
 Thinker 5.4a Passive 64-bit2793+22−2243.1%+46.032.9%700
96.1%
 Thinker 5.1e Passive 64-bit2758+32−3259.2%−62.429.1%354
100.0%
 Thinker 4.7a2536+11−1152.7%−22.031.7%2884
 

Results matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952            
2Thinker 5.4a Inert 64-bit 4CPU2927            
3Thinker 5.3b Inert 64-bit 4CPU2923            
4Thinker 5.4d Inert 64-bit 4CPU2897            
5Thinker 5.4d Inert 64-bit2886     21.5 − 18.5
+9−6=25
+17
      
6Thinker 5.4c Inert 64-bit2883    18.5 − 21.5
+6−9=25
−17
       
7Thinker 5.4a Inert 64-bit2882            
8Thinker 5.3b Inert 64-bit2868            
9Thinker 5.3b Passive 64-bit2820            
10Thinker 5.4a Passive 64-bit2793            
11Thinker 5.1e Passive 64-bit2758            
12Thinker 4.7a2536            
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 100.0100.085.8100.0100.0100.0100.0100.0100.0100.0100.0
2Thinker 5.4a Inert 64-bit 4CPU29270.0 65.871.5100.0100.0100.0100.0100.0100.0100.0100.0
3Thinker 5.3b Inert 64-bit 4CPU29230.034.2 68.7100.0100.0100.0100.0100.0100.0100.0100.0
4Thinker 5.4d Inert 64-bit 4CPU289714.228.531.3 58.860.861.571.392.997.799.5100.0
5Thinker 5.4d Inert 64-bit28860.00.00.041.2 68.067.492.5100.0100.0100.0100.0
6Thinker 5.4c Inert 64-bit28830.00.00.039.232.0 54.988.9100.0100.0100.0100.0
7Thinker 5.4a Inert 64-bit28820.00.00.038.532.645.1 85.1100.0100.0100.0100.0
8Thinker 5.3b Inert 64-bit28680.00.00.028.77.511.114.9 99.7100.0100.0100.0
9Thinker 5.3b Passive 64-bit28200.00.00.07.10.00.00.00.3 94.499.8100.0
10Thinker 5.4a Passive 64-bit27930.00.00.02.30.00.00.00.05.6 96.1100.0
11Thinker 5.1e Passive 64-bit27580.00.00.00.50.00.00.00.00.23.9 100.0
12Thinker 4.7a25360.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 418427630750862178900000
2Thinker 5.4a Inert 64-bit 4CPU29274184 2771019224179400000
3Thinker 5.3b Inert 64-bit 4CPU292327632771 016824158100000
4Thinker 5.4d Inert 64-bit 4CPU2897000 00000000
5Thinker 5.4d Inert 64-bit28867501921680 3867885743623715136123
6Thinker 5.4c Inert 64-bit2883862242403867 1602129111021399223205
7Thinker 5.4a Inert 64-bit288217891794158108851602 1113932133217081
8Thinker 5.3b Inert 64-bit2868000074312911113 10009487281
9Thinker 5.3b Passive 64-bit2820000062311029321000 8007281
10Thinker 5.4a Passive 64-bit2793000071513991332948800 17081
11Thinker 5.1e Passive 64-bit275800001362231707272170 110
12Thinker 4.7a2536000012320581818181110 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 57.941.90.06.78.526.00.00.00.00.00.0
2Thinker 5.4a Inert 64-bit 4CPU292757.9 77.70.02.40.346.80.00.00.00.00.0
3Thinker 5.3b Inert 64-bit 4CPU292341.977.7 0.02.20.449.30.00.00.00.00.0
4Thinker 5.4d Inert 64-bit 4CPU28970.00.00.0 0.00.00.00.00.00.00.00.0
5Thinker 5.4d Inert 64-bit28866.72.42.20.0 34.811.311.19.510.62.11.4
6Thinker 5.4c Inert 64-bit28838.50.30.40.034.8 23.622.819.824.34.12.6
7Thinker 5.4a Inert 64-bit288226.046.849.30.011.323.6 47.441.654.68.11.8
8Thinker 5.3b Inert 64-bit28680.00.00.00.011.122.847.4 90.272.47.52.3
9Thinker 5.3b Passive 64-bit28200.00.00.00.09.519.841.690.2 66.78.42.4
10Thinker 5.4a Passive 64-bit27930.00.00.00.010.624.354.672.466.7 16.12.3
11Thinker 5.1e Passive 64-bit27580.00.00.00.02.14.18.17.58.416.1 3.4
12Thinker 4.7a25360.00.00.00.01.42.61.82.32.42.33.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 94 common opponents

Custom engine selection
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Houdini 2.0c 64-bit3202    15%
1.5/10
8%
4/50
      
Komodo CCT 64-bit318116%
8/50
   19%
6/32
       
Houdini 1.5a 64-bit317019%
9.5/50
   10%
4/40
8%
2.5/32
      
Rybka 3 64-bit 4CPU316617%
16.5/99
18%
17.5/100
14%
13/96
 12%
1/8
 12%
12.5/100
     
Komodo 4 64-bit312724%
12/50
   10%
1/10
9%
4.5/49
      
Stockfish 2.2.2 64-bit3115    5%
0.5/10
3%
1.5/47
      
Komodo 3 64-bit310933%
16.5/50
   19%
1.5/8
20%
6.5/32
      
Rybka 4 64-bit310221%
10.5/50
    18%
13.5/77
      
Naum 4.2 64-bit 4CPU309927%
17.5/64
   19%
1.5/8
       
Rybka 3 64-bit3078    15%
6/40
22%
13/58
17%
8.5/50
16%
8/50
12%
6/50
   
Komodo 2.01 64-bit307232%
16/50
    20%
6.5/32
      
Komodo 2.03 64-bit307129%
14.5/50
    25%
8/32
      
Naum 4 64-bit 4CPU306130%
29.5/98
26%
26/100
26%
26/100
   22%
21.5/100
     
Stockfish 1.8 64-bit3058    30%
9.5/32
28%
9.5/34
      
Spike 1.4 Leiden 4CPU303944%
22/50
   12%
1/8
       
Spark 1.0 64-bit 4CPU303042%
21/50
   19%
1.5/8
       
Rybka 2.2 64-bit 4CPU300244%
44/100
40%
40/100
          
Komodo 1.3 64-bit299437%
18.5/50
    33%
10.5/32
      
Fritz 13298644%
22/50
   40%
17/42
       
Stockfish 1.6.3 64-bit2986    29%
17/58
35%
20.5/58
      
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Stockfish 1.6s JA 64-bit2980    40%
21.5/54
31%
16.5/54
      
Naum 3.1 64-bit 4CPU297944%
44.5/100
38%
38.5/100
36%
35/97
   36%
35.5/99
     
Rybka 2.3.2a 64-bit2978    34%
11/32
35%
17.5/50
29%
14.5/50
  15%
7.5/50
17%
8/48
 
Stockfish 1.4 64-bit 4CPU297650%
49.5/100
38%
38.5/100
          
Protector 1.4.0 64-bit 4CPU297237%
18.5/50
   38%
3/8
       
Zappa Mexico II 64-bit 4CPU297147%
47/100
46%
46.5/100
49%
48/98
         
Vajolet2 2.2 64-bit2961    33%
10.5/32
48%
9.5/20
      
Naum 4.1 64-bit2956    36%
14.5/40
32%
13/40
      
Onno 1.2.70 64-bit 4CPU295643%
21.5/50
   44%
3.5/8
       
Deep Shredder 12 64-bit2955    41%
18/44
34%
21/62
      
Naum 4 64-bit2948    35%
14/40
39%
22.5/58
44%
22/50
35%
34/98
 30%
15/50
  
Zappa Mexico 64-bit 4CPU294656%
56.5/100
50%
49.5/100
42%
42.5/100
         
Gull 1.1 64-bit294440%
20/50
    33%
10.5/32
      
Deep Sjeng WC2008 64-bit 4CPU294154%
54/100
46%
45.5/100
44%
43.5/98
   37%
37/100
     
Hiarcs 12 4CPU294154%
53.5/100
52%
51.5/100
53%
52/98
   40%
39.5/99
     
Hiarcs 12.1 4CPU293948%
48.5/100
52%
52/100
    45%
44/98
     
Texel 1.03 64-bit2939    53%
20.5/39
40%
4/10
      
Komodo 1.0 64-bit293352%
52.5/100
   46%
18.5/40
54%
21.5/40
      
Deep Shredder 11 64-bit 4CPU293255%
54/99
45%
45/99
51%
50/99
         
Deep Sjeng 3.0 64-bit 4CPU293050%
50.5/100
44%
44/100
54%
53/98
   44%
43.5/99
     
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Spark 1.0 64-bit2927    46%
6/13
39%
12.5/32
      
Spike 1.4 Leiden2922    67%
4/6
45%
13/29
      
Glaurung 2.2 64-bit 4CPU291559%
59/100
50%
49.5/100
48%
48/100
 44%
3.5/8
 40%
40/99
     
Stockfish 1.5.1 64-bit2913    44%
14/32
44%
34/78
      
Bright 0.4a 4CPU291056%
56/100
48%
48.5/100
57%
56.5/99
         
Fritz 122908    44%
3.5/8
46%
26.5/58
      
Toga II 1.4 beta5c 4CPU290462%
62/100
57%
57/100
  38%
3/8
       
Toga II 1.4.1SE 4CPU290056%
55/98
52%
51.5/100
54%
53/98
   46%
45.5/100
     
Doch 1.3.4 64-bit2894    46%
22/48
41%
16.5/40
      
Fritz 11288862%
62.5/100
54%
54.5/100
51%
47/93
 50%
20/40
19%
1.5/8
      
Loop M1-T 64-bit 4CPU288161%
59.5/97
64%
63.5/100
58%
56.5/98
         
Toga II 3.02876    75%
4.5/6
55%
5.5/10
      
Doch 1.2 64-bit2866    53%
9.5/18
48%
23/48
      
Naum 3.1 64-bit2863     51%
25.5/50
68%
34/50
46%
23/50
39%
19.5/50
37%
18.5/50
  
Doch 09.980 64-bit2856    59%
19/32
68%
34/50
      
Naum 3 64-bit2855     60%
29.5/49
65%
32.5/50
  44%
22/50
  
NirvanaChess 1.7 64-bit2849    55%
21/38
60%
6/10
      
Shredder 112848     61%
19/31
58%
18.5/32
59%
6.5/11
    
Spark 0.3 64-bit2844    47%
37.5/80
60%
77/128
      
Zappa Mexico II 64-bit2844    63%
33.5/53
65%
57.5/88
58%
47.5/82
54%
27/50
43%
21.5/50
42%
21/50
  
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Deep Shredder 11 64-bit2843     56%
28/50
60%
30/50
63%
31.5/50
43%
21.5/50
53%
26.5/50
  
Deep Sjeng WC2008 64-bit2843    46%
18.5/40
64%
56/88
49%
24.5/50
47%
23.5/50
54%
27/50
47%
23.5/50
  
Deuterium 14.2.33.276 64-bit2843    75%
4.5/6
50%
5/10
      
Deep Junior 11.1a 64-bit2840    56%
37/66
64%
42/66
      
Booot 5.1.02839    59%
23.5/40
64%
20.5/32
      
Deep Sjeng 3.0 64-bit2838    59%
23.5/40
53%
31/58
55%
27.5/50
  42%
21/50
  
Onno 1.1.1 64-bit2838    59%
23.5/40
61%
35.5/58
      
Hiarcs 122835    68%
27/40
66%
38.5/58
52%
26/50
59%
29.5/50
47%
23.5/50
44%
22/50
  
Hiarcs 12.12833    69%
27.5/40
68%
26/38
      
Toga II 1.4.1SE2824    55%
16.5/30
62%
37/60
 54%
27/50
41%
20.5/50
   
Hiarcs Paderborn 20072819     57%
28.5/50
56%
28/50
  44%
22/50
  
Scorpio 2.7.6 64-bit2816    67%
4/6
66%
21/32
      
Tornado 4.88 64-bit2810    62%
7.5/12
60%
6/10
      
Glaurung 2.1 64-bit2783     68%
34/50
64%
32/50
62%
31/50
60%
30/50
46%
23/50
  
Ktulu 92782    62%
20/32
59%
29.5/50
      
Bright 0.4a2780    71%
27/38
54%
27/50
68%
34/50
73%
36.5/50
67%
33.5/50
52%
26/50
  
Bright 0.5c2772    68%
27/40
69%
42.5/62
      
MinkoChess 0.9 64-bit2771    72%
21.5/30
76%
45.5/60
      
Twisted Logic 20090922 64-bit2771    69%
27/39
65%
32.5/50
      
Frenzee 3.5.19 64-bit2770    92%
5.5/6
76%
23.5/31
      
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Twisted Logic 20100131x 64-bit2767    67%
37.5/56
65%
57.5/88
      
Jonny 4.002763    67%
4/6
75%
21/28
      
BugChess2 1.9 64-bit2759    50%
3/6
75%
24/32
      
SmarThink 1.20 64-bit2748    75%
24/32
70%
35/50
      
Crafty 23.0 64-bit 4CPU274477%
75.5/98
81%
80/99
          
Spike 1.2 Turin2731    66%
21/32
72%
36/50
78%
39/50
71%
35.5/50
67%
33.5/50
55%
27.5/50
62%
15/24
16%
5/31
Scorpio 2.1 64-bit 4CPU272380%
79.5/100
78%
77/99
          
Naum 2.0 32-bit2700    92%
27.5/30
70%
21/30
     20%
6/30
Delfi 5.42683    83%
25/30
73%
44/60
      
Alaric 7072664     84%
24.5/29
    65%
15.5/24
 
Colossus 2007d2611          76%
17.5/23
42%
13.5/32
ProDeo 1.22609    87%
26/30
77%
23/30
      
ProDeo 1.12588     86%
27.5/32
     44%
14/32
Arasan 11.3 64-bit 4CPU257493%
92/99
91%
90/99
          
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 14, 2019