CCRL 40/4
Downloads and Statistics
October 19, 2019
Testing summary:
Total: 2'120'567 games
played by 2'479 programs
28673 CPU days (X2 4600+)

White wins: 822'832 (38.8%)
Black wins: 665'262 (31.4%)
Draws: 632'473 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 12 engines!
12 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on October 19, 2019 with Bayeselo based on 2'120'567 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Thinker 5.4c Inert 64-bit 4CPU2952+9−942.7%+49.534.8%5132 
100.0%
 Thinker 5.4a Inert 64-bit 4CPU2926+13−1350.9%−10.935.3%2096
65.8%
 Thinker 5.3b Inert 64-bit 4CPU2922+15−1545.9%+28.238.1%1468
68.6%
 Thinker 5.4d Inert 64-bit 4CPU2897+98−10045.3%+30.034.4%32
59.3%
 Thinker 5.4d Inert 64-bit2885+8−848.2%+13.336.0%6008
65.7%
 Thinker 5.4c Inert 64-bit2883+9−952.9%−20.735.2%5054
54.7%
 Thinker 5.4a Inert 64-bit2882+14−1445.1%+34.336.8%1740
85.2%
 Thinker 5.3b Inert 64-bit2867+23−2351.4%−8.337.1%609
99.7%
 Thinker 5.3b Passive 64-bit2819+26−2647.3%+22.635.4%500
94.4%
 Thinker 5.4a Passive 64-bit2792+22−2243.1%+46.332.9%700
96.1%
 Thinker 5.1e Passive 64-bit2757+32−3259.2%−62.029.1%354
100.0%
 Thinker 4.7a2535+11−1152.7%−21.731.7%2884
 

Results matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952            
2Thinker 5.4a Inert 64-bit 4CPU2926            
3Thinker 5.3b Inert 64-bit 4CPU2922            
4Thinker 5.4d Inert 64-bit 4CPU2897            
5Thinker 5.4d Inert 64-bit2885     21.5 − 18.5
+9−6=25
+18
      
6Thinker 5.4c Inert 64-bit2883    18.5 − 21.5
+6−9=25
−18
       
7Thinker 5.4a Inert 64-bit2882            
8Thinker 5.3b Inert 64-bit2867            
9Thinker 5.3b Passive 64-bit2819            
10Thinker 5.4a Passive 64-bit2792            
11Thinker 5.1e Passive 64-bit2757            
12Thinker 4.7a2535            
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 100.0100.085.7100.0100.0100.0100.0100.0100.0100.0100.0
2Thinker 5.4a Inert 64-bit 4CPU29260.0 65.871.4100.0100.0100.0100.0100.0100.0100.0100.0
3Thinker 5.3b Inert 64-bit 4CPU29220.034.2 68.6100.0100.0100.0100.0100.0100.0100.0100.0
4Thinker 5.4d Inert 64-bit 4CPU289714.328.631.4 59.361.061.771.593.097.799.5100.0
5Thinker 5.4d Inert 64-bit28850.00.00.040.7 65.765.692.2100.0100.0100.0100.0
6Thinker 5.4c Inert 64-bit28830.00.00.039.034.3 54.789.0100.0100.0100.0100.0
7Thinker 5.4a Inert 64-bit28820.00.00.038.334.445.3 85.2100.0100.0100.0100.0
8Thinker 5.3b Inert 64-bit28670.00.00.028.57.811.014.8 99.7100.0100.0100.0
9Thinker 5.3b Passive 64-bit28190.00.00.07.00.00.00.00.3 94.499.8100.0
10Thinker 5.4a Passive 64-bit27920.00.00.02.30.00.00.00.05.6 96.1100.0
11Thinker 5.1e Passive 64-bit27570.00.00.00.50.00.00.00.00.23.9 100.0
12Thinker 4.7a25350.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 418427630750862178900000
2Thinker 5.4a Inert 64-bit 4CPU29264184 2771019224179400000
3Thinker 5.3b Inert 64-bit 4CPU292227632771 016824158100000
4Thinker 5.4d Inert 64-bit 4CPU2897000 00000000
5Thinker 5.4d Inert 64-bit28857501921680 3867885743623715136123
6Thinker 5.4c Inert 64-bit2883862242403867 1602129111021399223205
7Thinker 5.4a Inert 64-bit288217891794158108851602 1113932133217081
8Thinker 5.3b Inert 64-bit2867000074312911113 10009487281
9Thinker 5.3b Passive 64-bit2819000062311029321000 8007281
10Thinker 5.4a Passive 64-bit2792000071513991332948800 17081
11Thinker 5.1e Passive 64-bit275700001362231707272170 110
12Thinker 4.7a2535000012320581818181110 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Thinker 5.4c Inert 64-bit 4CPU2952 57.941.90.06.78.526.00.00.00.00.00.0
2Thinker 5.4a Inert 64-bit 4CPU292657.9 77.70.02.40.346.80.00.00.00.00.0
3Thinker 5.3b Inert 64-bit 4CPU292241.977.7 0.02.20.449.30.00.00.00.00.0
4Thinker 5.4d Inert 64-bit 4CPU28970.00.00.0 0.00.00.00.00.00.00.00.0
5Thinker 5.4d Inert 64-bit28856.72.42.20.0 35.011.411.29.610.72.11.4
6Thinker 5.4c Inert 64-bit28838.50.30.40.035.0 23.622.819.824.34.12.6
7Thinker 5.4a Inert 64-bit288226.046.849.30.011.423.6 47.441.654.68.11.8
8Thinker 5.3b Inert 64-bit28670.00.00.00.011.222.847.4 90.272.47.52.3
9Thinker 5.3b Passive 64-bit28190.00.00.00.09.619.841.690.2 66.78.42.4
10Thinker 5.4a Passive 64-bit27920.00.00.00.010.724.354.672.466.7 16.12.3
11Thinker 5.1e Passive 64-bit27570.00.00.00.02.14.18.17.58.416.1 3.4
12Thinker 4.7a25350.00.00.00.01.42.61.82.32.42.33.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 94 common opponents

Custom engine selection
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Houdini 2.0c 64-bit3201    15%
1.5/10
8%
4/50
      
Komodo CCT 64-bit318116%
8/50
   19%
6/32
       
Houdini 1.5a 64-bit317019%
9.5/50
   10%
4/40
8%
2.5/32
      
Rybka 3 64-bit 4CPU316617%
16.5/99
18%
17.5/100
14%
13/96
 12%
1/8
 12%
12.5/100
     
Komodo 4 64-bit312624%
12/50
   10%
1/10
9%
4.5/49
      
Stockfish 2.2.2 64-bit3114    5%
0.5/10
3%
1.5/47
      
Komodo 3 64-bit310933%
16.5/50
   19%
1.5/8
20%
6.5/32
      
Rybka 4 64-bit310121%
10.5/50
    18%
13.5/77
      
Naum 4.2 64-bit 4CPU309827%
17.5/64
   19%
1.5/8
       
Rybka 3 64-bit3077    15%
6/40
22%
13/58
17%
8.5/50
16%
8/50
12%
6/50
   
Komodo 2.01 64-bit307132%
16/50
    20%
6.5/32
      
Komodo 2.03 64-bit307129%
14.5/50
    25%
8/32
      
Naum 4 64-bit 4CPU306130%
29.5/98
26%
26/100
26%
26/100
   22%
21.5/100
     
Stockfish 1.8 64-bit3057    30%
9.5/32
28%
9.5/34
      
Spike 1.4 Leiden 4CPU303944%
22/50
   12%
1/8
       
Spark 1.0 64-bit 4CPU302942%
21/50
   19%
1.5/8
       
Rybka 2.2 64-bit 4CPU300244%
44/100
40%
40/100
          
Komodo 1.3 64-bit299337%
18.5/50
    33%
10.5/32
      
Fritz 13298544%
22/50
   40%
17/42
       
Stockfish 1.6.3 64-bit2985    29%
17/58
35%
20.5/58
      
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Stockfish 1.6s JA 64-bit2979    40%
21.5/54
31%
16.5/54
      
Naum 3.1 64-bit 4CPU297844%
44.5/100
38%
38.5/100
36%
35/97
   36%
35.5/99
     
Rybka 2.3.2a 64-bit2977    34%
11/32
35%
17.5/50
29%
14.5/50
  15%
7.5/50
17%
8/48
 
Stockfish 1.4 64-bit 4CPU297550%
49.5/100
38%
38.5/100
          
Protector 1.4.0 64-bit 4CPU297237%
18.5/50
   38%
3/8
       
Zappa Mexico II 64-bit 4CPU297047%
47/100
46%
46.5/100
49%
48/98
         
Vajolet2 2.2 64-bit2961    33%
10.5/32
48%
9.5/20
      
Deep Shredder 12 64-bit2955    41%
18/44
34%
21/62
      
Naum 4.1 64-bit2955    36%
14.5/40
32%
13/40
      
Onno 1.2.70 64-bit 4CPU295543%
21.5/50
   44%
3.5/8
       
Naum 4 64-bit2947    35%
14/40
39%
22.5/58
44%
22/50
35%
34/98
 30%
15/50
  
Zappa Mexico 64-bit 4CPU294556%
56.5/100
50%
49.5/100
42%
42.5/100
         
Gull 1.1 64-bit294340%
20/50
    33%
10.5/32
      
Hiarcs 12 4CPU294154%
53.5/100
52%
51.5/100
53%
52/98
   40%
39.5/99
     
Deep Sjeng WC2008 64-bit 4CPU294054%
54/100
46%
45.5/100
44%
43.5/98
   37%
37/100
     
Hiarcs 12.1 4CPU293848%
48.5/100
52%
52/100
    45%
44/98
     
Texel 1.03 64-bit2938    53%
20.5/39
40%
4/10
      
Komodo 1.0 64-bit293252%
52.5/100
   46%
18.5/40
54%
21.5/40
      
Deep Shredder 11 64-bit 4CPU293155%
54/99
45%
45/99
51%
50/99
         
Deep Sjeng 3.0 64-bit 4CPU293050%
50.5/100
44%
44/100
54%
53/98
   44%
43.5/99
     
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Spark 1.0 64-bit2927    46%
6/13
39%
12.5/32
      
Spike 1.4 Leiden2921    67%
4/6
45%
13/29
      
Glaurung 2.2 64-bit 4CPU291459%
59/100
50%
49.5/100
48%
48/100
 44%
3.5/8
 40%
40/99
     
Stockfish 1.5.1 64-bit2912    44%
14/32
44%
34/78
      
Bright 0.4a 4CPU291056%
56/100
48%
48.5/100
57%
56.5/99
         
Fritz 122908    44%
3.5/8
46%
26.5/58
      
Toga II 1.4 beta5c 4CPU290462%
62/100
57%
57/100
  38%
3/8
       
Toga II 1.4.1SE 4CPU289956%
55/98
52%
51.5/100
54%
53/98
   46%
45.5/100
     
Doch 1.3.4 64-bit2893    46%
22/48
41%
16.5/40
      
Fritz 11288762%
62.5/100
54%
54.5/100
51%
47/93
 50%
20/40
19%
1.5/8
      
Loop M1-T 64-bit 4CPU288161%
59.5/97
64%
63.5/100
58%
56.5/98
         
Toga II 3.02875    75%
4.5/6
55%
5.5/10
      
Doch 1.2 64-bit2865    53%
9.5/18
48%
23/48
      
Naum 3.1 64-bit2863     51%
25.5/50
68%
34/50
46%
23/50
39%
19.5/50
37%
18.5/50
  
Doch 09.980 64-bit2855    59%
19/32
68%
34/50
      
Naum 3 64-bit2854     60%
29.5/49
65%
32.5/50
  44%
22/50
  
NirvanaChess 1.7 64-bit2848    55%
21/38
60%
6/10
      
Shredder 112847     61%
19/31
58%
18.5/32
59%
6.5/11
    
Spark 0.3 64-bit2843    47%
37.5/80
60%
77/128
      
Zappa Mexico II 64-bit2843    63%
33.5/53
65%
57.5/88
58%
47.5/82
54%
27/50
43%
21.5/50
42%
21/50
  
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Deep Shredder 11 64-bit2842     56%
28/50
60%
30/50
63%
31.5/50
43%
21.5/50
53%
26.5/50
  
Deep Sjeng WC2008 64-bit2842    46%
18.5/40
64%
56/88
49%
24.5/50
47%
23.5/50
54%
27/50
47%
23.5/50
  
Deuterium 14.2.33.276 64-bit2842    75%
4.5/6
50%
5/10
      
Deep Junior 11.1a 64-bit2840    56%
37/66
64%
42/66
      
Booot 5.1.02838    59%
23.5/40
64%
20.5/32
      
Deep Sjeng 3.0 64-bit2837    59%
23.5/40
53%
31/58
55%
27.5/50
  42%
21/50
  
Onno 1.1.1 64-bit2837    59%
23.5/40
61%
35.5/58
      
Hiarcs 122834    68%
27/40
66%
38.5/58
52%
26/50
59%
29.5/50
47%
23.5/50
44%
22/50
  
Hiarcs 12.12833    69%
27.5/40
68%
26/38
      
Toga II 1.4.1SE2823    55%
16.5/30
62%
37/60
 54%
27/50
41%
20.5/50
   
Hiarcs Paderborn 20072819     57%
28.5/50
56%
28/50
  44%
22/50
  
Scorpio 2.7.6 64-bit2815    67%
4/6
66%
21/32
      
Tornado 4.88 64-bit2810    62%
7.5/12
60%
6/10
      
Glaurung 2.1 64-bit2782     68%
34/50
64%
32/50
62%
31/50
60%
30/50
46%
23/50
  
Ktulu 92781    62%
20/32
59%
29.5/50
      
Bright 0.4a2779    71%
27/38
54%
27/50
68%
34/50
73%
36.5/50
67%
33.5/50
52%
26/50
  
Bright 0.5c2771    68%
27/40
69%
42.5/62
      
MinkoChess 0.9 64-bit2770    72%
21.5/30
76%
45.5/60
      
Twisted Logic 20090922 64-bit2770    69%
27/39
65%
32.5/50
      
Frenzee 3.5.19 64-bit2769    92%
5.5/6
76%
23.5/31
      
NameEloThinker
5.4c
Inert
64-bit
4CPU
Thinker
5.4a
Inert
64-bit
4CPU
Thinker
5.3b
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
4CPU
Thinker
5.4d
Inert
64-bit
Thinker
5.4c
Inert
64-bit
Thinker
5.4a
Inert
64-bit
Thinker
5.3b
Inert
64-bit
Thinker
5.3b
Passive
64-bit
Thinker
5.4a
Passive
64-bit
Thinker
5.1e
Passive
64-bit
Thinker
4.7a
Twisted Logic 20100131x 64-bit2766    67%
37.5/56
65%
57.5/88
      
Jonny 4.002762    67%
4/6
75%
21/28
      
BugChess2 1.9 64-bit2758    50%
3/6
75%
24/32
      
SmarThink 1.20 64-bit2747    75%
24/32
70%
35/50
      
Crafty 23.0 64-bit 4CPU274377%
75.5/98
81%
80/99
          
Spike 1.2 Turin2731    66%
21/32
72%
36/50
78%
39/50
71%
35.5/50
67%
33.5/50
55%
27.5/50
62%
15/24
16%
5/31
Scorpio 2.1 64-bit 4CPU272280%
79.5/100
78%
77/99
          
Naum 2.0 32-bit2699    92%
27.5/30
70%
21/30
     20%
6/30
Delfi 5.42682    83%
25/30
73%
44/60
      
Alaric 7072663     84%
24.5/29
    65%
15.5/24
 
Colossus 2007d2610          76%
17.5/23
42%
13.5/32
ProDeo 1.22608    87%
26/30
77%
23/30
      
ProDeo 1.12587     86%
27.5/32
     44%
14/32
Arasan 11.3 64-bit 4CPU257393%
92/99
91%
90/99
          
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 19, 2019