CCRL 40/4
Downloads and Statistics
September 14, 2019
Testing summary:
Total: 2'097'576 games
played by 2'442 programs
28220 CPU days (X2 4600+)

White wins: 814'639 (38.8%)
Black wins: 658'954 (31.4%)
Draws: 623'983 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 8 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on September 14, 2019 with Bayeselo based on 2'097'576 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Deep Sjeng WC2008 64-bit 4CPU2940+8−839.6%+78.532.1%6111 
96.1%
 Deep Sjeng 3.0 64-bit 4CPU2930+9−940.3%+72.133.3%4947
70.9%
 Deep Sjeng c't 20102925+14−1448.5%+8.435.8%1705
100.0%
 Deep Sjeng WC2008 64-bit2842+10−1044.4%+38.535.6%3617
73.7%
 Deep Sjeng 3.0 64-bit2838+10−1144.7%+37.333.5%3363
100.0%
 Deep Sjeng 2.7 4CPU2777+15−1533.7%+115.530.7%1714
100.0%
 Deep Sjeng 2.52665+32−3251.9%−13.534.2%322
100.0%
 Deep Sjeng 1.62573+33−3340.5%+64.228.4%320
100.0%
 Sjeng 12.132375+11−1148.7%+7.824.8%3237
 

Results matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng WC2008 64-bit 4CPU2940         
2Deep Sjeng 3.0 64-bit 4CPU2930         
3Deep Sjeng c't 20102925         
4Deep Sjeng WC2008 64-bit2842    2.5 − 5.5
+0−3=5
−105
    
5Deep Sjeng 3.0 64-bit2838   5.5 − 2.5
+3−0=5
+105
     
6Deep Sjeng 2.7 4CPU2777         
7Deep Sjeng 2.52665         
8Deep Sjeng 1.62573         
9Sjeng 12.132375         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng WC2008 64-bit 4CPU2940 96.196.3100.0100.0100.0100.0100.0100.0
2Deep Sjeng 3.0 64-bit 4CPU29303.9 70.9100.0100.0100.0100.0100.0100.0
3Deep Sjeng c't 201029253.729.1 100.0100.0100.0100.0100.0100.0
4Deep Sjeng WC2008 64-bit28420.00.00.0 73.7100.0100.0100.0100.0
5Deep Sjeng 3.0 64-bit28380.00.00.026.3 100.0100.0100.0100.0
6Deep Sjeng 2.7 4CPU27770.00.00.00.00.0 100.0100.0100.0
7Deep Sjeng 2.526650.00.00.00.00.00.0 100.0100.0
8Deep Sjeng 1.625730.00.00.00.00.00.00.0 100.0
9Sjeng 12.1323750.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng WC2008 64-bit 4CPU2940 74951321626394898000
2Deep Sjeng 3.0 64-bit 4CPU29307495 11125086381769000
3Deep Sjeng c't 2010292513211112 2652713640015
4Deep Sjeng WC2008 64-bit2842626508265 29840000
5Deep Sjeng 3.0 64-bit28383946382712984 150000
6Deep Sjeng 2.7 4CPU277789817693640150 000
7Deep Sjeng 2.52665000000 1770
8Deep Sjeng 1.62573000000177 63
9Sjeng 12.1323750015000063 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng WC2008 64-bit 4CPU2940 67.816.96.44.211.50.00.00.0
2Deep Sjeng 3.0 64-bit 4CPU293067.8 16.75.97.726.60.00.00.0
3Deep Sjeng c't 2010292516.916.7 5.05.310.60.00.00.3
4Deep Sjeng WC2008 64-bit28426.45.95.0 42.80.00.00.00.0
5Deep Sjeng 3.0 64-bit28384.27.75.342.8 3.00.00.00.0
6Deep Sjeng 2.7 4CPU277711.526.610.60.03.0 0.00.00.0
7Deep Sjeng 2.526650.00.00.00.00.00.0 27.60.0
8Deep Sjeng 1.625730.00.00.00.00.00.027.6 1.8
9Sjeng 12.1323750.00.00.30.00.00.00.01.8 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 116 common opponents

Custom engine selection
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Houdini 2.0c 64-bit 4CPU32778%
4/50
13%
6.5/50
       
Stockfish 4 64-bit 4CPU32696%
3/50
11%
5.5/50
       
Houdini 1.5a 64-bit 4CPU32658%
4/50
10%
5/50
       
Komodo 5.1 64-bit 4CPU323913%
6.5/51
6%
3/51
       
Stockfish 3 64-bit 4CPU32379%
4.5/50
12%
6/50
       
Critter 1.2 64-bit 4CPU320916%
8/49
10%
5/48
       
Rybka 4.1 64-bit 4CPU320614%
7/50
14%
7/50
       
Stockfish 2.1.1 64-bit 4CPU319415%
7.5/50
12%
6/50
       
Komodo CCT 64-bit318115%
7.5/50
12%
6/50
 14%
4.5/32
     
Houdini 1.5a 64-bit317015%
7.5/50
17%
8.5/50
       
Stockfish 2.0.1 64-bit 4CPU316719%
9.5/50
23%
11.5/49
       
Rybka 3 64-bit 4CPU316612%
12/100
21%
21/100
       
Critter 1.01 64-bit 4CPU315614%
7/50
17%
8.5/50
       
Stockfish 1.9.1 64-bit 4CPU315321%
21/99
12%
11.5/99
21%
10.5/50
      
Stockfish 1.7.1 64-bit 4CPU314127%
17.5/65
20%
13/65
       
Stockfish 1.8 64-bit 4CPU313725%
12.5/50
29%
14.5/50
       
Critter 0.90 64-bit 4CPU312825%
12.5/50
21%
10.5/49
18%
9/50
      
Komodo 4 64-bit312726%
13/50
20%
10/50
 17%
8.5/50
     
Komodo 3 64-bit310930%
15/50
20%
10/50
20%
19.5/100
      
Rybka 4.1 64-bit3109  0%
0/1
17%
8.5/50
     
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Rybka 4 64-bit310223%
11.5/50
   18%
9/50
    
Naum 4.2 64-bit 4CPU309925%
16/63
24%
15.5/64
30%
15/50
      
Rybka 3 64-bit3078 26%
26/100
 33%
3/9
25%
22.5/90
    
Komodo 2.01 64-bit307131%
15.5/50
32%
16/50
       
Komodo 2.03 64-bit307134%
17/50
33%
16.5/50
       
Critter 0.80 64-bit 4CPU307030%
15/50
24%
12/50
       
Naum 4.1 64-bit 4CPU307034%
17/50
39%
19.5/50
       
Naum 4 64-bit 4CPU306330%
29.5/100
38%
38/100
       
Stockfish 1.7.1 64-bit3045   23%
7.5/32
28%
9/32
    
Rybka 2.3.2a 64-bit 4CPU3044 42%
42.5/100
   15%
35/241
   
Deep Shredder 12 64-bit 4CPU304238%
77/200
 37%
18.5/50
      
Spike 1.4 Leiden 4CPU303834%
17/50
23%
11.5/50
       
Hiarcs 13.2 4CPU303334%
17/50
30%
15/50
       
Spark 1.0 64-bit 4CPU302934%
17/50
36%
18/50
26%
13.5/52
      
Deep Junior 12.5 64-bit 4CPU301446%
23/50
44%
22/50
       
Deep Junior 13 64-bit 4CPU301243%
21/49
47%
23.5/50
       
Hiarcs 13.1 4CPU300939%
19.5/50
32%
16/50
       
Rybka 2.2 64-bit 4CPU300242%
42/100
38%
37.5/100
       
Komodo 1.3 64-bit299339%
19.5/50
33%
16.5/50
       
Deep Junior 12 64-bit 4CPU299045%
22.5/50
46%
23/50
       
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Chiron 1.5 64-bit2989  40%
20/50
24%
7.5/31
     
Spark 0.4 64-bit 4CPU298941%
26.5/64
34%
21.5/64
       
Naum 4.2 64-bit2987   34%
17/50
24%
12/50
    
Fritz 13298646%
23/50
39%
19.5/50
       
Naum 3 64-bit 4CPU2986 42%
41.5/100
   19%
9.5/50
   
Stockfish 1.6.3 64-bit2985   24%
14/58
36%
21.5/59
    
Stockfish 1.6s JA 64-bit2980   29%
15.5/54
29%
15.5/54
    
Naum 3.1 64-bit 4CPU297945%
45/100
43%
43/100
       
Rybka 2.3.2a 64-bit2977 42%
42/100
  26%
13/50
    
Protector 1.4.0 64-bit 4CPU297248%
24/50
46%
22.5/49
       
Zappa Mexico II 64-bit 4CPU297143%
43/100
 48%
24/50
      
Komodo 1.2 64-bit2967  53%
26/49
 33%
10/30
    
Deep Shredder 12 64-bit2955   36%
22.5/62
23%
14/62
    
Naum 4.1 64-bit2955   45%
18/40
35%
14/40
    
Protector 1.3.4 64-bit 4CPU295249%
31.5/64
59%
20.5/35
47%
23/49
      
Thinker 5.4c Inert 64-bit 4CPU295246%
46/100
50%
49.5/100
       
Naum 4 64-bit2948   31%
18/58
25%
2/8
    
Zappa Mexico 64-bit 4CPU294646%
45.5/100
    30%
30/99
   
Deep Junior 11.1a 64-bit 4CPU294354%
27/50
48%
24/50
       
Gull 1.1 64-bit294353%
26.5/50
44%
22/50
       
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Hiarcs 12 4CPU294160%
60.5/100
46%
46.5/100
   33%
16.5/50
   
Hiarcs 12.1 4CPU293948%
47.5/100
51%
51/100
       
Deep Shredder 11 64-bit 4CPU293248%
48/100
38%
38/99
   28%
28.5/101
   
Komodo 1.0 64-bit293256%
55.5/100
  40%
16/40
41%
16.5/40
    
Thinker 5.4a Inert 64-bit 4CPU292754%
54.5/100
56%
56/100
       
Deep Fritz 10.1 4CPU2926 52%
27.5/53
   26%
26/100
   
Thinker 5.3b Inert 64-bit 4CPU292356%
54.5/98
46%
45/98
       
Spark 0.5 64-bit2920   38%
19/50
31%
11/35
    
Glaurung 2.2 64-bit 4CPU291560%
67.5/113
53%
59.5/113
       
DiscoCheck 5.2.1 64-bit2914  83%
2.5/3
 34%
11/32
    
Hiarcs 13.12914  62%
31/50
35%
17.5/50
     
Stockfish 1.5.1 64-bit2912   41%
33/80
36%
18/50
    
Bright 0.4a 4CPU291050%
50/100
49%
49/99
       
Fritz 122908   38%
41.5/108
44%
3.5/8
    
Toga II 1.4 beta5c 4CPU290450%
50/100
52%
52/100
       
Glaurung 2.1 64-bit 4CPU290057%
57/100
57%
57/100
       
Toga II 1.4.1SE 4CPU289954%
54.5/100
61%
61/100
59%
29.5/50
  31%
15.5/50
   
Doch 1.3.4 64-bit2894   44%
17.5/40
39%
15.5/40
    
Fritz 11288860%
60/100
  25%
2/8
69%
5.5/8
    
Thinker 5.4d Inert 64-bit2885   54%
21.5/40
41%
16.5/40
    
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Thinker 5.4c Inert 64-bit2883   36%
32/88
47%
27/58
    
Thinker 5.4a Inert 64-bit288263%
63/100
56%
55.5/99
 51%
25.5/50
45%
22.5/50
    
Loop M1-T 64-bit 4CPU288158%
58/100
55%
54/99
58%
28/48
  34%
33.5/98
   
Gaviota 1.0 64-bit2872  25%
0.5/2
 52%
16.5/32
    
Doch 1.2 64-bit2866   47%
22.5/48
39%
7/18
    
DisasterArea 1.65 64-bit2865  50%
1/2
 39%
12.5/32
    
Glaurung 2.0.1 64-bit 4CPU2861 59%
59/100
   37%
18.5/50
   
Doch 09.980 64-bit2855   51%
24.5/48
42%
21/50
    
Protector 1.3.4 64-bit2852   42%
13.5/32
50%
16/32
    
Shredder 112847   52%
22.5/43
52%
32/61
    
Spark 0.3 64-bit2844   47%
60.5/129
53%
26/49
    
Zappa Mexico II 64-bit2844  50%
1/2
49%
18.5/38
52%
46/89
    
Deep Junior 11.1a 64-bit2840   55%
36/66
48%
31/65
    
Onno 1.1.1 64-bit2837   52%
30/58
50%
29/58
    
Hiarcs 122835   69%
5.5/8
51%
45.5/90
    
Hiarcs 12.12833   51%
45/88
44%
3.5/8
    
Deep Junior 10 4CPU2832 69%
27.5/40
   39%
39/99
   
Crafty 23.8 64-bit2825   60%
6/10
47%
15/32
    
Toga II 1.4 beta5c2820   55%
27.5/50
49%
24.5/50
    
Glaurung 2.2 64-bit280274%
74/100
69%
69/100
 46%
23/50
     
NameEloDeep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.5
Deep
Sjeng
1.6
Sjeng
12.13
Thinker 5.4a Passive 64-bit2793   53%
26.5/50
58%
29/50
    
Ktulu 92781   60%
29.5/49
61%
30.5/50
    
Bright 0.5c2772  69%
27.5/40
53%
17/32
52%
16.5/32
    
Twisted Logic 20100131x 64-bit2766  0%
0/1
63%
36/57
60%
34/57
    
SmarThink 1.20 64-bit2747   66%
33/50
58%
29/50
    
Naum 2.1 32-bit2738      34%
10.5/31
38%
11.5/30
 
Spike 1.2 Turin2731 73%
72.5/99
80%
32/40
 65%
32.5/50
56%
55.5/100
   
Bright 0.1d2641      55%
17.5/32
31%
10/32
 
Scorpio 1.912641      55%
17.5/32
42%
8.5/20
 
Trace 1.37a2500  100%
1/1
     30%
9.5/32
Scorpio 2.1 64-bit2487   86%
43/50
88%
44/50
    
Kiwi 0.6d 64-bit2470  100%
1/1
     45%
13.5/30
Matacz 1.42446  50%
0.5/1
     35%
12/34
Snitch 1.6.2 32-bit2418  100%
1/1
     48%
15.5/32
Djinn 0.925x2373       79%
24.5/31
48%
15.5/32
Esc 1.162267  100%
1/1
     59%
19/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 14, 2019