CCRL 40/4
Downloads and Statistics
June 22, 2019
Testing summary:
Total: 2'052'494 games
played by 2'371 programs
27529 CPU days (X2 4600+)

White wins: 797'533 (38.9%)
Black wins: 645'585 (31.5%)
Draws: 609'376 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 11 engines!
11 selected engines played 256 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on June 22, 2019 with Bayeselo based on 2'052'494 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Deep Shredder 13 64-bit 4CPU3323+11−1158.9%−63.642.7%2818 
100.0%
 Shredder 13 64-bit3270+8−848.9%+7.145.9%6158
100.0%
 Deep Shredder 12 64-bit 4CPU3041+7−749.6%+2.637.3%8373
100.0%
 Deep Shredder 12 64-bit2955+8−849.9%+1.636.3%5792
60.5%
 Shredder 12 32-bit2952+19−1959.0%−62.538.1%897
96.6%
 Deep Shredder 11 64-bit 4CPU2932+9−952.1%−16.834.6%4927
100.0%
 Deep Shredder 10 64-bit 4CPU2847+14−1451.4%−11.036.2%1835
47.6%
 Shredder 112847+13−1355.2%−38.034.4%2311
73.3%
 Deep Shredder 11 64-bit2842+11−1150.7%−5.835.2%3117
100.0%
 Shredder Classic 4 c't2785+30−3046.6%+18.736.5%373
94.7%
 Shredder 102754+22−2251.6%−13.433.3%736
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323           
2Shredder 13 64-bit3270           
3Deep Shredder 12 64-bit 4CPU3041           
4Deep Shredder 12 64-bit2955           
5Shredder 12 32-bit2952           
6Deep Shredder 11 64-bit 4CPU2932           
7Deep Shredder 10 64-bit 4CPU2847           
8Shredder 112847        125.5 − 130.5
+58−63=135
−11
  
9Deep Shredder 11 64-bit2842       130.5 − 125.5
+63−58=135
+11
   
10Shredder Classic 4 c't2785           
11Shredder 102754           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Shredder 13 64-bit32700.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Deep Shredder 12 64-bit 4CPU30410.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
4Deep Shredder 12 64-bit29550.00.00.0 60.5100.0100.0100.0100.0100.0100.0
5Shredder 12 32-bit29520.00.00.039.5 96.6100.0100.0100.0100.0100.0
6Deep Shredder 11 64-bit 4CPU29320.00.00.00.03.4 100.0100.0100.0100.0100.0
7Deep Shredder 10 64-bit 4CPU28470.00.00.00.00.00.0 47.668.0100.0100.0
8Shredder 1128470.00.00.00.00.00.052.4 73.3100.0100.0
9Deep Shredder 11 64-bit28420.00.00.00.00.00.032.026.7 100.0100.0
10Shredder Classic 4 c't27850.00.00.00.00.00.00.00.00.0 94.7
11Shredder 1027540.00.00.00.00.00.00.00.00.05.3 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 1601018720000000
2Shredder 13 64-bit3270160 1145690000000
3Deep Shredder 12 64-bit 4CPU30411018114 54615042507081052462430
4Deep Shredder 12 64-bit295572569546 1569233019461635860
5Shredder 12 32-bit2952001501569 148085679500
6Deep Shredder 11 64-bit 4CPU2932004250233148 21383811156156150
7Deep Shredder 10 64-bit 4CPU284700708002138 188411102535
8Shredder 112847001051946856381188 2766207252
9Deep Shredder 11 64-bit284200246163579511564112766 8462
10Shredder Classic 4 c't27850024386015610220784 60
11Shredder 102754000001505352526260 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 1.89.10.80.00.00.00.00.00.00.0
2Shredder 13 64-bit32701.8 0.84.80.00.00.00.00.00.00.0
3Deep Shredder 12 64-bit 4CPU30419.10.8 3.91.632.06.91.02.12.80.0
4Deep Shredder 12 64-bit29550.84.83.9 23.52.20.024.018.41.40.0
5Shredder 12 32-bit29520.00.01.623.5 2.50.026.719.80.00.0
6Deep Shredder 11 64-bit 4CPU29320.00.032.02.22.5 31.65.314.42.92.6
7Deep Shredder 10 64-bit 4CPU28470.00.06.90.00.031.6 4.58.34.620.8
8Shredder 1128470.00.01.024.026.75.34.5 51.07.78.3
9Deep Shredder 11 64-bit28420.00.02.118.419.814.48.351.0 2.41.6
10Shredder Classic 4 c't27850.00.02.81.40.02.94.67.72.4 5.4
11Shredder 1027540.00.00.00.00.02.620.88.31.65.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 97 common opponents

Custom engine selection
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Deep
Shredder
10
64-bit
4CPU
Shredder
11
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Houdini 4 64-bit 4CPU333142%
22/52
 13%
6.5/50
        
Gull 3 64-bit 4CPU326053%
27.5/52
 14%
6.5/47
        
Houdini 4 64-bit3240 55%
35/64
20%
10/50
        
Critter 1.6a 64-bit 4CPU323261%
31.5/52
 21%
21/100
        
Hannibal 1.7 64-bit 4CPU322962%
32.5/52
 25%
13/53
        
Rybka 4 64-bit 4CPU319865%
34/52
 22%
22.5/101
        
Fire 4 64-bit3191 59%
38/64
 18%
5.5/31
       
Booot 6.1 64-bit 4CPU318776%
39.5/52
 26%
10.5/40
        
Komodo CCT 64-bit3180  25%
12.5/50
22%
7/32
       
Rybka 3 64-bit 4CPU3166  38%
77/200
  14%
15/110
     
Pedone 1.7 64-bit 4CPU313675%
30/40
70%
21/30
         
Protector 1.9.0 64-bit 4CPU312774%
39/53
 42%
22/52
        
Komodo 4 64-bit3126  39%
19.5/50
38%
12/32
       
Hannibal 1.7 64-bit3110 76%
38/50
 38%
12/32
       
Komodo 3 64-bit3109  43%
21.5/50
29%
29/100
       
Rybka 4.1 64-bit3108 77%
38.5/50
 30%
30/100
       
Rybka 4 64-bit3101  50%
25/50
31%
15.5/50
       
iCE 3.0 64-bit308188%
35/40
78%
39/50
 33%
10.5/32
       
Rybka 3 64-bit3078   32%
43.5/135
32%
16/50
27%
26/98
 14%
6/43
21%
17.5/82
  
Naum 4 64-bit 4CPU3062  43%
85.5/198
  29%
28.5/99
     
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Deep
Shredder
10
64-bit
4CPU
Shredder
11
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Stockfish 1.7.1 64-bit3045   36%
38/107
42%
21/50
      
Rybka 2.3.2a 64-bit 4CPU3044     35%
67/193
20%
20/99
 23%
23/100
  
Rybka 3 32-bit3042    42%
17/40
  30%
6/20
   
Spike 1.4 Leiden 4CPU303794%
37.5/40
 51%
25.5/50
        
Naum 4.6 64-bit3032 83%
41.5/50
 36%
11.5/32
       
Spark 1.0 64-bit 4CPU302988%
35/40
 54%
54.5/100
        
SmarThink 1.96 64-bit3026 78%
39/50
 40%
12/30
       
Rybka 2.2 64-bit 4CPU3002  54%
108.5/200
  40%
40.5/100
     
Naum 4.2 64-bit2987   47%
57/122
45%
22.5/50
      
Rybka 2.3.2a 64-bit2977     40%
79.5/197
 37%
18/49
41%
20/49
  
Stockfish 1.4 64-bit 4CPU2975  61%
121/199
  44%
43.5/100
     
Zappa Mexico II 64-bit 4CPU2970  63%
126.5/200
  48%
22.5/47
     
Thinker 5.4c Inert 64-bit 4CPU2952  61%
121.5/199
  45%
45/99
     
Naum 4 64-bit2947   53%
33.5/63
   38%
16.5/43
27%
13.5/50
  
Zappa Mexico 64-bit 4CPU2945  63%
125.5/200
  47%
138/296
35%
35/100
    
Hiarcs 12 4CPU2941  66%
132.5/200
  65%
63.5/98
     
Deep Sjeng WC2008 64-bit 4CPU2940  62%
123/200
  52%
52/100
     
Hiarcs 12.1 4CPU2939  70%
141/200
  48%
48/100
     
Komodo 1.0 64-bit2932  72%
71.5/100
48%
21/44
66%
33/50
      
Deep Sjeng c't 20102926  63%
31.5/50
      32%
12/37
 
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Deep
Shredder
10
64-bit
4CPU
Shredder
11
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Rybka 2.3.2a 32-bit2922       45%
29.5/65
 26%
14.5/55
15%
3/20
Hiarcs 11.2 4CPU2914     50%
98.5/197
42%
34/80
    
Hiarcs 13.12914   60%
29.5/49
   33%
16.5/50
   
Stockfish 1.5.1 64-bit2912   56%
28/50
   37%
18.5/50
34%
17/50
  
Bright 0.4a 4CPU2910  68%
136.5/200
  44%
43.5/99
     
Fritz 122908   52%
32.5/62
54%
48.5/89
  40%
24/60
   
Naum 2.2 64-bit 4CPU2908     48%
95/197
41%
41/99
    
Toga II 1.4 beta5c 4CPU2904  71%
142/200
  55%
27/49
  47%
23.5/50
  
Hiarcs 11.1 4CPU2900     54%
106.5/197
42%
42.5/100
    
Toga II 1.4.1SE 4CPU2899     49%
47/95
  60%
18.5/31
  
Rybka 2.2 32-bit2893       41%
20.5/50
  35%
10.5/30
Fritz 112888   52%
32/62
   50%
24.5/49
43%
22.5/52
  
Thinker 5.4c Inert 64-bit2883   66%
41/62
55%
27/49
  39%
12/31
44%
22/50
  
Spark 0.4 64-bit2882   73%
36.5/50
52%
26/50
      
Thinker 5.4a Inert 64-bit2882       42%
13.5/32
40%
20/50
  
Loop M1-T 64-bit 4CPU2881  76%
149.5/198
  51%
91/177
44%
38/86
    
Stockfish 1.4 64-bit2873       45%
14/31
49%
24.5/50
  
Thinker 5.3b Inert 64-bit2867       41%
4.5/11
37%
18.5/50
  
Glaurung 2.0.1 64-bit 4CPU2861     58%
47.5/82
  48%
32.5/68
  
Doch 09.980 64-bit2855   60%
30/50
   49%
24.5/50
   
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Deep
Shredder
10
64-bit
4CPU
Shredder
11
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Bright 0.3a 4CPU2853     63%
31.5/50
  65%
31/48
  
Protector 1.3.4 64-bit2852   66%
21/32
68%
34/50
      
Spark 0.3 64-bit2844   66%
103.5/156
   54%
27/50
46%
23/50
  
Zappa Mexico II 64-bit2843   65%
40/62
68%
34/50
  47%
20/43
44%
14/32
  
Deep Sjeng WC2008 64-bit2842   64%
39.5/62
   48%
20.5/43
   
Deep Junior 11.1a 64-bit2840   59%
58/98
69%
34.5/50
      
Deep Sjeng 3.0 64-bit2838   77%
48/62
59%
29.5/50
  48%
29/61
49%
40/82
  
Zap!Chess Paderborn 64-bit 4CPU2838      44%
44/100
   47%
23.5/50
Onno 1.1.1 64-bit2837   63%
38.5/61
   48%
24/50
50%
25/50
  
Hiarcs 122835   68%
41.5/61
65%
32.5/50
  36%
15.5/43
50%
41/82
  
Hiarcs 12.12833   67%
41.5/62
   36%
11.5/32
47%
23.5/50
  
Deep Junior 10 4CPU2832     57%
57/100
52%
52/100
   36%
18/50
Crafty 23.8 64-bit2824   70%
21/30
    33%
3/9
  
Junior 20102821    78%
31/40
  58%
23/40
   
Hiarcs Paderborn 20072819    65%
26/40
   52%
51.5/99
  
Loop 10.32f2813      65%
32.5/50
   48%
14.5/30
Hiarcs 11.22807       57%
20/35
46%
22.5/49
  
Hiarcs 11.12803       61%
21.5/35
56%
18/32
  
Glaurung 2.2 64-bit2801       56%
18/32
59%
29.5/50
  
Fritz 102799       65%
8.5/13
39%
12.5/32
  
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Deep
Shredder
10
64-bit
4CPU
Shredder
11
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Fruit 05/11/032792       65%
15/23
59%
19/32
  
Strelka 1.8 32-bit2782      55%
23/42
 53%
8.5/16
  
Ktulu 92781   68%
33.5/49
69%
34/49
  64%
30.5/48
60%
29.5/49
  
Deep Sjeng 2.7 4CPU2777     72%
72.5/101
67%
23.5/35
    
Bright 0.5c2772   83%
26.5/32
     54%
29/54
 
Naum 2.2 32-bit2770       58%
38/65
59%
19/32
  
Twisted Logic 20100131x 64-bit2766   81%
46/57
   59%
23.5/40
   
Zappa Mexico 32-bit2760       66%
41/62
  44%
14/32
SmarThink 1.20 64-bit2747   84%
42/50
   66%
33/50
56%
28/50
  
Spike 1.2 Turin2731  90%
179/200
  77%
151.5/197
63%
31.5/50
73%
25.5/35
62%
20/32
55%
28.5/52
 
Ktulu 82725      63%
29.5/47
   46%
13/28
Chess Tiger 2007.12714       92%
18.5/20
56%
18/32
  
Naum 2.0 32-bit2700      66%
33/50
50%
1.5/3
   
Alaric 7072663       75%
41.5/55
83%
26.5/32
  
Glaurung 1.2.1 32-bit2657       67%
2/3
  63%
19/30
CM10th Paralyse2655      78%
39/50
83%
2.5/3
80%
25.5/32
 55%
16.5/30
Slow Chess Blitz WV2.12615      80%
40/50
87%
30.5/35
   
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on June 22, 2019