CCRL 40/4
Downloads and Statistics
November 30, 2019
Testing summary:
Total: 2'140'277 games
played by 2'505 programs
29019 CPU days (X2 4600+)

White wins: 829'307 (38.7%)
Black wins: 669'765 (31.3%)
Draws: 641'205 (30.0%)
White score: 53.7%

Custom engine selection

Comparing 11 engines!
11 selected engines played 256 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 30, 2019 with Bayeselo based on 2'140'277 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Deep Shredder 13 64-bit 4CPU3323+11−1158.9%−63.642.7%2818 
100.0%
 Shredder 13 64-bit3270+7−748.6%+8.046.7%6866
100.0%
 Deep Shredder 12 64-bit 4CPU3041+7−749.6%+2.437.3%8373
100.0%
 Deep Shredder 12 64-bit2955+8−849.9%+1.636.3%5792
61.1%
 Shredder 12 32-bit2952+19−1959.0%−62.638.1%897
96.7%
 Deep Shredder 11 64-bit 4CPU2931+9−952.1%−16.134.6%4927
100.0%
 Shredder 112847+13−1255.2%−38.234.4%2311
52.9%
 Deep Shredder 10 64-bit 4CPU2846+14−1451.4%−10.336.2%1835
67.4%
 Deep Shredder 11 64-bit2842+11−1150.7%−6.035.2%3117
100.0%
 Shredder Classic 4 c't2784+30−3046.6%+19.236.5%373
94.5%
 Shredder 102754+22−2251.6%−13.733.3%736
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323           
2Shredder 13 64-bit3270           
3Deep Shredder 12 64-bit 4CPU3041           
4Deep Shredder 12 64-bit2955           
5Shredder 12 32-bit2952           
6Deep Shredder 11 64-bit 4CPU2931           
7Shredder 112847        125.5 − 130.5
+58−63=135
−11
  
8Deep Shredder 10 64-bit 4CPU2846           
9Deep Shredder 11 64-bit2842      130.5 − 125.5
+63−58=135
+11
    
10Shredder Classic 4 c't2784           
11Shredder 102754           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Shredder 13 64-bit32700.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Deep Shredder 12 64-bit 4CPU30410.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
4Deep Shredder 12 64-bit29550.00.00.0 61.1100.0100.0100.0100.0100.0100.0
5Shredder 12 32-bit29520.00.00.038.9 96.7100.0100.0100.0100.0100.0
6Deep Shredder 11 64-bit 4CPU29310.00.00.00.03.3 100.0100.0100.0100.0100.0
7Shredder 1128470.00.00.00.00.00.0 52.973.2100.0100.0
8Deep Shredder 10 64-bit 4CPU28460.00.00.00.00.00.047.1 67.4100.0100.0
9Deep Shredder 11 64-bit28420.00.00.00.00.00.026.832.6 100.0100.0
10Shredder Classic 4 c't27840.00.00.00.00.00.00.00.00.0 94.5
11Shredder 1027540.00.00.00.00.00.00.00.00.05.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 1601018720000000
2Shredder 13 64-bit3270160 1145690000000
3Deep Shredder 12 64-bit 4CPU30411018114 54615042501057082462430
4Deep Shredder 12 64-bit295572569546 1569233194601635860
5Shredder 12 32-bit2952001501569 148856079500
6Deep Shredder 11 64-bit 4CPU2931004250233148 38121381156156150
7Shredder 112847001051946856381 1882766207252
8Deep Shredder 10 64-bit 4CPU284600708002138188 411102535
9Deep Shredder 11 64-bit284200246163579511562766411 8462
10Shredder Classic 4 c't27840024386015620710284 60
11Shredder 102754000001502525356260 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Deep Shredder 13 64-bit 4CPU3323 1.79.10.80.00.00.00.00.00.00.0
2Shredder 13 64-bit32701.7 0.74.50.00.00.00.00.00.00.0
3Deep Shredder 12 64-bit 4CPU30419.10.7 3.91.632.01.06.92.12.80.0
4Deep Shredder 12 64-bit29550.84.53.9 23.52.224.00.018.41.40.0
5Shredder 12 32-bit29520.00.01.623.5 2.526.70.019.80.00.0
6Deep Shredder 11 64-bit 4CPU29310.00.032.02.22.5 5.331.614.42.92.6
7Shredder 1128470.00.01.024.026.75.3 4.551.07.78.3
8Deep Shredder 10 64-bit 4CPU28460.00.06.90.00.031.64.5 8.34.620.8
9Deep Shredder 11 64-bit28420.00.02.118.419.814.451.08.3 2.41.6
10Shredder Classic 4 c't27840.00.02.81.40.02.97.74.62.4 5.4
11Shredder 1027540.00.00.00.00.02.68.320.81.65.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 97 common opponents

Custom engine selection
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Shredder
11
Deep
Shredder
10
64-bit
4CPU
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Houdini 4 64-bit 4CPU333242%
22/52
 13%
6.5/50
        
Gull 3 64-bit 4CPU326053%
27.5/52
 14%
6.5/47
        
Houdini 4 64-bit3240 55%
35/64
20%
10/50
        
Critter 1.6a 64-bit 4CPU323261%
31.5/52
 21%
21/100
        
Hannibal 1.7 64-bit 4CPU322862%
32.5/52
 25%
13/53
        
Rybka 4 64-bit 4CPU319865%
34/52
 22%
22.5/101
        
Fire 4 64-bit3191 59%
38/64
 18%
5.5/31
       
Booot 6.1 64-bit 4CPU318776%
39.5/52
 26%
10.5/40
        
Komodo CCT 64-bit3180  25%
12.5/50
22%
7/32
       
Rybka 3 64-bit 4CPU3166  38%
77/200
  14%
15/110
     
Pedone 1.7 64-bit 4CPU313675%
30/40
70%
21/30
         
Protector 1.9.0 64-bit 4CPU312874%
39/53
 42%
22/52
        
Komodo 4 64-bit3126  39%
19.5/50
38%
12/32
       
Hannibal 1.7 64-bit3110 76%
38/50
 38%
12/32
       
Komodo 3 64-bit3108  43%
21.5/50
29%
29/100
       
Rybka 4.1 64-bit3108 77%
38.5/50
 30%
30/100
       
Rybka 4 64-bit3101  50%
25/50
31%
15.5/50
       
iCE 3.0 64-bit308088%
35/40
78%
39/50
 33%
10.5/32
       
Rybka 3 64-bit3077   32%
43.5/135
32%
16/50
27%
26/98
14%
6/43
 21%
17.5/82
  
Naum 4 64-bit 4CPU3061  43%
85.5/198
  29%
28.5/99
     
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Shredder
11
Deep
Shredder
10
64-bit
4CPU
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Rybka 2.3.2a 64-bit 4CPU3044     35%
67/193
 20%
20/99
23%
23/100
  
Stockfish 1.7.1 64-bit3044   36%
38/107
42%
21/50
      
Rybka 3 32-bit3042    42%
17/40
 30%
6/20
    
Spike 1.4 Leiden 4CPU303894%
37.5/40
 51%
25.5/50
        
Naum 4.6 64-bit3031 83%
41.5/50
 36%
11.5/32
       
Spark 1.0 64-bit 4CPU302888%
35/40
 54%
54.5/100
        
SmarThink 1.96 64-bit3025 78%
39/50
 40%
12/30
       
Rybka 2.2 64-bit 4CPU3001  54%
108.5/200
  40%
40.5/100
     
Naum 4.2 64-bit2987   47%
57/122
45%
22.5/50
      
Rybka 2.3.2a 64-bit2977     40%
79.5/197
37%
18/49
 41%
20/49
  
Stockfish 1.4 64-bit 4CPU2975  61%
121/199
  44%
43.5/100
     
Zappa Mexico II 64-bit 4CPU2970  63%
126.5/200
  48%
22.5/47
     
Thinker 5.4c Inert 64-bit 4CPU2951  61%
121.5/199
  45%
45/99
     
Naum 4 64-bit2947   53%
33.5/63
  38%
16.5/43
 27%
13.5/50
  
Zappa Mexico 64-bit 4CPU2945  63%
125.5/200
  47%
138/296
 35%
35/100
   
Hiarcs 12 4CPU2941  66%
132.5/200
  65%
63.5/98
     
Deep Sjeng WC2008 64-bit 4CPU2940  62%
123/200
  52%
52/100
     
Hiarcs 12.1 4CPU2938  70%
141/200
  48%
48/100
     
Komodo 1.0 64-bit2932  72%
71.5/100
48%
21/44
66%
33/50
      
Deep Sjeng c't 20102925  63%
31.5/50
      32%
12/37
 
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Shredder
11
Deep
Shredder
10
64-bit
4CPU
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Rybka 2.3.2a 32-bit2922      45%
29.5/65
  26%
14.5/55
15%
3/20
Hiarcs 11.2 4CPU2914     50%
98.5/197
 42%
34/80
   
Hiarcs 13.12913   60%
29.5/49
  33%
16.5/50
    
Stockfish 1.5.1 64-bit2912   56%
28/50
  37%
18.5/50
 34%
17/50
  
Bright 0.4a 4CPU2909  68%
136.5/200
  44%
43.5/99
     
Fritz 122908   52%
32.5/62
54%
48.5/89
 40%
24/60
    
Naum 2.2 64-bit 4CPU2908     48%
95/197
 41%
41/99
   
Toga II 1.4 beta5c 4CPU2904  71%
142/200
  55%
27/49
  47%
23.5/50
  
Hiarcs 11.1 4CPU2899     54%
106.5/197
 42%
42.5/100
   
Toga II 1.4.1SE 4CPU2899     49%
47/95
  60%
18.5/31
  
Rybka 2.2 32-bit2893      41%
20.5/50
   35%
10.5/30
Fritz 112887   52%
32/62
  50%
24.5/49
 43%
22.5/52
  
Thinker 5.4c Inert 64-bit2883   66%
41/62
55%
27/49
 39%
12/31
 44%
22/50
  
Spark 0.4 64-bit2882   73%
36.5/50
52%
26/50
      
Thinker 5.4a Inert 64-bit2882      42%
13.5/32
 40%
20/50
  
Loop M1-T 64-bit 4CPU2881  76%
149.5/198
  51%
91/177
 44%
38/86
   
Stockfish 1.4 64-bit2872      45%
14/31
 49%
24.5/50
  
Thinker 5.3b Inert 64-bit2867      41%
4.5/11
 37%
18.5/50
  
Glaurung 2.0.1 64-bit 4CPU2861     58%
47.5/82
  48%
32.5/68
  
Doch 09.980 64-bit2855   60%
30/50
  49%
24.5/50
    
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Shredder
11
Deep
Shredder
10
64-bit
4CPU
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Bright 0.3a 4CPU2853     63%
31.5/50
  65%
31/48
  
Protector 1.3.4 64-bit2852   66%
21/32
68%
34/50
      
Spark 0.3 64-bit2844   66%
103.5/156
  54%
27/50
 46%
23/50
  
Zappa Mexico II 64-bit2844   65%
40/62
68%
34/50
 47%
20/43
 44%
14/32
  
Deep Sjeng WC2008 64-bit2842   64%
39.5/62
  48%
20.5/43
    
Deep Junior 11.1a 64-bit2840   59%
58/98
69%
34.5/50
      
Deep Sjeng 3.0 64-bit2838   77%
48/62
59%
29.5/50
 48%
29/61
 49%
40/82
  
Zap!Chess Paderborn 64-bit 4CPU2838       44%
44/100
  47%
23.5/50
Onno 1.1.1 64-bit2837   63%
38.5/61
  48%
24/50
 50%
25/50
  
Hiarcs 122834   68%
41.5/61
65%
32.5/50
 36%
15.5/43
 50%
41/82
  
Hiarcs 12.12833   67%
41.5/62
  36%
11.5/32
 47%
23.5/50
  
Deep Junior 10 4CPU2832     57%
57/100
 52%
52/100
  36%
18/50
Crafty 23.8 64-bit2824   70%
21/30
    33%
3/9
  
Junior 20102821    78%
31/40
 58%
23/40
    
Hiarcs Paderborn 20072819    65%
26/40
   52%
51.5/99
  
Loop 10.32f2812       65%
32.5/50
  48%
14.5/30
Hiarcs 11.22806      57%
20/35
 46%
22.5/49
  
Hiarcs 11.12803      61%
21.5/35
 56%
18/32
  
Glaurung 2.2 64-bit2801      56%
18/32
 59%
29.5/50
  
Fritz 102799      65%
8.5/13
 39%
12.5/32
  
NameEloDeep
Shredder
13
64-bit
4CPU
Shredder
13
64-bit
Deep
Shredder
12
64-bit
4CPU
Deep
Shredder
12
64-bit
Shredder
12
32-bit
Deep
Shredder
11
64-bit
4CPU
Shredder
11
Deep
Shredder
10
64-bit
4CPU
Deep
Shredder
11
64-bit
Shredder
Classic
4
c't
Shredder
10
Fruit 05/11/032792      65%
15/23
 59%
19/32
  
Strelka 1.8 32-bit2782       55%
23/42
53%
8.5/16
  
Ktulu 92781   68%
33.5/49
69%
34/49
 64%
30.5/48
 60%
29.5/49
  
Deep Sjeng 2.7 4CPU2776     72%
72.5/101
 67%
23.5/35
   
Bright 0.5c2771   83%
26.5/32
     54%
29/54
 
Naum 2.2 32-bit2769      58%
38/65
 59%
19/32
  
Twisted Logic 20100131x 64-bit2766   81%
46/57
  59%
23.5/40
    
Zappa Mexico 32-bit2760      66%
41/62
   44%
14/32
SmarThink 1.20 64-bit2747   84%
42/50
  66%
33/50
 56%
28/50
  
Spike 1.2 Turin2731  90%
179/200
  77%
151.5/197
73%
25.5/35
63%
31.5/50
62%
20/32
55%
28.5/52
 
Ktulu 82725       63%
29.5/47
  46%
13/28
Chess Tiger 2007.12713      92%
18.5/20
 56%
18/32
  
Naum 2.0 32-bit2699      50%
1.5/3
66%
33/50
   
Alaric 7072663      75%
41.5/55
 83%
26.5/32
  
Glaurung 1.2.1 32-bit2657      67%
2/3
   63%
19/30
CM10th Paralyse2654      83%
2.5/3
78%
39/50
80%
25.5/32
 55%
16.5/30
Slow Chess Blitz WV2.12614      87%
30.5/35
80%
40/50
   
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 30, 2019