CCRL 40/40
Downloads and Statistics
July 19, 2019
Testing summary:
Total: 1'068'538 games
played by 2'502 programs
146028 CPU days (X2 4600+)

White wins: 371'241 (34.7%)
Black wins: 276'263 (25.9%)
Draws: 421'034 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 9 engines!
9 selected engines played 2 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on July 19, 2019 with Bayeselo based on 1'068'538 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Deep Sjeng c't 20102941+10−1046.3%+23.645.9%3326 
96.0%
 Deep Sjeng WC2008 64-bit 4CPU2926+13−1345.0%+32.840.3%2202
90.8%
 Deep Sjeng 3.0 64-bit 4CPU2908+22−2247.5%+18.241.9%632
100.0%
 Deep Sjeng 3.0 64-bit2837+22−2247.0%+21.336.8%673
54.8%
 Deep Sjeng WC2008 64-bit2835+13−1347.0%+21.141.2%1833
86.4%
 Deep Sjeng WC2008 32-bit2825+12−1248.1%+11.546.1%2161
83.3%
 Deep Sjeng 3.0 32-bit2813+21−2151.5%−8.742.6%712
99.0%
 Deep Sjeng 2.7 4CPU2780+18−1841.1%+58.538.7%1020
99.4%
 Deep Sjeng 2.72749+15−1546.9%+20.940.8%1441
 

Results matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng c't 20102941         
2Deep Sjeng WC2008 64-bit 4CPU2926         
3Deep Sjeng 3.0 64-bit 4CPU2908         
4Deep Sjeng 3.0 64-bit2837    1 − 1
+1−1=0
−2
    
5Deep Sjeng WC2008 64-bit2835   1 − 1
+1−1=0
+2
     
6Deep Sjeng WC2008 32-bit2825         
7Deep Sjeng 3.0 32-bit2813         
8Deep Sjeng 2.7 4CPU2780         
9Deep Sjeng 2.72749         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng c't 20102941 96.099.4100.0100.0100.0100.0100.0100.0
2Deep Sjeng WC2008 64-bit 4CPU29264.0 90.8100.0100.0100.0100.0100.0100.0
3Deep Sjeng 3.0 64-bit 4CPU29080.69.2 100.0100.0100.0100.0100.0100.0
4Deep Sjeng 3.0 64-bit28370.00.00.0 54.881.893.5100.0100.0
5Deep Sjeng WC2008 64-bit28350.00.00.045.2 86.495.8100.0100.0
6Deep Sjeng WC2008 32-bit28250.00.00.018.213.6 83.3100.0100.0
7Deep Sjeng 3.0 32-bit28130.00.00.06.54.216.7 99.0100.0
8Deep Sjeng 2.7 4CPU27800.00.00.00.00.00.01.0 99.4
9Deep Sjeng 2.727490.00.00.00.00.00.00.00.6 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng c't 20102941 18030181760000
2Deep Sjeng WC2008 64-bit 4CPU292618 1026106291828244888
3Deep Sjeng 3.0 64-bit 4CPU290801026 149560045964
4Deep Sjeng 3.0 64-bit283730106149 115151030782471
5Deep Sjeng WC2008 64-bit2835181291561151 93840668354
6Deep Sjeng WC2008 32-bit2825760820510938 103276753
7Deep Sjeng 3.0 32-bit281308203074061032 267986
8Deep Sjeng 2.7 4CPU27800448459826876267 575
9Deep Sjeng 2.7274908864471354753986575 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Deep Sjeng c't 20102941 0.30.00.83.513.90.00.00.0
2Deep Sjeng WC2008 64-bit 4CPU29260.3 36.23.77.21.92.813.92.4
3Deep Sjeng 3.0 64-bit 4CPU29080.036.2 11.42.30.00.027.83.1
4Deep Sjeng 3.0 64-bit28370.83.711.4 45.918.022.24.822.3
5Deep Sjeng WC2008 64-bit28353.57.22.345.9 23.516.02.410.8
6Deep Sjeng WC2008 32-bit282513.91.90.018.023.5 35.92.420.9
7Deep Sjeng 3.0 32-bit28130.02.80.022.216.035.9 15.445.8
8Deep Sjeng 2.7 4CPU27800.013.927.84.82.42.415.4 23.4
9Deep Sjeng 2.727490.02.43.122.310.820.945.823.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 83 common opponents

Custom engine selection
NameEloDeep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
WC2008
32-bit
Deep
Sjeng
3.0
32-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.7
Rybka 3 64-bit 4CPU3122 23%
19/83
24%
12/50
      
Rybka 3 Human 64-bit 4CPU3120 30%
7/23
8%
0.5/6
      
Rybka 4 64-bit3077 50%
0.5/1
  6%
1/16
    
Rybka 3 64-bit3047  28%
6.5/23
18%
8/44
21%
7/33
    
Rybka 4 32-bit301636%
13.5/38
    40%
12/30
   
Rybka 3 32-bit2994     21%
10.5/51
19%
10/53
  
Naum 4.2 64-bit297650%
1/2
   34%
17.5/52
    
Naum 3.1 64-bit 4CPU2969 46%
26.5/58
41%
20.5/50
      
Zappa Mexico II 64-bit 4CPU2969 41%
36.5/89
38%
13/34
    30%
9.5/32
 
Stockfish 1.6.3 64-bit2965   0%
0/2
38%
10/26
    
Rybka 2.3.2a 64-bit2961  41%
13/32
34%
17/50
    14%
4.5/32
Naum 4.2 32-bit295850%
39/78
    30%
9/30
   
Naum 4 64-bit2954   28%
13/46
28%
18.5/66
    
Naum 4.1 64-bit2951   50%
1.5/3
24%
5/21
    
Stockfish 1.6s 64-bit2951   50%
1/2
50%
1/2
    
Komodo 1.2 64-bit2946 49%
111/226
  44%
10.5/24
    
Deep Shredder 12 64-bit294029%
4/14
  25%
1/4
25%
1/4
    
Shredder 12 32-bit292859%
64/108
    34%
27/80
   
Komodo 1.0 64-bit2921 50%
16/32
 50%
1/2
41%
14/34
    
Deep Shredder 11 64-bit 4CPU2917 50%
30/60
41%
14/34
    34%
11.5/34
 
NameEloDeep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
WC2008
32-bit
Deep
Sjeng
3.0
32-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.7
Rybka 2.3.2a 32-bit2912      40%
16/40
 27%
9/33
Quazar 0.4 64-bit290558%
10.5/18
25%
0.5/2
       
Hiarcs 12.1 4CPU2904 55%
17.5/32
52%
34.5/66
      
Toga II 1.4.1SE 4CPU2904 62%
34/55
52%
16.5/32
      
Bright 0.4a 4CPU2897 53%
18/34
54%
52.5/97
      
Komodo 1.2 32-bit289661%
23/38
    42%
12.5/30
   
Hiarcs 12 4CPU2893 51%
25.5/50
59%
19/32
    30%
15/50
 
Spark 1.0 64-bit289355%
18/33
   44%
10.5/24
    
Deep Fritz 10.1 4CPU2888  63%
21.5/34
    28%
10/36
 
Fritz 12288651%
21.5/42
  75%
1.5/2
47%
16/34
31%
10.5/34
   
Hiarcs 13.1287456%
30.5/54
    46%
15.5/34
   
Glaurung 2.1 64-bit 4CPU2869 60%
35/58
52%
26/50
      
Thinker 5.4d Inert 64-bit286475%
3/4
  25%
0.5/2
42%
11/26
    
Naum 3.1 64-bit2860   44%
29/66
58%
18/31
    
Thinker 5.4c Inert 64-bit2860   50%
1/2
41%
14/34
    
Naum 3.1 32-bit2859     41%
16.5/40
47%
20.5/44
 28%
8.5/30
Deep Junior 12 32-bit285663%
21.5/34
    50%
5/10
   
Naum 3 64-bit2856   42%
5/12
    44%
22/50
Thinker 5.4d Inert 32-bit285662%
23.5/38
    44%
15/34
   
Zappa Mexico II 64-bit2854100%
2/2
  46%
37/80
46%
32/69
    
NameEloDeep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
WC2008
32-bit
Deep
Sjeng
3.0
32-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.7
Fritz 112852   44%
15/34
47%
15.5/33
53%
25.5/48
44%
15/34
 34%
17/50
Loop M1-T 64-bit 4CPU2849 67%
31/46
52%
26/50
    35%
10.5/30
 
Nemo 1.0.1 64-bit2847100%
4/4
50%
1/2
       
Booot 5.1.0284371%
24/34
75%
1.5/2
       
Deep Shredder 11 64-bit2843   47%
17/36
56%
17.5/31
    
Spark 0.3 64-bit2834   0%
0/2
32%
11/34
    
Shredder 112832     40%
21/52
46%
18.5/40
 40%
16.5/41
Bright 0.3a 4CPU2830  60%
25/42
    52%
26.5/51
 
Grapefruit 1.0 32-bit2826    58%
18.5/32
50%
24/48
   
Toga II 1.4.1SE2826   57%
50.5/88
44%
13.5/31
53%
27/51
48%
15.5/32
 31%
12.5/40
Booot 5.0282588%
3.5/4
   56%
13.5/24
50%
2/4
   
Cyclone xTreme282373%
22/30
    57%
17/30
   
Deep Junior 11.1a 64-bit2823    48%
11.5/24
56%
13.5/24
   
Toga II 1.4.1SE62820     50%
1/2
47%
15/32
  
Onno 1.0 64-bit2818 78%
25/32
  55%
17.5/32
    
Hiarcs 12.12817   69%
24/35
53%
48/91
59%
32/54
   
Hiarcs 12 Sharpen PV On2813    56%
18/32
57%
20.5/36
47%
16/34
 33%
10/30
Hiarcs 122809   45%
14/31
65%
22/34
33%
1/3
53%
16/30
 47%
14/30
Onno 1.1.1 64-bit2809   67%
2/3
58%
11/19
    
Zappa Mexico II 32-bit2809     51%
33/65
32%
11/34
 35%
10.5/30
NameEloDeep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
WC2008
32-bit
Deep
Sjeng
3.0
32-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.7
Hannibal 1.0a 32-bit280067%
20/30
    50%
2/4
   
Hiarcs Paderborn 20072795    55%
26.5/48
 65%
19.5/30
  
Toga II 1.3.12789       41%
14/34
36%
13.5/37
Fruit 2.3.12786     55%
23/42
61%
19.5/32
 50%
1/2
Fritz 102778       45%
12.5/28
53%
17/32
Bright 0.4a2775   57%
38.5/67
60%
45.5/76
60%
21.5/36
   
Loop 13.6 (Loop 2007) 32-bit2773     47%
18/38
66%
22.5/34
 44%
14.5/33
Glaurung 2.1 64-bit2770   31%
2.5/8
60%
18.5/31
    
Strelka 1.8 32-bit2769       58%
30/52
45%
14.5/32
Glaurung 2.1 32-bit2765     56%
18/32
55%
18/33
  
Thinker 5.2e Passive2761     64%
20.5/32
68%
13.5/20
  
Ktulu 92754    56%
17.5/31
60%
18/30
   
SmarThink 1.20 32-bit2746    67%
24/36
68%
13.5/20
   
Spike 1.2 Turin2745 79%
39.5/50
 70%
35/50
56%
20/36
58%
18.5/32
59%
19/32
53%
17/32
46%
17.5/38
Junior 102743     70%
22.5/32
56%
18/32
 52%
16.5/32
SmarThink 1.10 32-bit2718    73%
23.5/32
62%
12.5/20
   
Ktulu 82705     50%
1/2
66%
21/32
61%
19.5/32
59%
23/39
Chess Tiger 2007.12703     75%
1.5/2
55%
17.5/32
62%
24/39
54%
20.5/38
Movei 00.8.438 (10 10 10)2667     100%
2/2
  50%
1/2
Chessmaster 112665      70%
22.5/32
69%
25/36
65%
22/34
NameEloDeep
Sjeng
c't
2010
Deep
Sjeng
WC2008
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
4CPU
Deep
Sjeng
3.0
64-bit
Deep
Sjeng
WC2008
64-bit
Deep
Sjeng
WC2008
32-bit
Deep
Sjeng
3.0
32-bit
Deep
Sjeng
2.7
4CPU
Deep
Sjeng
2.7
Alaric 7072660     75%
1.5/2
  64%
22.5/35
Scorpio 1.912660       70%
22.5/32
65%
26/40
CM10th Guardian2638     75%
1.5/2
  100%
1/1
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 19, 2019