CCRL 40/40
Downloads and Statistics
September 14, 2019
Testing summary:
Total: 1'083'337 games
played by 2'531 programs
147896 CPU days (X2 4600+)

White wins: 376'125 (34.7%)
Black wins: 279'699 (25.8%)
Draws: 427'513 (39.5%)
White score: 54.5%

Custom engine selection

Comparing 9 engines!
9 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on September 14, 2019 with Bayeselo based on 1'083'337 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Spark 1.0 64-bit 4CPU2970+13−1345.0%+32.046.6%1787 
99.8%
 Spark 0.4 64-bit 4CPU2933+21−2143.0%+49.145.2%703
61.6%
 Spark 0.3 64-bit 4CPU2929+23−2346.5%+20.249.7%572
99.5%
 Spark 1.0 64-bit2894+12−1246.4%+26.842.7%2318
100.0%
 Spark 1.0 32-bit2865+11−1145.2%+31.344.2%2582
99.6%
 Spark 0.3 64-bit2836+18−1846.3%+25.838.3%1048
87.8%
 Spark 0.4 32-bit2822+16−1645.8%+27.247.8%1159
96.5%
 Spark 0.3a 32-bit2800+17−1745.7%+26.146.6%1070
56.2%
 Spark 0.3 32-bit2798+16−1647.7%+16.348.7%1264
 

Results matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970         
2Spark 0.4 64-bit 4CPU2933         
3Spark 0.3 64-bit 4CPU2929         
4Spark 1.0 64-bit2894         
5Spark 1.0 32-bit2865         
6Spark 0.3 64-bit2836         
7Spark 0.4 32-bit2822         
8Spark 0.3a 32-bit2800         
9Spark 0.3 32-bit2798         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 99.899.8100.0100.0100.0100.0100.0100.0
2Spark 0.4 64-bit 4CPU29330.2 61.699.9100.0100.0100.0100.0100.0
3Spark 0.3 64-bit 4CPU29290.138.4 99.5100.0100.0100.0100.0100.0
4Spark 1.0 64-bit28940.00.10.5 100.0100.0100.0100.0100.0
5Spark 1.0 32-bit28650.00.00.00.0 99.6100.0100.0100.0
6Spark 0.3 64-bit28360.00.00.00.00.4 87.899.899.9
7Spark 0.4 32-bit28220.00.00.00.00.012.2 96.598.0
8Spark 0.3a 32-bit28000.00.00.00.00.00.23.5 56.2
9Spark 0.3 32-bit27980.00.00.00.00.00.12.043.8 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 50330633460000
2Spark 0.4 64-bit 4CPU2933503 2350060000
3Spark 0.3 64-bit 4CPU2929306235 0071000
4Spark 1.0 64-bit289433400 631555736187
5Spark 1.0 32-bit2865600631 951390537485
6Spark 0.3 64-bit28360607155595 182262372
7Spark 0.4 32-bit2822000731390182 818603
8Spark 0.3a 32-bit280000061537262818 1496
9Spark 0.3 32-bit2798000874853726031496 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 20.213.08.10.10.00.00.00.0
2Spark 0.4 64-bit 4CPU293320.2 18.40.00.03.40.00.00.0
3Spark 0.3 64-bit 4CPU292913.018.4 0.00.04.40.00.00.0
4Spark 1.0 64-bit28948.10.00.0 12.916.52.11.82.4
5Spark 1.0 32-bit28650.10.00.012.9 2.637.214.712.6
6Spark 0.3 64-bit28360.03.44.416.52.6 8.212.416.1
7Spark 0.4 32-bit28220.00.00.02.137.28.2 36.724.9
8Spark 0.3a 32-bit28000.00.00.01.814.712.436.7 64.1
9Spark 0.3 32-bit27980.00.00.02.412.616.124.964.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 118 common opponents

Custom engine selection
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Komodo 4 64-bit309926%
9/34
  13%
7/52
     
Naum 4.6 64-bit 4CPU30960%
0/2
  15%
3/20
     
Naum 4.2 64-bit 4CPU306228%
13/46
21%
8/38
19%
3/16
      
Deep Shredder 12 64-bit 4CPU301948%
22.5/47
43%
14.5/34
43%
21.5/50
      
Rybka 4 32-bit3017    38%
13/34
 27%
8/30
  
Stockfish 1.9.1 32-bit3001    29%
9.5/33
 21%
7/34
  
Rybka 3 32-bit2995       16%
5.5/34
20%
6.5/33
Critter 0.90 32-bit2990    35%
14.5/42
 21%
7/34
  
Stockfish 1.7.1 32-bit2978      24%
8/34
32%
11/34
22%
6.5/30
Naum 4.2 64-bit2977   33%
14/43
 28%
14.5/52
   
Komodo 1.3 64-bit297460%
21/35
  41%
6.5/16
     
Zappa Mexico II 64-bit 4CPU297054%
30.5/57
0%
0/2
47%
15/32
      
Fritz 13296144%
14/32
  42%
21.5/51
     
Naum 4.2 32-bit2959    40%
13.5/34
  35%
7/20
 
Naum 4.1 32-bit2953       22%
6.5/30
20%
6/30
Komodo 1.2 64-bit2947 46%
16.5/36
   38%
9/24
   
Deep Sjeng c't 20102942   45%
15/33
40%
13.5/34
    
Deep Shredder 12 64-bit2940   45%
28/62
 23%
16/69
   
Arasan 17.5 64-bit 4CPU293675%
7.5/10
55%
11/20
       
Onno 1.2.70 64-bit 4CPU293557%
32.5/57
49%
18.5/38
       
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Stockfish 1.6.3 32-bit2934       33%
12.5/38
35%
12/34
Bobcat 7.1 64-bit 4CPU293344%
3.5/8
45%
4.5/10
       
EXchess 7.71b 64-bit 4CPU293355%
11/20
75%
7.5/10
       
Fizbo 1.4 64-bit 4CPU293375%
1.5/2
56%
4.5/8
       
Naum 4 32-bit2931       25%
1/4
26%
9/34
Shredder 12 32-bit2930   42%
10/24
36%
23/64
  18%
6/34
38%
24/63
Arasan 18.0 64-bit 4CPU292743%
9/21
61%
5.5/9
       
Deep Sjeng WC2008 64-bit 4CPU292771%
8.5/12
25%
1/4
52%
16.5/32
      
Thinker 5.4d Inert 64-bit 4CPU292775%
9/12
60%
21/35
48%
24/50
      
Komodo 1.0 64-bit2922  41%
13/32
  36%
14/39
   
Gull 1.2 64-bit291975%
1.5/2
  47%
22/47
     
Hannibal 1.2 64-bit291640%
4/10
  41%
19.5/47
     
Spike 1.4 Leiden2915   44%
48.5/110
39%
26.5/68
    
Rybka 2.3.2a 32-bit2913    43%
13/30
 27%
8/30
37%
11.5/31
33%
10.5/32
Crafty 23.8 64-bit 4CPU291169%
5.5/8
44%
3.5/8
       
Quazar 0.4 64-bit290642%
5/12
  52%
30/58
     
Toga II 1.4.1SE 4CPU290588%
3.5/4
56%
18.5/33
       
DiscoCheck 5.2 64-bit290160%
6/10
  50%
1/2
     
Cheng4 0.36c 64-bit 4CPU289850%
1/2
25%
2/8
       
Komodo 1.2 32-bit2897    44%
14/32
 38%
17.5/46
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Hiarcs 13.22896   50%
11.5/23
42%
16/38
    
Tornado 7.0 64-bit 4CPU289558%
3.5/6
50%
5/10
       
Cheng4 0.38 64-bit2890   25%
0.5/2
30%
3/10
    
Fritz 122887    38%
13/34
50%
1/2
40%
12/30
41%
14/34
51%
17.5/34
Gull 1.0a 32-bit2886    47%
14/30
 35%
12/34
  
Quazar 0.4 32-bit2880   38%
1.5/4
49%
17.5/36
    
Gull 1.1 32-bit2877    51%
21.5/42
 38%
13/34
  
Hiarcs 13.12875   58%
14/24
47%
14/30
 41%
14/34
  
Scorpio 2.7.6 64-bit 4CPU287575%
1.5/2
60%
6/10
       
Komodo 1.0 32-bit2868       38%
23/60
48%
14.5/30
EXchess 7.18b 64-bit 4CPU286667%
4/6
50%
5/10
       
Stockfish 1.5.1 32-bit2865   38%
1.5/4
    36%
13/36
Thinker 5.4d Inert 64-bit2865   65%
19.5/30
 47%
15/32
   
Thinker 5.4c Inert 64-bit2861   73%
17.5/24
 37%
13/35
   
Deep Junior 12 32-bit2858    51%
19.5/38
 60%
6/10
  
Doch 1.3.4 32-bit2858       42%
2.5/6
35%
11.5/33
Thinker 5.4d Inert 32-bit2857    50%
38/76
 47%
21.5/46
39%
18/46
38%
13/34
Zappa Mexico II 64-bit2855   64%
25.5/40
 54%
18.5/34
   
Rodent 1.7 64-bit2851   65%
6.5/10
50%
5/10
    
Atlas 3.80 64-bit2849   54%
6.5/12
75%
7.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Nemo 1.0.1 64-bit284867%
4/6
  59%
54.5/92
     
Booot 5.1.0284475%
1.5/2
  62%
2.5/4
58%
52/89
    
Arasan 17.4 64-bit2843   38%
1.5/4
65%
6.5/10
    
Deep Sjeng WC2008 64-bit2836   56%
13.5/24
 68%
23/34
   
Onno 1.2.70 64-bit2834   55%
22/40
 52%
12.5/24
   
Protector 1.3.5 32-bit2831    41%
15/37
 50%
28.5/57
  
Cyclone xTreme Fury2828       44%
15/34
33%
1/3
Grapefruit 1.0 32-bit2827    72%
21.5/30
54%
19/35
54%
20.5/38
44%
18.5/42
50%
19.5/39
Booot 5.02826    58%
18.5/32
 43%
18/42
  
Deep Sjeng WC2008 32-bit2826      38%
1.5/4
49%
16.5/34
41%
13.5/33
Protector 1.3.4 32-bit2825      55%
16.5/30
54%
14/26
 
Cyclone xTreme2824    55%
17.5/32
 52%
15.5/30
  
Deep Junior 11.1a 64-bit2824     58%
14/24
  40%
9.5/24
Octochess r5190 64-bit 4CPU282450%
1/2
75%
7.5/10
       
NirvanaChess 1.5 64-bit2823   75%
4.5/6
40%
4/10
    
Cyclone xTreme Rage2821    25%
1/4
 50%
2/4
75%
1.5/2
 
Tornado 6.0 64-bit2820   38%
1.5/4
35%
3.5/10
    
Hiarcs 12.12818     48%
27/56
 44%
16/36
50%
16.5/33
Toga II 3.1.2SE2817   62%
5/8
58%
3.5/6
    
Zappa Mexico II 32-bit2810    58%
3.5/6
 62%
5/8
50%
17/34
48%
16/33
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Deuterium 14.1.32.119 64-bit2809   50%
3/6
55%
5.5/10
    
Crafty 24.1 64-bit2804   50%
1/2
65%
6.5/10
    
Hannibal 1.0a 32-bit2801    58%
29/50
 46%
21/46
  
Onno 1.1.1 32-bit2798       25%
1.5/6
38%
12.5/33
Protector 1.3.2 32-bit2796       52%
34/66
53%
16/30
Nemo 1.0.1 32-bit2795   12%
0.5/4
75%
13.5/18
    
Texel 1.01 64-bit278825%
0.5/2
  58%
10.5/18
     
Onno 1.2.70 32-bit2787    67%
8/12
 44%
3.5/8
  
Jonny 4.002780   88%
3.5/4
61%
39.5/65
 56%
18.5/33
  
Bright 0.5c2779   50%
0.5/1
69%
5.5/8
88%
3.5/4
65%
19.5/30
51%
24.5/48
52%
15.5/30
Bright 0.4a2777     56%
18/32
  62%
18.5/30
Naraku 1.42776   69%
5.5/8
69%
12.5/18
    
Critter 0.52b 32-bit2774       56%
29/52
53%
16/30
Loop 13.6 (Loop 2007) 32-bit2774      53%
16/30
50%
15/30
 
Twisted Logic 20100131x 64-bit2768   50%
0.5/1
 70%
3.5/5
   
SmarThink 1.20 64-bit2764   50%
1/2
 67%
16/24
   
Ktulu 92755    50%
0.5/1
69%
21.5/31
38%
1.5/4
  
SmarThink 1.20 32-bit2748    50%
0.5/1
 38%
1.5/4
58%
10.5/18
 
Spike 1.2 Turin2746     67%
24/36
62%
18.5/30
48%
14.5/30
70%
21/30
Chronos 1.9.9 32-bit2741    77%
8.5/11
 69%
11/16
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
MinkoChess 1.1 32-bit2741    85%
11/13
 50%
2/4
  
Twisted Logic 20100131x 32-bit2740      63%
21.5/34
64%
25.5/40
52%
15.5/30
Crafty 23.4 64-bit2736100%
1/1
  62%
2.5/4
     
Crafty 23.4 32-bit2733    58%
3.5/6
 50%
2/4
  
Twisted Logic 20090922 32-bit2731       62%
2.5/4
60%
21/35
Bison 9.11 32-bit2728    25%
1/4
60%
3/5
69%
5.5/8
25%
1/4
62%
18.5/30
Critter 0.42 32-bit2706       50%
1.5/3
50%
0.5/1
Booot 4.15.12697      50%
4/8
75%
3/4
 
Crafty 23.2 32-bit2696      75%
3/4
80%
8/10
 
Frenzee Feb08 32-bit2696      62%
2.5/4
88%
3.5/4
63%
22/35
Booot 4.15.02694       69%
5.5/8
64%
22.5/35
Delfi 5.42690    50%
0.5/1
  75%
9/12
70%
24.5/35
Crafty 23.1 32-bit2688       70%
3.5/5
65%
20/31
MinkoChess 0.8 32-bit2674      71%
8.5/12
25%
0.5/2
 
Daydreamer 1.75 32-bit2668      88%
3.5/4
75%
1.5/2
 
Scorpio 2.5 32-bit2664      75%
3/4
75%
1.5/2
 
BugChess2 1.6.4 32-bit2658      100%
1/1
83%
5/6
 
Colossus 2008b2644      75%
3/4
100%
2/2
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 14, 2019