CCRL 40/40
Downloads and Statistics
October 12, 2019
Testing summary:
Total: 1'090'583 games
played by 2'551 programs
149018 CPU days (X2 4600+)

White wins: 378'348 (34.7%)
Black wins: 281'291 (25.8%)
Draws: 430'944 (39.5%)
White score: 54.4%

Custom engine selection

Comparing 9 engines!
9 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on October 12, 2019 with Bayeselo based on 1'090'583 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Spark 1.0 64-bit 4CPU2970+13−1345.0%+31.746.6%1787 
99.8%
 Spark 0.4 64-bit 4CPU2933+21−2143.0%+48.545.2%703
60.9%
 Spark 0.3 64-bit 4CPU2928+23−2346.5%+20.849.7%572
99.5%
 Spark 1.0 64-bit2893+12−1246.4%+27.642.7%2318
100.0%
 Spark 1.0 32-bit2864+11−1145.3%+32.044.3%2594
99.6%
 Spark 0.3 64-bit2836+18−1846.3%+25.738.3%1048
87.5%
 Spark 0.4 32-bit2822+16−1645.8%+27.047.8%1159
96.6%
 Spark 0.3a 32-bit2800+17−1745.7%+25.846.6%1070
56.2%
 Spark 0.3 32-bit2798+16−1647.7%+16.048.7%1264
 

Results matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970         
2Spark 0.4 64-bit 4CPU2933         
3Spark 0.3 64-bit 4CPU2928         
4Spark 1.0 64-bit2893         
5Spark 1.0 32-bit2864         
6Spark 0.3 64-bit2836         
7Spark 0.4 32-bit2822         
8Spark 0.3a 32-bit2800         
9Spark 0.3 32-bit2798         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 99.899.9100.0100.0100.0100.0100.0100.0
2Spark 0.4 64-bit 4CPU29330.2 60.999.9100.0100.0100.0100.0100.0
3Spark 0.3 64-bit 4CPU29280.139.1 99.5100.0100.0100.0100.0100.0
4Spark 1.0 64-bit28930.00.10.5 100.0100.0100.0100.0100.0
5Spark 1.0 32-bit28640.00.00.00.0 99.6100.0100.0100.0
6Spark 0.3 64-bit28360.00.00.00.00.4 87.599.899.9
7Spark 0.4 32-bit28220.00.00.00.00.012.5 96.698.0
8Spark 0.3a 32-bit28000.00.00.00.00.00.23.4 56.2
9Spark 0.3 32-bit27980.00.00.00.00.00.12.043.8 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 50330633460000
2Spark 0.4 64-bit 4CPU2933503 2350060000
3Spark 0.3 64-bit 4CPU2928306235 0071000
4Spark 1.0 64-bit289333400 631555736187
5Spark 1.0 32-bit2864600631 951390537485
6Spark 0.3 64-bit28360607155595 182262372
7Spark 0.4 32-bit2822000731390182 818603
8Spark 0.3a 32-bit280000061537262818 1496
9Spark 0.3 32-bit2798000874853726031496 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2970 20.213.08.10.10.00.00.00.0
2Spark 0.4 64-bit 4CPU293320.2 18.40.00.03.40.00.00.0
3Spark 0.3 64-bit 4CPU292813.018.4 0.00.04.40.00.00.0
4Spark 1.0 64-bit28938.10.00.0 12.816.52.11.82.4
5Spark 1.0 32-bit28640.10.00.012.8 2.637.014.712.6
6Spark 0.3 64-bit28360.03.44.416.52.6 8.212.416.1
7Spark 0.4 32-bit28220.00.00.02.137.08.2 36.724.9
8Spark 0.3a 32-bit28000.00.00.01.814.712.436.7 64.1
9Spark 0.3 32-bit27980.00.00.02.412.616.124.964.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 118 common opponents

Custom engine selection
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Komodo 4 64-bit309826%
9/34
  13%
7/52
     
Naum 4.6 64-bit 4CPU30950%
0/2
  15%
3/20
     
Naum 4.2 64-bit 4CPU306128%
13/46
21%
8/38
19%
3/16
      
Deep Shredder 12 64-bit 4CPU301948%
22.5/47
43%
14.5/34
43%
21.5/50
      
Rybka 4 32-bit3017    38%
13/34
 27%
8/30
  
Stockfish 1.9.1 32-bit3001    29%
9.5/33
 21%
7/34
  
Rybka 3 32-bit2994       16%
5.5/34
20%
6.5/33
Critter 0.90 32-bit2990    35%
14.5/42
 21%
7/34
  
Naum 4.2 64-bit2977   33%
14/43
 28%
14.5/52
   
Stockfish 1.7.1 32-bit2977      24%
8/34
32%
11/34
22%
6.5/30
Komodo 1.3 64-bit297460%
21/35
  41%
6.5/16
     
Zappa Mexico II 64-bit 4CPU296954%
30.5/57
0%
0/2
47%
15/32
      
Fritz 13296144%
14/32
  42%
21.5/51
     
Naum 4.2 32-bit2959    40%
13.5/34
  35%
7/20
 
Naum 4.1 32-bit2953       22%
6.5/30
20%
6/30
Komodo 1.2 64-bit2947 46%
16.5/36
   38%
9/24
   
Deep Sjeng c't 20102942   45%
15/33
40%
13.5/34
    
Deep Shredder 12 64-bit2940   45%
28/62
 23%
16/69
   
Arasan 17.5 64-bit 4CPU293575%
7.5/10
55%
11/20
       
Bobcat 7.1 64-bit 4CPU293544%
3.5/8
45%
4.5/10
       
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Onno 1.2.70 64-bit 4CPU293457%
32.5/57
49%
18.5/38
       
Stockfish 1.6.3 32-bit2934       33%
12.5/38
35%
12/34
EXchess 7.71b 64-bit 4CPU293355%
11/20
75%
7.5/10
       
Fizbo 1.4 64-bit 4CPU293275%
1.5/2
56%
4.5/8
       
Naum 4 32-bit2931       25%
1/4
26%
9/34
Shredder 12 32-bit2930   42%
10/24
36%
23/64
  18%
6/34
38%
24/63
Arasan 18.0 64-bit 4CPU292743%
9/21
61%
5.5/9
       
Thinker 5.4d Inert 64-bit 4CPU292775%
9/12
60%
21/35
48%
24/50
      
Deep Sjeng WC2008 64-bit 4CPU292671%
8.5/12
25%
1/4
52%
16.5/32
      
Komodo 1.0 64-bit2922  41%
13/32
  36%
14/39
   
Gull 1.2 64-bit291975%
1.5/2
  47%
22/47
     
Hannibal 1.2 64-bit291640%
4/10
  41%
19.5/47
     
Spike 1.4 Leiden2915   44%
48.5/110
39%
26.5/68
    
Rybka 2.3.2a 32-bit2913    43%
13/30
 27%
8/30
37%
11.5/31
33%
10.5/32
Crafty 23.8 64-bit 4CPU291169%
5.5/8
44%
3.5/8
       
Quazar 0.4 64-bit290642%
5/12
  52%
30/58
     
Toga II 1.4.1SE 4CPU290588%
3.5/4
56%
18.5/33
       
DiscoCheck 5.2 64-bit290160%
6/10
  50%
1/2
     
Cheng4 0.36c 64-bit 4CPU289750%
1/2
25%
2/8
       
Komodo 1.2 32-bit2897    44%
14/32
 38%
17.5/46
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Hiarcs 13.22896   50%
11.5/23
42%
16/38
    
Tornado 7.0 64-bit 4CPU289458%
3.5/6
50%
5/10
       
Cheng4 0.38 64-bit2890   25%
0.5/2
30%
3/10
    
Fritz 122887    38%
13/34
50%
1/2
40%
12/30
41%
14/34
51%
17.5/34
Gull 1.0a 32-bit2886    47%
14/30
 35%
12/34
  
Quazar 0.4 32-bit2880   38%
1.5/4
49%
17.5/36
    
Gull 1.1 32-bit2877    51%
21.5/42
 38%
13/34
  
Hiarcs 13.12875   58%
14/24
47%
14/30
 41%
14/34
  
Scorpio 2.7.6 64-bit 4CPU287575%
1.5/2
60%
6/10
       
Komodo 1.0 32-bit2868       38%
23/60
48%
14.5/30
EXchess 7.18b 64-bit 4CPU286767%
4/6
50%
5/10
       
Stockfish 1.5.1 32-bit2865   38%
1.5/4
    36%
13/36
Thinker 5.4d Inert 64-bit2865   65%
19.5/30
 47%
15/32
   
Thinker 5.4c Inert 64-bit2861   73%
17.5/24
 37%
13/35
   
Doch 1.3.4 32-bit2857       42%
2.5/6
35%
11.5/33
Thinker 5.4d Inert 32-bit2857    50%
38/76
 47%
21.5/46
39%
18/46
38%
13/34
Deep Junior 12 32-bit2856    51%
19.5/38
 60%
6/10
  
Zappa Mexico II 64-bit2855   64%
25.5/40
 54%
18.5/34
   
Rodent 1.7 64-bit2851   65%
6.5/10
50%
5/10
    
Atlas 3.80 64-bit2848   54%
6.5/12
75%
7.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Nemo 1.0.1 64-bit284867%
4/6
  59%
54.5/92
     
Booot 5.1.0284475%
1.5/2
  62%
2.5/4
58%
52/89
    
Arasan 17.4 64-bit2843   38%
1.5/4
65%
6.5/10
    
Deep Sjeng WC2008 64-bit2836   56%
13.5/24
 68%
23/34
   
Onno 1.2.70 64-bit2834   55%
22/40
 52%
12.5/24
   
Protector 1.3.5 32-bit2830    41%
15/37
 50%
28.5/57
  
Cyclone xTreme Fury2828       44%
15/34
33%
1/3
Grapefruit 1.0 32-bit2827    72%
21.5/30
54%
19/35
54%
20.5/38
44%
18.5/42
50%
19.5/39
Deep Sjeng WC2008 32-bit2826      38%
1.5/4
49%
16.5/34
41%
13.5/33
Booot 5.02825    58%
18.5/32
 43%
18/42
  
Protector 1.3.4 32-bit2825      55%
16.5/30
54%
14/26
 
Cyclone xTreme2824    55%
17.5/32
 52%
15.5/30
  
Deep Junior 11.1a 64-bit2824     58%
14/24
  40%
9.5/24
Octochess r5190 64-bit 4CPU282350%
1/2
75%
7.5/10
       
NirvanaChess 1.5 64-bit2822   75%
4.5/6
40%
4/10
    
Cyclone xTreme Rage2821    25%
1/4
 50%
2/4
75%
1.5/2
 
Tornado 6.0 64-bit2820   38%
1.5/4
35%
3.5/10
    
Hiarcs 12.12818     48%
27/56
 44%
16/36
50%
16.5/33
Toga II 3.1.2SE2816   62%
5/8
58%
3.5/6
    
Deuterium 14.1.32.119 64-bit2809   50%
3/6
55%
5.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Zappa Mexico II 32-bit2809    58%
3.5/6
 62%
5/8
50%
17/34
48%
16/33
Crafty 24.1 64-bit2804   50%
1/2
65%
6.5/10
    
Hannibal 1.0a 32-bit2801    58%
29/50
 46%
21/46
  
Onno 1.1.1 32-bit2798       25%
1.5/6
38%
12.5/33
Protector 1.3.2 32-bit2796       52%
34/66
53%
16/30
Nemo 1.0.1 32-bit2795   12%
0.5/4
75%
13.5/18
    
Onno 1.2.70 32-bit2787    67%
8/12
 44%
3.5/8
  
Texel 1.01 64-bit278725%
0.5/2
  58%
10.5/18
     
Jonny 4.002779   88%
3.5/4
61%
39.5/65
 56%
18.5/33
  
Bright 0.5c2778   50%
0.5/1
69%
5.5/8
88%
3.5/4
65%
19.5/30
51%
24.5/48
52%
15.5/30
Bright 0.4a2776     56%
18/32
  62%
18.5/30
Naraku 1.42776   69%
5.5/8
69%
12.5/18
    
Critter 0.52b 32-bit2774       56%
29/52
53%
16/30
Loop 13.6 (Loop 2007) 32-bit2774      53%
16/30
50%
15/30
 
Twisted Logic 20100131x 64-bit2768   50%
0.5/1
 70%
3.5/5
   
SmarThink 1.20 64-bit2764   50%
1/2
 67%
16/24
   
Ktulu 92755    50%
0.5/1
69%
21.5/31
38%
1.5/4
  
SmarThink 1.20 32-bit2747    50%
0.5/1
 38%
1.5/4
58%
10.5/18
 
Spike 1.2 Turin2746     67%
24/36
62%
18.5/30
48%
14.5/30
70%
21/30
Chronos 1.9.9 32-bit2741    77%
8.5/11
 69%
11/16
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
MinkoChess 1.1 32-bit2741    85%
11/13
 50%
2/4
  
Twisted Logic 20100131x 32-bit2739      63%
21.5/34
64%
25.5/40
52%
15.5/30
Crafty 23.4 64-bit2736100%
1/1
  62%
2.5/4
     
Crafty 23.4 32-bit2733    58%
3.5/6
 50%
2/4
  
Twisted Logic 20090922 32-bit2730       62%
2.5/4
60%
21/35
Bison 9.11 32-bit2728    25%
1/4
60%
3/5
69%
5.5/8
25%
1/4
62%
18.5/30
Critter 0.42 32-bit2706       50%
1.5/3
50%
0.5/1
Booot 4.15.12697      50%
4/8
75%
3/4
 
Crafty 23.2 32-bit2696      75%
3/4
80%
8/10
 
Frenzee Feb08 32-bit2696      62%
2.5/4
88%
3.5/4
63%
22/35
Booot 4.15.02693       69%
5.5/8
64%
22.5/35
Delfi 5.42690    50%
0.5/1
  75%
9/12
70%
24.5/35
Crafty 23.1 32-bit2687       70%
3.5/5
65%
20/31
MinkoChess 0.8 32-bit2674      71%
8.5/12
25%
0.5/2
 
Daydreamer 1.75 32-bit2668      88%
3.5/4
75%
1.5/2
 
Scorpio 2.5 32-bit2664      75%
3/4
75%
1.5/2
 
BugChess2 1.6.4 32-bit2658      100%
1/1
83%
5/6
 
Colossus 2008b2644      75%
3/4
100%
2/2
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 12, 2019