CCRL 40/40
Downloads and Statistics
July 19, 2019
Testing summary:
Total: 1'068'538 games
played by 2'502 programs
146028 CPU days (X2 4600+)

White wins: 371'241 (34.7%)
Black wins: 276'263 (25.9%)
Draws: 421'034 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 9 engines!
9 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on July 19, 2019 with Bayeselo based on 1'068'538 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Spark 1.0 64-bit 4CPU2969+13−1345.0%+32.146.6%1787 
99.8%
 Spark 0.4 64-bit 4CPU2933+21−2143.0%+48.345.2%703
61.6%
 Spark 0.3 64-bit 4CPU2928+23−2346.5%+20.249.7%572
99.5%
 Spark 1.0 64-bit2893+12−1246.4%+27.042.7%2318
100.0%
 Spark 1.0 32-bit2863+12−1245.2%+32.444.0%2558
99.7%
 Spark 0.3 64-bit2834+18−1845.9%+28.638.4%1038
86.1%
 Spark 0.4 32-bit2821+16−1645.6%+28.448.0%1149
96.2%
 Spark 0.3a 32-bit2799+17−1745.7%+26.146.6%1070
56.4%
 Spark 0.3 32-bit2797+16−1647.7%+16.248.7%1264
 

Results matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969         
2Spark 0.4 64-bit 4CPU2933         
3Spark 0.3 64-bit 4CPU2928         
4Spark 1.0 64-bit2893         
5Spark 1.0 32-bit2863         
6Spark 0.3 64-bit2834         
7Spark 0.4 32-bit2821         
8Spark 0.3a 32-bit2799         
9Spark 0.3 32-bit2797         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 99.899.9100.0100.0100.0100.0100.0100.0
2Spark 0.4 64-bit 4CPU29330.2 61.699.9100.0100.0100.0100.0100.0
3Spark 0.3 64-bit 4CPU29280.138.4 99.5100.0100.0100.0100.0100.0
4Spark 1.0 64-bit28930.00.10.5 100.0100.0100.0100.0100.0
5Spark 1.0 32-bit28630.00.00.00.0 99.7100.0100.0100.0
6Spark 0.3 64-bit28340.00.00.00.00.3 86.199.799.9
7Spark 0.4 32-bit28210.00.00.00.00.013.9 96.297.8
8Spark 0.3a 32-bit27990.00.00.00.00.00.33.8 56.4
9Spark 0.3 32-bit27970.00.00.00.00.00.12.243.6 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 50330633460000
2Spark 0.4 64-bit 4CPU2933503 2350060000
3Spark 0.3 64-bit 4CPU2928306235 0071000
4Spark 1.0 64-bit289333400 631555736187
5Spark 1.0 32-bit2863600631 951390537485
6Spark 0.3 64-bit28340607155595 182262372
7Spark 0.4 32-bit2821000731390182 818603
8Spark 0.3a 32-bit279900061537262818 1496
9Spark 0.3 32-bit2797000874853726031496 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 20.213.08.10.10.00.00.00.0
2Spark 0.4 64-bit 4CPU293320.2 18.40.00.03.40.00.00.0
3Spark 0.3 64-bit 4CPU292813.018.4 0.00.04.40.00.00.0
4Spark 1.0 64-bit28938.10.00.0 12.916.52.11.82.4
5Spark 1.0 32-bit28630.10.00.012.9 2.637.514.812.7
6Spark 0.3 64-bit28340.03.44.416.52.6 8.312.416.2
7Spark 0.4 32-bit28210.00.00.02.137.58.3 36.925.0
8Spark 0.3a 32-bit27990.00.00.01.814.812.436.9 64.1
9Spark 0.3 32-bit27970.00.00.02.412.716.225.064.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 118 common opponents

Custom engine selection
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Komodo 4 64-bit309826%
9/34
  13%
7/52
     
Naum 4.6 64-bit 4CPU30950%
0/2
  15%
3/20
     
Naum 4.2 64-bit 4CPU306128%
13/46
21%
8/38
19%
3/16
      
Deep Shredder 12 64-bit 4CPU301848%
22.5/47
43%
14.5/34
43%
21.5/50
      
Rybka 4 32-bit3016    38%
13/34
 27%
8/30
  
Stockfish 1.9.1 32-bit3000    29%
9.5/33
 21%
7/34
  
Rybka 3 32-bit2994       16%
5.5/34
20%
6.5/33
Critter 0.90 32-bit2989    35%
14.5/42
 21%
7/34
  
Stockfish 1.7.1 32-bit2977      24%
8/34
32%
11/34
22%
6.5/30
Naum 4.2 64-bit2976   33%
14/43
 28%
14.5/52
   
Komodo 1.3 64-bit297360%
21/35
  41%
6.5/16
     
Zappa Mexico II 64-bit 4CPU296954%
30.5/57
0%
0/2
47%
15/32
      
Fritz 13296044%
14/32
  42%
21.5/51
     
Naum 4.2 32-bit2958    40%
13.5/34
  35%
7/20
 
Naum 4.1 32-bit2952       22%
6.5/30
20%
6/30
Komodo 1.2 64-bit2946 46%
16.5/36
   38%
9/24
   
Deep Sjeng c't 20102941   45%
15/33
40%
13.5/34
    
Deep Shredder 12 64-bit2940   45%
28/62
 23%
16/69
   
Arasan 17.5 64-bit 4CPU293575%
7.5/10
55%
11/20
       
Onno 1.2.70 64-bit 4CPU293457%
32.5/57
49%
18.5/38
       
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Bobcat 7.1 64-bit 4CPU293244%
3.5/8
45%
4.5/10
       
EXchess 7.71b 64-bit 4CPU293255%
11/20
75%
7.5/10
       
Fizbo 1.4 64-bit 4CPU293275%
1.5/2
56%
4.5/8
       
Stockfish 1.6.3 32-bit2932       33%
12.5/38
35%
12/34
Naum 4 32-bit2930       25%
1/4
26%
9/34
Shredder 12 32-bit2928   42%
10/24
36%
23/64
  18%
6/34
38%
24/63
Arasan 18.0 64-bit 4CPU292643%
9/21
61%
5.5/9
       
Deep Sjeng WC2008 64-bit 4CPU292671%
8.5/12
25%
1/4
52%
16.5/32
      
Thinker 5.4d Inert 64-bit 4CPU292675%
9/12
60%
21/35
48%
24/50
      
Komodo 1.0 64-bit2921  41%
13/32
  36%
14/39
   
Gull 1.2 64-bit291875%
1.5/2
  47%
22/47
     
Hannibal 1.2 64-bit291640%
4/10
  41%
19.5/47
     
Spike 1.4 Leiden2915   44%
48.5/110
39%
26.5/68
    
Rybka 2.3.2a 32-bit2912    43%
13/30
 27%
8/30
37%
11.5/31
33%
10.5/32
Crafty 23.8 64-bit 4CPU291169%
5.5/8
44%
3.5/8
       
Quazar 0.4 64-bit290542%
5/12
  52%
30/58
     
Toga II 1.4.1SE 4CPU290488%
3.5/4
56%
18.5/33
       
DiscoCheck 5.2 64-bit290060%
6/10
  50%
1/2
     
Cheng4 0.36c 64-bit 4CPU289750%
1/2
25%
2/8
       
Hiarcs 13.22896   50%
11.5/23
42%
16/38
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Komodo 1.2 32-bit2896    44%
14/32
 38%
17.5/46
  
Tornado 7.0 64-bit 4CPU289458%
3.5/6
50%
5/10
       
Cheng4 0.38 64-bit2889   25%
0.5/2
30%
3/10
    
Fritz 122886    38%
13/34
50%
1/2
40%
12/30
41%
14/34
51%
17.5/34
Gull 1.0a 32-bit2884    47%
14/30
 35%
12/34
  
Quazar 0.4 32-bit2879   38%
1.5/4
49%
17.5/36
    
Gull 1.1 32-bit2876    51%
21.5/42
 38%
13/34
  
Hiarcs 13.12874   58%
14/24
47%
14/30
 41%
14/34
  
Scorpio 2.7.6 64-bit 4CPU287475%
1.5/2
60%
6/10
       
Komodo 1.0 32-bit2867       38%
23/60
48%
14.5/30
EXchess 7.18b 64-bit 4CPU286667%
4/6
50%
5/10
       
Stockfish 1.5.1 32-bit2864   38%
1.5/4
    36%
13/36
Thinker 5.4d Inert 64-bit2864   65%
19.5/30
 47%
15/32
   
Thinker 5.4c Inert 64-bit2860   73%
17.5/24
 37%
13/35
   
Deep Junior 12 32-bit2856    51%
19.5/38
 60%
6/10
  
Doch 1.3.4 32-bit2856       42%
2.5/6
35%
11.5/33
Thinker 5.4d Inert 32-bit2856    50%
38/76
 47%
21.5/46
39%
18/46
38%
13/34
Zappa Mexico II 64-bit2854   64%
25.5/40
 54%
18.5/34
   
Rodent 1.7 64-bit2851   65%
6.5/10
50%
5/10
    
Atlas 3.80 64-bit2848   54%
6.5/12
75%
7.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Nemo 1.0.1 64-bit284767%
4/6
  59%
54.5/92
     
Booot 5.1.0284375%
1.5/2
  62%
2.5/4
58%
52/89
    
Arasan 17.4 64-bit2842   38%
1.5/4
65%
6.5/10
    
Deep Sjeng WC2008 64-bit2835   56%
13.5/24
 68%
23/34
   
Onno 1.2.70 64-bit2833   55%
22/40
 52%
12.5/24
   
Protector 1.3.5 32-bit2829    41%
15/37
 50%
28.5/57
  
Cyclone xTreme Fury2827       44%
15/34
33%
1/3
Grapefruit 1.0 32-bit2826    72%
21.5/30
54%
19/35
54%
20.5/38
44%
18.5/42
50%
19.5/39
Booot 5.02825    58%
18.5/32
 43%
18/42
  
Deep Sjeng WC2008 32-bit2825      38%
1.5/4
49%
16.5/34
41%
13.5/33
Protector 1.3.4 32-bit2824      55%
16.5/30
54%
14/26
 
Cyclone xTreme2823    55%
17.5/32
 52%
15.5/30
  
Deep Junior 11.1a 64-bit2823     58%
14/24
  40%
9.5/24
Octochess r5190 64-bit 4CPU282350%
1/2
75%
7.5/10
       
NirvanaChess 1.5 64-bit2822   75%
4.5/6
40%
4/10
    
Cyclone xTreme Rage2820    25%
1/4
 50%
2/4
75%
1.5/2
 
Tornado 6.0 64-bit2819   38%
1.5/4
35%
3.5/10
    
Toga II 3.1.2SE2818   62%
5/8
58%
3.5/6
    
Hiarcs 12.12817     48%
27/56
 44%
16/36
50%
16.5/33
Zappa Mexico II 32-bit2809    58%
3.5/6
 62%
5/8
50%
17/34
48%
16/33
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Deuterium 14.1.32.119 64-bit2808   50%
3/6
55%
5.5/10
    
Crafty 24.1 64-bit2803   50%
1/2
65%
6.5/10
    
Hannibal 1.0a 32-bit2800    58%
29/50
 46%
21/46
  
Onno 1.1.1 32-bit2797       25%
1.5/6
38%
12.5/33
Protector 1.3.2 32-bit2795       52%
34/66
53%
16/30
Nemo 1.0.1 32-bit2794   12%
0.5/4
75%
13.5/18
    
Texel 1.01 64-bit278725%
0.5/2
  58%
10.5/18
     
Onno 1.2.70 32-bit2786    67%
8/12
 44%
3.5/8
  
Jonny 4.002779   88%
3.5/4
61%
39.5/65
 56%
18.5/33
  
Bright 0.5c2778   50%
0.5/1
69%
5.5/8
88%
3.5/4
65%
19.5/30
51%
24.5/48
52%
15.5/30
Bright 0.4a2775     56%
18/32
  62%
18.5/30
Naraku 1.42775   69%
5.5/8
69%
12.5/18
    
Critter 0.52b 32-bit2773       56%
29/52
53%
16/30
Loop 13.6 (Loop 2007) 32-bit2773      53%
16/30
50%
15/30
 
Twisted Logic 20100131x 64-bit2767   50%
0.5/1
 70%
3.5/5
   
SmarThink 1.20 64-bit2763   50%
1/2
 67%
16/24
   
Ktulu 92754    50%
0.5/1
69%
21.5/31
38%
1.5/4
  
SmarThink 1.20 32-bit2746    50%
0.5/1
 38%
1.5/4
58%
10.5/18
 
Spike 1.2 Turin2745     67%
24/36
62%
18.5/30
48%
14.5/30
70%
21/30
MinkoChess 1.1 32-bit2740    85%
11/13
 50%
2/4
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Chronos 1.9.9 32-bit2739    77%
8.5/11
 69%
11/16
  
Twisted Logic 20100131x 32-bit2739      63%
21.5/34
64%
25.5/40
52%
15.5/30
Crafty 23.4 64-bit2735100%
1/1
  62%
2.5/4
     
Crafty 23.4 32-bit2732    58%
3.5/6
 50%
2/4
  
Twisted Logic 20090922 32-bit2730       62%
2.5/4
60%
21/35
Bison 9.11 32-bit2727    25%
1/4
60%
3/5
69%
5.5/8
25%
1/4
62%
18.5/30
Critter 0.42 32-bit2705       50%
1.5/3
50%
0.5/1
Booot 4.15.12696      50%
4/8
75%
3/4
 
Crafty 23.2 32-bit2695      75%
3/4
80%
8/10
 
Frenzee Feb08 32-bit2695      62%
2.5/4
88%
3.5/4
63%
22/35
Booot 4.15.02693       69%
5.5/8
64%
22.5/35
Delfi 5.42689    50%
0.5/1
  75%
9/12
70%
24.5/35
Crafty 23.1 32-bit2687       70%
3.5/5
65%
20/31
MinkoChess 0.8 32-bit2674      71%
8.5/12
25%
0.5/2
 
Daydreamer 1.75 32-bit2668      88%
3.5/4
75%
1.5/2
 
Scorpio 2.5 32-bit2663      75%
3/4
75%
1.5/2
 
BugChess2 1.6.4 32-bit2657      100%
1/1
83%
5/6
 
Colossus 2008b2643      75%
3/4
100%
2/2
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 19, 2019