CCRL 40/4
Downloads and Statistics
June 15, 2019
Testing summary:
Total: 2'051'440 games
played by 2'369 programs
27518 CPU days (X2 4600+)

White wins: 797'129 (38.9%)
Black wins: 645'243 (31.5%)
Draws: 609'068 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 114 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on June 15, 2019 with Bayeselo based on 2'051'440 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Spark 1.0 64-bit 4CPU3029+9−939.9%+72.139.5%4577 
99.9%
 Spark 0.5 64-bit 4CPU3000+15−1545.9%+27.641.3%1448
86.0%
 Spark 0.4 64-bit 4CPU2988+14−1446.6%+24.241.5%1614
98.2%
 Spark 0.3 64-bit 4CPU2969+12−1247.4%+16.641.7%2237
75.1%
 Spark 0.3a 64-bit 4CPU2962+18−1744.6%+36.038.2%1093
100.0%
 Spark 1.0 64-bit2927+7−745.7%+30.634.8%9260
77.5%
 Spark 0.5 64-bit2920+18−1853.2%−21.734.9%1108
100.0%
 Spark 0.4 64-bit2882+11−1157.4%−55.133.6%3231
100.0%
 Spark 0.3 64-bit2844+10−1049.1%+4.537.0%3450
 

Results matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU3029         
2Spark 0.5 64-bit 4CPU3000         
3Spark 0.4 64-bit 4CPU2988   34 − 30
+17−13=34
−2
     
4Spark 0.3 64-bit 4CPU2969  30 − 34
+13−17=34
+2
      
5Spark 0.3a 64-bit 4CPU2962         
6Spark 1.0 64-bit2927         
7Spark 0.5 64-bit2920         
8Spark 0.4 64-bit2882        28 − 22
+18−12=20
0
9Spark 0.3 64-bit2844       22 − 28
+12−18=20
0
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU3029 99.9100.0100.0100.0100.0100.0100.0100.0
2Spark 0.5 64-bit 4CPU30000.1 86.099.999.9100.0100.0100.0100.0
3Spark 0.4 64-bit 4CPU29880.014.0 98.299.0100.0100.0100.0100.0
4Spark 0.3 64-bit 4CPU29690.00.11.8 75.1100.0100.0100.0100.0
5Spark 0.3a 64-bit 4CPU29620.00.11.024.9 100.099.9100.0100.0
6Spark 1.0 64-bit29270.00.00.00.00.0 77.5100.0100.0
7Spark 0.5 64-bit29200.00.00.00.00.122.5 100.0100.0
8Spark 0.4 64-bit28820.00.00.00.00.00.00.0 100.0
9Spark 0.3 64-bit28440.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU3029 200516891371100710669916524
2Spark 0.5 64-bit 4CPU30002005 1759122710640831150
3Spark 0.4 64-bit 4CPU298816891759 2717191581100217152
4Spark 0.3 64-bit 4CPU2969137112272717 28810147186352
5Spark 0.3a 64-bit 4CPU29621007106419152881 09982114
6Spark 1.0 64-bit2927106608100 9382208989
7Spark 0.5 64-bit2920998310014799938 21131976
8Spark 0.4 64-bit28821651152171868222082113 3747
9Spark 0.3 64-bit284424015235211498919763747 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU3029 33.327.320.117.87.71.72.10.3
2Spark 0.5 64-bit 4CPU300033.3 57.433.341.90.03.22.50.0
3Spark 0.4 64-bit 4CPU298827.357.4 70.670.70.73.74.53.0
4Spark 0.3 64-bit 4CPU296920.133.370.6 86.50.04.43.46.2
5Spark 0.3a 64-bit 4CPU296217.841.970.786.5 0.04.51.92.5
6Spark 1.0 64-bit29277.70.00.70.00.0 9.017.77.8
7Spark 0.5 64-bit29201.73.23.74.44.59.0 48.743.4
8Spark 0.4 64-bit28822.12.54.53.41.917.748.7 56.1
9Spark 0.3 64-bit28440.30.03.06.22.57.843.456.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 104 common opponents

Custom engine selection
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Rybka 4 64-bit 4CPU319820%
19.5/100
23%
11.5/50
22%
11/50
      
Komodo CCT 64-bit318134%
17/50
    20%
6.5/32
   
Houdini 1.5a 64-bit317030%
25.5/84
    18%
9/50
   
Stockfish 2.0.1 64-bit 4CPU316727%
13.5/50
24%
12/50
       
Rybka 3 64-bit 4CPU3166  29%
18.5/64
20%
20/100
20%
10/50
    
Stockfish 1.9.1 64-bit 4CPU315332%
31.5/97
26%
26.5/100
       
Stockfish 1.7.1 64-bit 4CPU3141 29%
29/100
25%
16/64
22%
14.5/65
24%
15.5/65
    
Critter 0.90 64-bit 4CPU312830%
30.5/100
 29%
15/52
      
Komodo 4 64-bit312632%
26/80
    24%
19.5/82
   
Komodo 3 64-bit310940%
20/50
    22%
29/130
   
Rybka 4 64-bit3102  33%
16.5/50
  19%
6/31
22%
11/50
21%
16/77
 
Naum 4.2 64-bit 4CPU309838%
41.5/109
42%
41.5/100
34%
21.5/64
27%
17/63
24%
15.5/64
    
Stockfish 1.6s JA 64-bit 4CPU3093  29%
18/63
23%
22.5/99
33%
16.5/50
    
Stockfish 1.6.3 64-bit 4CPU3089  26%
16.5/63
30%
30.5/100
33%
16.5/50
    
Rybka 3 64-bit3078      17%
6/35
 13%
14/106
Komodo 2.01 64-bit307146%
23/50
    27%
13/48
   
Komodo 2.03 64-bit307139%
19.5/50
    29%
14/48
   
Critter 0.80 64-bit 4CPU307050%
25/50
39%
19.5/50
       
Naum 4.1 64-bit 4CPU3070  33%
20.5/63
33%
16.5/50
33%
16.5/50
    
Naum 4 64-bit 4CPU3063  42%
27/64
41%
41/100
39%
19.5/50
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Stockfish 1.8 64-bit3058     22%
7/32
 24%
8/34
 
Critter 0.90 64-bit3049     62%
18.5/30
 19%
6/32
 
Stockfish 1.7.1 64-bit3045      43%
15/35
27%
17/64
22%
7/32
Deep Shredder 12 64-bit 4CPU304146%
45.5/100
44%
22/50
48%
31/64
44%
87/200
32%
32.5/100
    
Critter 0.70 64-bit 4CPU3037 53%
25.5/48
33%
11.5/35
      
Hiarcs 13.2 4CPU303353%
26.5/50
40%
20/50
       
Hiarcs 13.1 4CPU300945%
22.5/50
46%
46.5/100
45%
22.5/50
      
Rybka 2.2 64-bit 4CPU3002   50%
50.5/100
42%
21/50
    
Komodo 1.3 64-bit299357%
28.5/50
    40%
24.5/62
   
Deep Junior 12 64-bit 4CPU298956%
27.5/49
53%
26.5/50
       
Naum 4.2 64-bit2987     42%
20/48
37%
18.5/50
34%
17/50
20%
10/50
Fritz 13298562%
31/50
    33%
21/63
   
Stockfish 1.6.3 64-bit2985       37%
18.5/50
26%
28/106
Stockfish 1.6s JA 64-bit2980       37%
11/30
28%
25.5/90
Rybka 2.3.2a 64-bit2977     44%
14/32
35%
17.5/50
34%
11/32
 
Critter 0.70 64-bit2974      31%
11/35
38%
12/32
 
Zappa Mexico II 64-bit 4CPU297155%
55/100
55%
27.5/50
51%
32.5/64
45%
45/100
52%
26/50
    
Komodo 1.2 64-bit296760%
60/100
52%
26/50
    42%
14/33
34%
22/65
 
Deep Shredder 12 64-bit2955     48%
15.5/32
44%
37/85
27%
13.5/50
34%
52.5/156
Naum 4.1 64-bit2955       37%
18.5/50
29%
23.5/80
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Onno 1.2.70 64-bit 4CPU295554%
27/50
56%
56.5/100
46%
23/50
      
Protector 1.3.4 64-bit 4CPU295258%
29/50
61%
30.5/50
53%
34/64
 39%
13.5/35
    
Thinker 5.4c Inert 64-bit 4CPU295258%
29/50
52%
26/50
62%
39.5/64
53%
53/100
54%
27/50
    
Naum 4 64-bit2947       36%
18/50
40%
22.5/56
Zappa Mexico 64-bit 4CPU2946   51%
51/100
51%
25.5/50
    
Deep Junior 11.1a 64-bit 4CPU2943  60%
38.5/64
56%
28/50
58%
46/80
    
Gull 1.1 64-bit294359%
60.5/102
    38%
12/32
   
Hiarcs 12 4CPU2941 60%
30/50
63%
40.5/64
50%
50.5/100
50%
25/50
    
Deep Sjeng WC2008 64-bit 4CPU294066%
33/50
 59%
37.5/64
58%
58/100
61%
30.5/50
    
Hiarcs 12.1 4CPU2939 58%
29/50
59%
37.5/64
62%
61/99
56%
28/50
    
Gull 1.0a 64-bit2938     49%
23.5/48
 44%
14/32
 
Rybka 2.2 64-bit2937      42%
14/33
44%
27/62
 
Komodo 1.0 64-bit2932  55%
35.5/64
56%
55.5/100
   45%
13.5/30
41%
36.5/88
Deep Sjeng 3.0 64-bit 4CPU293064%
32/50
 66%
42.5/64
      
Deep Junior 11.2 64-bit 4CPU2924 58%
57.5/100
57%
28.5/50
      
Spike 1.4 Leiden2922     46%
25.5/55
 43%
13/30
 
Fritz 122908      58%
29/50
42%
21/50
43%
31.5/74
Bright 0.5c 4CPU290660%
31/52
 60%
38.5/64
64%
32/50
     
Toga II 1.4 beta5c 4CPU290471%
35.5/50
64%
32/50
70%
44.5/64
58%
58.5/100
56%
28/50
    
Thinker 5.4d Inert 64-bit288581%
6.5/8
    54%
7/13
  53%
42.5/80
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Thinker 5.4c Inert 64-bit2883     61%
19.5/32
59%
29.5/50
54%
33.5/62
40%
51/128
Loop M1-T 64-bit 4CPU288172%
36/50
  63%
61.5/97
62%
30.5/49
    
Critter 0.60 64-bit2866      60%
20.5/34
57%
44/77
 
Hannibal 1.0a 64-bit2862     61%
19.5/32
 57%
17/30
 
Protector 1.3.5 64-bit2856     67%
21.5/32
 38%
11.5/30
 
Onno 1.2.70 64-bit2845     56%
18/32
 54%
27/50
 
Deep Junior 11.2 64-bit2843     66%
20.5/31
48%
24/50
51%
25.5/50
 
Zappa Mexico II 64-bit2843     56%
22/39
60%
30/50
52%
15.5/30
49%
66.5/136
Deep Sjeng WC2008 64-bit2842     64%
20.5/32
62%
31/50
58%
57.5/99
53%
68.5/129
Deep Junior 11.1a 64-bit2840      61%
30.5/50
66%
33/50
61%
80/131
Deep Sjeng 3.0 64-bit2838      69%
24/35
 47%
23/49
Onno 1.1.1 64-bit2837       69%
34.5/50
53%
68/128
Hiarcs 122835       48%
24/50
62%
60.5/98
Hiarcs 12.12833       63%
31.5/50
51%
39.5/78
Toga II 1.4.1SE2823     67%
21.5/32
 70%
22.5/32
48%
14.5/30
Toga II 1.4 beta5c2820      81%
28.5/35
62%
18.5/30
 
Fruit 05/11/032792       58%
17.5/30
43%
13/30
Booot 5.02785     72%
23/32
 62%
18/29
 
Ktulu 92782     73%
23.5/32
71%
35/49
64%
32/50
61%
69.5/114
Bright 0.4a2779     78%
29.5/38
 72%
21.5/30
66%
33/50
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Loop 13.6 (Loop 2007) 32-bit2775     67%
21.5/32
 73%
22.5/31
 
Bright 0.5c2773       70%
57.5/82
58%
37/64
Twisted Logic 20090922 64-bit2771     73%
23.5/32
71%
35.5/50
64%
51.5/80
59%
48/81
Twisted Logic 20100131x 64-bit2766     100%
1/1
73%
36.5/50
67%
41.5/62
64%
73/114
Jonny 4.002763     74%
33.5/45
 67%
20/30
 
Bison 9.11 64-bit2761     75%
25.5/34
 69%
22/32
 
Crafty 23.3 64-bit2758     73%
23.5/32
 60%
18/30
 
Scorpio 2.6 64-bit2756     72%
23/32
 68%
20.5/30
 
SmarThink 1.20 64-bit2747     79%
24.5/31
76%
38/50
72%
21.5/30
64%
41/64
Chronos 1.9.9 64-bit2739     76%
25/33
 75%
22.5/30
 
Spike 1.2 Turin2731   76%
76/100
88%
44/50
 81%
39.5/49
70%
22.5/32
60%
38.5/64
Naum 2.0 32-bit2700     78%
25/32
 78%
23.5/30
 
Frenzee Feb08 64-bit2695     72%
23/32
 83%
26.5/32
 
Delfi 5.42684     83%
27.5/33
 77%
24.5/32
 
Booot 4.15.02665       73%
22/30
69%
22/32
Alaric 7072664     83%
2.5/3
 78%
25/32
72%
23/32
Colossus 2008b2642       73%
23.5/32
72%
23/32
Chronos 1.9.72639       78%
25/32
84%
27/32
E.T. Chess 13.01.082634     100%
1/1
 84%
27/32
 
Alfil 8.1.1 Optimized2625       83%
26.5/32
84%
27/32
NameEloSpark
1.0
64-bit
4CPU
Spark
0.5
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
0.3a
64-bit
4CPU
Spark
1.0
64-bit
Spark
0.5
64-bit
Spark
0.4
64-bit
Spark
0.3
64-bit
Movei 00.8.438 (10 10 10)2623       81%
26/32
69%
22/32
WildCat 82623       80%
25.5/32
80%
25.5/32
Sloppy 0.2.2 64-bit2617     100%
1/1
 86%
27.5/32
 
Slow Chess Blitz WV2.12615       88%
28/32
84%
27/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on June 15, 2019