CCRL 40/40
Downloads and Statistics
May 25, 2019
Testing summary:
Total: 1'048'225 games
played by 2'458 programs
143565 CPU days (X2 4600+)

White wins: 364'320 (34.8%)
Black wins: 271'251 (25.9%)
Draws: 412'654 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 10 engines!
10 selected engines played 40 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on May 25, 2019 with Bayeselo based on 1'048'225 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3321+15−1556.7%−41.959.2%1269 
99.8%
 Fire 6.1 64-bit 4CPU3287+18−1848.5%+8.358.4%940
96.0%
 Fire 5 64-bit 4CPU3265+18−1846.9%+17.962.5%867
72.6%
 Fire 7.1 64-bit3258+10−1053.7%−26.259.9%2885
100.0%
 Fire 6.1 64-bit3204+12−1253.0%−18.655.5%2104
73.0%
 Fire 4 64-bit 4CPU3198+13−1346.5%+22.159.7%1885
99.0%
 Fire 5 64-bit3175+13−1351.3%−6.158.2%1874
98.5%
 Fire 3.0 64-bit 4CPU3150+17−1749.5%+2.858.2%948
65.4%
 Fire 4 64-bit3146+10−1152.7%−17.557.0%2807
100.0%
 Fire 3.0 64-bit3080+14−1450.1%−2.057.2%1483
 

Results matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321          
2Fire 6.1 64-bit 4CPU3287          
3Fire 5 64-bit 4CPU3265          
4Fire 7.1 64-bit3258    20.5 − 19.5
+4−3=33
−48
     
5Fire 6.1 64-bit3204   19.5 − 20.5
+3−4=33
+48
      
6Fire 4 64-bit 4CPU3198          
7Fire 5 64-bit3175          
8Fire 3.0 64-bit 4CPU3150          
9Fire 4 64-bit3146          
10Fire 3.0 64-bit3080          
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 99.8100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU32870.2 96.099.6100.0100.0100.0100.0100.0100.0
3Fire 5 64-bit 4CPU32650.04.0 72.6100.0100.0100.0100.0100.0100.0
4Fire 7.1 64-bit32580.00.427.4 100.0100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32040.00.00.00.0 73.099.9100.0100.0100.0
6Fire 4 64-bit 4CPU31980.00.00.00.027.0 99.0100.0100.0100.0
7Fire 5 64-bit31750.00.00.00.00.11.0 98.5100.0100.0
8Fire 3.0 64-bit 4CPU31500.00.00.00.00.00.01.5 65.4100.0
9Fire 4 64-bit31460.00.00.00.00.00.00.034.6 100.0
10Fire 3.0 64-bit30800.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 101244780172160961249292
2Fire 6.1 64-bit 4CPU32871012 850186244355881928484
3Fire 5 64-bit 4CPU3265447850 072649020000
4Fire 7.1 64-bit3258801860 216809190532360
5Fire 6.1 64-bit3204172244722168 020940859440
6Fire 4 64-bit 4CPU319816035564900 082600
7Fire 5 64-bit31759688091920940 02034620
8Fire 3.0 64-bit 4CPU3150124192200008260 00
9Fire 4 64-bit314692840532859020340 1542
10Fire 3.0 64-bit308092840360440062001542 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 45.820.91.95.15.13.15.62.33.3
2Fire 6.1 64-bit 4CPU328745.8 47.04.98.012.63.110.22.23.5
3Fire 5 64-bit 4CPU326520.947.0 0.02.423.60.011.00.00.0
4Fire 7.1 64-bit32581.94.90.0 43.50.019.30.09.38.2
5Fire 6.1 64-bit32045.18.02.443.5 0.052.60.017.512.3
6Fire 4 64-bit 4CPU31985.112.623.60.00.0 0.029.20.00.0
7Fire 5 64-bit31753.13.10.019.352.60.0 0.043.518.5
8Fire 3.0 64-bit 4CPU31505.610.211.00.00.029.20.0 0.00.0
9Fire 4 64-bit31462.32.20.09.317.50.043.50.0 35.9
10Fire 3.0 64-bit30803.33.50.08.212.30.018.50.035.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 102 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Stockfish 9 64-bit 4CPU343228%
11/40
27%
13.5/50
        
SugaR XPrO 1.4 64-bit 4CPU341139%
15.5/40
34%
17/50
        
SugaR XPrO 1.2 64-bit 4CPU3399 27%
8.5/32
25%
8/32
       
Houdini 6 64-bit 4CPU339642%
8.5/20
27%
9/33
33%
19/57
       
Komodo 12 64-bit 4CPU339635%
14/40
33%
16.5/50
        
Komodo 11.2 64-bit 4CPU3392 32%
10.5/33
32%
21.5/68
       
Stockfish 8 64-bit 4CPU3378 35%
11/31
28%
10/36
  25%
8.5/34
    
SugaR XPrO 1.4 64-bit3368   30%
18/61
23%
13.5/58
     
Stockfish 9 64-bit3367 39%
15.5/40
 30%
22/74
21%
10/48
     
Komodo 10.1 64-bit 4CPU3362  23%
7/30
  28%
9.5/34
    
Komodo 10.2 64-bit 4CPU3354  50%
2/4
  29%
9.5/33
    
Houdini 6 64-bit3334   37%
27.5/74
24%
15.5/64
     
Komodo 11.3.1 64-bit3324   38%
19.5/52
30%
15.5/52
     
Komodo 11.2 64-bit3321   46%
18.5/40
35%
18/52
 26%
15.5/60
   
Komodo 12 64-bit3316   38%
25/65
29%
15/52
     
Houdini 6 Tactical 64-bit3314   35%
14/40
27%
13.5/50
     
SugaR XPrO 1.2 64-bit3314    29%
16.5/56
 24%
14/58
   
MateFinder 9 64-bit3313   36%
14.5/40
27%
8/30
     
Komodo 10.4 64-bit3306      32%
24/76
 29%
15/52
 
Houdini 5.01 64-bit3301    38%
19.5/52
 22%
18/80
   
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Stockfish 8 64-bit3301    28%
15.5/56
 32%
34/105
 28%
14.5/52
 
Komodo 10.2 64-bit3291      31%
19.5/62
 28%
14.5/52
 
Komodo 8 64-bit 4CPU3285     30%
10.5/35
 34%
17/50
  
Deep Shredder 13 64-bit 4CPU328061%
34/56
47%
15/32
45%
17/38
  50%
1/2
    
Fizbo 2 64-bit 4CPU327855%
25.5/46
50%
16/32
        
Komodo 10.3 64-bit3270      41%
21.5/52
 33%
17/52
 
Stockfish 5 64-bit 4CPU3269     39%
13.5/35
 26%
20/77
  
Komodo 10 64-bit3266   56%
4.5/8
    29%
15.5/54
 
Fizbo 1.9 64-bit 4CPU3255 59%
19.5/33
44%
14/32
       
Houdini 4 64-bit 4CPU324265%
13/20
    45%
33.5/75
 29%
10/34
  
Andscacs 0.93 64-bit 4CPU323964%
25.5/40
55%
17.5/32
        
Houdini 4 Tactical 64-bit 4CPU3231     50%
2/4
 37%
12.5/34
  
Booot 6.2 64-bit 4CPU321869%
27.5/40
62%
20/32
59%
19/32
       
Andscacs 0.88 64-bit 4CPU3210  62%
2.5/4
  100%
1/1
    
Komodo 8 64-bit3204      50%
2/4
 36%
17/47
29%
11.5/40
Shredder 13 64-bit3202   63%
35.5/56
56%
35/62
 48%
40.5/84
 32%
16.5/52
 
Fizbo 2 64-bit3198   62%
45/73
54%
37.5/70
     
Stockfish 5 64-bit3194        36%
16/44
30%
28/92
Chiron 4 64-bit 4CPU319268%
28/41
62%
20/32
66%
21/32
       
Fritz 16 64-bit 4CPU319270%
28/40
66%
33/50
        
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Gull 3 64-bit 4CPU318068%
27/40
62%
20/32
60%
21.5/36
  52%
28/54
 42%
12.5/30
  
Fizbo 1.8 64-bit 4CPU3179  88%
3.5/4
  54%
19.5/36
    
NirvanaChess 2.4 64-bit 4CPU317974%
29.5/40
61%
19.5/32
64%
20.5/32
 59%
23.5/40
     
Gull 2.8b 64-bit 4CPU3178     51%
21.5/42
 50%
1/2
  
Fizbo 1.9 64-bit3176    54%
41.5/77
 51%
43.5/86
   
Equinox 3.20 64-bit 4CPU3175 69%
22/32
70%
22.5/32
  55%
39.5/72
 44%
14/32
  
Andscacs 0.93 64-bit3170   67%
28/42
57%
39/68
     
Houdini 4 64-bit3168        47%
31/66
27%
12/44
Booot 6.1 64-bit 4CPU3167  60%
21.5/36
  25%
0.5/2
    
Equinox 3.30 64-bit 4CPU3162 50%
0.5/1
75%
3/4
  55%
23/42
    
Fritz 15 64-bit 4CPU3161  68%
24.5/36
  56%
22.5/40
    
Critter 1.6a 64-bit 4CPU3159 64%
20.5/32
64%
23/36
  61%
54/88
 50%
17/34
  
Hannibal 1.7 64-bit 4CPU3154  68%
24.5/36
  62%
28.5/46
    
NirvanaChess 2.3 64-bit 4CPU3152  62%
2.5/4
  61%
22/36
    
Bouquet 1.8 64-bit 4CPU3149     61%
36.5/60
 49%
16.5/34
  
Booot 6.2 64-bit3144   69%
27.5/40
62%
42/68
 54%
38/71
   
Rybka 4.1 64-bit 4CPU3144     56%
9/16
 39%
12.5/32
  
Andscacs 0.91 64-bit3141    62%
33/53
 62%
39.5/64
   
Protector 1.9.0 64-bit 4CPU3138 100%
1/1
   50%
11.5/23
    
DeepSaros 4.1.6 64-bit 4CPU3128     50%
1/2
 75%
1.5/2
  
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
BlackMamba 2.0 64-bit 4CPU3123     60%
21.5/36
 57%
19.5/34
  
Gull 3 64-bit3120   75%
30/40
58%
30/52
 58%
40.5/70
 53%
51/97
46%
37/80
Roc 0.7 64-bit3116   88%
3.5/4
61%
41.5/68
 58%
38.5/66
   
Fizbo 1.8 64-bit3114      61%
40.5/66
 51%
28.5/56
 
Chiron 4 64-bit3113   74%
29.5/40
62%
32/52
 62%
42/68
   
Houdini 1.5a 64-bit3113   77%
17/22
  50%
2/4
 56%
18/32
45%
4.5/10
Andscacs 0.88 64-bit3112      62%
38.5/62
 62%
32/52
 
Strelka 5.5 64-bit310486%
34.5/40
83%
26.5/32
 78%
31/40
69%
36/52
 61%
34/56
 54%
28/52
41%
21.5/52
Critter 1.6a 64-bit3101   76%
30.5/40
66%
34.5/52
 53%
29.5/56
 55%
38.5/70
44%
29/66
Fritz 16 64-bit3101   70%
31.5/45
67%
40/60
     
NirvanaChess 2.4 64-bit3101   79%
41/52
66%
45/68
 61%
35.5/58
   
Equinox 3.20 64-bit3096    63%
33/52
 60%
31/52
 63%
19/30
46%
15.5/34
Fritz 15 64-bit3095      58%
30/52
 57%
28.5/50
 
Naum 4.6 64-bit 4CPU3095     67%
4/6
 56%
18/32
  
Xiphos 0.3 64-bit3093   88%
3.5/4
  75%
15/20
   
Hannibal 1.7 64-bit3080   75%
3/4
78%
12.5/16
 65%
43.5/67
 60%
24/40
 
Booot 6.1 64-bit3078      55%
6/11
 55%
5.5/10
 
Rybka 4.1 64-bit3078   62%
2.5/4
    59%
23.5/40
53%
24.5/46
Rybka 4 64-bit3077    76%
39.5/52
 72%
37.5/52
 56%
31.5/56
 
Bouquet 1.8 64-bit3075      67%
35/52
 59%
40/68
51%
40/78
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Texel 1.07 64-bit3075   88%
38.5/44
77%
18.5/24
     
NirvanaChess 2.3 64-bit3073      73%
11/15
 54%
19.5/36
 
Laser 1.5 64-bit3072   70%
28/40
75%
21/28
     
Sting SF 4.7 64-bit3065        62%
21/34
53%
18/34
Protector 1.9.0 64-bit3059    50%
2/4
 60%
9/15
 64%
36/56
 
BlackMamba 2.0 64-bit3056        66%
46.5/70
52%
33.5/64
Texel 1.06 64-bit3043      77%
11.5/15
 75%
13.5/18
 
iCE 3.0 64-bit3042    88%
3.5/4
 78%
12.5/16
 58%
15/26
 
Sting SF 8.5 64-bit3040    75%
3/4
 50%
0.5/1
   
Deep Fritz 14 64-bit 1CPU3018        66%
21/32
65%
19.5/30
Chiron 2 64-bit3014        67%
20/30
58%
21/36
Naum 4.6 64-bit3012        76%
38/50
60%
20.5/34
Protector 1.7.0 64-bit3010        75%
3/4
74%
25/34
SmarThink 1.96 64-bit3007      75%
1.5/2
 75%
3/4
 
Sting SF 7.3 64-bit3006      94%
7.5/8
 75%
3/4
 
Hannibal 1.4b 64-bit3002        88%
3.5/4
57%
32/56
SmarThink 1.97 64-bit2995    75%
3/4
 80%
4/5
   
Andscacs 0.80 64-bit2961        88%
3.5/4
60%
6/10
Senpai 1.0 64-bit2961        88%
3.5/4
71%
32.5/46
Hakkapeliitta 3.0 64-bit2954      75%
3/4
 69%
5.5/8
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Deep Sjeng c't 20102941   100%
2/2
75%
1.5/2
     
SmarThink 1.70 64-bit2918        100%
4/4
75%
3/4
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on May 25, 2019