CCRL 40/4
Downloads and Statistics
September 14, 2019
Testing summary:
Total: 2'097'576 games
played by 2'442 programs
28220 CPU days (X2 4600+)

White wins: 814'639 (38.8%)
Black wins: 658'954 (31.4%)
Draws: 623'983 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on September 14, 2019 with Bayeselo based on 2'097'576 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3425+12−1251.4%−12.254.8%2038 
100.0%
 Fire 6.1 64-bit 4CPU3350+15−1544.9%+32.944.1%1568
89.9%
 Fire 5 64-bit 4CPU3336+15−1553.3%−18.351.4%1390
47.1%
 Fire 7.1 64-bit3336+9−951.0%−8.251.4%3918
100.0%
 Fire 6.1 64-bit3288+11−1150.0%−13.644.8%2726
100.0%
 Fire 4 64-bit 4CPU3257+10−1046.1%+24.149.7%3212
70.7%
 Fire 5 64-bit3251+15−1549.9%+0.937.1%1465
99.8%
 Fire 3.0 64-bit 4CPU3216+17−1743.7%+38.447.5%1126
99.2%
 Fire 4 64-bit3191+10−1053.3%−25.041.0%3415
 

Results matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425         
2Fire 6.1 64-bit 4CPU3350         
3Fire 5 64-bit 4CPU3336         
4Fire 7.1 64-bit3336    25.5 − 14.5
+12−1=27
+28
    
5Fire 6.1 64-bit3288   14.5 − 25.5
+1−12=27
−28
     
6Fire 4 64-bit 4CPU3257         
7Fire 5 64-bit3251         
8Fire 3.0 64-bit 4CPU3216         
9Fire 4 64-bit3191         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU33500.0 89.991.6100.0100.0100.0100.0100.0
3Fire 5 64-bit 4CPU33360.010.1 47.1100.0100.0100.0100.0100.0
4Fire 7.1 64-bit33360.08.452.9 100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32880.00.00.00.0 100.0100.0100.0100.0
6Fire 4 64-bit 4CPU32570.00.00.00.00.0 70.7100.0100.0
7Fire 5 64-bit32510.00.00.00.00.029.3 99.8100.0
8Fire 3.0 64-bit 4CPU32160.00.00.00.00.00.00.1 99.2
9Fire 4 64-bit31910.00.00.00.00.00.00.00.8 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 573376817034201260
2Fire 6.1 64-bit 4CPU3350573 93200257000
3Fire 5 64-bit 4CPU3336376932 102013290143113
4Fire 7.1 64-bit33368170102 241011910610700
5Fire 6.1 64-bit32880002410 0191801384
6Fire 4 64-bit 4CPU325734225713291190 0957308
7Fire 5 64-bit3251000106119180 01265
8Fire 3.0 64-bit 4CPU32161260143009570 0
9Fire 4 64-bit319100113700138430812650 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 15.911.013.70.06.50.04.00.0
2Fire 6.1 64-bit 4CPU335015.9 31.50.00.05.40.00.00.0
3Fire 5 64-bit 4CPU333611.031.5 1.90.028.90.05.72.4
4Fire 7.1 64-bit333613.70.01.9 36.31.719.70.09.5
5Fire 6.1 64-bit32880.00.00.036.3 0.045.80.022.5
6Fire 4 64-bit 4CPU32576.55.428.91.70.0 0.022.14.6
7Fire 5 64-bit32510.00.00.019.745.80.0 0.025.9
8Fire 3.0 64-bit 4CPU32164.00.05.70.00.022.10.0 0.0
9Fire 4 64-bit31910.00.02.49.522.54.625.90.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 65 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Stockfish 9 64-bit 4CPU354740%
16/40
21%
17.5/82
       
Houdini 6 64-bit 4CPU3519 15%
27/178
23%
24/104
      
Stockfish 8 64-bit 4CPU3494 23%
20.5/89
25%
13/52
  21%
16/76
   
Komodo 12 64-bit 4CPU348941%
17/41
28%
26.5/96
       
Lc0 0.21.1 JH.T6.532 GTX1050348642%
42/100
  27%
27/100
     
Stockfish 9 64-bit3482   30%
28/94
20%
39.5/200
    
Lc0 0.21.1 w41800 GTX1050347436%
36.5/100
  32%
31.5/100
     
SugaR XPrO 1.4 64-bit3472   28%
11/40
21%
10.5/50
    
Lc0 0.20.2 w32930 GTX1050345246%
45.5/100
  38%
38/100
     
Houdini 6 64-bit3444   31%
30.5/97
22%
42/191
 22%
21.5/100
  
Allie 0.5 nn42482 GTX1050344147%
26.5/56
  40%
28/70
     
Houdini 5.01 64-bit3421      17%
8.5/50
 17%
11/64
Komodo 11.2 64-bit3421   37%
34/93
31%
59.5/190
 20%
30.5/150
  
Stockfish 8 64-bit3421    29%
54/189
 20%
10/50
 16%
13.5/85
Komodo 12 64-bit3411   38%
136.5/357
0%
0/1
    
Komodo 10.3 64-bit3386      24%
12/50
 22%
14/64
Stockfish 5 64-bit 4CPU3367     22%
4/18
 27%
35/129
 
Komodo 8 64-bit 4CPU3353     30%
29.5/98
 26%
25.5/100
 
Fizbo 2 64-bit 4CPU334559%
24/41
60%
59.5/99
       
Houdini 4 64-bit 4CPU3332     32%
31.5/98
 19%
12.5/66
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Deep Shredder 13 64-bit 4CPU3324 45%
18/40
54%
28/52
  43%
22.5/52
   
Fizbo 1.9 64-bit 4CPU3320 60%
52.5/88
47%
24.5/52
      
Stoofvlees II a10 GTX980Ti331872%
36/50
  45%
18.5/41
     
Stockfish 6 64-bit3317     38%
12/32
  19%
17.5/92
Andscacs 0.91 64-bit 4CPU3276 66%
51.5/78
59%
35.5/60
      
Shredder 13 64-bit3271   60%
55.5/93
55%
50/91
   41%
26/64
Gull 3 64-bit 4CPU3261  66%
34.5/52
  43%
41.5/96
   
Equinox 3.30 64-bit 4CPU325580%
33.5/42
 58%
30/52
  50%
50/100
   
Fizbo 1.8 64-bit 4CPU3248  67%
35/52
  61%
31.5/52
   
Fizbo 2 64-bit3247   63%
26/41
56%
28.5/51
    
Chiron 4 64-bit 4CPU324171%
30/42
72%
62.5/87
69%
36/52
      
Fizbo 1.9 64-bit3236    59%
119/201
 64%
48/75
 50%
49.5/99
Komodo 8 64-bit3235     41%
13/32
  48%
24/50
Critter 1.6a 64-bit 4CPU323387%
36.5/42
 67%
35/52
  47%
37.5/80
 43%
39.5/91
 
Hannibal 1.7 64-bit 4CPU323083%
35/42
 67%
35/52
  52%
27/52
   
NirvanaChess 2.4 64-bit 4CPU322589%
36.5/41
66%
26.5/40
       
Fritz 15 64-bit 4CPU3224  70%
36.5/52
  48%
33.5/70
   
NirvanaChess 2.3 64-bit 4CPU3212  72%
37.5/52
  62%
31/50
   
Rybka 4.1 64-bit 4CPU3206     56%
45/80
 61%
48.5/80
 
Andscacs 0.93 64-bit3203   69%
27.5/40
67%
64/95
    
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Andscacs 0.92 64-bit3201    63%
76/120
 64%
38.5/60
  
Andscacs 0.921 64-bit3200   64%
34.5/54
68%
67.5/100
    
Gull 3 64-bit3192   78%
31/40
58%
18.5/32
 56%
28/50
 50%
24/48
Booot 6.1 64-bit 4CPU3188  74%
38.5/52
  60%
24/40
   
Booot 6.2 64-bit3168   79%
31.5/40
67%
147/218
 57%
28.5/50
  
Chiron 4 64-bit3164   75%
30/40
71%
44/62
 73%
36/49
 58%
37/64
Equinox 3.30 64-bit3161    66%
19/29
   36%
37.5/104
Critter 1.6a 64-bit3158   76%
30.5/40
69%
22/32
   52%
26/50
Fritz 15 64-bit3145    83%
26.5/32
   63%
40.5/64
Fritz 16 64-bit3141   81%
32.5/40
72%
43.5/60
    
Strelka 5.5 64-bit3141  87%
54/62
80%
32/40
 65%
51.5/79
  48%
24.5/51
NirvanaChess 2.4 64-bit3129   83%
35/42
79%
22/28
 71%
35/49
  
Hannibal 1.4b 64-bit 4CPU3118     70%
70.5/100
 69%
67.5/98
 
Texel 1.07 64-bit3113   86%
34.5/40
76%
25/33
 73%
23.5/32
  
Hannibal 1.7 64-bit3110   87%
35.5/41
71%
23.5/33
 79%
39.5/50
 70%
22.5/32
Rybka 4.1 64-bit3109   50%
1/2
  67%
33.5/50
 63%
31.5/50
NirvanaChess 2.3 64-bit3097      76%
35.5/47
 62%
12.5/20
Laser 1.5 64-bit3095   80%
32/40
79%
27/34
    
Texel 1.06 64-bit3095      66%
33/50
 61%
30.5/50
Protector 1.9.0 64-bit3084   86%
34.5/40
83%
27.5/33
 83%
40.5/49
 64%
29/45
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
iCE 3.0 64-bit3081   50%
0.5/1
86%
27.5/32
 74%
37/50
 68%
21/31
Bouquet 1.8 64-bit 4CPU3072     78%
39/50
 62%
2.5/4
 
Defenchess 1.1f 64-bit3047   50%
0.5/1
83%
5/6
    
Bobcat 8.0 64-bit2959   50%
0.5/1
100%
1/1
    
Spark 1.0 64-bit2927   100%
1/1
    83%
26.5/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 14, 2019