CCRL 40/4
Downloads and Statistics
June 22, 2019
Testing summary:
Total: 2'052'494 games
played by 2'371 programs
27529 CPU days (X2 4600+)

White wins: 797'533 (38.9%)
Black wins: 645'585 (31.5%)
Draws: 609'376 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on June 22, 2019 with Bayeselo based on 2'052'494 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3423+14−1351.2%−10.855.2%1673 
100.0%
 Fire 6.1 64-bit 4CPU3349+14−1544.9%+33.344.1%1568
90.2%
 Fire 7.1 64-bit3336+10−1052.2%−16.852.5%3395
55.0%
 Fire 5 64-bit 4CPU3335+15−1553.3%−18.151.4%1390
100.0%
 Fire 6.1 64-bit3288+11−1150.0%−13.444.8%2726
100.0%
 Fire 4 64-bit 4CPU3256+10−1046.1%+24.249.7%3212
66.3%
 Fire 5 64-bit3252+16−1549.9%+0.137.1%1465
99.9%
 Fire 3.0 64-bit 4CPU3215+17−1743.7%+38.447.5%1126
99.1%
 Fire 4 64-bit3191+10−1053.3%−25.341.0%3415
 

Results matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3423         
2Fire 6.1 64-bit 4CPU3349         
3Fire 7.1 64-bit3336    25.5 − 14.5
+12−1=27
+28
    
4Fire 5 64-bit 4CPU3335         
5Fire 6.1 64-bit3288  14.5 − 25.5
+1−12=27
−28
      
6Fire 4 64-bit 4CPU3256         
7Fire 5 64-bit3252         
8Fire 3.0 64-bit 4CPU3215         
9Fire 4 64-bit3191         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3423 100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU33490.0 90.289.9100.0100.0100.0100.0100.0
3Fire 7.1 64-bit33360.09.8 55.0100.0100.0100.0100.0100.0
4Fire 5 64-bit 4CPU33350.010.145.0 100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32880.00.00.00.0 100.0100.0100.0100.0
6Fire 4 64-bit 4CPU32560.00.00.00.00.0 66.3100.0100.0
7Fire 5 64-bit32520.00.00.00.00.033.7 99.9100.0
8Fire 3.0 64-bit 4CPU32150.00.00.00.00.00.00.1 99.1
9Fire 4 64-bit31910.00.00.00.00.00.00.00.9 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3423 573600376034201260
2Fire 6.1 64-bit 4CPU3349573 09320257000
3Fire 7.1 64-bit33366000 102240811910590700
4Fire 5 64-bit 4CPU3335376932102 013290143113
5Fire 6.1 64-bit32880024080 0191801384
6Fire 4 64-bit 4CPU325634225711913290 0957308
7Fire 5 64-bit3252001059019180 01265
8Fire 3.0 64-bit 4CPU32151260014309570 0
9Fire 4 64-bit319100700113138430812650 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3423 17.711.812.30.07.00.04.50.0
2Fire 6.1 64-bit 4CPU334917.7 0.031.50.05.40.00.00.0
3Fire 7.1 64-bit333611.80.0 2.139.31.821.80.010.3
4Fire 5 64-bit 4CPU333512.331.52.1 0.028.90.05.72.4
5Fire 6.1 64-bit32880.00.039.30.0 0.045.80.022.5
6Fire 4 64-bit 4CPU32567.05.41.828.90.0 0.022.14.6
7Fire 5 64-bit32520.00.021.80.045.80.0 0.025.9
8Fire 3.0 64-bit 4CPU32154.50.00.05.70.022.10.0 0.0
9Fire 4 64-bit31910.00.010.32.422.54.625.90.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 63 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Stockfish 9 64-bit 4CPU354640%
16/40
21%
17.5/82
       
Houdini 6 64-bit 4CPU3520 15%
27/178
 23%
24/104
     
Stockfish 8 64-bit 4CPU3494 23%
20.5/89
 25%
13/52
 21%
16/76
   
Komodo 12 64-bit 4CPU348841%
17/41
28%
26.5/96
       
Lc0 0.21.1 JH.T6.532 GPU348642%
42/100
 27%
27/100
      
Stockfish 9 64-bit3482  30%
28/94
 20%
39.5/200
    
Lc0 0.21.1 w41800 GPU347436%
36.5/100
 32%
31.5/100
      
SugaR XPrO 1.4 64-bit3472  28%
11/40
 21%
10.5/50
    
Lc0 0.20.2 w32930 GPU345246%
45.5/100
 38%
38/100
      
Houdini 6 64-bit3446  31%
30/96
 22%
42/191
 22%
21.5/100
  
Houdini 5.01 64-bit3421      17%
8.5/50
 17%
11/64
Komodo 11.2 64-bit3421  37%
34/93
 31%
59.5/190
 20%
30.5/150
  
Stockfish 8 64-bit3421    29%
54/189
 20%
10/50
 16%
13.5/85
Komodo 12 64-bit3411  38%
136.5/357
 0%
0/1
    
Komodo 10.3 64-bit3386      24%
12/50
 22%
14/64
Stockfish 5 64-bit 4CPU3366     22%
4/18
 27%
35/129
 
Komodo 8 64-bit 4CPU3352     30%
29.5/98
 26%
25.5/100
 
Fizbo 2 64-bit 4CPU334359%
24/41
60%
59.5/99
       
Houdini 4 64-bit 4CPU3331     32%
31.5/98
 19%
12.5/66
 
Deep Shredder 13 64-bit 4CPU3323 45%
18/40
 54%
28/52
 43%
22.5/52
   
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fizbo 1.9 64-bit 4CPU3320 60%
52.5/88
 47%
24.5/52
     
Stockfish 6 64-bit3317     38%
12/32
  19%
17.5/92
Andscacs 0.91 64-bit 4CPU3275 66%
51.5/78
 59%
35.5/60
     
Shredder 13 64-bit3270  60%
55.5/93
 55%
50/91
   41%
26/64
Gull 3 64-bit 4CPU3260   66%
34.5/52
 43%
41.5/96
   
Equinox 3.30 64-bit 4CPU325280%
33.5/42
  58%
30/52
 50%
50/100
   
Fizbo 1.8 64-bit 4CPU3247   67%
35/52
 61%
31.5/52
   
Fizbo 2 64-bit3247  63%
26/41
 56%
28.5/51
    
Chiron 4 64-bit 4CPU324171%
30/42
72%
62.5/87
 69%
36/52
     
Fizbo 1.9 64-bit3236    59%
119/201
 64%
48/75
 50%
49.5/99
Komodo 8 64-bit3235     41%
13/32
  48%
24/50
Critter 1.6a 64-bit 4CPU323287%
36.5/42
  67%
35/52
 47%
37.5/80
 43%
39.5/91
 
Hannibal 1.7 64-bit 4CPU322983%
35/42
  67%
35/52
 52%
27/52
   
NirvanaChess 2.4 64-bit 4CPU322489%
36.5/41
66%
26.5/40
       
Fritz 15 64-bit 4CPU3223   70%
36.5/52
 48%
33.5/70
   
NirvanaChess 2.3 64-bit 4CPU3211   72%
37.5/52
 62%
31/50
   
Rybka 4.1 64-bit 4CPU3205     56%
45/80
 61%
48.5/80
 
Andscacs 0.93 64-bit3203  69%
27.5/40
 67%
64/95
    
Andscacs 0.92 64-bit3201    63%
76/120
 64%
38.5/60
  
Andscacs 0.921 64-bit3201  64%
34.5/54
 68%
67.5/100
    
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Gull 3 64-bit3191  78%
31/40
 58%
18.5/32
 56%
28/50
 50%
24/48
Booot 6.1 64-bit 4CPU3187   74%
38.5/52
 60%
24/40
   
Booot 6.2 64-bit3168  79%
31.5/40
 67%
147/218
 57%
28.5/50
  
Chiron 4 64-bit3165  75%
30/40
 71%
44/62
 73%
36/49
 58%
37/64
Equinox 3.30 64-bit3161    66%
19/29
   36%
37.5/104
Critter 1.6a 64-bit3157  76%
30.5/40
 69%
22/32
   52%
26/50
Fritz 15 64-bit3144    83%
26.5/32
   63%
40.5/64
Fritz 16 64-bit3141  81%
32.5/40
 72%
43.5/60
    
Strelka 5.5 64-bit3140  80%
32/40
87%
54/62
 65%
51.5/79
  48%
24.5/51
NirvanaChess 2.4 64-bit3130  83%
34/41
 79%
22/28
 71%
35/49
  
Hannibal 1.4b 64-bit 4CPU3117     70%
70.5/100
 69%
67.5/98
 
Texel 1.07 64-bit3114  86%
34.5/40
 76%
25/33
 73%
23.5/32
  
Hannibal 1.7 64-bit3110  87%
35.5/41
 71%
23.5/33
 79%
39.5/50
 70%
22.5/32
Rybka 4.1 64-bit3108  50%
1/2
   67%
33.5/50
 63%
31.5/50
NirvanaChess 2.3 64-bit3097      76%
35.5/47
 62%
12.5/20
Laser 1.5 64-bit3095  80%
32/40
 79%
27/34
    
Texel 1.06 64-bit3095      66%
33/50
 61%
30.5/50
Protector 1.9.0 64-bit3084  86%
34.5/40
 83%
27.5/33
 83%
40.5/49
 64%
29/45
iCE 3.0 64-bit3081  50%
0.5/1
 86%
27.5/32
 74%
37/50
 68%
21/31
Bouquet 1.8 64-bit 4CPU3072     78%
39/50
 62%
2.5/4
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Defenchess (SCTR) 1.1f 64-bit3047  50%
0.5/1
 83%
5/6
    
Bobcat 8.0 64-bit2960  50%
0.5/1
 100%
1/1
    
Spark 1.0 64-bit2927  100%
1/1
     83%
26.5/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on June 22, 2019