CCRL 40/4
Downloads and Statistics
November 16, 2019
Testing summary:
Total: 2'132'153 games
played by 2'491 programs
28840 CPU days (X2 4600+)

White wins: 826'813 (38.8%)
Black wins: 668'076 (31.3%)
Draws: 637'264 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 16, 2019 with Bayeselo based on 2'132'153 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3425+11−1146.6%+19.352.7%2660 
100.0%
 Fire 6.1 64-bit 4CPU3349+14−1544.9%+33.444.1%1568
86.6%
 Fire 7.1 64-bit3339+9−951.6%−12.351.9%4291
63.3%
 Fire 5 64-bit 4CPU3335+15−1553.3%−17.751.4%1390
100.0%
 Fire 6.1 64-bit3288+11−1150.0%−13.544.8%2726
100.0%
 Fire 4 64-bit 4CPU3256+10−1046.1%+24.649.7%3212
68.4%
 Fire 5 64-bit3252+15−1549.9%+0.037.1%1465
99.9%
 Fire 3.0 64-bit 4CPU3216+17−1743.7%+38.247.5%1126
99.1%
 Fire 4 64-bit3191+10−1053.3%−25.041.0%3415
 

Results matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425         
2Fire 6.1 64-bit 4CPU3349         
3Fire 7.1 64-bit3339    25.5 − 14.5
+12−1=27
+25
    
4Fire 5 64-bit 4CPU3335         
5Fire 6.1 64-bit3288  14.5 − 25.5
+1−12=27
−25
      
6Fire 4 64-bit 4CPU3256         
7Fire 5 64-bit3252         
8Fire 3.0 64-bit 4CPU3216         
9Fire 4 64-bit3191         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU33490.0 86.689.6100.0100.0100.0100.0100.0
3Fire 7.1 64-bit33390.013.4 63.3100.0100.0100.0100.0100.0
4Fire 5 64-bit 4CPU33350.010.436.7 100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32880.00.00.00.0 100.0100.0100.0100.0
6Fire 4 64-bit 4CPU32560.00.00.00.00.0 68.4100.0100.0
7Fire 5 64-bit32520.00.00.00.00.031.6 99.9100.0
8Fire 3.0 64-bit 4CPU32160.00.00.00.00.00.00.1 99.1
9Fire 4 64-bit31910.00.00.00.00.00.00.00.9 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 573817376034201260
2Fire 6.1 64-bit 4CPU3349573 09320257000
3Fire 7.1 64-bit33398170 102241011910610700
4Fire 5 64-bit 4CPU3335376932102 013290143113
5Fire 6.1 64-bit32880024100 0191801384
6Fire 4 64-bit 4CPU325634225711913290 0957308
7Fire 5 64-bit3252001061019180 01265
8Fire 3.0 64-bit 4CPU32161260014309570 0
9Fire 4 64-bit319100700113138430812650 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Fire 7.1 64-bit 4CPU3425 13.611.89.30.05.80.03.30.0
2Fire 6.1 64-bit 4CPU334913.6 0.031.50.05.40.00.00.0
3Fire 7.1 64-bit333911.80.0 1.834.31.618.40.09.1
4Fire 5 64-bit 4CPU33359.331.51.8 0.028.90.05.72.4
5Fire 6.1 64-bit32880.00.034.30.0 0.045.80.022.5
6Fire 4 64-bit 4CPU32565.85.41.628.90.0 0.022.14.6
7Fire 5 64-bit32520.00.018.40.045.80.0 0.025.9
8Fire 3.0 64-bit 4CPU32163.30.00.05.70.022.10.0 0.0
9Fire 4 64-bit31910.00.09.12.422.54.625.90.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 65 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Stockfish 9 64-bit 4CPU354640%
16/40
21%
17.5/82
       
Houdini 6 64-bit 4CPU3519 15%
27/178
 23%
24/104
     
Stockfish 8 64-bit 4CPU3494 23%
20.5/89
 25%
13/52
 21%
16/76
   
Lc0 0.21.1 JH.T6.532 GTX1050349242%
42/100
 27%
27/100
      
Komodo 12 64-bit 4CPU348841%
17/41
28%
26.5/96
       
Stockfish 9 64-bit3482  30%
28/94
 20%
39.5/200
    
Lc0 0.21.1 w41800 GTX1050347536%
36.5/100
 32%
31.5/100
      
SugaR XPrO 1.4 64-bit3472  28%
11/40
 21%
10.5/50
    
Lc0 0.20.2 w32930 GTX1050345246%
45.5/100
 38%
38/100
      
Allie 0.5 nn42482 GTX1050345047%
26.5/56
 40%
28/70
      
Houdini 6 64-bit3445  31%
30.5/97
 22%
42/191
 22%
21.5/100
  
Houdini 5.01 64-bit3421      17%
8.5/50
 17%
11/64
Komodo 11.2 64-bit3421  37%
34/93
 31%
59.5/190
 20%
30.5/150
  
Stockfish 8 64-bit3421    29%
54/189
 20%
10/50
 16%
13.5/85
Komodo 12 64-bit3412  38%
136.5/357
 0%
0/1
    
Komodo 10.3 64-bit3386      24%
12/50
 22%
14/64
Stockfish 5 64-bit 4CPU3366     22%
4/18
 27%
35/129
 
Komodo 8 64-bit 4CPU3353     30%
29.5/98
 26%
25.5/100
 
Fizbo 2 64-bit 4CPU334559%
24/41
60%
59.5/99
       
Houdini 4 64-bit 4CPU3332     32%
31.5/98
 19%
12.5/66
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Deep Shredder 13 64-bit 4CPU3323 45%
18/40
 54%
28/52
 43%
22.5/52
   
Fizbo 1.9 64-bit 4CPU3320 60%
52.5/88
 47%
24.5/52
     
Stockfish 6 64-bit3317     38%
12/32
  19%
17.5/92
Stoofvlees II a10 GTX980Ti331772%
36/50
 45%
18.5/41
      
Andscacs 0.91 64-bit 4CPU3275 66%
51.5/78
 59%
35.5/60
     
Shredder 13 64-bit3270  60%
55.5/93
 55%
50/91
   41%
26/64
Gull 3 64-bit 4CPU3260   66%
34.5/52
 43%
41.5/96
   
Equinox 3.30 64-bit 4CPU325380%
33.5/42
  58%
30/52
 50%
50/100
   
Fizbo 1.8 64-bit 4CPU3248   67%
35/52
 61%
31.5/52
   
Fizbo 2 64-bit3247  63%
26/41
 56%
28.5/51
    
Chiron 4 64-bit 4CPU324171%
30/42
72%
62.5/87
 69%
36/52
     
Fizbo 1.9 64-bit3236    59%
119/201
 64%
48/75
 50%
49.5/99
Komodo 8 64-bit3235     41%
13/32
  48%
24/50
Critter 1.6a 64-bit 4CPU323387%
36.5/42
  67%
35/52
 47%
37.5/80
 43%
39.5/91
 
Hannibal 1.7 64-bit 4CPU322883%
35/42
  67%
35/52
 52%
27/52
   
NirvanaChess 2.4 64-bit 4CPU322589%
36.5/41
66%
26.5/40
       
Fritz 15 64-bit 4CPU3224   70%
36.5/52
 48%
33.5/70
   
NirvanaChess 2.3 64-bit 4CPU3211   72%
37.5/52
 62%
31/50
   
Rybka 4.1 64-bit 4CPU3206     56%
45/80
 61%
48.5/80
 
Andscacs 0.93 64-bit3203  69%
27.5/40
 67%
64/95
    
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Andscacs 0.92 64-bit3201    63%
76/120
 64%
38.5/60
  
Andscacs 0.921 64-bit3201  64%
34.5/54
 68%
67.5/100
    
Gull 3 64-bit3192  78%
31/40
 58%
18.5/32
 56%
28/50
 50%
24/48
Booot 6.1 64-bit 4CPU3188   74%
38.5/52
 60%
24/40
   
Booot 6.2 64-bit3168  79%
31.5/40
 67%
147/218
 57%
28.5/50
  
Chiron 4 64-bit3164  75%
30/40
 71%
44/62
 73%
36/49
 58%
37/64
Equinox 3.30 64-bit3161    66%
19/29
   36%
37.5/104
Critter 1.6a 64-bit3158  76%
30.5/40
 69%
22/32
   52%
26/50
Fritz 15 64-bit3146    83%
26.5/32
   63%
40.5/64
Fritz 16 64-bit3141  81%
32.5/40
 72%
43.5/60
    
Strelka 5.5 64-bit3140  80%
32/40
87%
54/62
 65%
51.5/79
  48%
24.5/51
NirvanaChess 2.4 64-bit3130  83%
35/42
 79%
22/28
 71%
35/49
  
Hannibal 1.4b 64-bit 4CPU3118     70%
70.5/100
 69%
67.5/98
 
Texel 1.07 64-bit3112  86%
34.5/40
 76%
25/33
 73%
23.5/32
  
Hannibal 1.7 64-bit3110  87%
35.5/41
 71%
23.5/33
 79%
39.5/50
 70%
22.5/32
Rybka 4.1 64-bit3108  50%
1/2
   67%
33.5/50
 63%
31.5/50
NirvanaChess 2.3 64-bit3097      76%
35.5/47
 62%
12.5/20
Laser 1.5 64-bit3095  80%
32/40
 79%
27/34
    
Texel 1.06 64-bit3095      66%
33/50
 61%
30.5/50
Protector 1.9.0 64-bit3085  86%
34.5/40
 83%
27.5/33
 83%
40.5/49
 64%
29/45
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
7.1
64-bit
Fire
5
64-bit
4CPU
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
iCE 3.0 64-bit3081  50%
0.5/1
 86%
27.5/32
 74%
37/50
 68%
21/31
Bouquet 1.8 64-bit 4CPU3072     78%
39/50
 62%
2.5/4
 
Defenchess 1.1f 64-bit3047  50%
0.5/1
 83%
5/6
    
Bobcat 8.0 64-bit2957  50%
0.5/1
 100%
1/1
    
Spark 1.0 64-bit2927  100%
1/1
     83%
26.5/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 16, 2019