CCRL 40/4
Downloads and Statistics
August 20, 2019
Testing summary:
Total: 2'086'404 games
played by 2'425 programs
28073 CPU days (X2 4600+)

White wins: 810'229 (38.8%)
Black wins: 655'304 (31.4%)
Draws: 620'871 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on August 20, 2019 with Bayeselo based on 2'086'404 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3403+16−1652.2%−15.952.5%1145 
100.0%
 Xiphos 0.4 64-bit 4CPU3324+18−1847.2%+17.346.1%1038
94.7%
 Xiphos 0.5 64-bit3305+14−1444.8%+35.748.3%1745
100.0%
 Xiphos 0.4.18 64-bit3243+18−1846.7%+24.944.5%959
92.0%
 Xiphos 0.4 64-bit3227+14−1549.4%+7.847.1%1555
100.0%
 Xiphos 0.3 64-bit3136+14−1453.4%−29.441.5%1658
100.0%
 Xiphos 0.1 64-bit 4CPU3077+20−2043.5%+40.541.4%804
89.4%
 Xiphos 0.2 64-bit3061+13−1353.4%−30.242.8%1967
99.5%
 Xiphos 0.1 64-bit3032+19−1950.7%−9.639.8%908
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403         
2Xiphos 0.4 64-bit 4CPU3324         
3Xiphos 0.5 64-bit3305         
4Xiphos 0.4.18 64-bit3243         
5Xiphos 0.4 64-bit3227         
6Xiphos 0.3 64-bit3136         
7Xiphos 0.1 64-bit 4CPU3077         
8Xiphos 0.2 64-bit3061        22.5 − 17.5
+11−6=23
+6
9Xiphos 0.1 64-bit3032       17.5 − 22.5
+6−11=23
−6
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU33240.0 94.7100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit33050.05.3 100.0100.0100.0100.0100.0100.0
4Xiphos 0.4.18 64-bit32430.00.00.0 92.0100.0100.0100.0100.0
5Xiphos 0.4 64-bit32270.00.00.08.0 100.0100.0100.0100.0
6Xiphos 0.3 64-bit31360.00.00.00.00.0 100.0100.0100.0
7Xiphos 0.1 64-bit 4CPU30770.00.00.00.00.00.0 89.499.9
8Xiphos 0.2 64-bit30610.00.00.00.00.00.010.6 99.5
9Xiphos 0.1 64-bit30320.00.00.00.00.00.00.10.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 6289100011200
2Xiphos 0.4 64-bit 4CPU3324628 00013224712684
3Xiphos 0.5 64-bit3305910 13871292213066
4Xiphos 0.4.18 64-bit3243001387 1755724000
5Xiphos 0.4 64-bit32270012921755 13700379290
6Xiphos 0.3 64-bit313601322137241370 019981286
7Xiphos 0.1 64-bit 4CPU30771122470000 03
8Xiphos 0.2 64-bit306101266037919980 1927
9Xiphos 0.1 64-bit303208460290128631927 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 28.83.10.00.00.05.70.00.0
2Xiphos 0.4 64-bit 4CPU332428.8 0.00.00.04.913.44.24.3
3Xiphos 0.5 64-bit33053.10.0 51.339.26.30.00.20.2
4Xiphos 0.4.18 64-bit32430.00.051.3 69.827.70.00.00.0
5Xiphos 0.4 64-bit32270.00.039.269.8 42.60.010.811.8
6Xiphos 0.3 64-bit31360.04.96.327.742.6 0.055.150.1
7Xiphos 0.1 64-bit 4CPU30775.713.40.00.00.00.0 0.00.2
8Xiphos 0.2 64-bit30610.04.20.20.010.855.10.0 67.0
9Xiphos 0.1 64-bit30320.04.30.20.011.850.10.267.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 63 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU354726%
19/72
16%
17/108
       
Stockfish 10 64-bit3490  20%
18/91
10%
6.5/64
9%
6/64
    
Stockfish 9 64-bit3481    16%
9.5/60
  0%
0/1
 
Houdini 6 64-bit3444  24%
21.5/91
24%
15.5/64
22%
13.5/61
    
Komodo 12 64-bit3411    22%
13.5/60
0%
0/1
   
Komodo 12.3 MCTS 64-bit 4CPU341150%
36.5/73
30%
29.5/98
       
Ethereal 11.25 64-bit 4CPU339252%
13/25
43%
35/82
       
Andscacs 0.95 64-bit 4CPU333654%
13.5/25
38%
12.5/33
       
Fire 7.1 64-bit3336  51%
45.5/90
37%
23.5/64
35%
21/60
    
Booot 6.3.1 64-bit 4CPU332654%
13.5/25
56%
28/50
       
Komodo 12.3 MCTS 64-bit3324  47%
23.5/50
34%
22/64
36%
36.5/100
    
Stoofvlees II a10 GTX980Ti331769%
34/49
 43%
18/42
      
Ethereal 11.25 64-bit3304  52%
46.5/90
 50%
0.5/1
    
Ethereal 11.00 64-bit3301   41%
26.5/64
40%
24/60
31%
18.5/60
   
Schooner 2.0.34 64-bit 4CPU327670%
17.5/25
60%
26.5/44
       
Laser 1.7 64-bit3271  53%
48/90
48%
30.5/64
     
Shredder 13 64-bit3270  58%
29/50
41%
26/64
45%
27/60
    
Booot 6.3.1 64-bit3254  63%
31.5/50
55%
35.5/64
46%
27.5/60
34%
21.5/64
   
Fizbo 2 64-bit3247  59%
30/51
41%
26/64
47%
28/60
0%
0/1
   
Chiron 4 64-bit 4CPU324278%
56.5/72
     22%
9/40
  
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Andscacs 0.95 64-bit3237  65%
26/40
48%
30.5/64
54%
33.5/62
    
Andscacs 0.94 64-bit3229    48%
28.5/60
37%
23.5/64
   
Texel 1.07 64-bit 4CPU3207 67%
30/45
    26%
10.5/40
  
Schooner 2.0.34 64-bit3191  62%
25/40
63%
40.5/64
59%
19.5/33
    
Laser 1.6 64-bit3187   66%
41.5/63
48%
29/60
41%
26/64
   
Senpai 2.0 64-bit 4CPU3177 83%
38/46
    34%
13.5/40
  
Chiron 4 64-bit3164  65%
26/40
59%
38/64
62%
37.5/60
51%
25.5/50
   
Critter 1.6a 64-bit3157   65%
41.5/64
61%
36.5/60
42%
21/50
   
Fritz 15 64-bit3144   68%
43.5/64
61%
36.5/60
47%
23.5/50
   
Ethereal 10.00 64-bit3143     44%
22/50
 39%
19.5/50
 
Strelka 5.5 64-bit3140 86%
31/36
    39%
15.5/40
  
NirvanaChess 2.4 64-bit3129    71%
42.5/60
44%
22.5/51
 40%
16/40
32%
9.5/30
RofChade 2.0 64-bit3129  70%
28/40
 56%
18/32
    
Nemorino 5.00 64-bit3117    63%
38/60
53%
26/49
   
Texel 1.07 64-bit3112    70%
42/60
50%
25/50
 40%
28.5/72
46%
18.5/40
Hannibal 1.7 64-bit3110    75%
45/60
59%
30/51
 38%
27/72
40%
12.5/31
Rybka 4.1 64-bit3108     53%
27.5/52
 45%
37/83
28%
9/32
Pedone 1.8 64-bit3106    62%
38/61
52%
16.5/32
   
Laser 1.5 64-bit3094     58%
71/122
 42%
34.5/82
54%
21/39
Protector 1.9.0 64-bit3084  100%
1/1
 50%
0.5/1
64%
32/50
 47%
38/81
35%
11/31
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Senpai 2.0 64-bit3083     62%
31.5/51
 48%
39.5/82
42%
17/40
Vajolet2 2.6 64-bit3083    50%
0.5/1
  51%
25.5/50
 
iCE 3.0 64-bit3080 78%
34.5/44
   61%
75/123
 45%
37/82
45%
18/40
Nemorino 4.00 64-bit3066     61%
30.5/50
 49%
35/72
35%
11/31
Arasan 20.5 64-bit3059     61%
30.5/50
 50%
16/32
41%
16.5/40
Pedone 1.7 64-bit3052       45%
37/82
45%
14.5/32
ChessBrainVB 3.723047  100%
1/1
 50%
0.5/1
    
Defenchess 1.1f 64-bit3046  100%
1/1
  66%
49/74
 53%
38.5/72
48%
15.5/32
Arasan 20.4.1 64-bit3043       56%
22.5/40
52%
16.5/32
Vajolet2 2.5 64-bit3039       57%
47/82
50%
16/32
SmarThink 1.98 64-bit3036    50%
0.5/1
67%
33.5/50
 58%
42/72
42%
13/31
Naum 4.6 64-bit3032     59%
42.5/72
 59%
48.5/82
52%
16.5/32
Hakkapeliitta TCEC v2 64-bit3022      75%
30/40
 100%
1/1
Hakkapeliitta 3.0 64-bit2984       65%
47/72
47%
15/32
Wasp 2.6 64-bit2977       65%
26/40
58%
18.5/32
Bobcat 8.0 64-bit2958    50%
0.5/1
  71%
28.5/40
73%
23.5/32
Cheng 4.39 64-bit2943     75%
56/75
 70%
28/40
66%
21/32
DiscoCheck 5.2.1 64-bit2913    100%
1/1
100%
1/1
   
Rodent III 0.232 64-bit2913     50%
0.5/1
 69%
27.5/40
 
Delocto 0.6 64-bit2610     100%
1/1
 100%
2/2
 
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Brutus 8.05 64-bit2556     100%
1/1
 100%
1/1
 
Winter 0.1.1 64-bit2480     100%
1/1
 100%
2/2
 
Matacz 1.42445     100%
1/1
 100%
1/1
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 20, 2019