CCRL 40/40
Downloads and Statistics
October 19, 2019
Testing summary:
Total: 1'092'341 games
played by 2'556 programs
149261 CPU days (X2 4600+)

White wins: 378'952 (34.7%)
Black wins: 281'710 (25.8%)
Draws: 431'679 (39.5%)
White score: 54.5%

Custom engine selection

Comparing 9 engines!
9 selected engines played 30 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on October 19, 2019 with Bayeselo based on 1'092'341 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3314+20−2044.0%+38.864.1%669 
100.0%
 Xiphos 0.4 64-bit 4CPU3252+19−1943.8%+39.261.1%830
95.7%
 Xiphos 0.5 64-bit3231+13−1347.2%+16.362.7%1698
100.0%
 Xiphos 0.3 64-bit 4CPU3180+21−2149.2%+3.154.2%660
98.7%
 Xiphos 0.4 64-bit3151+12−1241.9%+53.850.1%2192
99.9%
 Xiphos 0.2.2 64-bit 4CPU3103+26−2647.3%+14.353.6%414
71.1%
 Xiphos 0.3 64-bit3094+19−1950.6%−3.751.6%801
100.0%
 Xiphos 0.2 64-bit3024+18−1852.8%−14.946.8%999
99.8%
 Xiphos 0.1 64-bit2987+20−2049.1%+5.348.4%787
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3314         
2Xiphos 0.4 64-bit 4CPU3252         
3Xiphos 0.5 64-bit3231         
4Xiphos 0.3 64-bit 4CPU3180         
5Xiphos 0.4 64-bit3151         
6Xiphos 0.2.2 64-bit 4CPU3103         
7Xiphos 0.3 64-bit3094         
8Xiphos 0.2 64-bit3024        17.5 − 12.5
+7−2=21
+7
9Xiphos 0.1 64-bit2987       12.5 − 17.5
+2−7=21
−7
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3314 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU32520.0 95.7100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit32310.04.3 100.0100.0100.0100.0100.0100.0
4Xiphos 0.3 64-bit 4CPU31800.00.00.0 98.7100.0100.0100.0100.0
5Xiphos 0.4 64-bit31510.00.00.01.3 99.9100.0100.0100.0
6Xiphos 0.2.2 64-bit 4CPU31030.00.00.00.00.1 71.1100.0100.0
7Xiphos 0.3 64-bit30940.00.00.00.00.028.9 100.0100.0
8Xiphos 0.2 64-bit30240.00.00.00.00.00.00.0 99.8
9Xiphos 0.1 64-bit29870.00.00.00.00.00.00.00.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3314 5720264000780
2Xiphos 0.4 64-bit 4CPU3252572 0465030753
3Xiphos 0.5 64-bit323100 01924015630
4Xiphos 0.3 64-bit 4CPU31802644650 026824600
5Xiphos 0.4 64-bit31510019240 0285130104
6Xiphos 0.2.2 64-bit 4CPU31030302680 000
7Xiphos 0.3 64-bit309400156242850 422326
8Xiphos 0.2 64-bit302478753601300422 1266
9Xiphos 0.1 64-bit2987030010403261266 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3314 38.20.019.90.00.00.04.70.0
2Xiphos 0.4 64-bit 4CPU325238.2 0.031.20.00.20.04.10.2
3Xiphos 0.5 64-bit32310.00.0 0.049.50.06.20.10.0
4Xiphos 0.3 64-bit 4CPU318019.931.20.0 0.025.01.63.60.0
5Xiphos 0.4 64-bit31510.00.049.50.0 0.09.54.13.5
6Xiphos 0.2.2 64-bit 4CPU31030.00.20.025.00.0 0.00.00.0
7Xiphos 0.3 64-bit30940.00.06.21.69.50.0 23.420.5
8Xiphos 0.2 64-bit30244.74.10.13.64.10.023.4 70.9
9Xiphos 0.1 64-bit29870.00.20.00.03.50.020.570.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 78 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU346322%
9.5/44
12%
5.5/44
       
SugaR XPrO 1.5.3 64-bit 4CPU3434 25%
8/32
 19%
6/32
     
Houdini 6 64-bit 4CPU339931%
10/32
33%
10.5/32
       
Stockfish 10 64-bit3388  26%
16.5/64
 15%
27.5/178
    
SugaR 1.6.1 64-bit3382  25%
14/56
 19%
10.5/56
    
Stockfish 9 64-bit3367    19%
9.5/50
 12%
0.5/4
  
ShashChess 6.0 64-bit3346  31%
16/52
 25%
14/56
    
Houdini 6 64-bit3335  31%
16/52
 22%
11/50
    
SugaR XPrO 1.5.3 64-bit3326    25%
13.5/54
 25%
1/4
  
Komodo 11.3.1 64-bit3324  38%
20/52
 17%
9/52
  0%
0/1
 
Komodo 12.2.2 64-bit3324  37%
19/52
 17%
9/52
    
Fire 7.1 64-bit 4CPU332257%
21.5/38
45%
14.5/32
 12%
2.5/20
   16%
6.5/40
 
Komodo 12 64-bit3317    26%
13/50
 0%
0/1
  
Komodo 12.3 MCTS 64-bit 4CPU329450%
19/38
29%
7/24
       
Laser 1.7 64-bit 4CPU328256%
18/32
40%
4/10
       
Deep Shredder 13 64-bit 4CPU328061%
23/38
50%
16/32
 32%
6.5/20
     
Fizbo 2 64-bit 4CPU327755%
21/38
48%
15.5/32
 40%
8/20
     
Andscacs 0.95 64-bit 4CPU326961%
23/38
40%
4/10
       
Andscacs 0.94 64-bit 4CPU3264 44%
15/34
 42%
13.5/32
     
Booot 6.3.1 64-bit 4CPU326461%
23/38
50%
16/32
 34%
17.5/52
     
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Fire 7.1 64-bit3258  42%
27/64
 35%
20.5/58
 12%
0.5/4
  
Ethereal 11.25 64-bit3238  54%
30/56
 34%
19/56
    
Komodo 12.3 MCTS 64-bit3235  47%
24.5/52
 41%
21.5/52
    
Laser 1.6 64-bit 4CPU3219 56%
18.5/33
 41%
13/32
     
Laser 1.7 64-bit3211  54%
34.5/64
 45%
25/56
    
Booot 6.3.1 64-bit3203  57%
50/88
 43%
30/70
 25%
1/4
  
Schooner 2.0.34 64-bit 4CPU320258%
3.5/6
62%
26.5/43
       
Shredder 13 64-bit3202  55%
41.5/76
 44%
22/50
 32%
6.5/20
  
Fizbo 2 64-bit3199  57%
50/88
 51%
29.5/58
 44%
10.5/24
  
Chiron 4 64-bit 4CPU3193   55%
11/20
 41%
6.5/16
   
Houdini 1.5a 64-bit 4CPU3186 55%
5.5/10
 58%
11.5/20
     
Ginkgo 2.18 64-bit3185  62%
7.5/12
 38%
1.5/4
    
Andscacs 0.95 64-bit3184  57%
34/60
 43%
20/46
    
Gull 3 64-bit 4CPU3181   52%
10.5/20
 47%
7.5/16
   
NirvanaChess 2.4 64-bit 4CPU3181   48%
9.5/20
 44%
7/16
   
Andscacs 0.94 64-bit3172    46%
32.5/70
 25%
1/4
  
Defenchess 2.1 64-bit3150  60%
12/20
 52%
10.5/20
    
Laser 1.5 64-bit 4CPU3144   55%
11/20
 47%
7.5/16
   
ChessBrainVB 3.68 4CPU3125   65%
13/20
 39%
12.5/32
   
Arasan 21.3 64-bit3124  63%
33/52
 46%
6.5/14
    
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Gull 3 64-bit3121  62%
32/52
 54%
27/50
    
Chiron 4 64-bit3115    62%
2.5/4
 40%
8.5/21
41%
12/29
36%
11.5/32
Senpai 2.0 64-bit 4CPU3112   72%
14.5/20
 59%
9.5/16
   
Schooner 2.0.34 64-bit3111  75%
3/4
 53%
47/88
    
Fritz 16 64-bit3102    75%
3/4
  38%
11.5/30
37%
11/30
NirvanaChess 2.4 64-bit3102    44%
3.5/8
 57%
20.5/36
100%
1/1
 
Ethereal 10.00 64-bit3093      40%
9.5/24
30%
9/30
 
Nemorino 5.00 64-bit3088    60%
6/10
 48%
9.5/20
  
Texel 1.07 64-bit3076    50%
2/4
 56%
29.5/53
  
Laser 1.5 64-bit3073      58%
11.5/20
45%
13.5/30
35%
10.5/30
Defenchess 1.1f 64-bit 4CPU3066   65%
13/20
 53%
8.5/16
   
Vajolet2 2.6 64-bit3061    75%
3/4
 53%
23.5/44
  
BlackMamba 2.0 64-bit3057       42%
12.5/30
52%
15.5/30
Gull 3.1 64-bit3040       40%
12/30
22%
6.5/30
Nemorino 4.00 64-bit3040      65%
13/20
50%
2/4
 
Arasan 20.4.1 64-bit3038      60%
12/20
48%
14.5/30
37%
11/30
Senpai 2.0 64-bit3037      69%
16.5/24
45%
13.5/30
42%
12.5/30
SmarThink 1.98 64-bit3027      58%
14.5/25
49%
16.5/34
43%
13/30
ChessBrainVB 3.683026      38%
1.5/4
54%
7.5/14
 
Deep Fritz 14 64-bit 1CPU3019    76%
38/50
  51%
25.5/50
40%
12/30
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Crafty 25.2 64-bit 4CPU3014 100%
1/1
   66%
10.5/16
   
Pedone 1.7 64-bit3014      75%
15/20
38%
1.5/4
 
Sting SF 9.9 64-bit3010       38%
1.5/4
39%
12.5/32
Ethereal 9.30 64-bit3005       50%
0.5/1
38%
4.5/12
Vajolet2 2.5 64-bit3002       54%
18.5/34
59%
19/32
Hakkapeliitta TCEC v2 64-bit2999      62%
2.5/4
48%
14.5/30
45%
13.5/30
Defenchess 1.1f 64-bit2998      72%
14.5/20
59%
20/34
61%
19.5/32
Rodent III 0.238 64-bit2983       59%
20/34
50%
16/32
Ethereal 9.00 64-bit2969       63%
19/30
50%
16/32
chess22k 1.10 64-bit2956   81%
32.5/40
  75%
6/8
  
Wasp 2.6 64-bit2948       67%
20/30
52%
16.5/32
Crafty 25.2 64-bit2931       67%
20/30
52%
16.5/32
Amoeba 2.8 64-bit2927 100%
1/1
     67%
20/30
59%
19/32
Bobcat 8.0 64-bit2924       62%
2.5/4
75%
1.5/2
Demolito 2018-03-01 64-bit2911       72%
21.5/30
75%
1.5/2
Toga II 4.0 64-bit2905       72%
21.5/30
100%
2/2
chess22k 1.7 64-bit2900       68%
20.5/30
73%
22/30
Scorpio 2.8 64-bit2886       68%
20.5/30
68%
9.5/14
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 19, 2019