CCRL 40/40
Downloads and Statistics
July 11, 2019
Testing summary:
Total: 1'066'603 games
played by 2'494 programs
145750 CPU days (X2 4600+)

White wins: 370'641 (34.7%)
Black wins: 275'905 (25.9%)
Draws: 420'057 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 9 engines!
9 selected engines played 30 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on July 11, 2019 with Bayeselo based on 1'066'603 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3316+24−2447.0%+20.968.3%476 
100.0%
 Xiphos 0.4 64-bit 4CPU3250+19−1943.8%+39.761.1%830
88.7%
 Xiphos 0.5 64-bit3235+15−1547.5%+13.762.9%1295
100.0%
 Xiphos 0.3 64-bit 4CPU3178+21−2149.2%+3.554.2%660
98.3%
 Xiphos 0.4 64-bit3150+12−1241.1%+59.249.8%2108
99.9%
 Xiphos 0.2.2 64-bit 4CPU3102+26−2647.3%+13.853.6%414
70.4%
 Xiphos 0.3 64-bit3093+19−1950.6%−3.851.6%801
100.0%
 Xiphos 0.2 64-bit3023+18−1852.8%−15.246.8%999
99.8%
 Xiphos 0.1 64-bit2985+20−2049.1%+6.048.4%787
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3316         
2Xiphos 0.4 64-bit 4CPU3250         
3Xiphos 0.5 64-bit3235         
4Xiphos 0.3 64-bit 4CPU3178         
5Xiphos 0.4 64-bit3150         
6Xiphos 0.2.2 64-bit 4CPU3102         
7Xiphos 0.3 64-bit3093         
8Xiphos 0.2 64-bit3023        17.5 − 12.5
+7−2=21
+6
9Xiphos 0.1 64-bit2985       12.5 − 17.5
+2−7=21
−6
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3316 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU32500.0 88.7100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit32350.011.3 100.0100.0100.0100.0100.0100.0
4Xiphos 0.3 64-bit 4CPU31780.00.00.0 98.3100.0100.0100.0100.0
5Xiphos 0.4 64-bit31500.00.00.01.7 99.9100.0100.0100.0
6Xiphos 0.2.2 64-bit 4CPU31020.00.00.00.00.1 70.4100.0100.0
7Xiphos 0.3 64-bit30930.00.00.00.00.029.6 100.0100.0
8Xiphos 0.2 64-bit30230.00.00.00.00.00.00.0 99.8
9Xiphos 0.1 64-bit29850.00.00.00.00.00.00.00.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3316 5720264000780
2Xiphos 0.4 64-bit 4CPU3250572 0465030753
3Xiphos 0.5 64-bit323500 01829015630
4Xiphos 0.3 64-bit 4CPU31782644650 026824600
5Xiphos 0.4 64-bit31500018290 0285130104
6Xiphos 0.2.2 64-bit 4CPU31020302680 000
7Xiphos 0.3 64-bit309300156242850 422326
8Xiphos 0.2 64-bit302378753601300422 1266
9Xiphos 0.1 64-bit2985030010403261266 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3316 43.80.023.20.00.00.05.30.0
2Xiphos 0.4 64-bit 4CPU325043.8 0.031.20.00.20.04.10.2
3Xiphos 0.5 64-bit32350.00.0 0.053.70.07.40.10.0
4Xiphos 0.3 64-bit 4CPU317823.231.20.0 0.025.01.63.60.0
5Xiphos 0.4 64-bit31500.00.053.70.0 0.09.84.23.6
6Xiphos 0.2.2 64-bit 4CPU31020.00.20.025.00.0 0.00.00.0
7Xiphos 0.3 64-bit30930.00.07.41.69.80.0 23.420.5
8Xiphos 0.2 64-bit30235.34.10.13.64.20.023.4 70.9
9Xiphos 0.1 64-bit29850.00.20.00.03.60.020.570.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 76 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU346222%
9.5/44
12%
5.5/44
       
SugaR XPrO 1.5.3 64-bit 4CPU3433 25%
8/32
 19%
6/32
     
Houdini 6 64-bit 4CPU339731%
10/32
33%
10.5/32
       
Stockfish 10 64-bit3388  26%
15/58
 15%
27.5/178
    
SugaR 1.6.1 64-bit3383  25%
14/56
 19%
10.5/56
    
Stockfish 9 64-bit3367    19%
9.5/50
 12%
0.5/4
  
ShashChess 6.0 64-bit3346  31%
16/52
 25%
14/56
    
Houdini 6 64-bit3334  31%
16/52
 22%
11/50
    
Komodo 12.2.2 64-bit3326  37%
19/52
 17%
9/52
    
SugaR XPrO 1.5.3 64-bit3325    25%
13.5/54
 25%
1/4
  
Komodo 11.3.1 64-bit3324  38%
20/52
 17%
9/52
  0%
0/1
 
Fire 7.1 64-bit 4CPU332057%
21.5/38
45%
14.5/32
 12%
2.5/20
   16%
6.5/40
 
Komodo 12 64-bit3316    26%
13/50
 0%
0/1
  
Komodo 12.3 MCTS 64-bit 4CPU329350%
19/38
29%
7/24
       
Deep Shredder 13 64-bit 4CPU327961%
23/38
50%
16/32
 32%
6.5/20
     
Fizbo 2 64-bit 4CPU327855%
21/38
48%
15.5/32
 40%
8/20
     
Laser 1.7 64-bit 4CPU327756%
18/32
40%
4/10
       
Andscacs 0.95 64-bit 4CPU326561%
23/38
40%
4/10
       
Andscacs 0.94 64-bit 4CPU3263 44%
15/34
 42%
13.5/32
     
Booot 6.3.1 64-bit 4CPU326061%
23/38
50%
16/32
 34%
17.5/52
     
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Fire 7.1 64-bit3258  44%
25.5/58
 35%
20.5/58
 12%
0.5/4
  
Ethereal 11.25 64-bit3239  54%
30/56
 34%
19/56
    
Komodo 12.3 MCTS 64-bit3235  47%
24.5/52
 41%
21.5/52
    
Laser 1.6 64-bit 4CPU3217 56%
18.5/33
 41%
13/32
     
Laser 1.7 64-bit3212  53%
31.5/59
 45%
25/56
    
Booot 6.3.1 64-bit3203  56%
46/82
 43%
30/70
 25%
1/4
  
Shredder 13 64-bit3201  55%
41.5/76
 44%
22/50
 32%
6.5/20
  
Schooner 2.0.34 64-bit 4CPU320058%
3.5/6
62%
26.5/43
       
Fizbo 2 64-bit3198  57%
46.5/82
 51%
29.5/58
 44%
10.5/24
  
Chiron 4 64-bit 4CPU3191   55%
11/20
 41%
6.5/16
   
Andscacs 0.95 64-bit3185  57%
33/58
 43%
20/46
    
Houdini 1.5a 64-bit 4CPU3185 55%
5.5/10
 58%
11.5/20
     
Gull 3 64-bit 4CPU3180   52%
10.5/20
 47%
7.5/16
   
NirvanaChess 2.4 64-bit 4CPU3180   48%
9.5/20
 44%
7/16
   
Andscacs 0.94 64-bit3171    46%
32.5/70
 25%
1/4
  
Laser 1.5 64-bit 4CPU3143   55%
11/20
 47%
7.5/16
   
Arasan 21.3 64-bit3123  63%
33/52
 46%
6.5/14
    
ChessBrainVB 3.68 4CPU3123   65%
13/20
 39%
12.5/32
   
Gull 3 64-bit3120  62%
32/52
 54%
27/50
    
Chiron 4 64-bit3114    62%
2.5/4
 40%
8.5/21
41%
12/29
36%
11.5/32
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Schooner 2.0.34 64-bit3110  75%
3/4
 53%
47/88
    
Senpai 2.0 64-bit 4CPU3108   72%
14.5/20
 59%
9.5/16
   
Fritz 16 64-bit3101    75%
3/4
  38%
11.5/30
37%
11/30
NirvanaChess 2.4 64-bit3101    44%
3.5/8
 57%
20.5/36
100%
1/1
 
Ethereal 10.00 64-bit3092      40%
9.5/24
30%
9/30
 
Nemorino 5.00 64-bit3089    60%
6/10
 48%
9.5/20
  
Texel 1.07 64-bit3075    50%
2/4
 56%
29.5/53
  
Laser 1.5 64-bit3072      58%
11.5/20
45%
13.5/30
35%
10.5/30
Defenchess (SCTR) 1.1f 64-bit 4CPU3064   65%
13/20
 53%
8.5/16
   
Vajolet2 2.6 64-bit3060    75%
3/4
 53%
23.5/44
  
BlackMamba 2.0 64-bit3055       42%
12.5/30
52%
15.5/30
Nemorino 4.00 64-bit3039      65%
13/20
50%
2/4
 
Gull 3.1 64-bit3038       40%
12/30
22%
6.5/30
Arasan 20.4.1 64-bit3036      60%
12/20
48%
14.5/30
37%
11/30
Senpai 2.0 64-bit3036      69%
16.5/24
45%
13.5/30
42%
12.5/30
SmarThink 1.98 64-bit3027      58%
14.5/25
49%
16.5/34
43%
13/30
ChessBrainVB 3.683025      38%
1.5/4
54%
7.5/14
 
Deep Fritz 14 64-bit 1CPU3018    76%
38/50
  51%
25.5/50
40%
12/30
Crafty 25.2 64-bit 4CPU3013 100%
1/1
   66%
10.5/16
   
Pedone 1.7 64-bit3013      75%
15/20
38%
1.5/4
 
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Sting SF 9.9 64-bit3009       38%
1.5/4
39%
12.5/32
Ethereal 9.30 64-bit3004       50%
0.5/1
38%
4.5/12
Vajolet2 2.5 64-bit3001       54%
18.5/34
59%
19/32
Hakkapeliitta TCEC v2 64-bit2998      62%
2.5/4
48%
14.5/30
45%
13.5/30
Defenchess (SCTR) 1.1f 64-bit2997      72%
14.5/20
59%
20/34
61%
19.5/32
Rodent III 0.238 64-bit2982       59%
20/34
50%
16/32
Ethereal 9.00 64-bit2967       63%
19/30
50%
16/32
chess22k 1.10 64-bit2955   81%
32.5/40
  75%
6/8
  
Wasp 2.6 64-bit2946       67%
20/30
52%
16.5/32
Crafty 25.2 64-bit2930       67%
20/30
52%
16.5/32
Amoeba 2.8 64-bit2926 100%
1/1
     67%
20/30
59%
19/32
Bobcat 8.0 64-bit2923       62%
2.5/4
75%
1.5/2
Demolito 2018-03-01 64-bit2909       72%
21.5/30
75%
1.5/2
Toga II 4.0 64-bit2904       72%
21.5/30
100%
2/2
chess22k 1.7 64-bit2898       68%
20.5/30
73%
22/30
Scorpio 2.8 64-bit2884       68%
20.5/30
68%
9.5/14
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 11, 2019