CCRL 40/15
Downloads and Statistics
August 1, 2020
Testing summary:
Total: 1'166'106 games
played by 2'690 programs

White wins: 402'287 (34.5%)
Black wins: 297'247 (25.5%)
Draws: 466'572 (40.0%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 30 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on August 1, 2020 with Bayeselo based on 1'166'106 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.6 64-bit 4CPU3339+18−1846.4%+22.665.5%830 
98.8%
 Xiphos 0.5 64-bit 4CPU3308+19−1943.9%+39.464.2%745
100.0%
 Xiphos 0.6 64-bit3253+12−1245.4%+29.663.1%2072
59.7%
 Xiphos 0.4 64-bit 4CPU3250+19−1943.8%+39.661.1%830
95.2%
 Xiphos 0.5 64-bit3230+13−1347.2%+16.562.6%1691
100.0%
 Xiphos 0.3 64-bit 4CPU3178+21−2149.2%+3.654.2%660
99.5%
 Xiphos 0.4 64-bit3145+11−1244.2%+39.750.7%2492
99.8%
 Xiphos 0.2.2 64-bit 4CPU3102+26−2647.3%+13.953.6%414
71.2%
 Xiphos 0.3 64-bit3093+19−1950.6%−3.951.6%801
100.0%
 Xiphos 0.2 64-bit3023+18−1852.8%−14.846.8%999
99.8%
 Xiphos 0.1 64-bit2986+20−2049.1%+5.348.4%787
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3339           
2Xiphos 0.5 64-bit 4CPU3308           
3Xiphos 0.6 64-bit3253           
4Xiphos 0.4 64-bit 4CPU3250           
5Xiphos 0.5 64-bit3230           
6Xiphos 0.3 64-bit 4CPU3178           
7Xiphos 0.4 64-bit3145           
8Xiphos 0.2.2 64-bit 4CPU3102           
9Xiphos 0.3 64-bit3093           
10Xiphos 0.2 64-bit3023          17.5 − 12.5
+7−2=21
+7
11Xiphos 0.1 64-bit2986         12.5 − 17.5
+2−7=21
−7
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3339 98.8100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.5 64-bit 4CPU33081.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Xiphos 0.6 64-bit32530.00.0 59.799.6100.0100.0100.0100.0100.0100.0
4Xiphos 0.4 64-bit 4CPU32500.00.040.3 95.2100.0100.0100.0100.0100.0100.0
5Xiphos 0.5 64-bit32300.00.00.44.8 100.0100.0100.0100.0100.0100.0
6Xiphos 0.3 64-bit 4CPU31780.00.00.00.00.0 99.5100.0100.0100.0100.0
7Xiphos 0.4 64-bit31450.00.00.00.00.00.5 99.8100.0100.0100.0
8Xiphos 0.2.2 64-bit 4CPU31020.00.00.00.00.00.00.2 71.2100.0100.0
9Xiphos 0.3 64-bit30930.00.00.00.00.00.00.028.8 100.0100.0
10Xiphos 0.2 64-bit30230.00.00.00.00.00.00.00.00.0 99.8
11Xiphos 0.1 64-bit29860.00.00.00.00.00.00.00.00.00.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3339 734883620156000720
2Xiphos 0.5 64-bit 4CPU3308734 05720264000780
3Xiphos 0.6 64-bit3253880 016230982015600
4Xiphos 0.4 64-bit 4CPU32503625720 0465030753
5Xiphos 0.5 64-bit32300016230 01912015630
6Xiphos 0.3 64-bit 4CPU317815626404650 026824600
7Xiphos 0.4 64-bit314500982019120 0285130104
8Xiphos 0.2.2 64-bit 4CPU3102000302680 000
9Xiphos 0.3 64-bit3093001560156242850 422326
10Xiphos 0.2 64-bit302372780753601300422 1266
11Xiphos 0.1 64-bit298600030010403261266 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3339 46.63.021.80.010.50.00.00.03.90.0
2Xiphos 0.5 64-bit 4CPU330846.6 0.036.30.018.80.00.00.04.50.0
3Xiphos 0.6 64-bit32533.00.0 0.043.10.021.50.05.40.00.0
4Xiphos 0.4 64-bit 4CPU325021.836.30.0 0.031.20.00.20.04.10.2
5Xiphos 0.5 64-bit32300.00.043.10.0 0.045.70.06.30.10.0
6Xiphos 0.3 64-bit 4CPU317810.518.80.031.20.0 0.025.01.63.60.0
7Xiphos 0.4 64-bit31450.00.021.50.045.70.0 0.08.73.73.2
8Xiphos 0.2.2 64-bit 4CPU31020.00.00.00.20.025.00.0 0.00.00.0
9Xiphos 0.3 64-bit30930.00.05.40.06.31.68.70.0 23.420.5
10Xiphos 0.2 64-bit30233.94.50.04.10.13.63.70.023.4 70.9
11Xiphos 0.1 64-bit29860.00.00.00.20.00.03.20.020.570.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 89 common opponents

Custom engine selection
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
SugaR NN 1.1 64-bit 4CPU347833%
10.5/32
23%
7.5/32
         
Stockfish 10 64-bit 4CPU346328%
9/32
22%
9.5/44
 12%
5.5/44
       
ShashChess 8.0 64-bit 4CPU344533%
10.5/32
33%
10.5/32
         
Stockfish 2019-12-10 64-bit344228%
9/32
 23%
13/56
        
SugaR XPrO 1.5.3 64-bit 4CPU3433   25%
8/32
 19%
6/32
     
SugaR NN 310719 64-bit3413  29%
16.5/56
 25%
1/4
      
Komodo 13.1 64-bit 4CPU340745%
14.5/32
27%
8.5/32
         
Houdini 6 64-bit 4CPU339936%
11.5/32
31%
10/32
 33%
10.5/32
       
Stockfish 10 64-bit3387  32%
18/56
 26%
16.5/64
 15%
27.5/178
    
SugaR 1.6.1 64-bit3381    25%
14/56
 19%
10.5/56
    
Stockfish 9 64-bit3366      19%
9.5/50
 12%
0.5/4
  
ShashChess 8.0 64-bit3364  31%
17.5/56
 30%
19.5/64
      
ShashChess 6.0 64-bit3345    31%
16/52
 25%
14/56
    
Houdini 6 64-bit3339  35%
18/52
 31%
16/52
 22%
11/50
    
Komodo 13.1 64-bit3331  38%
20/52
 29%
16/56
      
SugaR XPrO 1.5.3 64-bit3325      25%
13.5/54
 25%
1/4
  
Fire 7.1 64-bit 4CPU332350%
16/32
57%
21.5/38
 45%
14.5/32
 12%
2.5/20
   16%
6.5/40
 
Komodo 11.3.1 64-bit3323    38%
20/52
 17%
9/52
  0%
0/1
 
Komodo 12.2.2 64-bit3323    37%
19/52
 17%
9/52
    
Komodo 12 64-bit3316      26%
13/50
 0%
0/1
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Komodo 12.3 MCTS 64-bit 4CPU3293 50%
19/38
 29%
7/24
       
Laser 1.7 64-bit 4CPU328655%
17.5/32
56%
18/32
 40%
4/10
       
RofChade 2.202 64-bit 4CPU328159%
19/32
53%
17/32
         
Defenchess 2.2 64-bit 4CPU328064%
20.5/32
50%
16/32
         
Deep Shredder 13 64-bit 4CPU327964%
20.5/32
61%
23/38
 50%
16/32
 32%
6.5/20
     
Fizbo 2 64-bit 4CPU327461%
19.5/32
55%
21/38
 48%
15.5/32
 40%
8/20
     
Andscacs 0.95 64-bit 4CPU3263 61%
23/38
 40%
4/10
       
Andscacs 0.94 64-bit 4CPU3262   44%
15/34
 42%
13.5/32
     
Booot 6.3.1 64-bit 4CPU3262 61%
23/38
 50%
16/32
 34%
17.5/52
     
Komodo 10 64-bit3262  44%
23/52
 46%
24/52
      
Fire 7.1 64-bit3257  51%
36.5/72
 42%
27/64
 35%
20.5/58
 12%
0.5/4
  
Ethereal 11.25 64-bit3237    54%
30/56
 34%
19/56
    
Komodo 12.3 MCTS 64-bit3234    47%
24.5/52
 41%
21.5/52
    
Laser 1.6 64-bit 4CPU3217   56%
18.5/33
 41%
13/32
     
Laser 1.7 64-bit3207  59%
41.5/70
 54%
34.5/64
 45%
25/56
    
RofChade 2.202 64-bit3206  55%
35.5/64
 52%
27/52
      
Defenchess 2.2 64-bit3202  57%
39/69
 50%
28/56
      
Booot 6.3.1 64-bit3200  60%
36/60
 57%
50/88
 43%
30/70
 25%
1/4
  
Schooner 2.0.34 64-bit 4CPU3200 58%
3.5/6
 62%
26.5/43
       
Shredder 13 64-bit3200  61%
31.5/52
 55%
41.5/76
 44%
22/50
 32%
6.5/20
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Fizbo 2 64-bit3197  59%
33/56
 57%
50/88
 51%
29.5/58
 44%
10.5/24
  
Chiron 4 64-bit 4CPU3189     55%
11/20
 41%
6.5/16
   
Andscacs 0.95 64-bit3182  62%
39.5/64
 57%
34/60
 43%
20/46
    
Houdini 1.5a 64-bit 4CPU3182   55%
5.5/10
 58%
11.5/20
     
Gull 3 64-bit 4CPU3180     52%
10.5/20
 47%
7.5/16
   
NirvanaChess 2.4 64-bit 4CPU3180     48%
9.5/20
 44%
7/16
   
Andscacs 0.94 64-bit3170      46%
32.5/70
 25%
1/4
  
Defenchess 2.1 64-bit3148    60%
12/20
 52%
10.5/20
    
Laser 1.5 64-bit 4CPU3143     55%
11/20
 47%
7.5/16
   
Arasan 21.3 64-bit3123    63%
33/52
 46%
6.5/14
    
ChessBrainVB 3.68 4CPU3123     65%
13/20
 39%
12.5/32
   
Gull 3 64-bit3119    62%
32/52
 54%
27/50
    
Chiron 4 64-bit3114      62%
2.5/4
 40%
8.5/21
41%
12/29
36%
11.5/32
Schooner 2.0.34 64-bit3109    75%
3/4
 53%
47/88
    
Senpai 2.0 64-bit 4CPU3108     72%
14.5/20
 59%
9.5/16
   
Fritz 16 64-bit3101      75%
3/4
  38%
11.5/30
37%
11/30
NirvanaChess 2.4 64-bit3101      44%
3.5/8
 57%
20.5/36
100%
1/1
 
Ethereal 10.00 64-bit3092        40%
9.5/24
30%
9/30
 
Nemorino 5.00 64-bit3086      60%
6/10
 48%
9.5/20
  
Texel 1.07 64-bit3075      50%
2/4
 56%
29.5/53
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Laser 1.5 64-bit3072        58%
11.5/20
45%
13.5/30
35%
10.5/30
Defenchess 1.1f 64-bit 4CPU3065     65%
13/20
 53%
8.5/16
   
Vajolet2 2.6 64-bit3060      75%
3/4
 53%
23.5/44
  
BlackMamba 2.0 64-bit3056         42%
12.5/30
52%
15.5/30
Gull 3.1 64-bit3040         40%
12/30
22%
6.5/30
Nemorino 4.00 64-bit3039        65%
13/20
50%
2/4
 
Arasan 20.4.1 64-bit3037        60%
12/20
48%
14.5/30
37%
11/30
Senpai 2.0 64-bit3033        69%
16.5/24
45%
13.5/30
42%
12.5/30
SmarThink 1.98 64-bit3026        58%
14.5/25
49%
16.5/34
43%
13/30
ChessBrainVB 3.683025        38%
1.5/4
54%
7.5/14
 
Deep Fritz 14 64-bit 1CPU3018      76%
38/50
  51%
25.5/50
40%
12/30
Crafty 25.2 64-bit 4CPU3014   100%
1/1
   66%
10.5/16
   
Pedone 1.7 64-bit3013        75%
15/20
38%
1.5/4
 
Sting SF 9.9 64-bit3010         38%
1.5/4
39%
12.5/32
Ethereal 9.30 64-bit3004         50%
0.5/1
38%
4.5/12
Vajolet2 2.5 64-bit3001         54%
18.5/34
59%
19/32
Hakkapeliitta TCEC v2 64-bit3000        62%
2.5/4
48%
14.5/30
45%
13.5/30
Defenchess 1.1f 64-bit2997        72%
14.5/20
59%
20/34
61%
19.5/32
Rodent III 0.238 64-bit2982         59%
20/34
50%
16/32
Ethereal 9.00 64-bit2968         63%
19/30
50%
16/32
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
chess22k 1.10 64-bit2955     81%
32.5/40
  75%
6/8
  
Wasp 2.6 64-bit2947         67%
20/30
52%
16.5/32
Crafty 25.2 64-bit2931         67%
20/30
52%
16.5/32
Amoeba 2.8 64-bit2926   100%
1/1
     67%
20/30
59%
19/32
Bobcat 8.0 64-bit2924         62%
2.5/4
75%
1.5/2
Demolito 2018-03-01 64-bit2910         72%
21.5/30
75%
1.5/2
Toga II 4.0 64-bit2904         72%
21.5/30
100%
2/2
chess22k 1.7 64-bit2899         68%
20.5/30
73%
22/30
Scorpio 2.8 64-bit2885         68%
20.5/30
68%
9.5/14
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 1, 2020