CCRL 40/15
Downloads and Statistics
February 8, 2020
Testing summary:
Total: 1'120'733 games
played by 2'610 programs

White wins: 387'881 (34.6%)
Black wins: 287'767 (25.7%)
Draws: 445'085 (39.7%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 30 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on February 8, 2020 with Bayeselo based on 1'120'733 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.6 64-bit 4CPU3341+22−2243.8%+38.562.3%570 
97.9%
 Xiphos 0.5 64-bit 4CPU3311+19−1943.9%+39.164.2%745
100.0%
 Xiphos 0.6 64-bit3256+15−1546.5%+22.764.5%1170
60.6%
 Xiphos 0.4 64-bit 4CPU3252+19−1943.8%+39.461.1%830
95.5%
 Xiphos 0.5 64-bit3231+13−1347.2%+16.862.6%1691
100.0%
 Xiphos 0.3 64-bit 4CPU3180+21−2149.2%+3.254.2%660
99.3%
 Xiphos 0.4 64-bit3148+12−1242.7%+48.950.1%2312
99.8%
 Xiphos 0.2.2 64-bit 4CPU3103+26−2647.3%+14.553.6%414
71.3%
 Xiphos 0.3 64-bit3094+19−1950.6%−3.651.6%801
100.0%
 Xiphos 0.2 64-bit3025+18−1852.8%−15.746.8%999
99.8%
 Xiphos 0.1 64-bit2987+20−2049.1%+5.548.4%787
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3341           
2Xiphos 0.5 64-bit 4CPU3311           
3Xiphos 0.6 64-bit3256           
4Xiphos 0.4 64-bit 4CPU3252           
5Xiphos 0.5 64-bit3231           
6Xiphos 0.3 64-bit 4CPU3180           
7Xiphos 0.4 64-bit3148           
8Xiphos 0.2.2 64-bit 4CPU3103           
9Xiphos 0.3 64-bit3094           
10Xiphos 0.2 64-bit3025          17.5 − 12.5
+7−2=21
+6
11Xiphos 0.1 64-bit2987         12.5 − 17.5
+2−7=21
−6
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3341 97.9100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.5 64-bit 4CPU33112.1 100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Xiphos 0.6 64-bit32560.00.0 60.699.2100.0100.0100.0100.0100.0100.0
4Xiphos 0.4 64-bit 4CPU32520.00.039.4 95.5100.0100.0100.0100.0100.0100.0
5Xiphos 0.5 64-bit32310.00.00.84.5 100.0100.0100.0100.0100.0100.0
6Xiphos 0.3 64-bit 4CPU31800.00.00.00.00.0 99.3100.0100.0100.0100.0
7Xiphos 0.4 64-bit31480.00.00.00.00.00.7 99.8100.0100.0100.0
8Xiphos 0.2.2 64-bit 4CPU31030.00.00.00.00.00.00.2 71.3100.0100.0
9Xiphos 0.3 64-bit30940.00.00.00.00.00.00.028.7 100.0100.0
10Xiphos 0.2 64-bit30250.00.00.00.00.00.00.00.00.0 99.8
11Xiphos 0.1 64-bit29870.00.00.00.00.00.00.00.00.00.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3341 734883620156000720
2Xiphos 0.5 64-bit 4CPU3311734 05720264000780
3Xiphos 0.6 64-bit3256880 015800952015600
4Xiphos 0.4 64-bit 4CPU32523625720 0465030753
5Xiphos 0.5 64-bit32310015800 01912015630
6Xiphos 0.3 64-bit 4CPU318015626404650 026824600
7Xiphos 0.4 64-bit314800952019120 0285130104
8Xiphos 0.2.2 64-bit 4CPU3103000302680 000
9Xiphos 0.3 64-bit3094001560156242850 422326
10Xiphos 0.2 64-bit302572780753601300422 1266
11Xiphos 0.1 64-bit298700030010403261266 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Xiphos 0.6 64-bit 4CPU3341 55.85.125.90.012.70.00.00.04.60.0
2Xiphos 0.5 64-bit 4CPU331155.8 0.036.30.018.80.00.00.04.50.0
3Xiphos 0.6 64-bit32565.10.0 0.055.20.027.30.07.90.00.0
4Xiphos 0.4 64-bit 4CPU325225.936.30.0 0.031.20.00.20.04.10.2
5Xiphos 0.5 64-bit32310.00.055.20.0 0.047.80.06.30.10.0
6Xiphos 0.3 64-bit 4CPU318012.718.80.031.20.0 0.025.01.63.60.0
7Xiphos 0.4 64-bit31480.00.027.30.047.80.0 0.09.23.93.4
8Xiphos 0.2.2 64-bit 4CPU31030.00.00.00.20.025.00.0 0.00.00.0
9Xiphos 0.3 64-bit30940.00.07.90.06.31.69.20.0 23.420.5
10Xiphos 0.2 64-bit30254.64.50.04.10.13.63.90.023.4 70.9
11Xiphos 0.1 64-bit29870.00.00.00.20.00.03.40.020.570.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 89 common opponents

Custom engine selection
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
SugaR NN 1.1 64-bit 4CPU348333%
10.5/32
23%
7.5/32
         
Stockfish 10 64-bit 4CPU346528%
9/32
22%
9.5/44
 12%
5.5/44
       
Stockfish 2019-12-10 64-bit345828%
9/32
 23%
13/56
        
ShashChess 8.0 64-bit 4CPU345233%
10.5/32
33%
10.5/32
         
SugaR XPrO 1.5.3 64-bit 4CPU3435   25%
8/32
 19%
6/32
     
SugaR NN 310719 64-bit3414  29%
16.5/56
 25%
1/4
      
Komodo 13.1 64-bit 4CPU340945%
14.5/32
27%
8.5/32
         
Houdini 6 64-bit 4CPU340036%
11.5/32
31%
10/32
 33%
10.5/32
       
Stockfish 10 64-bit3388  32%
18/56
 26%
16.5/64
 15%
27.5/178
    
SugaR 1.6.1 64-bit3382    25%
14/56
 19%
10.5/56
    
Stockfish 9 64-bit3368      19%
9.5/50
 12%
0.5/4
  
ShashChess 8.0 64-bit3364  31%
17.5/56
 30%
19.5/64
      
ShashChess 6.0 64-bit3346    31%
16/52
 25%
14/56
    
Houdini 6 64-bit3338  35%
18/52
 31%
16/52
 22%
11/50
    
Komodo 13.1 64-bit3333  38%
20/52
 29%
16/56
      
SugaR XPrO 1.5.3 64-bit3326      25%
13.5/54
 25%
1/4
  
Komodo 12.2.2 64-bit3325    37%
19/52
 17%
9/52
    
Komodo 11.3.1 64-bit3324    38%
20/52
 17%
9/52
  0%
0/1
 
Fire 7.1 64-bit 4CPU332350%
16/32
57%
21.5/38
 45%
14.5/32
 12%
2.5/20
   16%
6.5/40
 
Komodo 12 64-bit3317      26%
13/50
 0%
0/1
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Komodo 12.3 MCTS 64-bit 4CPU3295 50%
19/38
 29%
7/24
       
RofChade 2.202 64-bit 4CPU328859%
19/32
53%
17/32
         
Defenchess 2.2 64-bit 4CPU328564%
20.5/32
50%
16/32
         
Laser 1.7 64-bit 4CPU328555%
17.5/32
56%
18/32
 40%
4/10
       
Deep Shredder 13 64-bit 4CPU328064%
20.5/32
61%
23/38
 50%
16/32
 32%
6.5/20
     
Fizbo 2 64-bit 4CPU327661%
19.5/32
55%
21/38
 48%
15.5/32
 40%
8/20
     
Andscacs 0.95 64-bit 4CPU3267 61%
23/38
 40%
4/10
       
Andscacs 0.94 64-bit 4CPU3264   44%
15/34
 42%
13.5/32
     
Booot 6.3.1 64-bit 4CPU3264 61%
23/38
 50%
16/32
 34%
17.5/52
     
Komodo 10 64-bit3263  44%
23/52
 46%
24/52
      
Fire 7.1 64-bit3258  52%
31.5/60
 42%
27/64
 35%
20.5/58
 12%
0.5/4
  
Ethereal 11.25 64-bit3239    54%
30/56
 34%
19/56
    
Komodo 12.3 MCTS 64-bit3235    47%
24.5/52
 41%
21.5/52
    
Laser 1.6 64-bit 4CPU3218   56%
18.5/33
 41%
13/32
     
Laser 1.7 64-bit3210  58%
35/60
 54%
34.5/64
 45%
25/56
    
RofChade 2.202 64-bit3207  57%
34/60
 52%
27/52
      
Defenchess 2.2 64-bit3206  58%
34.5/60
 50%
28/56
      
Booot 6.3.1 64-bit3202  60%
36/60
 57%
50/88
 43%
30/70
 25%
1/4
  
Schooner 2.0.34 64-bit 4CPU3202 58%
3.5/6
 62%
26.5/43
       
Shredder 13 64-bit3201  61%
31.5/52
 55%
41.5/76
 44%
22/50
 32%
6.5/20
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Fizbo 2 64-bit3199  59%
33/56
 57%
50/88
 51%
29.5/58
 44%
10.5/24
  
Chiron 4 64-bit 4CPU3193     55%
11/20
 41%
6.5/16
   
Andscacs 0.95 64-bit3185  62%
34.5/56
 57%
34/60
 43%
20/46
    
Houdini 1.5a 64-bit 4CPU3184   55%
5.5/10
 58%
11.5/20
     
NirvanaChess 2.4 64-bit 4CPU3182     48%
9.5/20
 44%
7/16
   
Gull 3 64-bit 4CPU3181     52%
10.5/20
 47%
7.5/16
   
Andscacs 0.94 64-bit3172      46%
32.5/70
 25%
1/4
  
Defenchess 2.1 64-bit3149    60%
12/20
 52%
10.5/20
    
Laser 1.5 64-bit 4CPU3144     55%
11/20
 47%
7.5/16
   
ChessBrainVB 3.68 4CPU3125     65%
13/20
 39%
12.5/32
   
Arasan 21.3 64-bit3124    63%
33/52
 46%
6.5/14
    
Gull 3 64-bit3121    62%
32/52
 54%
27/50
    
Chiron 4 64-bit3115      62%
2.5/4
 40%
8.5/21
41%
12/29
36%
11.5/32
Schooner 2.0.34 64-bit3111    75%
3/4
 53%
47/88
    
Senpai 2.0 64-bit 4CPU3111     72%
14.5/20
 59%
9.5/16
   
NirvanaChess 2.4 64-bit3103      44%
3.5/8
 57%
20.5/36
100%
1/1
 
Fritz 16 64-bit3102      75%
3/4
  38%
11.5/30
37%
11/30
Ethereal 10.00 64-bit3093        40%
9.5/24
30%
9/30
 
Nemorino 5.00 64-bit3089      60%
6/10
 48%
9.5/20
  
Texel 1.07 64-bit3076      50%
2/4
 56%
29.5/53
  
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Laser 1.5 64-bit3073        58%
11.5/20
45%
13.5/30
35%
10.5/30
Defenchess 1.1f 64-bit 4CPU3066     65%
13/20
 53%
8.5/16
   
Vajolet2 2.6 64-bit3061      75%
3/4
 53%
23.5/44
  
BlackMamba 2.0 64-bit3057         42%
12.5/30
52%
15.5/30
Gull 3.1 64-bit3041         40%
12/30
22%
6.5/30
Nemorino 4.00 64-bit3041        65%
13/20
50%
2/4
 
Arasan 20.4.1 64-bit3038        60%
12/20
48%
14.5/30
37%
11/30
Senpai 2.0 64-bit3037        69%
16.5/24
45%
13.5/30
42%
12.5/30
SmarThink 1.98 64-bit3027        58%
14.5/25
49%
16.5/34
43%
13/30
ChessBrainVB 3.683026        38%
1.5/4
54%
7.5/14
 
Deep Fritz 14 64-bit 1CPU3019      76%
38/50
  51%
25.5/50
40%
12/30
Crafty 25.2 64-bit 4CPU3015   100%
1/1
   66%
10.5/16
   
Pedone 1.7 64-bit3014        75%
15/20
38%
1.5/4
 
Sting SF 9.9 64-bit3012         38%
1.5/4
39%
12.5/32
Ethereal 9.30 64-bit3005         50%
0.5/1
38%
4.5/12
Vajolet2 2.5 64-bit3002         54%
18.5/34
59%
19/32
Hakkapeliitta TCEC v2 64-bit3001        62%
2.5/4
48%
14.5/30
45%
13.5/30
Defenchess 1.1f 64-bit2998        72%
14.5/20
59%
20/34
61%
19.5/32
Rodent III 0.238 64-bit2983         59%
20/34
50%
16/32
Ethereal 9.00 64-bit2969         63%
19/30
50%
16/32
NameEloXiphos
0.6
64-bit
4CPU
Xiphos
0.5
64-bit
4CPU
Xiphos
0.6
64-bit
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.3
64-bit
4CPU
Xiphos
0.4
64-bit
Xiphos
0.2.2
64-bit
4CPU
Xiphos
0.3
64-bit
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
chess22k 1.10 64-bit2957     81%
32.5/40
  75%
6/8
  
Wasp 2.6 64-bit2948         67%
20/30
52%
16.5/32
Crafty 25.2 64-bit2932         67%
20/30
52%
16.5/32
Amoeba 2.8 64-bit2927   100%
1/1
     67%
20/30
59%
19/32
Bobcat 8.0 64-bit2924         62%
2.5/4
75%
1.5/2
Demolito 2018-03-01 64-bit2911         72%
21.5/30
75%
1.5/2
Toga II 4.0 64-bit2905         72%
21.5/30
100%
2/2
chess22k 1.7 64-bit2900         68%
20.5/30
73%
22/30
Scorpio 2.8 64-bit2886         68%
20.5/30
68%
9.5/14
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on February 8, 2020