CCRL 40/15
Downloads and Statistics
February 26, 2020
Testing summary:
Total: 1'125'289 games
played by 2'622 programs

White wins: 389'459 (34.6%)
Black wins: 288'887 (25.7%)
Draws: 446'943 (39.7%)
White score: 54.5%

Custom engine selection

Comparing 9 engines!
9 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on February 26, 2020 with Bayeselo based on 1'125'289 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 13.2.5 MCTS 64-bit 4CPU3369+24−2453.3%−18.069.8%474 
100.0%
 Komodo 12.3 MCTS 64-bit 4CPU3295+22−2247.0%+18.055.0%604
80.7%
 Komodo 13.2.5 MCTS 64-bit3282+18−1848.7%+9.861.4%906
61.6%
 Komodo 12.2.2 MCTS 64-bit 4CPU3277+23−2353.9%−23.955.4%560
50.3%
 Komodo 13.01 MCTS 64-bit3277+17−1852.2%−12.063.2%904
100.0%
 Komodo 12.3 MCTS 64-bit3235+14−1450.4%−3.054.6%1616
97.8%
 Komodo 12.2.2 MCTS 64-bit3213+16−1662.4%−82.845.3%1350
99.6%
 Komodo 12.1.1 MCTS 64-bit 4CPU3182+17−1749.9%−0.449.3%1142
100.0%
 Komodo 12.1.1 MCTS 64-bit3080+15−1546.9%+24.739.9%1430
 

Results matrix

Custom engine selection
#NameElo123456789
1Komodo 13.2.5 MCTS 64-bit 4CPU3369         
2Komodo 12.3 MCTS 64-bit 4CPU3295         
3Komodo 13.2.5 MCTS 64-bit3282         
4Komodo 12.2.2 MCTS 64-bit 4CPU3277         
5Komodo 13.01 MCTS 64-bit3277         
6Komodo 12.3 MCTS 64-bit3235         
7Komodo 12.2.2 MCTS 64-bit3213         
8Komodo 12.1.1 MCTS 64-bit 4CPU3182         
9Komodo 12.1.1 MCTS 64-bit3080         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Komodo 13.2.5 MCTS 64-bit 4CPU3369 100.0100.0100.0100.0100.0100.0100.0100.0
2Komodo 12.3 MCTS 64-bit 4CPU32950.0 80.786.387.9100.0100.0100.0100.0
3Komodo 13.2.5 MCTS 64-bit32820.019.3 61.664.0100.0100.0100.0100.0
4Komodo 12.2.2 MCTS 64-bit 4CPU32770.013.738.4 50.399.9100.0100.0100.0
5Komodo 13.01 MCTS 64-bit32770.012.136.049.7 100.0100.0100.0100.0
6Komodo 12.3 MCTS 64-bit32350.00.00.00.10.0 97.8100.0100.0
7Komodo 12.2.2 MCTS 64-bit32130.00.00.00.00.02.2 99.6100.0
8Komodo 12.1.1 MCTS 64-bit 4CPU31820.00.00.00.00.00.00.4 100.0
9Komodo 12.1.1 MCTS 64-bit30800.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Komodo 13.2.5 MCTS 64-bit 4CPU3369 42802160002360
2Komodo 12.3 MCTS 64-bit 4CPU3295428 0720006240062
3Komodo 13.2.5 MCTS 64-bit328200 9210408925820368
4Komodo 12.2.2 MCTS 64-bit 4CPU327721672092 92120240670240
5Komodo 13.01 MCTS 64-bit327700104092 13465820368
6Komodo 12.3 MCTS 64-bit3235008921201346 11920690
7Komodo 12.2.2 MCTS 64-bit32130625822405821192 1701200
8Komodo 12.1.1 MCTS 64-bit 4CPU3182236400067000170 440
9Komodo 12.1.1 MCTS 64-bit30800623682403686901200440 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Komodo 13.2.5 MCTS 64-bit 4CPU3369 39.70.020.90.00.00.014.60.0
2Komodo 12.3 MCTS 64-bit 4CPU329539.7 0.061.90.00.03.222.93.0
3Komodo 13.2.5 MCTS 64-bit32820.00.0 6.357.535.425.80.015.8
4Komodo 12.2.2 MCTS 64-bit 4CPU327720.961.96.3 6.35.512.639.412.1
5Komodo 13.01 MCTS 64-bit32770.00.057.56.3 53.425.80.015.8
6Komodo 12.3 MCTS 64-bit32350.00.035.45.553.4 40.20.022.7
7Komodo 12.2.2 MCTS 64-bit32130.03.225.812.625.840.2 6.843.2
8Komodo 12.1.1 MCTS 64-bit 4CPU318214.622.90.039.40.00.06.8 17.1
9Komodo 12.1.1 MCTS 64-bit30800.03.015.812.115.822.743.217.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 50 common opponents

Custom engine selection
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Stockfish 2019-10-09 64-bit 4CPU349433%
10.5/32
30%
3/10
       
ShashChess 8.0 64-bit 4CPU345433%
10.5/32
28%
9/32
       
Houdini 6 64-bit 4CPU339944%
14/32
28%
14.5/52
       
Stockfish 10 64-bit3388  25%
13/52
 35%
18/52
20%
11.5/58
19%
13/70
  
SugaR 1.6.1 64-bit3382    39%
20.5/52
25%
19.5/78
   
SugaR XPrO 1.4 64-bit3368     29%
15/52
  16%
6.5/40
Stockfish 9 64-bit3367   28%
11/40
  32%
13/40
20%
10/50
11%
4.5/40
ShashChess 8.0 64-bit3363  38%
20/52
 39%
20.5/52
29%
15/52
   
Houdini 6 64-bit3337  39%
20.5/52
28%
11/40
42%
22/52
33%
27/82
26%
10.5/40
 9%
3.5/40
Komodo 12.2.2 64-bit3324     35%
18/52
28%
11/40
  
Fire 7.1 64-bit 4CPU332262%
20/32
40%
17/42
 42%
17/40
   26%
13/50
 
Houdini 6 Tactical 64-bit3314       25%
12.5/50
16%
6.5/40
MateFinder 9 64-bit3314       30%
15/50
15%
6/40
Ethereal 11.00 64-bit 4CPU3300 48%
12.5/26
 46%
18.5/40
     
Laser 1.7 64-bit 4CPU328559%
19/32
58%
18.5/32
       
Deep Shredder 13 64-bit 4CPU328055%
17.5/32
44%
7/16
 46%
18.5/40
   31%
15.5/50
 
Fizbo 2 64-bit 4CPU327569%
22/32
39%
12.5/32
 44%
17.5/40
   36%
14.5/40
 
Andscacs 0.94 64-bit 4CPU3263 60%
14.5/24
 52%
21/40
     
Booot 6.3.1 64-bit 4CPU3263 62%
18.5/30
 64%
25.5/40
     
Fire 7.1 64-bit3257  63%
33/52
 51%
26.5/52
52%
30/58
51%
20.5/40
 28%
11/40
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Xiphos 0.4 64-bit 4CPU3251 71%
17/24
 64%
25.5/40
     
Ethereal 11.25 64-bit3238    54%
28/52
53%
30.5/58
   
Xiphos 0.5 64-bit3230    57%
29.5/52
53%
27.5/52
   
Ethereal 11.00 64-bit3224     58%
30/52
49%
19.5/40
  
Laser 1.6 64-bit 4CPU3217 60%
14.5/24
 59%
23.5/40
     
Laser 1.7 64-bit3210  61%
31.5/52
 68%
35.5/52
57%
29.5/52
   
RofChade 2.202 64-bit3206  61%
31.5/52
 66%
34.5/52
    
Defenchess 2.2 64-bit3205  64%
33.5/52
 61%
31.5/52
    
Booot 6.3.1 64-bit3201  64%
33.5/52
 62%
32.5/52
54%
31.5/58
56%
22.5/40
  
Shredder 13 64-bit3201  68%
35.5/52
 63%
33/52
53%
31/58
56%
22.5/40
 34%
13.5/40
Fizbo 2 64-bit3199  62%
32.5/52
 59%
30.5/52
63%
36.5/58
45%
18/40
 40%
16/40
Fritz 16 64-bit 4CPU3193 69%
16.5/24
 71%
28.5/40
   56%
28/50
 
Chiron 4 64-bit 4CPU3191 58%
14/24
 66%
26.5/40
   55%
16.5/30
 
Andscacs 0.95 64-bit3184    63%
33/52
59%
34/58
   
Gull 3 64-bit 4CPU3181   69%
27.5/40
   54%
21.5/40
 
Andscacs 0.93 64-bit3171     60%
31/52
  31%
12.5/40
Xiphos 0.4 64-bit3147     59%
30.5/52
60%
24/40
  
Laser 1.6 64-bit3129     67%
35/52
66%
26.5/40
  
Gull 3 64-bit3121     67%
35/52
65%
26/40
 40%
16/40
Chiron 4 64-bit3115      58%
23/40
 42%
17/40
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Strelka 5.5 64-bit3104 82%
18/22
 76%
30.5/40
  62%
25/40
64%
25.5/40
40%
16/40
Fritz 16 64-bit3102      74%
29.5/40
 45%
18/40
NirvanaChess 2.4 64-bit3102      59%
23.5/40
 48%
19/40
Nemorino 5.00 64-bit3089     76%
39.5/52
65%
26/40
  
Texel 1.07 64-bit3076      75%
30/40
 62%
25/40
Senpai 2.0 64-bit3035      81%
32.5/40
 48%
19/40
SmarThink 1.98 64-bit3027      69%
27.5/40
 64%
25.5/40
Sting SF 9.9 64-bit3012       80%
40/50
62%
25/40
Defenchess 1.1f 64-bit2997      78%
31/40
 58%
23/40
Wasp 3.0 64-bit2985      82%
33/40
 69%
27.5/40
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on February 26, 2020