CCRL 40/15
Downloads and Statistics
August 8, 2020
Testing summary:
Total: 1'167'960 games
played by 2'693 programs

White wins: 402'856 (34.5%)
Black wins: 297'658 (25.5%)
Draws: 467'446 (40.0%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on August 8, 2020 with Bayeselo based on 1'167'960 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 13.2.5 MCTS 64-bit 4CPU3365+20−1953.2%−17.771.0%696 
100.0%
 Komodo 12.3 MCTS 64-bit 4CPU3294+22−2247.0%+17.955.0%604
48.9%
 Komodo 13.3 MCTS 64-bit3294+20−2051.6%−8.163.6%703
59.2%
 Komodo 14 MCTS 64-bit3291+22−2243.4%+40.859.4%577
80.1%
 Komodo 13.2.5 MCTS 64-bit3279+16−1646.1%+24.361.4%1114
55.6%
 Komodo 12.2.2 MCTS 64-bit 4CPU3277+23−2353.9%−24.155.4%560
49.4%
 Komodo 13.01 MCTS 64-bit3277+18−1852.2%−12.263.2%904
100.0%
 Komodo 12.3 MCTS 64-bit3234+14−1450.4%−2.354.6%1616
97.8%
 Komodo 12.2.2 MCTS 64-bit3213+16−1662.4%−83.145.3%1350
99.6%
 Komodo 12.1.1 MCTS 64-bit 4CPU3182+17−1649.9%−0.849.3%1142
100.0%
 Komodo 12.1.1 MCTS 64-bit3080+16−1646.9%+24.439.9%1430
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3365           
2Komodo 12.3 MCTS 64-bit 4CPU3294           
3Komodo 13.3 MCTS 64-bit3294           
4Komodo 14 MCTS 64-bit3291           
5Komodo 13.2.5 MCTS 64-bit3279           
6Komodo 12.2.2 MCTS 64-bit 4CPU3277           
7Komodo 13.01 MCTS 64-bit3277           
8Komodo 12.3 MCTS 64-bit3234           
9Komodo 12.2.2 MCTS 64-bit3213           
10Komodo 12.1.1 MCTS 64-bit 4CPU3182           
11Komodo 12.1.1 MCTS 64-bit3080           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3365 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Komodo 12.3 MCTS 64-bit 4CPU32940.0 48.957.284.585.486.6100.0100.0100.0100.0
3Komodo 13.3 MCTS 64-bit32940.051.1 59.288.286.489.7100.0100.0100.0100.0
4Komodo 14 MCTS 64-bit32910.042.840.8 80.179.682.4100.0100.0100.0100.0
5Komodo 13.2.5 MCTS 64-bit32790.015.511.819.9 55.656.0100.0100.0100.0100.0
6Komodo 12.2.2 MCTS 64-bit 4CPU32770.014.613.620.444.4 49.499.9100.0100.0100.0
7Komodo 13.01 MCTS 64-bit32770.013.410.317.644.050.6 100.0100.0100.0100.0
8Komodo 12.3 MCTS 64-bit32340.00.00.00.00.00.10.0 97.8100.0100.0
9Komodo 12.2.2 MCTS 64-bit32130.00.00.00.00.00.00.02.2 99.6100.0
10Komodo 12.1.1 MCTS 64-bit 4CPU31820.00.00.00.00.00.00.00.00.4 100.0
11Komodo 12.1.1 MCTS 64-bit30800.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3365 4280002160002360
2Komodo 12.3 MCTS 64-bit 4CPU3294428 000720006240062
3Komodo 13.3 MCTS 64-bit329400 905946923123481840184
4Komodo 14 MCTS 64-bit329100905 7633616813296096
5Komodo 13.2.5 MCTS 64-bit327900946763 9210408925820368
6Komodo 12.2.2 MCTS 64-bit 4CPU3277216720923692 92120240670240
7Komodo 13.01 MCTS 64-bit327700312168104092 13465820368
8Komodo 12.3 MCTS 64-bit3234003481328921201346 11920690
9Komodo 12.2.2 MCTS 64-bit3213062184965822405821192 1701200
10Komodo 12.1.1 MCTS 64-bit 4CPU318223640000067000170 440
11Komodo 12.1.1 MCTS 64-bit3080062184963682403686901200440 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3365 32.90.00.00.017.20.00.00.012.80.0
2Komodo 12.3 MCTS 64-bit 4CPU329432.9 0.00.00.061.90.00.03.222.93.0
3Komodo 13.3 MCTS 64-bit32940.00.0 70.752.17.319.415.09.00.08.6
4Komodo 14 MCTS 64-bit32910.00.070.7 45.13.211.36.05.00.04.8
5Komodo 13.2.5 MCTS 64-bit32790.00.052.145.1 5.551.532.723.60.014.5
6Komodo 12.2.2 MCTS 64-bit 4CPU327717.261.97.33.25.5 6.35.512.639.412.1
7Komodo 13.01 MCTS 64-bit32770.00.019.411.351.56.3 53.425.80.015.8
8Komodo 12.3 MCTS 64-bit32340.00.015.06.032.75.553.4 40.20.022.7
9Komodo 12.2.2 MCTS 64-bit32130.03.29.05.023.612.625.840.2 6.843.2
10Komodo 12.1.1 MCTS 64-bit 4CPU318212.822.90.00.00.039.40.00.06.8 17.1
11Komodo 12.1.1 MCTS 64-bit30800.03.08.64.814.512.115.822.743.217.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 62 common opponents

Custom engine selection
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Stockfish 2019-10-09 64-bit 4CPU349533%
10.5/32
30%
3/10
         
ShashChess 8.0 64-bit 4CPU344633%
10.5/32
28%
9/32
         
Stockfish 2019-12-10 64-bit3443  28%
14.5/52
19%
10/52
18%
11/60
      
Stockfish 11 64-bit3433  24%
12.5/52
25%
3/12
27%
14.5/54
      
SugaR XPro NN 1.0 64-bit3420   27%
14/52
23%
12/52
      
ShashChess 11.0 64-bit3402   30%
15.5/52
29%
15/52
      
Houdini 6 64-bit 4CPU340044%
14/32
28%
14.5/52
         
Stockfish 10 64-bit3387    25%
13/52
 35%
18/52
20%
11.5/58
19%
13/70
  
SugaR 1.6.1 64-bit3381      39%
20.5/52
25%
19.5/78
   
SugaR XPrO 1.4 64-bit3368       29%
15/52
  16%
6.5/40
Stockfish 9 64-bit3367     28%
11/40
  32%
13/40
20%
10/50
11%
4.5/40
ShashChess 8.0 64-bit3365    38%
20/52
 39%
20.5/52
29%
15/52
   
Komodo 13.3 64-bit3355  38%
20/52
44%
23/52
38%
20/52
      
Houdini 6 64-bit3339  41%
21.5/52
33%
4/12
39%
20.5/52
28%
11/40
42%
22/52
33%
27/82
26%
10.5/40
 9%
3.5/40
Komodo 12.2.2 64-bit3324       35%
18/52
28%
11/40
  
Fire 7.1 64-bit 4CPU332362%
20/32
40%
17/42
   42%
17/40
   26%
13/50
 
Houdini 6 Tactical 64-bit3314         25%
12.5/50
16%
6.5/40
MateFinder 9 64-bit3314         30%
15/50
15%
6/40
Ethereal 11.00 64-bit 4CPU3299 48%
12.5/26
   46%
18.5/40
     
Ethereal 12.25 64-bit3292  49%
25.5/52
50%
29/58
       
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Laser 1.7 64-bit 4CPU328659%
19/32
58%
18.5/32
         
Deep Shredder 13 64-bit 4CPU327955%
17.5/32
44%
7/16
   46%
18.5/40
   31%
15.5/50
 
Fizbo 2 64-bit 4CPU327469%
22/32
39%
12.5/32
   44%
17.5/40
   36%
14.5/40
 
Ethereal 12.00 64-bit3266  56%
29/52
50%
6/12
50%
26/52
      
SlowChess Blitz Classic 2.2 64-bit3264  56%
29/52
51%
30.5/60
       
Andscacs 0.94 64-bit 4CPU3263 60%
14.5/24
   52%
21/40
     
Booot 6.3.1 64-bit 4CPU3262 62%
18.5/30
   64%
25.5/40
     
Fire 7.1 64-bit3258  63%
33/52
60%
12/20
63%
33/52
 51%
26.5/52
52%
30/58
51%
20.5/40
 28%
11/40
Xiphos 0.6 64-bit3254  60%
31/52
55%
11.5/21
58%
30/52
      
Xiphos 0.4 64-bit 4CPU3251 71%
17/24
   64%
25.5/40
     
RofChade 2.3 64-bit3239  59%
30.5/52
58%
35/60
       
Booot 6.4 64-bit3238  54%
34/63
60%
12/20
       
Ethereal 11.25 64-bit3238      54%
28/52
53%
30.5/58
   
Xiphos 0.5 64-bit3230      57%
29.5/52
53%
27.5/52
   
Ethereal 11.00 64-bit3224       58%
30/52
49%
19.5/40
  
Laser 1.6 64-bit 4CPU3217 60%
14.5/24
   59%
23.5/40
     
Laser 1.7 64-bit3207  65%
34/52
67%
8/12
61%
31.5/52
 68%
35.5/52
57%
29.5/52
   
RofChade 2.202 64-bit3207    61%
31.5/52
 66%
34.5/52
    
Schooner 2.2 64-bit3205  69%
36/52
75%
9/12
62%
32/52
      
Defenchess 2.2 64-bit3202   75%
9/12
64%
33.5/52
 61%
31.5/52
    
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Booot 6.3.1 64-bit3201    64%
33.5/52
 62%
32.5/52
54%
31.5/58
56%
22.5/40
  
Shredder 13 64-bit3200    68%
35.5/52
 63%
33/52
53%
31/58
56%
22.5/40
 34%
13.5/40
Fizbo 2 64-bit3198    62%
32.5/52
 59%
30.5/52
63%
36.5/58
45%
18/40
 40%
16/40
Fritz 16 64-bit 4CPU3192 69%
16.5/24
   71%
28.5/40
   56%
28/50
 
Chiron 4 64-bit 4CPU3190 58%
14/24
   66%
26.5/40
   55%
16.5/30
 
Andscacs 0.95 64-bit3182      63%
33/52
59%
34/58
   
Gull 3 64-bit 4CPU3181     69%
27.5/40
   54%
21.5/40
 
Andscacs 0.93 64-bit3170       60%
31/52
  31%
12.5/40
Xiphos 0.4 64-bit3146       59%
30.5/52
60%
24/40
  
Laser 1.6 64-bit3131       67%
35/52
66%
26.5/40
  
Gull 3 64-bit3120       67%
35/52
65%
26/40
 40%
16/40
Chiron 4 64-bit3115        58%
23/40
 42%
17/40
Strelka 5.5 64-bit3104 82%
18/22
   76%
30.5/40
  62%
25/40
64%
25.5/40
40%
16/40
Fritz 16 64-bit3102        74%
29.5/40
 45%
18/40
NirvanaChess 2.4 64-bit3101        59%
23.5/40
 48%
19/40
Nemorino 5.00 64-bit3087       76%
39.5/52
65%
26/40
  
Texel 1.07 64-bit3075        75%
30/40
 62%
25/40
Senpai 2.0 64-bit3033        81%
32.5/40
 48%
19/40
SmarThink 1.98 64-bit3026        69%
27.5/40
 64%
25.5/40
Sting SF 9.9 64-bit3011         80%
40/50
62%
25/40
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Defenchess 1.1f 64-bit2997        78%
31/40
 58%
23/40
Wasp 3.0 64-bit2984        82%
33/40
 69%
27.5/40
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 8, 2020