CCRL 40/40
Downloads and Statistics
October 12, 2019
Testing summary:
Total: 1'090'583 games
played by 2'551 programs
149018 CPU days (X2 4600+)

White wins: 378'348 (34.7%)
Black wins: 281'291 (25.8%)
Draws: 430'944 (39.5%)
White score: 54.4%

Custom engine selection

Comparing 7 engines!
7 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on October 12, 2019 with Bayeselo based on 1'090'583 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 12.3 MCTS 64-bit 4CPU3294+22−2247.3%+16.654.9%594 
85.0%
 Komodo 12.2.2 MCTS 64-bit 4CPU3277+23−2353.9%−23.655.4%560
54.9%
 Komodo 13.01 MCTS 64-bit3275+18−1851.3%−6.963.6%852
100.0%
 Komodo 12.3 MCTS 64-bit3235+14−1450.4%−3.254.6%1616
97.8%
 Komodo 12.2.2 MCTS 64-bit3213+16−1662.4%−82.945.3%1350
99.6%
 Komodo 12.1.1 MCTS 64-bit 4CPU3182+16−1649.9%−0.649.3%1142
100.0%
 Komodo 12.1.1 MCTS 64-bit3080+15−1546.9%+24.539.9%1430
 

Results matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3294       
2Komodo 12.2.2 MCTS 64-bit 4CPU3277       
3Komodo 13.01 MCTS 64-bit3275       
4Komodo 12.3 MCTS 64-bit3235       
5Komodo 12.2.2 MCTS 64-bit3213       
6Komodo 12.1.1 MCTS 64-bit 4CPU3182       
7Komodo 12.1.1 MCTS 64-bit3080       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3294 85.088.6100.0100.0100.0100.0
2Komodo 12.2.2 MCTS 64-bit 4CPU327715.0 54.999.9100.0100.0100.0
3Komodo 13.01 MCTS 64-bit327511.445.1 100.0100.0100.0100.0
4Komodo 12.3 MCTS 64-bit32350.00.10.0 97.8100.0100.0
5Komodo 12.2.2 MCTS 64-bit32130.00.00.02.2 99.6100.0
6Komodo 12.1.1 MCTS 64-bit 4CPU31820.00.00.00.00.4 100.0
7Komodo 12.1.1 MCTS 64-bit30800.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3294 720006240062
2Komodo 12.2.2 MCTS 64-bit 4CPU3277720 92120240670240
3Komodo 13.01 MCTS 64-bit3275092 13465820368
4Komodo 12.3 MCTS 64-bit323501201346 11920690
5Komodo 12.2.2 MCTS 64-bit3213622405821192 1701200
6Komodo 12.1.1 MCTS 64-bit 4CPU318240067000170 440
7Komodo 12.1.1 MCTS 64-bit3080622403686901200440 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3294 62.40.00.03.223.03.1
2Komodo 12.2.2 MCTS 64-bit 4CPU327762.4 6.55.512.639.412.1
3Komodo 13.01 MCTS 64-bit32750.06.5 54.526.40.016.1
4Komodo 12.3 MCTS 64-bit32350.05.554.5 40.20.022.7
5Komodo 12.2.2 MCTS 64-bit32133.212.626.440.2 6.843.2
6Komodo 12.1.1 MCTS 64-bit 4CPU318223.039.40.00.06.8 17.1
7Komodo 12.1.1 MCTS 64-bit30803.112.116.122.743.217.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 44 common opponents

Custom engine selection
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Stockfish 10 64-bit3387  35%
18/52
20%
11.5/58
19%
13/70
  
SugaR 1.6.1 64-bit3381  39%
20.5/52
25%
19.5/78
   
SugaR XPrO 1.4 64-bit3368   29%
15/52
  16%
6.5/40
Stockfish 9 64-bit3367 28%
11/40
  32%
13/40
20%
10/50
11%
4.5/40
ShashChess 8.0 64-bit3360  39%
20.5/52
29%
15/52
   
Houdini 6 64-bit3335 28%
11/40
42%
22/52
33%
27/82
26%
10.5/40
 9%
3.5/40
Komodo 12.2.2 64-bit3324   35%
18/52
28%
11/40
  
Fire 7.1 64-bit 4CPU332140%
17/42
42%
17/40
   26%
13/50
 
Houdini 6 Tactical 64-bit3314     25%
12.5/50
16%
6.5/40
MateFinder 9 64-bit3313     30%
15/50
15%
6/40
Ethereal 11.00 64-bit 4CPU330048%
12.5/26
46%
18.5/40
     
Deep Shredder 13 64-bit 4CPU328044%
7/16
46%
18.5/40
   31%
15.5/50
 
Fizbo 2 64-bit 4CPU327639%
12.5/32
44%
17.5/40
   36%
14.5/40
 
Andscacs 0.94 64-bit 4CPU326460%
14.5/24
52%
21/40
     
Booot 6.3.1 64-bit 4CPU326462%
18.5/30
64%
25.5/40
     
Fire 7.1 64-bit3257  51%
26.5/52
52%
30/58
51%
20.5/40
 28%
11/40
Xiphos 0.4 64-bit 4CPU325271%
17/24
64%
25.5/40
     
Ethereal 11.25 64-bit3238  54%
28/52
53%
30.5/58
   
Xiphos 0.5 64-bit3230  57%
29.5/52
53%
27.5/52
   
Ethereal 11.00 64-bit3224   58%
30/52
49%
19.5/40
  
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Laser 1.6 64-bit 4CPU321960%
14.5/24
59%
23.5/40
     
Laser 1.7 64-bit3211  68%
35.5/52
57%
29.5/52
   
Booot 6.3.1 64-bit3203  62%
32.5/52
54%
31.5/58
56%
22.5/40
  
Shredder 13 64-bit3201  63%
33/52
53%
31/58
56%
22.5/40
 34%
13.5/40
Fizbo 2 64-bit3198  59%
30.5/52
63%
36.5/58
45%
18/40
 40%
16/40
Fritz 16 64-bit 4CPU319369%
16.5/24
71%
28.5/40
   56%
28/50
 
Chiron 4 64-bit 4CPU319258%
14/24
66%
26.5/40
   55%
16.5/30
 
Andscacs 0.95 64-bit3183  63%
33/52
59%
34/58
   
Gull 3 64-bit 4CPU3180 69%
27.5/40
   54%
21.5/40
 
Andscacs 0.93 64-bit3170   60%
31/52
  31%
12.5/40
Xiphos 0.4 64-bit3150   59%
30.5/52
60%
24/40
  
Laser 1.6 64-bit3129   67%
35/52
66%
26.5/40
  
Gull 3 64-bit3120   67%
35/52
65%
26/40
 40%
16/40
Chiron 4 64-bit3115    58%
23/40
 42%
17/40
Strelka 5.5 64-bit310482%
18/22
76%
30.5/40
  62%
25/40
64%
25.5/40
40%
16/40
NirvanaChess 2.4 64-bit3102    59%
23.5/40
 48%
19/40
Fritz 16 64-bit3101    74%
29.5/40
 45%
18/40
Nemorino 5.00 64-bit3088   76%
39.5/52
65%
26/40
  
Texel 1.07 64-bit3076    75%
30/40
 62%
25/40
Senpai 2.0 64-bit3036    81%
32.5/40
 48%
19/40
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
SmarThink 1.98 64-bit3026    69%
27.5/40
 64%
25.5/40
Sting SF 9.9 64-bit3010     80%
40/50
62%
25/40
Defenchess 1.1f 64-bit2998    78%
31/40
 58%
23/40
Wasp 3.0 64-bit2985    82%
33/40
 69%
27.5/40
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 12, 2019