CCRL 40/40
Downloads and Statistics
June 15, 2019
Testing summary:
Total: 1'059'406 games
played by 2'473 programs
144801 CPU days (X2 4600+)

White wins: 368'317 (34.8%)
Black wins: 274'199 (25.9%)
Draws: 416'890 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 7 engines!
7 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on June 15, 2019 with Bayeselo based on 1'059'406 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 12.3 MCTS 64-bit 4CPU3292+24−2447.6%+14.855.1%514 
63.7%
 Komodo 13.01 MCTS 64-bit3286+21−2152.5%−14.263.4%606
70.2%
 Komodo 12.2.2 MCTS 64-bit 4CPU3277+23−2253.9%−23.855.4%560
99.8%
 Komodo 12.3 MCTS 64-bit3236+14−1450.4%−2.954.6%1616
98.1%
 Komodo 12.2.2 MCTS 64-bit3214+16−1662.4%−83.545.3%1350
99.6%
 Komodo 12.1.1 MCTS 64-bit 4CPU3182+16−1649.9%−0.649.3%1142
100.0%
 Komodo 12.1.1 MCTS 64-bit3080+15−1646.9%+24.539.9%1430
 

Results matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3292       
2Komodo 13.01 MCTS 64-bit3286       
3Komodo 12.2.2 MCTS 64-bit 4CPU3277       
4Komodo 12.3 MCTS 64-bit3236       
5Komodo 12.2.2 MCTS 64-bit3214       
6Komodo 12.1.1 MCTS 64-bit 4CPU3182       
7Komodo 12.1.1 MCTS 64-bit3080       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3292 63.781.0100.0100.0100.0100.0
2Komodo 13.01 MCTS 64-bit328636.3 70.2100.0100.0100.0100.0
3Komodo 12.2.2 MCTS 64-bit 4CPU327719.029.8 99.8100.0100.0100.0
4Komodo 12.3 MCTS 64-bit32360.00.00.2 98.1100.0100.0
5Komodo 12.2.2 MCTS 64-bit32140.00.00.01.9 99.6100.0
6Komodo 12.1.1 MCTS 64-bit 4CPU31820.00.00.00.00.4 100.0
7Komodo 12.1.1 MCTS 64-bit30800.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3292 072006240062
2Komodo 13.01 MCTS 64-bit32860 8612785480344
3Komodo 12.2.2 MCTS 64-bit 4CPU327772086 120240670240
4Komodo 12.3 MCTS 64-bit323601278120 11920690
5Komodo 12.2.2 MCTS 64-bit3214625482401192 1701200
6Komodo 12.1.1 MCTS 64-bit 4CPU318240006700170 440
7Komodo 12.1.1 MCTS 64-bit3080623442406901200440 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3292 0.067.00.03.324.23.2
2Komodo 13.01 MCTS 64-bit32860.0 7.457.528.00.016.9
3Komodo 12.2.2 MCTS 64-bit 4CPU327767.07.4 5.512.639.412.1
4Komodo 12.3 MCTS 64-bit32360.057.55.5 40.20.022.7
5Komodo 12.2.2 MCTS 64-bit32143.328.012.640.2 6.843.2
6Komodo 12.1.1 MCTS 64-bit 4CPU318224.20.039.40.06.8 17.1
7Komodo 12.1.1 MCTS 64-bit30803.216.912.122.743.217.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 44 common opponents

Custom engine selection
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Stockfish 10 64-bit3389 34%
15.5/46
 20%
11.5/58
19%
13/70
  
SugaR 1.6.1 64-bit3385 40%
18.5/46
 25%
19.5/78
   
ShashChess 8.0 64-bit3368 39%
18/46
 29%
15/52
   
SugaR XPrO 1.4 64-bit3368   29%
15/52
  16%
6.5/40
Stockfish 9 64-bit3367  28%
11/40
 32%
13/40
20%
10/50
11%
4.5/40
Houdini 6 64-bit3334 45%
20.5/46
28%
11/40
33%
27/82
26%
10.5/40
 9%
3.5/40
Komodo 12.2.2 64-bit3326   35%
18/52
28%
11/40
  
Fire 7.1 64-bit 4CPU332140%
17/42
 42%
17/40
  26%
13/50
 
Houdini 6 Tactical 64-bit3314     25%
12.5/50
16%
6.5/40
MateFinder 9 64-bit3314     30%
15/50
15%
6/40
Ethereal 11.00 64-bit 4CPU329948%
12.5/26
 46%
18.5/40
    
Deep Shredder 13 64-bit 4CPU328044%
7/16
 46%
18.5/40
  31%
15.5/50
 
Fizbo 2 64-bit 4CPU327839%
12.5/32
 44%
17.5/40
  36%
14.5/40
 
Andscacs 0.94 64-bit 4CPU326460%
14.5/24
 52%
21/40
    
Booot 6.3.1 64-bit 4CPU326362%
18.5/30
 64%
25.5/40
    
Fire 7.1 64-bit3259 52%
24/46
 52%
30/58
51%
20.5/40
 28%
11/40
Xiphos 0.4 64-bit 4CPU325271%
17/24
 64%
25.5/40
    
Ethereal 11.25 64-bit3238 53%
24.5/46
 53%
30.5/58
   
Xiphos 0.5 64-bit3237 59%
27/46
 53%
27.5/52
   
Ethereal 11.00 64-bit3225   58%
30/52
49%
19.5/40
  
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Laser 1.6 64-bit 4CPU321860%
14.5/24
 59%
23.5/40
    
Laser 1.7 64-bit3212 68%
31.5/46
 57%
29.5/52
   
Booot 6.3.1 64-bit3203 62%
30/48
 54%
31.5/58
56%
22.5/40
  
Shredder 13 64-bit3202 63%
29/46
 53%
31/58
56%
22.5/40
 34%
13.5/40
Fizbo 2 64-bit3200 60%
27.5/46
 63%
36.5/58
45%
18/40
 40%
16/40
Fritz 16 64-bit 4CPU319369%
16.5/24
 71%
28.5/40
  56%
28/50
 
Chiron 4 64-bit 4CPU319258%
14/24
 66%
26.5/40
  55%
16.5/30
 
Andscacs 0.95 64-bit3186 64%
30.5/48
 59%
34/58
   
Gull 3 64-bit 4CPU3180  69%
27.5/40
  54%
21.5/40
 
Andscacs 0.93 64-bit3171   60%
31/52
  31%
12.5/40
Xiphos 0.4 64-bit3152   59%
30.5/52
60%
24/40
  
Laser 1.6 64-bit3130   67%
35/52
66%
26.5/40
  
Gull 3 64-bit3120   67%
35/52
65%
26/40
 40%
16/40
Chiron 4 64-bit3114    58%
23/40
 42%
17/40
Strelka 5.5 64-bit310482%
18/22
 76%
30.5/40
 62%
25/40
64%
25.5/40
40%
16/40
NirvanaChess 2.4 64-bit3102    59%
23.5/40
 48%
19/40
Fritz 16 64-bit3101    74%
29.5/40
 45%
18/40
Nemorino 5.00 64-bit3089   76%
39.5/52
65%
26/40
  
Texel 1.07 64-bit3076    75%
30/40
 62%
25/40
Senpai 2.0 64-bit3037    81%
32.5/40
 48%
19/40
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
SmarThink 1.98 64-bit3026    69%
27.5/40
 64%
25.5/40
Sting SF 9.9 64-bit3010     80%
40/50
62%
25/40
Defenchess (SCTR) 1.1f 64-bit2997    78%
31/40
 58%
23/40
Wasp 3.0 64-bit2984    82%
33/40
 69%
27.5/40
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on June 15, 2019