CCRL 40/4
Downloads and Statistics
October 12, 2019
Testing summary:
Total: 2'115'766 games
played by 2'468 programs
28564 CPU days (X2 4600+)

White wins: 821'094 (38.8%)
Black wins: 663'997 (31.4%)
Draws: 630'675 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 6 engines!
6 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on October 12, 2019 with Bayeselo based on 2'115'766 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 12.3 MCTS 64-bit 4CPU3411+15−1553.1%−19.351.8%1310 
100.0%
 Komodo 13.01 MCTS 64-bit3359+17−1766.2%−111.138.9%1233
99.9%
 Komodo 12.3 MCTS 64-bit3325+13−1359.0%−57.842.9%1886
99.9%
 Komodo 12.2.2 MCTS 64-bit3289+17−1759.5%−61.643.2%1108
100.0%
 Komodo 12.1.1 MCTS 64-bit3095+18−1852.7%−18.036.0%1037
100.0%
 Komodo 12 MCTS 64-bit3045+23−2348.9%+7.242.8%572
 

Results matrix

Custom engine selection
#NameElo123456
1Komodo 12.3 MCTS 64-bit 4CPU3411      
2Komodo 13.01 MCTS 64-bit3359      
3Komodo 12.3 MCTS 64-bit3325      
4Komodo 12.2.2 MCTS 64-bit3289      
5Komodo 12.1.1 MCTS 64-bit3095      
6Komodo 12 MCTS 64-bit3045      
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456
1Komodo 12.3 MCTS 64-bit 4CPU3411 100.0100.0100.0100.0100.0
2Komodo 13.01 MCTS 64-bit33590.0 99.9100.0100.0100.0
3Komodo 12.3 MCTS 64-bit33250.00.1 99.9100.0100.0
4Komodo 12.2.2 MCTS 64-bit32890.00.00.1 100.0100.0
5Komodo 12.1.1 MCTS 64-bit30950.00.00.00.0 100.0
6Komodo 12 MCTS 64-bit30450.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456
1Komodo 12.3 MCTS 64-bit 4CPU3411 00000
2Komodo 13.01 MCTS 64-bit33590 22831205354162
3Komodo 12.3 MCTS 64-bit332502283 2026313162
4Komodo 12.2.2 MCTS 64-bit3289012052026 511270
5Komodo 12.1.1 MCTS 64-bit30950354313511 786
6Komodo 12 MCTS 64-bit30450162162270786 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456
1Komodo 12.3 MCTS 64-bit 4CPU3411 0.00.00.00.00.0
2Komodo 13.01 MCTS 64-bit33590.0 73.251.515.69.0
3Komodo 12.3 MCTS 64-bit33250.073.2 67.710.76.6
4Komodo 12.2.2 MCTS 64-bit32890.051.567.7 23.816.1
5Komodo 12.1.1 MCTS 64-bit30950.015.610.723.8 48.9
6Komodo 12 MCTS 64-bit30450.09.06.616.148.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 31 common opponents

Custom engine selection
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
Komodo
12
MCTS
64-bit
Stockfish 10 64-bit3493 28%
18/64
20%
19.5/100
   
Houdini 6 64-bit3444 30%
19/64
30%
29.5/99
23%
14.5/64
  
Fire 7.1 64-bit3338 52%
33/64
52%
52/100
39%
25/64
  
Ethereal 11.25 64-bit3306 59%
38/64
48%
48.5/100
   
Xiphos 0.5 64-bit3305 58%
37/64
53%
26.5/50
   
Ethereal 11.00 64-bit3302  55%
54.5/99
45%
28.5/64
  
Laser 1.7 64-bit3274 59%
38/64
62%
40/64
   
Shredder 13 64-bit3270 61%
39/64
56%
55/98
49%
31/63
  
Booot 6.3.1 64-bit3255 75%
48/64
60%
59.5/99
58%
36.5/63
  
Fizbo 2 64-bit3247 77%
49/64
58%
57.5/99
49%
31.5/64
  
Andscacs 0.95 64-bit3239 66%
42/64
76%
48.5/64
   
Xiphos 0.4 64-bit3227  64%
63.5/100
61%
30.5/50
  
RofChade 2.1 64-bit3216 73%
46.5/64
67%
33.5/50
   
Schooner 2.0.34 64-bit3192 69%
44/64
80%
80.5/100
64%
32/50
  
Laser 1.6 64-bit3188  75%
75/100
73%
36.5/50
  
Chiron 4 64-bit3164 81%
52/64
78%
78/100
72%
36/50
30%
19/63
44%
8/18
Critter 1.6a 64-bit3158 81%
52/64
74%
73.5/100
70%
35/50
 31%
5.5/18
Fritz 15 64-bit3146  74%
74.5/100
74%
37/50
  
NirvanaChess 2.4 64-bit3130 85%
54.5/64
74%
74.5/100
74%
37/50
51%
25.5/50
44%
8/18
Nemorino 5.00 64-bit3117 82%
51.5/63
 83%
40/48
44%
22/50
 
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
Komodo
12
MCTS
64-bit
Texel 1.07 64-bit3113   76%
38/50
42%
21/50
22%
4/18
Hannibal 1.7 64-bit3110   79%
39.5/50
53%
26.5/50
44%
8/18
Laser 1.5 64-bit3095    47%
23.5/50
56%
10/18
Protector 1.9.0 64-bit3085    52%
26/50
50%
9/18
Senpai 2.0 64-bit3085    44%
22/50
36%
6.5/18
iCE 3.0 64-bit3081    62%
31/50
36%
6.5/18
Nemorino 4.00 64-bit3067    55%
27.5/50
50%
9/18
Xiphos 0.2 64-bit3062    63%
31.5/50
50%
9/18
Arasan 20.5 64-bit3060    54%
61/113
36%
11.5/32
SmarThink 1.98 64-bit3037    75%
37.5/50
61%
11/18
Naum 4.6 64-bit3032    48%
31/64
55%
17.5/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 12, 2019