CCRL 40/4
Downloads and Statistics
September 21, 2019
Testing summary:
Total: 2'102'110 games
played by 2'449 programs
28319 CPU days (X2 4600+)

White wins: 816'272 (38.8%)
Black wins: 660'160 (31.4%)
Draws: 625'678 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 7 engines!
7 selected engines played 800 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on September 21, 2019 with Bayeselo based on 2'102'110 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Elektro 1.2 64-bit 4CPU3176+16−1642.5%+54.246.5%1300 
99.9%
 PanChess 00.537 64-bit3139+15−1556.4%−43.950.7%1445
72.5%
 Bouquet 1.6 64-bit3133+14−1455.4%−36.654.1%1490
89.2%
 RobboLito 0.21Q 64-bit3121+14−1553.4%−24.750.3%1481
77.7%
 Vitruvius 1.11C 64-bit3113+14−1451.9%−15.851.0%1483
73.6%
 IvanHoe 9.46h 64-bit3107+14−1450.3%−5.651.0%1533
99.8%
 Bouquet 1.8 64-bit 4CPU3072+17−1732.2%+124.541.2%1256
 

Results matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3176       
2PanChess 00.537 64-bit3139  44 − 36
+14−6=60
+19
41.5 − 38.5
+16−13=51
−6
42.5 − 37.5
+18−13=49
−8
42.5 − 37.5
+15−10=55
−15
 
3Bouquet 1.6 64-bit3133 36 − 44
+6−14=60
−19
 38.5 − 41.5
+13−16=51
−22
41 − 39
+14−12=54
−13
41 − 39
+11−9=60
−19
 
4RobboLito 0.21Q 64-bit3121 38.5 − 41.5
+13−16=51
+6
41.5 − 38.5
+16−13=51
+22
 46.5 − 33.5
+23−10=47
+37
38.5 − 41.5
+10−13=57
−24
 
5Vitruvius 1.11C 64-bit3113 37.5 − 42.5
+13−18=49
+8
39 − 41
+12−14=54
+13
33.5 − 46.5
+10−23=47
−37
 38.5 − 41.5
+12−15=53
−17
 
6IvanHoe 9.46h 64-bit3107 37.5 − 42.5
+10−15=55
+15
39 − 41
+9−11=60
+19
41.5 − 38.5
+13−10=57
+24
41.5 − 38.5
+15−12=53
+17
  
7Bouquet 1.8 64-bit 4CPU3072       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3176 99.9100.0100.0100.0100.0100.0
2PanChess 00.537 64-bit31390.1 72.596.599.599.9100.0
3Bouquet 1.6 64-bit31330.027.5 89.297.899.6100.0
4RobboLito 0.21Q 64-bit31210.03.510.8 77.791.9100.0
5Vitruvius 1.11C 64-bit31130.00.52.222.3 73.6100.0
6IvanHoe 9.46h 64-bit31070.00.10.48.126.4 99.8
7Bouquet 1.8 64-bit 4CPU30720.00.00.00.00.00.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3176 000001496
2PanChess 00.537 64-bit31390 28962886289828980
3Bouquet 1.6 64-bit313302896 2971297329040
4RobboLito 0.21Q 64-bit3121028862971 296428940
5Vitruvius 1.11C 64-bit31130289829732964 29060
6IvanHoe 9.46h 64-bit310702898290428942906 0
7Bouquet 1.8 64-bit 4CPU3072149600000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3176 0.00.00.00.00.058.5
2PanChess 00.537 64-bit31390.0 98.798.699.097.30.0
3Bouquet 1.6 64-bit31330.098.7 100.0100.096.10.0
4RobboLito 0.21Q 64-bit31210.098.6100.0 100.096.00.0
5Vitruvius 1.11C 64-bit31130.099.0100.0100.0 96.40.0
6IvanHoe 9.46h 64-bit31070.097.396.196.096.4 0.0
7Bouquet 1.8 64-bit 4CPU307258.50.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 36 common opponents

Custom engine selection
NameEloElektro
1.2
64-bit
4CPU
PanChess
00.537
64-bit
Bouquet
1.6
64-bit
RobboLito
0.21Q
64-bit
Vitruvius
1.11C
64-bit
IvanHoe
9.46h
64-bit
Bouquet
1.8
64-bit
4CPU
Komodo 10.1 64-bit 4CPU342713%
7/52
     7%
3.5/52
Komodo 9 64-bit 4CPU338320%
6/30
     27%
8/30
Houdini 4 64-bit 4CPU333220%
10.5/52
     13%
6.5/50
Gull 3 64-bit 4CPU326145%
23.5/52
     25%
12.5/50
Fire 4 64-bit 4CPU325746%
24/52
     22%
11/50
Equinox 3.30 64-bit 4CPU325545%
23.5/52
     19%
9.5/50
Critter 1.6a 64-bit 4CPU323338%
20/52
     27%
13.5/50
Fritz 15 64-bit 4CPU322448%
25/52
     22%
11/50
Houdini 3 64-bit3217 45%
36/80
36%
28.5/80
31%
25/80
38%
30/80
28%
22.5/80
 
Komodo TCEC 64-bit3211 34%
17/50
34%
17/50
32%
13.5/42
32%
16/50
32%
16/50
 
Komodo 7a 64-bit3206 35%
17.5/50
36%
18/50
40%
20/50
34%
17/50
34%
17/50
 
Rybka 4.1 64-bit 4CPU320641%
21.5/52
     28%
14/50
Komodo CCT 64-bit3181 45%
36/80
45%
36/80
37%
29.5/79
41%
32.5/80
34%
27/80
 
Stockfish 4 64-bit3180 42%
33.5/80
46%
37/80
39%
31/80
39%
31.5/80
38%
30.5/80
 
Komodo 5.1 64-bit3164 44%
35/80
48%
38/80
42%
34/80
43%
34.5/80
39%
31.5/80
 
Critter 1.6a 64-bit3158 46%
36.5/80
48%
38/80
44%
35.5/80
39%
31.5/80
41%
32.5/79
 
Naum 4.6 64-bit 4CPU315352%
27/52
     43%
21.5/50
Chiron 3.01 64-bit 4CPU314655%
28.5/52
     35%
18/52
PanChess 00.537 64-bit3139  45%
36/80
48%
38.5/80
47%
37.5/80
47%
37.5/80
 
Bouquet 1.6 64-bit3133 55%
44/80
 52%
41.5/80
49%
39/80
49%
39/80
 
NameEloElektro
1.2
64-bit
4CPU
PanChess
00.537
64-bit
Bouquet
1.6
64-bit
RobboLito
0.21Q
64-bit
Vitruvius
1.11C
64-bit
IvanHoe
9.46h
64-bit
Bouquet
1.8
64-bit
4CPU
Stockfish 3 64-bit3128  46%
18/39
51%
20.5/40
48%
14.5/30
  
RobboLito 0.21Q 64-bit3121 52%
41.5/80
48%
38.5/80
 42%
33.5/80
52%
41.5/80
 
Vitruvius 1.11C 64-bit3113 53%
42.5/80
51%
41/80
58%
46.5/80
 52%
41.5/80
 
Hiarcs 14 4CPU310955%
28.5/52
     46%
23/50
Rybka 4.1 64-bit3109 68%
54.5/80
59%
47.5/80
54%
43/80
61%
48.5/80
57%
45.5/80
 
IvanHoe 9.46h 64-bit3107 53%
42.5/80
51%
41/80
48%
38.5/80
48%
38.5/80
  
Gull 2.1 64-bit3098 64%
47/73
61%
47/77
58%
45/78
61%
48.5/80
54%
42.5/78
 
Gull 2.2 64-bit3075 58%
41.5/72
58%
43.5/75
44%
32/72
52%
38/73
47%
35.5/76
 
Vajolet2 2.2 64-bit 4CPU306871%
37/52
     54%
28/52
Pedone 1.4.1 64-bit 4CPU306768%
35.5/52
     43%
22.5/52
Cheng 4.39 64-bit 4CPU306565%
34/52
     46%
23/50
Hannibal 1.3 64-bit2998 68%
54/80
69%
55/80
68%
54/80
62%
50/80
66%
53/80
 
Naum 4.2 64-bit2987 66%
53/80
75%
60/80
71%
56.5/80
68%
54/80
66%
52.5/80
 
Protector 1.5.0 64-bit2984 78%
62/80
73%
57.5/79
72%
57.5/80
69%
55.5/80
64%
51.5/80
 
Spark 1.0 64-bit2927 74%
59.5/80
80%
64/80
79%
63.5/80
76%
60.5/80
73%
58.5/80
 
Spike 1.4 Leiden2922 76%
61/80
79%
63.5/80
81%
65/80
74%
59/80
75%
60/80
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 21, 2019