CCRL 40/4
Downloads and Statistics
July 17, 2019
Testing summary:
Total: 2'068'038 games
played by 2'396 programs
27793 CPU days (X2 4600+)

White wins: 803'434 (38.9%)
Black wins: 650'049 (31.4%)
Draws: 614'555 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 7 engines!
7 selected engines played 800 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on July 17, 2019 with Bayeselo based on 2'068'038 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Elektro 1.2 64-bit 4CPU3175+16−1642.5%+53.946.5%1300 
99.9%
 PanChess 00.537 64-bit3138+15−1556.4%−43.350.7%1445
72.5%
 Bouquet 1.6 64-bit3133+14−1455.4%−37.154.1%1490
89.2%
 RobboLito 0.21Q 64-bit3120+15−1453.4%−24.050.3%1481
77.7%
 Vitruvius 1.11C 64-bit3113+14−1551.9%−16.251.0%1483
73.6%
 IvanHoe 9.46h 64-bit3107+14−1450.3%−6.151.0%1533
99.9%
 Bouquet 1.8 64-bit 4CPU3071+17−1732.2%+124.241.2%1256
 

Results matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3175       
2PanChess 00.537 64-bit3138  44 − 36
+14−6=60
+20
41.5 − 38.5
+16−13=51
−6
42.5 − 37.5
+18−13=49
−7
42.5 − 37.5
+15−10=55
−14
 
3Bouquet 1.6 64-bit3133 36 − 44
+6−14=60
−20
 38.5 − 41.5
+13−16=51
−23
41 − 39
+14−12=54
−13
41 − 39
+11−9=60
−19
 
4RobboLito 0.21Q 64-bit3120 38.5 − 41.5
+13−16=51
+6
41.5 − 38.5
+16−13=51
+23
 46.5 − 33.5
+23−10=47
+38
38.5 − 41.5
+10−13=57
−23
 
5Vitruvius 1.11C 64-bit3113 37.5 − 42.5
+13−18=49
+7
39 − 41
+12−14=54
+13
33.5 − 46.5
+10−23=47
−38
 38.5 − 41.5
+12−15=53
−17
 
6IvanHoe 9.46h 64-bit3107 37.5 − 42.5
+10−15=55
+14
39 − 41
+9−11=60
+19
41.5 − 38.5
+13−10=57
+23
41.5 − 38.5
+15−12=53
+17
  
7Bouquet 1.8 64-bit 4CPU3071       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3175 99.9100.0100.0100.0100.0100.0
2PanChess 00.537 64-bit31380.1 72.596.599.599.9100.0
3Bouquet 1.6 64-bit31330.027.5 89.297.899.6100.0
4RobboLito 0.21Q 64-bit31200.03.510.8 77.791.9100.0
5Vitruvius 1.11C 64-bit31130.00.52.222.3 73.6100.0
6IvanHoe 9.46h 64-bit31070.00.10.48.126.4 99.9
7Bouquet 1.8 64-bit 4CPU30710.00.00.00.00.00.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3175 000001496
2PanChess 00.537 64-bit31380 28962886289828980
3Bouquet 1.6 64-bit313302896 2971297329040
4RobboLito 0.21Q 64-bit3120028862971 296428940
5Vitruvius 1.11C 64-bit31130289829732964 29060
6IvanHoe 9.46h 64-bit310702898290428942906 0
7Bouquet 1.8 64-bit 4CPU3071149600000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Elektro 1.2 64-bit 4CPU3175 0.00.00.00.00.058.5
2PanChess 00.537 64-bit31380.0 98.798.699.097.30.0
3Bouquet 1.6 64-bit31330.098.7 100.0100.096.10.0
4RobboLito 0.21Q 64-bit31200.098.6100.0 100.096.00.0
5Vitruvius 1.11C 64-bit31130.099.0100.0100.0 96.40.0
6IvanHoe 9.46h 64-bit31070.097.396.196.096.4 0.0
7Bouquet 1.8 64-bit 4CPU307158.50.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 36 common opponents

Custom engine selection
NameEloElektro
1.2
64-bit
4CPU
PanChess
00.537
64-bit
Bouquet
1.6
64-bit
RobboLito
0.21Q
64-bit
Vitruvius
1.11C
64-bit
IvanHoe
9.46h
64-bit
Bouquet
1.8
64-bit
4CPU
Komodo 10.1 64-bit 4CPU342513%
7/52
     7%
3.5/52
Komodo 9 64-bit 4CPU338120%
6/30
     27%
8/30
Houdini 4 64-bit 4CPU333120%
10.5/52
     13%
6.5/50
Gull 3 64-bit 4CPU326045%
23.5/52
     25%
12.5/50
Fire 4 64-bit 4CPU325646%
24/52
     22%
11/50
Equinox 3.30 64-bit 4CPU325245%
23.5/52
     19%
9.5/50
Critter 1.6a 64-bit 4CPU323138%
20/52
     27%
13.5/50
Fritz 15 64-bit 4CPU322348%
25/52
     22%
11/50
Houdini 3 64-bit3217 45%
36/80
36%
28.5/80
31%
25/80
38%
30/80
28%
22.5/80
 
Komodo TCEC 64-bit3210 34%
17/50
34%
17/50
32%
13.5/42
32%
16/50
32%
16/50
 
Komodo 7a 64-bit3205 35%
17.5/50
36%
18/50
40%
20/50
34%
17/50
34%
17/50
 
Rybka 4.1 64-bit 4CPU320541%
21.5/52
     28%
14/50
Komodo CCT 64-bit3180 45%
36/80
45%
36/80
37%
29.5/79
41%
32.5/80
34%
27/80
 
Stockfish 4 64-bit3179 42%
33.5/80
46%
37/80
39%
31/80
39%
31.5/80
38%
30.5/80
 
Komodo 5.1 64-bit3164 44%
35/80
48%
38/80
42%
34/80
43%
34.5/80
39%
31.5/80
 
Critter 1.6a 64-bit3158 46%
36.5/80
48%
38/80
44%
35.5/80
39%
31.5/80
41%
32.5/79
 
Naum 4.6 64-bit 4CPU315152%
27/52
     43%
21.5/50
Chiron 3.01 64-bit 4CPU314555%
28.5/52
     35%
18/52
PanChess 00.537 64-bit3138  45%
36/80
48%
38.5/80
47%
37.5/80
47%
37.5/80
 
Bouquet 1.6 64-bit3133 55%
44/80
 52%
41.5/80
49%
39/80
49%
39/80
 
NameEloElektro
1.2
64-bit
4CPU
PanChess
00.537
64-bit
Bouquet
1.6
64-bit
RobboLito
0.21Q
64-bit
Vitruvius
1.11C
64-bit
IvanHoe
9.46h
64-bit
Bouquet
1.8
64-bit
4CPU
Stockfish 3 64-bit3128  46%
18/39
51%
20.5/40
48%
14.5/30
  
RobboLito 0.21Q 64-bit3120 52%
41.5/80
48%
38.5/80
 42%
33.5/80
52%
41.5/80
 
Vitruvius 1.11C 64-bit3113 53%
42.5/80
51%
41/80
58%
46.5/80
 52%
41.5/80
 
Hiarcs 14 4CPU310855%
28.5/52
     46%
23/50
Rybka 4.1 64-bit3108 68%
54.5/80
59%
47.5/80
54%
43/80
61%
48.5/80
57%
45.5/80
 
IvanHoe 9.46h 64-bit3107 53%
42.5/80
51%
41/80
48%
38.5/80
48%
38.5/80
  
Gull 2.1 64-bit3098 64%
47/73
61%
47/77
58%
45/78
61%
48.5/80
54%
42.5/78
 
Gull 2.2 64-bit3074 58%
41.5/72
58%
43.5/75
44%
32/72
52%
38/73
47%
35.5/76
 
Vajolet2 2.2 64-bit 4CPU306771%
37/52
     54%
28/52
Pedone 1.4.1 64-bit 4CPU306668%
35.5/52
     43%
22.5/52
Cheng 4.39 64-bit 4CPU306565%
34/52
     46%
23/50
Hannibal 1.3 64-bit2998 68%
54/80
69%
55/80
68%
54/80
62%
50/80
66%
53/80
 
Naum 4.2 64-bit2987 66%
53/80
75%
60/80
71%
56.5/80
68%
54/80
66%
52.5/80
 
Protector 1.5.0 64-bit2984 78%
62/80
73%
57.5/79
72%
57.5/80
69%
55.5/80
64%
51.5/80
 
Spark 1.0 64-bit2927 74%
59.5/80
80%
64/80
79%
63.5/80
76%
60.5/80
73%
58.5/80
 
Spike 1.4 Leiden2921 76%
61/80
79%
63.5/80
81%
65/80
74%
59/80
75%
60/80
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 17, 2019