CCRL 40/4
Downloads and Statistics
April 13, 2019
Testing summary:
Total: 1'978'909 games
played by 2'316 programs
26642 CPU days (X2 4600+)

White wins: 772'756 (39.0%)
Black wins: 624'315 (31.5%)
Draws: 581'838 (29.4%)
White score: 53.8%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on April 13, 2019 with Bayeselo based on 1'978'909 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3403+20−2055.7%−37.550.5%778 
100.0%
 Xiphos 0.4 64-bit 4CPU3323+18−1847.2%+16.946.1%1038
93.5%
 Xiphos 0.5 64-bit3303+17−1747.1%+21.450.3%1140
100.0%
 Xiphos 0.4.18 64-bit3242+18−1846.7%+25.244.5%959
91.2%
 Xiphos 0.4 64-bit3226+15−1449.4%+8.647.1%1555
100.0%
 Xiphos 0.3 64-bit3136+14−1453.4%−29.241.5%1658
100.0%
 Xiphos 0.1 64-bit 4CPU3076+20−2043.5%+41.141.4%804
87.8%
 Xiphos 0.2 64-bit3062+13−1353.4%−30.642.8%1967
99.5%
 Xiphos 0.1 64-bit3033+19−1950.7%−10.339.8%908
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403         
2Xiphos 0.4 64-bit 4CPU3323         
3Xiphos 0.5 64-bit3303         
4Xiphos 0.4.18 64-bit3242         
5Xiphos 0.4 64-bit3226         
6Xiphos 0.3 64-bit3136         
7Xiphos 0.1 64-bit 4CPU3076         
8Xiphos 0.2 64-bit3062        22.5 − 17.5
+11−6=23
+6
9Xiphos 0.1 64-bit3033       17.5 − 22.5
+6−11=23
−6
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU33230.0 93.5100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit33030.06.5 100.0100.0100.0100.0100.0100.0
4Xiphos 0.4.18 64-bit32420.00.00.0 91.2100.0100.0100.0100.0
5Xiphos 0.4 64-bit32260.00.00.08.8 100.0100.0100.0100.0
6Xiphos 0.3 64-bit31360.00.00.00.00.0 100.0100.0100.0
7Xiphos 0.1 64-bit 4CPU30760.00.00.00.00.00.0 87.899.9
8Xiphos 0.2 64-bit30620.00.00.00.00.00.012.2 99.5
9Xiphos 0.1 64-bit30330.00.00.00.00.00.00.10.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 628000011200
2Xiphos 0.4 64-bit 4CPU3323628 00013224712684
3Xiphos 0.5 64-bit330300 13841285207000
4Xiphos 0.4.18 64-bit3242001384 1755724000
5Xiphos 0.4 64-bit32260012851755 13700379290
6Xiphos 0.3 64-bit313601322077241370 019981286
7Xiphos 0.1 64-bit 4CPU30761122470000 03
8Xiphos 0.2 64-bit306201260037919980 1927
9Xiphos 0.1 64-bit303308400290128631927 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3403 34.60.00.00.00.07.10.00.0
2Xiphos 0.4 64-bit 4CPU332334.6 0.00.00.04.913.44.24.3
3Xiphos 0.5 64-bit33030.00.0 65.947.77.40.00.00.0
4Xiphos 0.4.18 64-bit32420.00.065.9 69.827.70.00.00.0
5Xiphos 0.4 64-bit32260.00.047.769.8 42.60.010.811.8
6Xiphos 0.3 64-bit31360.04.97.427.742.6 0.055.150.1
7Xiphos 0.1 64-bit 4CPU30767.113.40.00.00.00.0 0.00.2
8Xiphos 0.2 64-bit30620.04.20.00.010.855.10.0 67.0
9Xiphos 0.1 64-bit30330.04.30.00.011.850.10.267.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 61 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU354726%
19/72
16%
17/108
       
Stockfish 10 64-bit3496  20%
18/90
10%
6.5/64
9%
6/64
    
Stockfish 9 64-bit3482    16%
9.5/60
  0%
0/1
 
Houdini 6 64-bit3446  24%
21.5/90
24%
15.5/64
22%
13.5/61
    
Komodo 12 64-bit3411    22%
13.5/60
0%
0/1
   
Komodo 12.3 MCTS 64-bit 4CPU340950%
36.5/73
30%
29.5/98
       
Ethereal 11.25 64-bit 4CPU338952%
13/25
43%
35/82
       
Andscacs 0.95 64-bit 4CPU333554%
13.5/25
38%
12.5/33
       
Fire 7.1 64-bit3334  51%
45.5/90
37%
23.5/64
35%
21/60
    
Booot 6.3.1 64-bit 4CPU332454%
13.5/25
56%
28/50
       
Komodo 12.3 MCTS 64-bit3324  47%
23.5/50
34%
22/64
36%
36.5/100
    
Ethereal 11.25 64-bit3310  46%
23/50
 50%
0.5/1
    
Ethereal 11.00 64-bit3301   41%
26.5/64
40%
24/60
31%
18.5/60
   
Schooner 2.0.34 64-bit 4CPU327570%
17.5/25
60%
26.5/44
       
Laser 1.7 64-bit3271  53%
48/90
48%
30.5/64
     
Shredder 13 64-bit3270  58%
29/50
41%
26/64
45%
27/60
    
Booot 6.3.1 64-bit3254  63%
31.5/50
55%
35.5/64
46%
27.5/60
34%
21.5/64
   
Fizbo 2 64-bit3247  59%
29.5/50
41%
26/64
47%
28/60
0%
0/1
   
Chiron 4 64-bit 4CPU323978%
56.5/72
     22%
9/40
  
Andscacs 0.94 64-bit3229    48%
28.5/60
37%
23.5/64
   
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Andscacs 0.95 64-bit3224  65%
26/40
48%
30.5/64
54%
33.5/62
    
Texel 1.07 64-bit 4CPU3206 67%
30/45
    26%
10.5/40
  
Laser 1.6 64-bit3187   66%
41.5/63
48%
29/60
41%
26/64
   
Schooner 2.0.34 64-bit3187  62%
25/40
63%
40.5/64
59%
19.5/33
    
Senpai 2.0 64-bit 4CPU3176 83%
38/46
    34%
13.5/40
  
Chiron 4 64-bit3164  65%
26/40
59%
38/64
62%
37.5/60
51%
25.5/50
   
Critter 1.6a 64-bit3157   65%
41.5/64
61%
36.5/60
42%
21/50
   
Fritz 15 64-bit3144   68%
43.5/64
61%
36.5/60
47%
23.5/50
   
Ethereal 10.00 64-bit3143     44%
22/50
 39%
19.5/50
 
Strelka 5.5 64-bit3140 86%
31/36
    39%
15.5/40
  
NirvanaChess 2.4 64-bit3129    71%
42.5/60
44%
22.5/51
 40%
16/40
32%
9.5/30
RofChade 2.0 64-bit3128  70%
28/40
 56%
18/32
    
Nemorino 5.00 64-bit3118    63%
38/60
53%
26/49
   
Texel 1.07 64-bit3113    70%
42/60
50%
25/50
 40%
28.5/72
46%
18.5/40
Hannibal 1.7 64-bit3110    75%
45/60
59%
30/51
 38%
27/72
40%
12.5/31
Rybka 4.1 64-bit3107     53%
27.5/52
 45%
37/83
28%
9/32
Pedone 1.8 64-bit3106    62%
38/61
52%
16.5/32
   
Laser 1.5 64-bit3094     58%
71/122
 42%
34.5/82
54%
21/39
Protector 1.9.0 64-bit3084    50%
0.5/1
64%
32/50
 47%
38/81
35%
11/31
Senpai 2.0 64-bit3083     62%
31.5/51
 48%
39.5/82
42%
17/40
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Vajolet2 2.6 64-bit3083    50%
0.5/1
  51%
25.5/50
 
iCE 3.0 64-bit3080 78%
34.5/44
   61%
75/123
 45%
37/82
45%
18/40
Nemorino 4.00 64-bit3067     61%
30.5/50
 49%
35/72
35%
11/31
Arasan 20.5 64-bit3059     61%
30.5/50
 50%
16/32
41%
16.5/40
Pedone 1.7 64-bit3053       45%
37/82
45%
14.5/32
Defenchess (SCTR) 1.1f 64-bit3047     66%
49/74
 53%
38.5/72
48%
15.5/32
Arasan 20.4.1 64-bit3043       56%
22.5/40
52%
16.5/32
SmarThink 1.98 64-bit3039    50%
0.5/1
67%
33.5/50
 58%
42/72
42%
13/31
Vajolet2 2.5 64-bit3039       57%
47/82
50%
16/32
Naum 4.6 64-bit3032     59%
42.5/72
 59%
48.5/82
52%
16.5/32
Hakkapeliitta TCEC v2 64-bit3024      75%
30/40
 100%
1/1
Hakkapeliitta 3.0 64-bit2984       65%
47/72
47%
15/32
Wasp 2.6 64-bit2977       65%
26/40
58%
18.5/32
Bobcat 8.0 64-bit2960    50%
0.5/1
  71%
28.5/40
73%
23.5/32
Cheng 4.39 64-bit2943     75%
56/75
 70%
28/40
66%
21/32
Rodent III 0.232 64-bit2914     50%
0.5/1
 69%
27.5/40
 
DiscoCheck 5.2.1 64-bit2913    100%
1/1
100%
1/1
   
Delocto 0.6 64-bit2611     100%
1/1
 100%
2/2
 
Brutus 8.05 64-bit2556     100%
1/1
 100%
1/1
 
Winter 0.1.1 64-bit2480     100%
1/1
 100%
2/2
 
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Matacz 1.42446     100%
1/1
 100%
1/1
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on April 13, 2019