CCRL 40/4
Downloads and Statistics
November 8, 2019
Testing summary:
Total: 2'127'795 games
played by 2'486 programs
28766 CPU days (X2 4600+)

White wins: 825'412 (38.8%)
Black wins: 667'151 (31.4%)
Draws: 635'232 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 8, 2019 with Bayeselo based on 2'127'795 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3399+14−1446.1%+25.949.4%1542 
100.0%
 Xiphos 0.4 64-bit 4CPU3324+18−1847.2%+17.246.1%1038
93.0%
 Xiphos 0.5 64-bit3307+13−1344.9%+34.349.2%1989
100.0%
 Xiphos 0.4.18 64-bit3245+18−1846.7%+24.544.5%959
92.3%
 Xiphos 0.4 64-bit3228+15−1549.4%+8.147.1%1555
100.0%
 Xiphos 0.3 64-bit3137+14−1453.4%−29.341.5%1658
100.0%
 Xiphos 0.1 64-bit 4CPU3077+20−2043.5%+40.341.4%804
87.3%
 Xiphos 0.2 64-bit3062+13−1353.4%−30.142.8%1967
99.5%
 Xiphos 0.1 64-bit3034+19−1950.7%−10.639.8%908
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3399         
2Xiphos 0.4 64-bit 4CPU3324         
3Xiphos 0.5 64-bit3307         
4Xiphos 0.4.18 64-bit3245         
5Xiphos 0.4 64-bit3228         
6Xiphos 0.3 64-bit3137         
7Xiphos 0.1 64-bit 4CPU3077         
8Xiphos 0.2 64-bit3062        22.5 − 17.5
+11−6=23
+7
9Xiphos 0.1 64-bit3034       17.5 − 22.5
+6−11=23
−7
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3399 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU33240.0 93.0100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit33070.07.0 100.0100.0100.0100.0100.0100.0
4Xiphos 0.4.18 64-bit32450.00.00.0 92.3100.0100.0100.0100.0
5Xiphos 0.4 64-bit32280.00.00.07.7 100.0100.0100.0100.0
6Xiphos 0.3 64-bit31370.00.00.00.00.0 100.0100.0100.0
7Xiphos 0.1 64-bit 4CPU30770.00.00.00.00.00.0 87.399.9
8Xiphos 0.2 64-bit30620.00.00.00.00.00.012.7 99.5
9Xiphos 0.1 64-bit30340.00.00.00.00.00.00.10.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3399 6289100011200
2Xiphos 0.4 64-bit 4CPU3324628 00013224712684
3Xiphos 0.5 64-bit3307910 13871292213066
4Xiphos 0.4.18 64-bit3245001387 1755724000
5Xiphos 0.4 64-bit32280012921755 13700379290
6Xiphos 0.3 64-bit313701322137241370 019981286
7Xiphos 0.1 64-bit 4CPU30771122470000 03
8Xiphos 0.2 64-bit306201266037919980 1927
9Xiphos 0.1 64-bit303408460290128631927 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3399 24.32.60.00.00.04.80.00.0
2Xiphos 0.4 64-bit 4CPU332424.3 0.00.00.04.913.44.24.3
3Xiphos 0.5 64-bit33072.60.0 47.036.55.80.00.20.2
4Xiphos 0.4.18 64-bit32450.00.047.0 69.827.70.00.00.0
5Xiphos 0.4 64-bit32280.00.036.569.8 42.60.010.811.8
6Xiphos 0.3 64-bit31370.04.95.827.742.6 0.055.150.1
7Xiphos 0.1 64-bit 4CPU30774.813.40.00.00.00.0 0.00.2
8Xiphos 0.2 64-bit30620.04.20.20.010.855.10.0 67.0
9Xiphos 0.1 64-bit30340.04.30.20.011.850.10.267.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 63 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU354926%
19/72
16%
17/108
       
Stockfish 10 64-bit3493  20%
18/91
10%
6.5/64
9%
6/64
    
Stockfish 9 64-bit3483    16%
9.5/60
  0%
0/1
 
Houdini 6 64-bit3445  24%
21.5/91
24%
15.5/64
22%
13.5/61
    
Komodo 12 64-bit3412    22%
13.5/60
0%
0/1
   
Komodo 12.3 MCTS 64-bit 4CPU340850%
36.5/73
30%
29.5/98
       
Ethereal 11.25 64-bit 4CPU339352%
13/25
43%
35/82
       
Fire 7.1 64-bit3339  51%
45.5/90
37%
23.5/64
35%
21/60
    
Andscacs 0.95 64-bit 4CPU333654%
13.5/25
38%
12.5/33
       
Komodo 12.3 MCTS 64-bit3326  47%
23.5/50
34%
22/64
36%
36.5/100
    
Booot 6.3.1 64-bit 4CPU332554%
13.5/25
56%
28/50
       
Stoofvlees II a10 GTX980Ti331869%
34/49
 43%
18/42
      
Ethereal 11.25 64-bit3307  52%
46.5/90
 50%
0.5/1
    
Ethereal 11.00 64-bit3302   41%
26.5/64
40%
24/60
31%
18.5/60
   
Schooner 2.0.34 64-bit 4CPU327670%
17.5/25
60%
26.5/44
       
Laser 1.7 64-bit3274  53%
48/90
48%
30.5/64
     
Shredder 13 64-bit3271  58%
29/50
41%
26/64
45%
27/60
    
Booot 6.3.1 64-bit3255  63%
31.5/50
55%
35.5/64
46%
27.5/60
34%
21.5/64
   
Fizbo 2 64-bit3247  59%
30/51
41%
26/64
47%
28/60
0%
0/1
   
Chiron 4 64-bit 4CPU324178%
56.5/72
     22%
9/40
  
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Andscacs 0.95 64-bit3239  65%
26/40
48%
30.5/64
54%
33.5/62
    
Andscacs 0.94 64-bit3230    48%
28.5/60
37%
23.5/64
   
Texel 1.07 64-bit 4CPU3205 67%
30/45
    26%
10.5/40
  
Schooner 2.0.34 64-bit3193  62%
25/40
63%
40.5/64
59%
19.5/33
    
Laser 1.6 64-bit3188   66%
41.5/63
48%
29/60
41%
26/64
   
Senpai 2.0 64-bit 4CPU3176 83%
38/46
    34%
13.5/40
  
Chiron 4 64-bit3165  65%
26/40
59%
38/64
62%
37.5/60
51%
25.5/50
   
Critter 1.6a 64-bit3158   65%
41.5/64
61%
36.5/60
42%
21/50
   
Fritz 15 64-bit3146   68%
43.5/64
61%
36.5/60
47%
23.5/50
   
Ethereal 10.00 64-bit3144     44%
22/50
 39%
19.5/50
 
Strelka 5.5 64-bit3141 86%
31/36
    39%
15.5/40
  
NirvanaChess 2.4 64-bit3131    71%
42.5/60
44%
22.5/51
 40%
16/40
32%
9.5/30
RofChade 2.0 64-bit3130  70%
28/40
 56%
18/32
    
Nemorino 5.00 64-bit3117    63%
38/60
53%
26/49
   
Texel 1.07 64-bit3113    70%
42/60
50%
25/50
 40%
28.5/72
46%
18.5/40
Hannibal 1.7 64-bit3111    75%
45/60
59%
30/51
 38%
27/72
40%
12.5/31
Rybka 4.1 64-bit3108     53%
27.5/52
 45%
37/83
28%
9/32
Pedone 1.8 64-bit3107    62%
38/61
52%
16.5/32
   
Laser 1.5 64-bit3095     58%
71/122
 42%
34.5/82
54%
21/39
Protector 1.9.0 64-bit3085  100%
1/1
 50%
0.5/1
64%
32/50
 47%
38/81
35%
11/31
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Senpai 2.0 64-bit3085     62%
31.5/51
 48%
39.5/82
42%
17/40
Vajolet2 2.6 64-bit3084    50%
0.5/1
  51%
25.5/50
 
iCE 3.0 64-bit3081 78%
34.5/44
   61%
75/123
 45%
37/82
45%
18/40
Nemorino 4.00 64-bit3067     61%
30.5/50
 49%
35/72
35%
11/31
Arasan 20.5 64-bit3060     61%
30.5/50
 50%
16/32
41%
16.5/40
Pedone 1.7 64-bit3053       45%
37/82
45%
14.5/32
ChessBrainVB 3.723048  100%
1/1
 50%
0.5/1
    
Defenchess 1.1f 64-bit3047  100%
1/1
  66%
49/74
 53%
38.5/72
48%
15.5/32
Arasan 20.4.1 64-bit3044       56%
22.5/40
52%
16.5/32
Vajolet2 2.5 64-bit3040       57%
47/82
50%
16/32
SmarThink 1.98 64-bit3038    50%
0.5/1
67%
33.5/50
 58%
42/72
42%
13/31
Naum 4.6 64-bit3032     59%
42.5/72
 59%
48.5/82
52%
16.5/32
Hakkapeliitta TCEC v2 64-bit3021      75%
30/40
 100%
1/1
Hakkapeliitta 3.0 64-bit2985       65%
47/72
47%
15/32
Wasp 2.6 64-bit2978       65%
26/40
58%
18.5/32
Bobcat 8.0 64-bit2958    50%
0.5/1
  71%
28.5/40
73%
23.5/32
Cheng 4.39 64-bit2946     75%
56/75
 70%
28/40
66%
21/32
Rodent III 0.232 64-bit2915     50%
0.5/1
 69%
27.5/40
 
DiscoCheck 5.2.1 64-bit2914    100%
1/1
100%
1/1
   
Delocto 0.6 64-bit2610     100%
1/1
 100%
2/2
 
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Brutus 8.05 64-bit2557     100%
1/1
 100%
1/1
 
Winter 0.1.1 64-bit2481     100%
1/1
 100%
2/2
 
Matacz 1.42446     100%
1/1
 100%
1/1
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 8, 2019