CCRL 40/4
Downloads and Statistics
October 22, 2019
Testing summary:
Total: 2'121'427 games
played by 2'481 programs
28688 CPU days (X2 4600+)

White wins: 823'094 (38.8%)
Black wins: 665'478 (31.4%)
Draws: 632'855 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 9 engines!
9 selected engines played 40 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on October 22, 2019 with Bayeselo based on 2'121'427 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Xiphos 0.5 64-bit 4CPU3398+15−1548.2%+11.150.6%1442 
100.0%
 Xiphos 0.4 64-bit 4CPU3323+18−1847.2%+17.746.1%1038
93.6%
 Xiphos 0.5 64-bit3306+13−1344.4%+37.249.3%1958
100.0%
 Xiphos 0.4.18 64-bit3244+18−1846.7%+25.044.5%959
92.3%
 Xiphos 0.4 64-bit3227+14−1549.4%+8.647.1%1555
100.0%
 Xiphos 0.3 64-bit3137+14−1453.4%−29.641.5%1658
100.0%
 Xiphos 0.1 64-bit 4CPU3076+20−2043.5%+41.141.4%804
87.6%
 Xiphos 0.2 64-bit3062+13−1353.4%−30.342.8%1967
99.5%
 Xiphos 0.1 64-bit3033+19−1950.7%−9.839.8%908
 

Results matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3398         
2Xiphos 0.4 64-bit 4CPU3323         
3Xiphos 0.5 64-bit3306         
4Xiphos 0.4.18 64-bit3244         
5Xiphos 0.4 64-bit3227         
6Xiphos 0.3 64-bit3137         
7Xiphos 0.1 64-bit 4CPU3076         
8Xiphos 0.2 64-bit3062        22.5 − 17.5
+11−6=23
+6
9Xiphos 0.1 64-bit3033       17.5 − 22.5
+6−11=23
−6
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3398 100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.4 64-bit 4CPU33230.0 93.6100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit33060.06.4 100.0100.0100.0100.0100.0100.0
4Xiphos 0.4.18 64-bit32440.00.00.0 92.3100.0100.0100.0100.0
5Xiphos 0.4 64-bit32270.00.00.07.7 100.0100.0100.0100.0
6Xiphos 0.3 64-bit31370.00.00.00.00.0 100.0100.0100.0
7Xiphos 0.1 64-bit 4CPU30760.00.00.00.00.00.0 87.699.9
8Xiphos 0.2 64-bit30620.00.00.00.00.00.012.4 99.5
9Xiphos 0.1 64-bit30330.00.00.00.00.00.00.10.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3398 6289100011200
2Xiphos 0.4 64-bit 4CPU3323628 00013224712684
3Xiphos 0.5 64-bit3306910 13871292213066
4Xiphos 0.4.18 64-bit3244001387 1755724000
5Xiphos 0.4 64-bit32270012921755 13700379290
6Xiphos 0.3 64-bit313701322137241370 019981286
7Xiphos 0.1 64-bit 4CPU30761122470000 03
8Xiphos 0.2 64-bit306201266037919980 1927
9Xiphos 0.1 64-bit303308460290128631927 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Xiphos 0.5 64-bit 4CPU3398 25.32.70.00.00.05.00.00.0
2Xiphos 0.4 64-bit 4CPU332325.3 0.00.00.04.913.44.24.3
3Xiphos 0.5 64-bit33062.70.0 47.536.85.90.00.20.2
4Xiphos 0.4.18 64-bit32440.00.047.5 69.827.70.00.00.0
5Xiphos 0.4 64-bit32270.00.036.869.8 42.60.010.811.8
6Xiphos 0.3 64-bit31370.04.95.927.742.6 0.055.150.1
7Xiphos 0.1 64-bit 4CPU30765.013.40.00.00.00.0 0.00.2
8Xiphos 0.2 64-bit30620.04.20.20.010.855.10.0 67.0
9Xiphos 0.1 64-bit30330.04.30.20.011.850.10.267.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 63 common opponents

Custom engine selection
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Stockfish 10 64-bit 4CPU354926%
19/72
16%
17/108
       
Stockfish 10 64-bit3493  20%
18/91
10%
6.5/64
9%
6/64
    
Stockfish 9 64-bit3482    16%
9.5/60
  0%
0/1
 
Houdini 6 64-bit3445  24%
21.5/91
24%
15.5/64
22%
13.5/61
    
Komodo 12 64-bit3411    22%
13.5/60
0%
0/1
   
Komodo 12.3 MCTS 64-bit 4CPU340750%
36.5/73
30%
29.5/98
       
Ethereal 11.25 64-bit 4CPU339252%
13/25
43%
35/82
       
Fire 7.1 64-bit3338  51%
45.5/90
37%
23.5/64
35%
21/60
    
Andscacs 0.95 64-bit 4CPU333654%
13.5/25
38%
12.5/33
       
Komodo 12.3 MCTS 64-bit3325  47%
23.5/50
34%
22/64
36%
36.5/100
    
Booot 6.3.1 64-bit 4CPU332454%
13.5/25
56%
28/50
       
Stoofvlees II a10 GTX980Ti331869%
34/49
 43%
18/42
      
Ethereal 11.25 64-bit3306  52%
46.5/90
 50%
0.5/1
    
Ethereal 11.00 64-bit3302   41%
26.5/64
40%
24/60
31%
18.5/60
   
Schooner 2.0.34 64-bit 4CPU327670%
17.5/25
60%
26.5/44
       
Laser 1.7 64-bit3274  53%
48/90
48%
30.5/64
     
Shredder 13 64-bit3270  58%
29/50
41%
26/64
45%
27/60
    
Booot 6.3.1 64-bit3254  63%
31.5/50
55%
35.5/64
46%
27.5/60
34%
21.5/64
   
Fizbo 2 64-bit3247  59%
30/51
41%
26/64
47%
28/60
0%
0/1
   
Chiron 4 64-bit 4CPU324178%
56.5/72
     22%
9/40
  
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Andscacs 0.95 64-bit3239  65%
26/40
48%
30.5/64
54%
33.5/62
    
Andscacs 0.94 64-bit3230    48%
28.5/60
37%
23.5/64
   
Texel 1.07 64-bit 4CPU3205 67%
30/45
    26%
10.5/40
  
Schooner 2.0.34 64-bit3192  62%
25/40
63%
40.5/64
59%
19.5/33
    
Laser 1.6 64-bit3188   66%
41.5/63
48%
29/60
41%
26/64
   
Senpai 2.0 64-bit 4CPU3176 83%
38/46
    34%
13.5/40
  
Chiron 4 64-bit3164  65%
26/40
59%
38/64
62%
37.5/60
51%
25.5/50
   
Critter 1.6a 64-bit3158   65%
41.5/64
61%
36.5/60
42%
21/50
   
Fritz 15 64-bit3145   68%
43.5/64
61%
36.5/60
47%
23.5/50
   
Ethereal 10.00 64-bit3143     44%
22/50
 39%
19.5/50
 
Strelka 5.5 64-bit3140 86%
31/36
    39%
15.5/40
  
NirvanaChess 2.4 64-bit3130    71%
42.5/60
44%
22.5/51
 40%
16/40
32%
9.5/30
RofChade 2.0 64-bit3130  70%
28/40
 56%
18/32
    
Nemorino 5.00 64-bit3116    63%
38/60
53%
26/49
   
Texel 1.07 64-bit3113    70%
42/60
50%
25/50
 40%
28.5/72
46%
18.5/40
Hannibal 1.7 64-bit3110    75%
45/60
59%
30/51
 38%
27/72
40%
12.5/31
Rybka 4.1 64-bit3109     53%
27.5/52
 45%
37/83
28%
9/32
Pedone 1.8 64-bit3107    62%
38/61
52%
16.5/32
   
Laser 1.5 64-bit3095     58%
71/122
 42%
34.5/82
54%
21/39
Protector 1.9.0 64-bit3085  100%
1/1
 50%
0.5/1
64%
32/50
 47%
38/81
35%
11/31
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Senpai 2.0 64-bit3085     62%
31.5/51
 48%
39.5/82
42%
17/40
Vajolet2 2.6 64-bit3084    50%
0.5/1
  51%
25.5/50
 
iCE 3.0 64-bit3081 78%
34.5/44
   61%
75/123
 45%
37/82
45%
18/40
Nemorino 4.00 64-bit3067     61%
30.5/50
 49%
35/72
35%
11/31
Arasan 20.5 64-bit3059     61%
30.5/50
 50%
16/32
41%
16.5/40
Pedone 1.7 64-bit3053       45%
37/82
45%
14.5/32
ChessBrainVB 3.723048  100%
1/1
 50%
0.5/1
    
Defenchess 1.1f 64-bit3047  100%
1/1
  66%
49/74
 53%
38.5/72
48%
15.5/32
Arasan 20.4.1 64-bit3043       56%
22.5/40
52%
16.5/32
Vajolet2 2.5 64-bit3040       57%
47/82
50%
16/32
SmarThink 1.98 64-bit3038    50%
0.5/1
67%
33.5/50
 58%
42/72
42%
13/31
Naum 4.6 64-bit3032     59%
42.5/72
 59%
48.5/82
52%
16.5/32
Hakkapeliitta TCEC v2 64-bit3022      75%
30/40
 100%
1/1
Hakkapeliitta 3.0 64-bit2984       65%
47/72
47%
15/32
Wasp 2.6 64-bit2978       65%
26/40
58%
18.5/32
Bobcat 8.0 64-bit2958    50%
0.5/1
  71%
28.5/40
73%
23.5/32
Cheng 4.39 64-bit2946     75%
56/75
 70%
28/40
66%
21/32
DiscoCheck 5.2.1 64-bit2914    100%
1/1
100%
1/1
   
Rodent III 0.232 64-bit2914     50%
0.5/1
 69%
27.5/40
 
Delocto 0.6 64-bit2610     100%
1/1
 100%
2/2
 
NameEloXiphos
0.5
64-bit
4CPU
Xiphos
0.4
64-bit
4CPU
Xiphos
0.5
64-bit
Xiphos
0.4.18
64-bit
Xiphos
0.4
64-bit
Xiphos
0.3
64-bit
Xiphos
0.1
64-bit
4CPU
Xiphos
0.2
64-bit
Xiphos
0.1
64-bit
Brutus 8.05 64-bit2557     100%
1/1
 100%
1/1
 
Winter 0.1.1 64-bit2480     100%
1/1
 100%
2/2
 
Matacz 1.42446     100%
1/1
 100%
1/1
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 22, 2019