CCRL 40/40
Downloads and Statistics
July 11, 2019
Testing summary:
Total: 1'066'603 games
played by 2'494 programs
145750 CPU days (X2 4600+)

White wins: 370'641 (34.7%)
Black wins: 275'905 (25.9%)
Draws: 420'057 (39.4%)
White score: 54.4%

Custom engine selection

Comparing 5 engines!
5 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on July 11, 2019 with Bayeselo based on 1'066'603 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1BlackMamba 2.0 64-bit 4CPU3122+15−1544.2%+38.154.3%1408 
100.0%
 BlackMamba 2.0 64-bit3055+10−945.0%+32.253.0%3418
99.9%
 BlackMamba 1.4 64-bit3027+15−1544.7%+31.151.8%1380
92.8%
 BlackMamba 1.2c 64-bit3002+30−3048.4%+8.551.9%320
74.8%
 BlackMamba 1.2b 64-bit2987+30−3048.3%+10.254.1%316
 

Results matrix

Custom engine selection
#NameElo12345
1BlackMamba 2.0 64-bit 4CPU3122     
2BlackMamba 2.0 64-bit3055     
3BlackMamba 1.4 64-bit3027     
4BlackMamba 1.2c 64-bit3002     
5BlackMamba 1.2b 64-bit2987     
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345
1BlackMamba 2.0 64-bit 4CPU3122 100.0100.0100.0100.0
2BlackMamba 2.0 64-bit30550.0 99.9100.0100.0
3BlackMamba 1.4 64-bit30270.00.1 92.898.9
4BlackMamba 1.2c 64-bit30020.00.07.2 74.8
5BlackMamba 1.2b 64-bit29870.00.01.125.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345
1BlackMamba 2.0 64-bit 4CPU3122 0000
2BlackMamba 2.0 64-bit30550 127119090
3BlackMamba 1.4 64-bit302701271 684349
4BlackMamba 1.2c 64-bit30020190684 221
5BlackMamba 1.2b 64-bit2987090349221 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345
1BlackMamba 2.0 64-bit 4CPU3122 0.00.00.00.0
2BlackMamba 2.0 64-bit30550.0 26.55.12.4
3BlackMamba 1.4 64-bit30270.026.5 40.220.6
4BlackMamba 1.2c 64-bit30020.05.140.2 34.7
5BlackMamba 1.2b 64-bit29870.02.420.634.7 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 42 common opponents

Custom engine selection
NameEloBlackMamba
2.0
64-bit
4CPU
BlackMamba
2.0
64-bit
BlackMamba
1.4
64-bit
BlackMamba
1.2c
64-bit
BlackMamba
1.2b
64-bit
Houdini 4 64-bit3168 28%
9.5/34
32%
9.5/30
  
Stockfish DD 64-bit3164 28%
14.5/52
31%
10.5/34
  
Houdini 3 64-bit3158  18%
5.5/30
 22%
6.5/30
Houdini 3 Tactical 64-bit3153  25%
7.5/30
0%
0/2
 
Komodo TCEC 64-bit3143 34%
11.5/34
25%
7.5/30
  
Komodo 6 64-bit3142 31%
16/51
27%
8/30
  
Komodo 5 64-bit3108 40%
4/10
37%
11/30
38%
4.5/12
 
Strelka 5.5 64-bit3103 46%
22/48
34%
15/44
28%
4.5/16
12%
0.5/4
Critter 1.6a 64-bit3101 44%
32.5/74
32%
14.5/46
22%
3.5/16
25%
1/4
Gull 2.8b 64-bit3082 42%
20/48
38%
13/34
  
Fire 3.0 64-bit3079 48%
30.5/64
41%
14/34
  
Rybka 4.1 64-bit3078 41%
16.5/40
48%
14.5/30
33%
4/12
 
Stockfish 2.3.1 64-bit3077  45%
13.5/30
31%
5/16
38%
1.5/4
Bouquet 1.8 64-bit3074 46%
51.5/112
45%
19/42
  
Bouquet 1.5 64-bit3062  53%
16/30
50%
1/2
 
Fizbo 1.7 64-bit3061 38%
1.5/4
  45%
4.5/10
IvanHoe 9.46h 64-bit3061  41%
15.5/38
34%
5.5/16
38%
1.5/4
RobboLito 0.21Q 64-bit3058  48%
20/42
50%
8/16
42%
15/36
DeepSaros 4.1.6 64-bit3055 46%
27.5/60
50%
2/4
  
Bouquet 1.6 64-bit3050  65%
22/34
29%
4/14
36%
13/36
NameEloBlackMamba
2.0
64-bit
4CPU
BlackMamba
2.0
64-bit
BlackMamba
1.4
64-bit
BlackMamba
1.2c
64-bit
BlackMamba
1.2b
64-bit
Vitruvius 1.11C 64-bit3049 38%
1.5/4
48%
14.5/30
46%
5.5/12
 
DeepSaros 3.3b 64-bit3045  42%
5/12
42%
2.5/6
38%
1.5/4
Sting SF 4 64-bit3025 63%
26.5/42
52%
12.5/24
  
Sting SF 2 64-bit3022  52%
15.5/30
53%
8.5/16
62%
2.5/4
Deep Fritz 14 64-bit 1CPU3018 56%
18/32
50%
15/30
  
Chiron 2 64-bit3014 58%
22/38
52%
15.5/30
  
SmarThink 1.96 64-bit3006 45%
4.5/10
  46%
6.5/14
Hannibal 1.4b 64-bit3001 63%
34/54
55%
23/42
  
Gull II b2 64-bit2993  58%
17.5/30
25%
0.5/2
 
Gull II 64-bit2986   75%
7.5/10
38%
1.5/4
Protector 1.5.0 64-bit2985 75%
3/4
55%
25.5/46
53%
18/34
 
Gull R375 64-bit2984  62%
2.5/4
54%
18.5/34
 
Chiron 1.1a 64-bit2979  67%
20/30
75%
1.5/2
 
Naum 4.2 64-bit2976  53%
16/30
58%
7/12
 
Fizbo 1.6 64-bit2965 100%
2/2
70%
7/10
  
Hannibal 1.3 64-bit2962  52%
16.5/32
61%
8.5/14
55%
16.5/30
Hiarcs 142961 88%
3.5/4
55%
16.5/30
45%
4.5/10
 
Vajolet2 2.2 64-bit2960 62%
2.5/4
  65%
6.5/10
SmarThink 1.80 64-bit2938 50%
1/2
  65%
6.5/10
Quazar 0.4 64-bit2905  88%
3.5/4
62%
2.5/4
83%
2.5/3
NameEloBlackMamba
2.0
64-bit
4CPU
BlackMamba
2.0
64-bit
BlackMamba
1.4
64-bit
BlackMamba
1.2c
64-bit
BlackMamba
1.2b
64-bit
DiscoCheck 5.2.1 64-bit2894 88%
3.5/4
  50%
5/10
Booot 5.2.0 64-bit2893 100%
4/4
44%
3.5/8
  
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 11, 2019