CCRL 40/40
Downloads and Statistics
December 7, 2019
Testing summary:
Total: 1'104'002 games
played by 2'573 programs
150928 CPU days (X2 4600+)

White wins: 382'601 (34.7%)
Black wins: 284'129 (25.7%)
Draws: 437'272 (39.6%)
White score: 54.5%

Custom engine selection

Comparing 5 engines!
5 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern CPU.
Computed on December 7, 2019 with Bayeselo based on 1'104'002 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Strelka 5.5 64-bit3104+6−645.6%+31.648.1%9977 
96.8%
 Strelka 5.5 32-bit3088+15−1561.8%−73.749.3%1398
72.0%
 Strelka 5.1 32-bit3082+16−1561.1%−70.548.7%1334
100.0%
 Strelka 1.8 32-bit2769+19−1947.6%+14.642.1%878
86.3%
 Strelka 1.0b 32-bit2750+28−2852.8%−17.540.7%413
 

Results matrix

Custom engine selection
#NameElo12345
1Strelka 5.5 64-bit3104     
2Strelka 5.5 32-bit3088     
3Strelka 5.1 32-bit3082     
4Strelka 1.8 32-bit2769     
5Strelka 1.0b 32-bit2750     
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345
1Strelka 5.5 64-bit3104 96.899.4100.0100.0
2Strelka 5.5 32-bit30883.2 72.0100.0100.0
3Strelka 5.1 32-bit30820.628.0 100.0100.0
4Strelka 1.8 32-bit27690.00.00.0 86.3
5Strelka 1.0b 32-bit27500.00.00.013.7 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345
1Strelka 5.5 64-bit3104 11011000
2Strelka 5.5 32-bit3088110 21371550
3Strelka 5.1 32-bit30821102137 1550
4Strelka 1.8 32-bit276901515 297
5Strelka 1.0b 32-bit275005050297 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345
1Strelka 5.5 64-bit3104 1.01.00.00.0
2Strelka 5.5 32-bit30881.0 78.20.72.8
3Strelka 5.1 32-bit30821.078.2 0.72.9
4Strelka 1.8 32-bit27690.00.70.7 23.0
5Strelka 1.0b 32-bit27500.02.82.923.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 48 common opponents

Custom engine selection
NameEloStrelka
5.5
64-bit
Strelka
5.5
32-bit
Strelka
5.1
32-bit
Strelka
1.8
32-bit
Strelka
1.0b
32-bit
Houdini 3 32-bit3135 39%
12.5/32
39%
12.5/32
  
Houdini 2.0c 32-bit3102 52%
15.5/30
52%
15.5/30
  
Houdini 1.5a 32-bit3091 48%
14.5/30
48%
15.5/32
  
Critter 1.4 32-bit3073 50%
15/30
52%
21/40
  
Critter 1.6a 32-bit3068 58%
18.5/32
50%
16/32
  
Stockfish 2.2.2 32-bit3050 62%
18.5/30
50%
20/40
  
Komodo 5 32-bit3047 59%
19/32
52%
16.5/32
  
Stockfish 2.3.1 32-bit3040 66%
21/32
42%
13.5/32
  
Komodo 4 32-bit3032 60%
18/30
60%
24/40
  
Rybka 4.1 32-bit3030 48%
14.5/30
62%
25/40
  
Vitruvius 1.11C 32-bit3030 68%
20.5/30
63%
19/30
  
IvanHoe 9.46h 32-bit3023 68%
20.5/30
61%
24.5/40
  
Komodo 3 32-bit3023 57%
17/30
48%
14.5/30
  
DeepSaros 2.3j 32-bit3021 57%
17/30
63%
19/30
  
Bouquet 1.6 32-bit3017 67%
20/30
58%
17.5/30
  
Bouquet 1.5 32-bit3010 66%
21/32
69%
22/32
  
DeepSaros 3.0 32-bit2999 58%
18.5/32
62%
20/32
  
Gull II b2 32-bit2982 78%
26.5/34
62%
20/32
  
Gull II 32-bit2978 70%
22.5/32
68%
19/28
  
Hiarcs 14296275%
24/32
75%
24/32
70%
22.5/32
  
NameEloStrelka
5.5
64-bit
Strelka
5.5
32-bit
Strelka
5.1
32-bit
Strelka
1.8
32-bit
Strelka
1.0b
32-bit
Fritz 132960 69%
22/32
76%
23.5/31
  
Naum 4.2 32-bit2958 65%
19.5/30
68%
20.5/30
  
Deep Sjeng c't 20102941 68%
20.5/30
76%
23.5/31
  
Chiron 1.1a 32-bit2931 73%
22/30
70%
21/30
  
Shredder 12 32-bit2929 76%
45.5/60
75%
46/61
  
Spike 1.4 Leiden291478%
12.5/16
82%
24.5/30
82%
24.5/30
  
Rybka 2.3.2a 32-bit2912 78%
23.5/30
83%
25/30
30%
1.5/5
12%
2.5/20
Deep Junior 13.3 32-bit2909 66%
21/32
78%
25/32
  
Hannibal 1.2 32-bit2905 77%
23/30
77%
24.5/32
  
Gull 1.0a 32-bit2885 87%
26/30
88%
26.5/30
  
Protector 1.4.0 32-bit2879 68%
20.5/30
83%
25/30
  
Quazar 0.4 32-bit2879 75%
22.5/30
78%
23.5/30
  
Gull 1.2 32-bit2876 83%
25/30
78%
23.5/30
  
Hiarcs 11.12789   53%
16/30
50%
1/2
Zap!Chess Zanzibar 32-bit2781   38%
1.5/4
28%
5.5/20
Fritz 102778   54%
20/37
62%
12.5/20
Loop 13.6 (Loop 2007) 32-bit2773   44%
16/36
54%
28/52
Shredder 102770   56%
20/36
50%
1/2
Toga II 1.2.1a 32-bit2759   55%
17/31
25%
0.5/2
Spike 1.2 Turin2745   55%
17.5/32
0%
0/2
NameEloStrelka
5.5
64-bit
Strelka
5.5
32-bit
Strelka
5.1
32-bit
Strelka
1.8
32-bit
Strelka
1.0b
32-bit
Ktulu 82705   61%
20/33
50%
1/2
Chess Tiger 2007.12704   62%
22.5/36
59%
13/22
Glaurung 2 epsilon/5 32-bit2696   70%
3.5/5
64%
36/56
Scorpio 1.912661   100%
2/2
50%
1/2
Chess Tiger 2007 Gambit2628   50%
1/2
50%
1/2
Delfi 5.12628   100%
3/3
50%
1/2
The Baron 1.8.12591   100%
1/1
100%
2/2
Petir 4.392590   50%
1/2
80%
17.5/22
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on December 7, 2019