CCRL 40/40
Downloads and Statistics
September 14, 2019
Testing summary:
Total: 1'083'337 games
played by 2'531 programs
147896 CPU days (X2 4600+)

White wins: 376'125 (34.7%)
Black wins: 279'699 (25.8%)
Draws: 427'513 (39.5%)
White score: 54.5%

Custom engine selection

Comparing 8 engines!
8 selected engines played 0 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on September 14, 2019 with Bayeselo based on 1'083'337 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.21.2 w42716 GTX10503442+29−2964.7%−89.059.8%336 
100.0%
 Lc0 0.21.3 wLD2 64-bit3074+65−6461.5%−90.246.2%78
70.8%
 Lc0 0.20.1 w36089 64-bit3055+21−2157.5%−57.636.7%829
100.0%
 Lc0 0.20.1 w11258 64-bit2951+36−3650.2%−4.440.2%246
96.6%
 Lc0 0.20.2 w32930 64-bit2902+38−3852.1%−17.144.3%210
79.6%
 Lc0 0.21.1 w11258 64-bit2866+75−7550.0%+6.135.7%56
61.5%
 Lc0 0.19.1 w11248 64-bit2853+47−4749.0%+8.134.5%148
100.0%
 Leela Chess 0.10 w323 64-bit2652+18−1852.2%−18.125.1%1102
 

Results matrix

Custom engine selection
#NameElo12345678
1Lc0 0.21.2 w42716 GTX10503442        
2Lc0 0.21.3 wLD2 64-bit3074        
3Lc0 0.20.1 w36089 64-bit3055        
4Lc0 0.20.1 w11258 64-bit2951        
5Lc0 0.20.2 w32930 64-bit2902        
6Lc0 0.21.1 w11258 64-bit2866        
7Lc0 0.19.1 w11248 64-bit2853        
8Leela Chess 0.10 w323 64-bit2652        
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678
1Lc0 0.21.2 w42716 GTX10503442 100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.21.3 wLD2 64-bit30740.0 70.899.9100.0100.0100.0100.0
3Lc0 0.20.1 w36089 64-bit30550.029.2 100.0100.0100.0100.0100.0
4Lc0 0.20.1 w11258 64-bit29510.00.10.0 96.697.799.9100.0
5Lc0 0.20.2 w32930 64-bit29020.00.00.03.4 79.694.3100.0
6Lc0 0.21.1 w11258 64-bit28660.00.00.02.320.4 61.5100.0
7Lc0 0.19.1 w11248 64-bit28530.00.00.00.15.738.5 100.0
8Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678
1Lc0 0.21.2 w42716 GTX10503442 0000000
2Lc0 0.21.3 wLD2 64-bit30740 1284452200
3Lc0 0.20.1 w36089 64-bit3055012 724824480
4Lc0 0.20.1 w11258 64-bit29510872 280680
5Lc0 0.20.2 w32930 64-bit29020444828 44160
6Lc0 0.21.1 w11258 64-bit286605224044 360
7Lc0 0.19.1 w11248 64-bit285302048681636 0
8Leela Chess 0.10 w323 64-bit26520000000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678
1Lc0 0.21.2 w42716 GTX10503442 0.00.00.00.00.00.00.0
2Lc0 0.21.3 wLD2 64-bit30740.0 1.32.515.338.88.80.0
3Lc0 0.20.1 w36089 64-bit30550.01.3 6.74.62.74.90.0
4Lc0 0.20.1 w11258 64-bit29510.02.56.7 6.10.017.30.0
5Lc0 0.20.2 w32930 64-bit29020.015.34.66.1 16.54.50.0
6Lc0 0.21.1 w11258 64-bit28660.038.82.70.016.5 17.60.0
7Lc0 0.19.1 w11248 64-bit28530.08.84.917.34.517.6 0.0
8Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 25 common opponents

Custom engine selection
NameEloLc0
0.21.2
w42716
GTX1050
Lc0
0.21.3
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
RubiChess 1.4 64-bit3038  44%
7/16
75%
3/4
    
RubiChess 1.3 64-bit2981  61%
8.5/14
 38%
1.5/4
 12%
0.5/4
 
Pirarucu 2.9.5 64-bit2967  68%
9.5/14
100%
4/4
50%
2/4
   
Deuterium 2019.1.36.50 64-bit2954   38%
1.5/4
38%
1.5/4
 25%
1/4
 
Pirarucu 2.7.4 64-bit2950   33%
4/12
  31%
2.5/8
 
Marvin 3.4.0 64-bit2938 88%
3.5/4
   50%
6/12
  
Amoeba 2.8 64-bit2927  64%
20.5/32
58%
7/12
25%
1/4
   
Godel 6.0 64-bit2927 75%
3/4
  43%
6/14
   
Winter 0.6 64-bit2927 62%
2.5/4
 75%
3/4
    
Cheng 4.39 64-bit2921  55%
17.5/32
62%
2.5/4
  25%
1/4
 
Dirty CUCUMBER 64-bit2919   31%
5/16
  62%
2.5/4
 
Deuterium 2018.1.35.514 64-bit2913  64%
20.5/32
   38%
1.5/4
 
RubiChess 1.2.1 64-bit2908   50%
6/12
  31%
2.5/8
 
Toga II 4.0 64-bit2904 75%
3/4
67%
21.5/32
 25%
1/4
62%
2.5/4
  
Atlas 3.91 64-bit2901  73%
23.5/32
  38%
1.5/4
  
Scorpio 2.9 MCTS 64-bit2867 88%
3.5/4
  50%
9/18
38%
1.5/4
  
The Baron 3.44 64-bit2863 50%
2/4
   12%
0.5/4
53%
8.5/16
 
Marvin 3.3.2 64-bit2857    54%
6.5/12
75%
3/4
  
Counter 3.3 64-bit2846 75%
3/4
  58%
7/12
   
Tornado 8.0 64-bit2843  73%
23.5/32
   25%
1/4
 
NameEloLc0
0.21.2
w42716
GTX1050
Lc0
0.21.3
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Tucano 7.07 64-bit2842 62%
2.5/4
   88%
3.5/4
  
Counter 3.2 64-bit2834    66%
10.5/16
12%
0.5/4
  
Fruit Reloaded 3.2.1 64-bit2834 25%
1/4
   75%
3/4
25%
1/4
 
Zurichess Neuchatel 64-bit2822     50%
2/4
88%
3.5/4
 
Monolith 1.0 64-bit2797     62%
2.5/4
38%
1.5/4
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 14, 2019