CCRL 40/15
Downloads and Statistics
September 26, 2020
Testing summary:
Total: 1'179'815 games
played by 2'715 programs

White wins: 406'597 (34.5%)
Black wins: 300'322 (25.5%)
Draws: 472'896 (40.1%)
White score: 54.5%

Custom engine selection

Comparing 13 engines!
13 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on September 26, 2020 with Bayeselo based on 1'179'815 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.22.0 T40B.4-160 GTX10503462+21−2162.1%−76.163.9%642 
87.1%
 Lc0 0.21.2 w42716 GTX10503441+29−2964.7%−88.959.8%336
100.0%
 Lc0 0.26.2 w703810 64-bit3151+149−15441.7%+42.750.0%12
56.9%
 Lc0 0.24.0 w591226 64-bit3137+36−3649.6%−1.852.2%230
95.5%
 Lc0 0.21.3 wLD2 64-bit3095+33−3351.2%−15.347.5%284
64.7%
 Lc0 0.22.0 wLD2 64-bit3086+37−3750.4%−6.847.3%224
74.9%
 Lc0 0.23.2 wLD2 64-bit3068+36−3653.4%−25.044.9%236
74.6%
 Lc0 0.20.1 w36089 64-bit3054+21−2057.5%−57.536.7%829
100.0%
 Lc0 0.21.1 w11258 64-bit2969+37−3752.7%−17.839.8%226
72.0%
 Lc0 0.20.1 w11258 64-bit2954+34−3450.2%−4.840.5%274
97.9%
 Lc0 0.20.2 w32930 64-bit2905+33−3352.2%−17.542.1%292
90.3%
 Lc0 0.19.1 w11248 64-bit2874+33−3351.9%−13.138.9%296
100.0%
 Leela Chess 0.10 w323 64-bit2652+18−1852.2%−18.125.1%1102
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.22.0 T40B.4-160 GTX10503462             
2Lc0 0.21.2 w42716 GTX10503441             
3Lc0 0.26.2 w703810 64-bit3151             
4Lc0 0.24.0 w591226 64-bit3137             
5Lc0 0.21.3 wLD2 64-bit3095             
6Lc0 0.22.0 wLD2 64-bit3086             
7Lc0 0.23.2 wLD2 64-bit3068             
8Lc0 0.20.1 w36089 64-bit3054             
9Lc0 0.21.1 w11258 64-bit2969             
10Lc0 0.20.1 w11258 64-bit2954             
11Lc0 0.20.2 w32930 64-bit2905             
12Lc0 0.19.1 w11248 64-bit2874             
13Leela Chess 0.10 w323 64-bit2652             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.22.0 T40B.4-160 GTX10503462 87.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.21.2 w42716 GTX1050344112.9 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Lc0 0.26.2 w703810 64-bit31510.00.0 56.976.479.985.789.899.099.499.9100.0100.0
4Lc0 0.24.0 w591226 64-bit31370.00.043.1 95.597.699.6100.0100.0100.0100.0100.0100.0
5Lc0 0.21.3 wLD2 64-bit30950.00.023.64.5 64.786.198.1100.0100.0100.0100.0100.0
6Lc0 0.22.0 wLD2 64-bit30860.00.020.12.435.3 74.993.0100.0100.0100.0100.0100.0
7Lc0 0.23.2 wLD2 64-bit30680.00.014.30.413.925.1 74.6100.0100.0100.0100.0100.0
8Lc0 0.20.1 w36089 64-bit30540.00.010.20.01.97.025.4 100.0100.0100.0100.0100.0
9Lc0 0.21.1 w11258 64-bit29690.00.01.00.00.00.00.00.0 72.099.4100.0100.0
10Lc0 0.20.1 w11258 64-bit29540.00.00.60.00.00.00.00.028.0 97.9100.0100.0
11Lc0 0.20.2 w32930 64-bit29050.00.00.10.00.00.00.00.00.62.1 90.3100.0
12Lc0 0.19.1 w11248 64-bit28740.00.00.00.00.00.00.00.00.00.09.7 100.0
13Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.22.0 T40B.4-160 GTX10503462 4500120006600000
2Lc0 0.21.2 w42716 GTX10503441450 00000000000
3Lc0 0.26.2 w703810 64-bit315100 24600000000
4Lc0 0.24.0 w591226 64-bit313712024 7092884800000
5Lc0 0.21.3 wLD2 64-bit309500670 24562452844320
6Lc0 0.22.0 wLD2 64-bit30860009224 322420724480
7Lc0 0.23.2 wLD2 64-bit3068000885632 1200000
8Lc0 0.20.1 w36089 64-bit3054660048242412 607248480
9Lc0 0.21.1 w11258 64-bit296900005220060 1244480
10Lc0 0.20.1 w11258 64-bit2954000087207212 28680
11Lc0 0.20.2 w32930 64-bit2905000044440484428 160
12Lc0 0.19.1 w11248 64-bit28740000328048486816 0
13Leela Chess 0.10 w323 64-bit2652000000000000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.22.0 T40B.4-160 GTX10503462 46.00.01.40.00.00.04.50.00.00.00.00.0
2Lc0 0.21.2 w42716 GTX1050344146.0 0.00.00.00.00.00.00.00.00.00.00.0
3Lc0 0.26.2 w703810 64-bit31510.00.0 9.92.00.00.00.00.00.00.00.00.0
4Lc0 0.24.0 w591226 64-bit31371.40.09.9 13.620.318.94.50.00.00.00.00.0
5Lc0 0.21.3 wLD2 64-bit30950.00.02.013.6 4.710.82.210.21.47.65.50.0
6Lc0 0.22.0 wLD2 64-bit30860.00.00.020.34.7 7.02.34.414.58.51.50.0
7Lc0 0.23.2 wLD2 64-bit30680.00.00.018.910.87.0 1.10.00.00.00.00.0
8Lc0 0.20.1 w36089 64-bit30544.50.00.04.52.22.31.1 5.76.54.34.30.0
9Lc0 0.21.1 w11258 64-bit29690.00.00.00.010.24.40.05.7 2.48.59.20.0
10Lc0 0.20.1 w11258 64-bit29540.00.00.00.01.414.50.06.52.4 4.911.90.0
11Lc0 0.20.2 w32930 64-bit29050.00.00.00.07.68.50.04.38.54.9 2.70.0
12Lc0 0.19.1 w11248 64-bit28740.00.00.00.05.51.50.04.39.211.92.7 0.0
13Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 64 common opponents

Custom engine selection
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Stockfish 10 64-bit 4CPU346349%
17.5/36
51%
22.5/44
           
Stockfish 10 64-bit338764%
20.5/32
62%
25/40
           
Houdini 6 64-bit333865%
32.5/50
62%
23.5/38
           
Fire 7.1 64-bit 4CPU332370%
22.5/32
67%
29.5/44
           
Xiphos 0.5 64-bit 4CPU330880%
24/30
75%
31.5/42
           
Ethereal 11.53 64-bit324687%
26/30
80%
25.5/32
           
RofChade 2.3 64-bit3239  0%
0/1
38%
1.5/4
         
Laser 1.7 64-bit320887%
29.5/34
  50%
2/4
   33%
10.5/32
     
RofChade 2.202 64-bit3208   0%
0/1
12%
0.5/4
        
Schooner 2.2 64-bit3205  50%
0.5/1
31%
2.5/8
         
Defenchess 2.2 64-bit3202  0%
0/1
25%
1/4
25%
1/4
        
Booot 6.3.1 64-bit3201   38%
1.5/4
   30%
9.5/32
     
Fizbo 2 64-bit3197   50%
2/4
   30%
9.5/32
     
Fritz 17 64-bit3193  50%
0.5/1
12%
0.5/4
42%
13.5/32
        
Andscacs 0.95 64-bit3182   25%
1/4
38%
1.5/4
 38%
1.5/4
33%
10.5/32
     
RubiChess 1.7.1 64-bit3173   38%
1.5/4
 38%
7.5/20
       
Roc 1.6 64-bit3157   50%
4/8
 40%
8/20
       
Arasan 22.1 64-bit3144  50%
1/2
25%
1/4
         
Roc 1.7 64-bit3144  25%
0.5/2
25%
1/4
         
Arasan 22.0 64-bit3141   50%
4/8
  45%
9/20
      
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Pedone 2.0 64-bit3108   56%
4.5/8
 66%
10.5/16
38%
1.5/4
      
SlowChess Blitz Classic 1.9 64-bit3105   0%
0/1
38%
6/16
        
NirvanaChess 2.4 64-bit3101    38%
1.5/4
33%
4/12
       
Vajolet2 2.8 64-bit3100   56%
4.5/8
 55%
11/20
50%
2/4
      
Nemorino 5.00 64-bit3087   25%
1/4
  50%
2/4
      
Pedone 1.9 64-bit3080     62%
2.5/4
 58%
11.5/20
     
ChessBrainVB 3.743068   62%
2.5/4
47%
8.5/18
 50%
2/4
      
Wasp 3.75 64-bit3063   12%
0.5/4
52%
10.5/20
38%
1.5/4
75%
3/4
      
chess22k 1.13 64-bit3063    45%
4.5/10
 75%
3/4
      
iCE 4.0 64-bit3059   62%
2.5/4
75%
15/20
 25%
1/4
      
RubiChess 1.4 64-bit3037       44%
7/16
 75%
3/4
   
Senpai 2.0 64-bit3033     75%
3/4
    25%
1/4
  
Pirarucu 3.0.7 64-bit3013     50%
4/8
    34%
5.5/16
  
Winter 0.7 64-bit3004     50%
2/4
   56%
9/16
   
Hakkapeliitta TCEC v2 64-bit3000     62%
5/8
    50%
2/4
  
Rodent III 0.281 64-bit2992     50%
2/4
   42%
7.5/18
   
RubiChess 1.3 64-bit2981       61%
8.5/14
  38%
1.5/4
12%
0.5/4
 
Deuterium 2019.2.37.73 64-bit2980     75%
3/4
  52%
10.5/20
    
Pirarucu 2.9.5 64-bit2966       68%
9.5/14
 100%
4/4
50%
2/4
  
Amoeba 3.0 64-bit2956     62%
5/8
   54%
13/24
   
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Deuterium 2019.1.36.50 64-bit2954         38%
1.5/4
38%
1.5/4
25%
1/4
 
Pirarucu 2.7.4 64-bit2950         33%
4/12
 31%
2.5/8
 
Marvin 3.4.0 64-bit2938    88%
3.5/4
   50%
6/12
    
Amoeba 2.8 64-bit2927       64%
20.5/32
 58%
7/12
25%
1/4
  
Winter 0.6 64-bit2927    62%
2.5/4
    75%
3/4
   
Godel 6.0 64-bit2923    75%
3/4
     43%
6/14
  
Cheng 4.39 64-bit2921       55%
17.5/32
62%
7.5/12
62%
2.5/4
 25%
1/4
 
Dirty CUCUMBER 64-bit2917     62%
2.5/4
   31%
5/16
 62%
2.5/4
 
Deuterium 2018.1.35.514 64-bit2913       64%
20.5/32
   38%
1.5/4
 
Crafty 25.3 64-bit2912     50%
2/4
   42%
5/12
   
RubiChess 1.2.1 64-bit2908         50%
6/12
 31%
2.5/8
 
Toga II 4.0 64-bit2904    75%
3/4
  67%
21.5/32
62%
2.5/4
 25%
1/4
  
Atlas 3.91 64-bit2898     88%
3.5/4
 73%
23.5/32
38%
1.5/4
    
Scorpio 2.9 MCTS 64-bit2868    88%
3.5/4
   38%
1.5/4
 50%
9/18
  
The Baron 3.44 64-bit2865    50%
2/4
   12%
0.5/4
  53%
8.5/16
 
Marvin 3.3.2 64-bit2858        75%
3/4
 54%
6.5/12
  
Counter 3.3 64-bit2848    75%
3/4
     58%
7/12
  
Tornado 8.0 64-bit2843       73%
23.5/32
   25%
1/4
 
Tucano 7.07 64-bit2842    62%
2.5/4
   88%
3.5/4
    
Asymptote 0.6.3 64-bit2837    88%
3.5/4
      58%
7/12
 
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Fruit Reloaded 3.2.1 64-bit2837    25%
1/4
   75%
3/4
  25%
1/4
 
Counter 3.2 64-bit2834        12%
0.5/4
 66%
10.5/16
  
Zurichess Neuchatel 64-bit2827        50%
2/4
  88%
3.5/4
 
Monolith 1.0 64-bit2796        62%
2.5/4
  38%
1.5/4
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on September 26, 2020