CCRL 40/15
Downloads and Statistics
January 25, 2020
Testing summary:
Total: 1'116'816 games
played by 2'606 programs

White wins: 386'579 (34.6%)
Black wins: 286'858 (25.7%)
Draws: 443'379 (39.7%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on January 25, 2020 with Bayeselo based on 1'116'816 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.22.0 T40B.4-160 GTX10503464+22−2263.5%−84.663.2%590 
87.8%
 Lc0 0.21.2 w42716 GTX10503442+29−2964.7%−89.159.8%336
100.0%
 Lc0 0.21.3 wLD2 64-bit3099+34−3452.1%−20.647.4%268
68.5%
 Lc0 0.23.2 wLD2 64-bit3078+79−8046.3%+15.967.5%40
50.4%
 Lc0 0.22.0 wLD2 64-bit3077+54−5457.7%−53.046.2%104
77.7%
 Lc0 0.20.1 w36089 64-bit3055+21−2057.5%−57.636.7%829
100.0%
 Lc0 0.21.1 w11258 64-bit2963+51−5056.0%−38.538.9%126
62.6%
 Lc0 0.20.1 w11258 64-bit2953+34−3450.2%−4.940.5%274
96.9%
 Lc0 0.20.2 w32930 64-bit2907+34−3452.4%−18.543.3%270
96.0%
 Lc0 0.19.1 w11248 64-bit2863+35−3550.6%−5.239.0%254
100.0%
 Leela Chess 0.10 w323 64-bit2652+18−1852.2%−18.425.1%1102
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.22.0 T40B.4-160 GTX10503464           
2Lc0 0.21.2 w42716 GTX10503442           
3Lc0 0.21.3 wLD2 64-bit3099           
4Lc0 0.23.2 wLD2 64-bit3078           
5Lc0 0.22.0 wLD2 64-bit3077           
6Lc0 0.20.1 w36089 64-bit3055           
7Lc0 0.21.1 w11258 64-bit2963           
8Lc0 0.20.1 w11258 64-bit2953           
9Lc0 0.20.2 w32930 64-bit2907           
10Lc0 0.19.1 w11248 64-bit2863           
11Leela Chess 0.10 w323 64-bit2652           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.22.0 T40B.4-160 GTX10503464 87.8100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.21.2 w42716 GTX1050344212.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Lc0 0.21.3 wLD2 64-bit30990.00.0 68.575.098.5100.0100.0100.0100.0100.0
4Lc0 0.23.2 wLD2 64-bit30780.00.031.5 50.470.499.199.7100.0100.0100.0
5Lc0 0.22.0 wLD2 64-bit30770.00.025.049.6 77.799.9100.0100.0100.0100.0
6Lc0 0.20.1 w36089 64-bit30550.00.01.529.622.3 100.0100.0100.0100.0100.0
7Lc0 0.21.1 w11258 64-bit29630.00.00.00.90.10.0 62.696.499.9100.0
8Lc0 0.20.1 w11258 64-bit29530.00.00.00.30.00.037.4 96.9100.0100.0
9Lc0 0.20.2 w32930 64-bit29070.00.00.00.00.00.03.63.1 96.0100.0
10Lc0 0.19.1 w11248 64-bit28630.00.00.00.00.00.00.10.04.0 100.0
11Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.22.0 T40B.4-160 GTX10503464 4500006600000
2Lc0 0.21.2 w42716 GTX10503442450 000000000
3Lc0 0.21.3 wLD2 64-bit309900 47242452844320
4Lc0 0.23.2 wLD2 64-bit30780047 161200000
5Lc0 0.22.0 wLD2 64-bit3077002416 2420724480
6Lc0 0.20.1 w36089 64-bit3055660241224 607248480
7Lc0 0.21.1 w11258 64-bit2963005202060 1244480
8Lc0 0.20.1 w11258 64-bit29530080727212 28680
9Lc0 0.20.2 w32930 64-bit29070044044484428 160
10Lc0 0.19.1 w11248 64-bit286300320848486816 0
11Leela Chess 0.10 w323 64-bit26520000000000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.22.0 T40B.4-160 GTX10503464 48.60.00.00.04.70.00.00.00.00.0
2Lc0 0.21.2 w42716 GTX1050344248.6 0.00.00.00.00.00.00.00.00.0
3Lc0 0.21.3 wLD2 64-bit30990.00.0 15.36.52.213.21.58.26.10.0
4Lc0 0.23.2 wLD2 64-bit30780.00.015.3 11.11.40.00.00.00.00.0
5Lc0 0.22.0 wLD2 64-bit30770.00.06.511.1 2.68.719.011.82.20.0
6Lc0 0.20.1 w36089 64-bit30554.70.02.21.42.6 6.36.54.44.40.0
7Lc0 0.21.1 w11258 64-bit29630.00.013.20.08.76.3 3.011.112.60.0
8Lc0 0.20.1 w11258 64-bit29530.00.01.50.019.06.53.0 5.112.90.0
9Lc0 0.20.2 w32930 64-bit29070.00.08.20.011.84.411.15.1 3.10.0
10Lc0 0.19.1 w11248 64-bit28630.00.06.10.02.24.412.612.93.1 0.0
11Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 49 common opponents

Custom engine selection
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.21.3
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Stockfish 10 64-bit 4CPU346549%
17.5/36
51%
22.5/44
         
Stockfish 10 64-bit338864%
20.5/32
62%
25/40
         
Houdini 6 64-bit333765%
32.5/50
62%
23.5/38
         
Fire 7.1 64-bit 4CPU332370%
22.5/32
67%
29.5/44
         
Xiphos 0.5 64-bit 4CPU331080%
24/30
75%
31.5/42
         
Ethereal 11.53 64-bit324787%
26/30
80%
25.5/32
         
Laser 1.7 64-bit321087%
29.5/34
    33%
10.5/32
     
Andscacs 0.95 64-bit3184  38%
1.5/4
38%
1.5/4
 33%
10.5/32
     
Vajolet2 2.8 64-bit3107   50%
1.5/3
55%
11/20
      
NirvanaChess 2.4 64-bit3103  38%
1.5/4
 33%
4/12
      
Pedone 1.9 64-bit3082    62%
2.5/4
58%
11.5/20
     
ChessBrainVB 3.743069  47%
8.5/18
50%
2/4
       
iCE 4.0 64-bit3064  75%
15/20
17%
0.5/3
       
chess22k 1.13 64-bit3061  45%
4.5/10
67%
2/3
       
Wasp 3.75 64-bit3055  52%
10.5/20
83%
2.5/3
38%
1.5/4
      
RubiChess 1.4 64-bit3038     44%
7/16
 75%
3/4
   
Senpai 2.0 64-bit3036    75%
3/4
   25%
1/4
  
Pirarucu 3.0.7 64-bit3013    50%
4/8
   34%
5.5/16
  
Hakkapeliitta TCEC v2 64-bit3000    62%
5/8
   50%
2/4
  
Winter 0.7 64-bit2997    50%
2/4
  56%
9/16
   
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.21.3
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Rodent III 0.281 64-bit2991    50%
2/4
  42%
7.5/18
   
Deuterium 2019.2.37.73 64-bit2988    75%
3/4
 52%
10.5/20
    
RubiChess 1.3 64-bit2981     61%
8.5/14
  38%
1.5/4
12%
0.5/4
 
Pirarucu 2.9.5 64-bit2967     68%
9.5/14
 100%
4/4
50%
2/4
  
Amoeba 3.0 64-bit2956    62%
5/8
  54%
13/24
   
Deuterium 2019.1.36.50 64-bit2954       38%
1.5/4
38%
1.5/4
25%
1/4
 
Pirarucu 2.7.4 64-bit2951       33%
4/12
 31%
2.5/8
 
Marvin 3.4.0 64-bit2936  88%
3.5/4
   50%
6/12
    
Amoeba 2.8 64-bit2927     64%
20.5/32
 58%
7/12
25%
1/4
  
Winter 0.6 64-bit2927  62%
2.5/4
    75%
3/4
   
Godel 6.0 64-bit2926  75%
3/4
     43%
6/14
  
Cheng 4.39 64-bit2922     55%
17.5/32
62%
7.5/12
62%
2.5/4
 25%
1/4
 
Dirty CUCUMBER 64-bit2917    62%
2.5/4
  31%
5/16
 62%
2.5/4
 
Deuterium 2018.1.35.514 64-bit2913     64%
20.5/32
   38%
1.5/4
 
RubiChess 1.2.1 64-bit2908       50%
6/12
 31%
2.5/8
 
Toga II 4.0 64-bit2905  75%
3/4
  67%
21.5/32
62%
2.5/4
 25%
1/4
  
Crafty 25.3 64-bit2904    50%
2/4
  42%
5/12
   
Atlas 3.91 64-bit2903    88%
3.5/4
73%
23.5/32
38%
1.5/4
    
Scorpio 2.9 MCTS 64-bit2868  88%
3.5/4
   38%
1.5/4
 50%
9/18
  
The Baron 3.44 64-bit2864  50%
2/4
   12%
0.5/4
  53%
8.5/16
 
NameEloLc0
0.22.0
T40B.4-160
GTX1050
Lc0
0.21.2
w42716
GTX1050
Lc0
0.21.3
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Marvin 3.3.2 64-bit2858      75%
3/4
 54%
6.5/12
  
Counter 3.3 64-bit2850  75%
3/4
     58%
7/12
  
Tornado 8.0 64-bit2842     73%
23.5/32
   25%
1/4
 
Tucano 7.07 64-bit2842  62%
2.5/4
   88%
3.5/4
    
Fruit Reloaded 3.2.1 64-bit2837  25%
1/4
   75%
3/4
  25%
1/4
 
Asymptote 0.6.3 64-bit2836  88%
3.5/4
      58%
7/12
 
Counter 3.2 64-bit2835      12%
0.5/4
 66%
10.5/16
  
Zurichess Neuchatel 64-bit2824      50%
2/4
  88%
3.5/4
 
Monolith 1.0 64-bit2796      62%
2.5/4
  38%
1.5/4
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on January 25, 2020