CCRL 40/4
Downloads and Statistics
July 20, 2019
Testing summary:
Total: 2'069'919 games
played by 2'400 programs
27811 CPU days (X2 4600+)

White wins: 804'066 (38.8%)
Black wins: 650'528 (31.4%)
Draws: 615'325 (29.7%)
White score: 53.7%

Custom engine selection

Comparing 13 engines!
13 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on July 20, 2019 with Bayeselo based on 2'069'919 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.21.1 JH.T6.532 GTX10503486+17−1759.2%−58.552.4%1100 
83.4%
 Lc0 0.21.1 w41800 GTX10503474+17−1755.7%−37.151.2%1000
97.7%
 Lc0 0.20.2 w32930 GTX10503452+14−1459.2%−60.648.4%1600
100.0%
 Lc0 0.20.1 w36089 GTX980Ti3329+26−2645.2%+30.054.4%439
100.0%
 Lc0 0.20.1 w36089 64-bit2797+19−1955.1%−41.624.6%982
82.0%
 Lc0 0.21.0 w32930 64-bit2755+80−9412.8%+319.613.4%82
89.9%
 Lc0 0.20.2 w32930 64-bit2676+80−9018.8%+239.521.9%64
93.7%
 Leela Chess 0.10 w483 64-bit2607+22−2248.6%+10.724.3%725
100.0%
 Leela Chess 0.10 w323 64-bit2537+23−2257.2%−55.220.8%754
100.0%
 Leela Chess 0.10 w272 64-bit2308+33−3256.1%−46.619.7%350
94.4%
 Leela Chess 0.9 w272 64-bit2271+33−3251.3%−9.517.9%352
96.4%
 Leela Chess 0.7 w187 64-bit2235+22−2263.3%−104.618.9%814
100.0%
 Leela Chess 0.5 w123 64-bit1963+32−3246.9%+24.417.7%373
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.21.1 JH.T6.532 GTX10503486             
2Lc0 0.21.1 w41800 GTX10503474             
3Lc0 0.20.2 w32930 GTX10503452             
4Lc0 0.20.1 w36089 GTX980Ti3329             
5Lc0 0.20.1 w36089 64-bit2797             
6Lc0 0.21.0 w32930 64-bit2755             
7Lc0 0.20.2 w32930 64-bit2676             
8Leela Chess 0.10 w483 64-bit2607             
9Leela Chess 0.10 w323 64-bit2537             
10Leela Chess 0.10 w272 64-bit2308             
11Leela Chess 0.9 w272 64-bit2271             
12Leela Chess 0.7 w187 64-bit2235             
13Leela Chess 0.5 w123 64-bit1963             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.21.1 JH.T6.532 GTX10503486 83.499.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.21.1 w41800 GTX1050347416.6 97.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Lc0 0.20.2 w32930 GTX105034520.12.3 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Lc0 0.20.1 w36089 GTX980Ti33290.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Lc0 0.20.1 w36089 64-bit27970.00.00.00.0 82.099.7100.0100.0100.0100.0100.0100.0
6Lc0 0.21.0 w32930 64-bit27550.00.00.00.018.0 89.999.9100.0100.0100.0100.0100.0
7Lc0 0.20.2 w32930 64-bit26760.00.00.00.00.310.1 93.799.9100.0100.0100.0100.0
8Leela Chess 0.10 w483 64-bit26070.00.00.00.00.00.16.3 100.0100.0100.0100.0100.0
9Leela Chess 0.10 w323 64-bit25370.00.00.00.00.00.00.10.0 100.0100.0100.0100.0
10Leela Chess 0.10 w272 64-bit23080.00.00.00.00.00.00.00.00.0 94.4100.0100.0
11Leela Chess 0.9 w272 64-bit22710.00.00.00.00.00.00.00.00.05.6 96.4100.0
12Leela Chess 0.7 w187 64-bit22350.00.00.00.00.00.00.00.00.00.03.6 100.0
13Leela Chess 0.5 w123 64-bit19630.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.21.1 JH.T6.532 GTX10503486 20002200591000000000
2Lc0 0.21.1 w41800 GTX105034742000 2000591000000000
3Lc0 0.20.2 w32930 GTX1050345222002000 591000000000
4Lc0 0.20.1 w36089 GTX980Ti3329591591591 000000000
5Lc0 0.20.1 w36089 64-bit27970000 0025300000
6Lc0 0.21.0 w32930 64-bit275500000 64000000
7Lc0 0.20.2 w32930 64-bit26760000064 000000
8Leela Chess 0.10 w483 64-bit2607000025300 00000
9Leela Chess 0.10 w323 64-bit253700000000 0000
10Leela Chess 0.10 w272 64-bit2308000000000 7021850
11Leela Chess 0.9 w272 64-bit2271000000000702 1850
12Leela Chess 0.7 w187 64-bit2235000000000185185 352
13Leela Chess 0.5 w123 64-bit196300000000000352 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.21.1 JH.T6.532 GTX10503486 95.281.538.40.00.00.00.00.00.00.00.00.0
2Lc0 0.21.1 w41800 GTX1050347495.2 76.941.10.00.00.00.00.00.00.00.00.0
3Lc0 0.20.2 w32930 GTX1050345281.576.9 29.00.00.00.00.00.00.00.00.00.0
4Lc0 0.20.1 w36089 GTX980Ti332938.441.129.0 0.00.00.00.00.00.00.00.00.0
5Lc0 0.20.1 w36089 64-bit27970.00.00.00.0 0.00.014.80.00.00.00.00.0
6Lc0 0.21.0 w32930 64-bit27550.00.00.00.00.0 43.80.00.00.00.00.00.0
7Lc0 0.20.2 w32930 64-bit26760.00.00.00.00.043.8 0.00.00.00.00.00.0
8Leela Chess 0.10 w483 64-bit26070.00.00.00.014.80.00.0 0.00.00.00.00.0
9Leela Chess 0.10 w323 64-bit25370.00.00.00.00.00.00.00.0 0.00.00.00.0
10Leela Chess 0.10 w272 64-bit23080.00.00.00.00.00.00.00.00.0 100.015.90.0
11Leela Chess 0.9 w272 64-bit22710.00.00.00.00.00.00.00.00.0100.0 15.90.0
12Leela Chess 0.7 w187 64-bit22350.00.00.00.00.00.00.00.00.015.915.9 29.7
13Leela Chess 0.5 w123 64-bit19630.00.00.00.00.00.00.00.00.00.00.029.7 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 33 common opponents

Custom engine selection
NameEloLc0
0.21.1
JH.T6.532
GTX1050
Lc0
0.21.1
w41800
GTX1050
Lc0
0.20.2
w32930
GTX1050
Lc0
0.20.1
w36089
GTX980Ti
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.0
w32930
64-bit
Lc0
0.20.2
w32930
64-bit
Leela
Chess
0.10
w483
64-bit
Leela
Chess
0.10
w323
64-bit
Leela
Chess
0.10
w272
64-bit
Leela
Chess
0.9
w272
64-bit
Leela
Chess
0.7
w187
64-bit
Leela
Chess
0.5
w123
64-bit
Stockfish 10 64-bit 4CPU354540%
39.5/100
40%
40/100
32%
32.5/100
          
Houdini 6 64-bit 4CPU351948%
47.5/100
44%
44/100
46%
46/100
          
Stockfish 10 64-bit349352%
51.5/100
47%
47/100
48%
48.5/100
24%
12/49
         
Komodo 12.3 64-bit 4CPU348753%
53/100
51%
51/100
46%
45.5/100
          
Houdini 6 64-bit344660%
59.5/100
54%
54/100
55%
55/100
39%
19/49
         
Fire 7.1 64-bit 4CPU342358%
58/100
64%
63.5/100
54%
54.5/100
          
Komodo 11.3.1 64-bit341963%
63/100
56%
56.5/100
62%
62/100
          
Ethereal 11.25 64-bit 4CPU339064%
64.5/100
59%
59/100
54%
54/100
          
Fire 7.1 64-bit333873%
73/100
68%
68.5/100
62%
62/100
42%
20.5/49
         
Andscacs 0.95 64-bit 4CPU333370%
70/100
 72%
71.5/100
          
Xiphos 0.5 64-bit330972%
71.5/100
74%
73.5/100
66%
65.5/100
51%
25.5/50
         
Pirarucu 2.9.5 64-bit2985     19%
6/32
19%
6/32
      
Colossus 2008b2641    73%
22.5/31
  56%
18/32
     
Cyrano 0.6b17 64-bit2641    67%
21.5/32
  48%
15.5/32
     
Sjakk 2.2 64-bit2638    67%
21.5/32
  52%
15.5/30
     
WyldChess 1.51 64-bit2631    61%
19.5/32
  47%
15/32
     
Galjoen 0.38 64-bit2319         39%
12.5/32
44%
14/32
  
Absolute Zero 2.4.7.2 64-bit2316         70%
22.5/32
70%
22.5/32
  
Aice 0.99.22315         56%
17.5/31
48%
15.5/32
  
Sungorus 1.4 64-bit2314         52%
16.5/32
52%
16.5/32
  
NameEloLc0
0.21.1
JH.T6.532
GTX1050
Lc0
0.21.1
w41800
GTX1050
Lc0
0.20.2
w32930
GTX1050
Lc0
0.20.1
w36089
GTX980Ti
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.0
w32930
64-bit
Lc0
0.20.2
w32930
64-bit
Leela
Chess
0.10
w483
64-bit
Leela
Chess
0.10
w323
64-bit
Leela
Chess
0.10
w272
64-bit
Leela
Chess
0.9
w272
64-bit
Leela
Chess
0.7
w187
64-bit
Leela
Chess
0.5
w123
64-bit
Napoleon 1.8 64-bit2250         42%
13/31
38%
12/32
  
GopherCheck 0.2.3 64-bit2237         53%
17/32
38%
12/32
  
Robocide 20170718 64-bit2236         59%
19/32
50%
16/32
45%
13/29
 
Anechka 0.082235         61%
19.5/32
47%
15/32
35%
10.5/30
 
AliChess 4.252229         47%
15/32
55%
17.5/32
57%
17/30
 
CT800 1.20 64-bit2218         70%
22.5/32
75%
24/32
  
FireFly 2.7.0 64-bit2208         67%
21.5/32
48%
15.5/32
  
Vice 1.0 64-bit2041           71%
20.5/29
33%
10.5/32
Jabba 1.0 64-bit2036           75%
22.5/30
39%
12.5/32
Embla 1.0.1 64-bit1987           85%
25.5/30
47%
14.5/31
Snowy 0.2 64-bit1986           78%
19.5/25
41%
12/29
Hedgehog 1.8041969           84%
24.5/29
60%
18.5/31
Etude 0.1.21954           72%
16.5/23
47%
14.5/31
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 20, 2019