CCRL 40/2 FRC
Downloads and Statistics
September 15, 2020
Testing summary:
Total: 294'230 games
played by 227 programs

White wins: 119'042 (40.5%)
Black wins: 101'521 (34.5%)
Draws: 73'667 (25.0%)
White score: 53.0%

Custom engine selection

Comparing 29 engines!
29 selected engines played 500 games with each other

CCRL 40/2 FRC Rating List — Custom engine selection (Quote)

Ponder off, 5-men EGTB, 128MB hash, 64-bit executables where available, random openings with switched sides
Time control: Equivalent to 40 moves in 2 minutes on an Intel i7-4770k.
Computed on September 15, 2020 with Bayeselo based on 294'230 games
RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
ELO+
1Stockfish 123767+12−1269.7%−141.037.4%2522 
85.4%
 Stockfish 1707203759+12−1269.6%−136.140.3%2650
100.0%
 Stockfish 103714+10−1074.8%−175.737.3%4148
100.0%
 Stockfish 93671+13−1377.3%−213.834.8%2400
99.7%
 Stockfish 1809173644+15−1477.9%−221.133.0%2100
99.8%
 Stockfish 83618+11−1172.7%−181.436.9%3300
100.0%
 Stockfish 2005163564+16−1678.0%−229.827.1%1800
99.7%
 Stockfish 1503163534+15−1575.2%−199.831.6%1800
99.9%
 Stockfish 2008153501+15−1571.6%−169.031.6%1800
100.0%
 Stockfish 63463+13−1370.9%−161.032.6%2400
100.0%
 Stockfish 0405143413+15−1579.7%−245.123.0%2100
100.0%
 Stockfish DD3349+15−1574.9%−200.425.0%2100
100.0%
 Stockfish 1609133302+14−1464.6%−117.628.9%2100
100.0%
 Stockfish 33229+13−1369.2%−156.824.3%2700
99.3%
 Stockfish 2.3.13205+15−1556.7%−56.329.3%1700
84.2%
 Stockfish 2.2.13193+18−1864.1%−110.227.0%1200
51.2%
 Stockfish VE_093193+16−1553.8%−37.529.5%1600
64.6%
 Stockfish 2.1.13188+19−1966.3%−124.228.6%1100
56.9%
 Stockfish 2.2.23185+20−2066.3%−125.428.5%1000
100.0%
 Stockfish 2.0.13138+18−1768.7%−145.526.8%1300
75.3%
 Stockfish 1.83129+20−1971.7%−167.423.9%1100
85.5%
 Stockfish 1.73113+22−2271.5%−163.027.3%800
56.9%
 Stockfish 1.9.13110+25−2473.0%−179.621.7%700
100.0%
 Stockfish 1.63037+22−2264.6%−111.026.1%800
100.0%
 Stockfish 1.5.12940+19−1955.2%−40.323.8%1000
100.0%
 Glaurung 2.22795+14−1458.3%−71.319.8%2200
100.0%
 Glaurung 2.12730+14−1451.0%−10.319.8%2000
99.9%
 Glaurung 2.0.12697+15−1548.0%+8.722.6%1900
100.0%
 Glaurung 1.2.12637+13−1346.6%+23.521.4%2400
 

Results matrix

Custom engine selection
#NameELO1234567891011121314151617181920212223242526272829
1Stockfish 123767 281 − 219
+151−89=260
+28
                           
2Stockfish 1707203759219 − 281
+89−151=260
−28
                            
3Stockfish 103714                             
4Stockfish 93671                             
5Stockfish 1809173644                             
6Stockfish 83618                             
7Stockfish 2005163564                             
8Stockfish 1503163534                             
9Stockfish 2008153501                             
10Stockfish 63463                             
11Stockfish 0405143413                             
12Stockfish DD3349                             
13Stockfish 1609133302                             
14Stockfish 33229                             
15Stockfish 2.3.13205                             
16Stockfish 2.2.13193                             
17Stockfish VE_093193                             
18Stockfish 2.1.13188                             
19Stockfish 2.2.23185                             
20Stockfish 2.0.13138                             
21Stockfish 1.83129                             
22Stockfish 1.73113                             
23Stockfish 1.9.13110                             
24Stockfish 1.63037                             
25Stockfish 1.5.12940                             
26Glaurung 2.22795                             
27Glaurung 2.12730                             
28Glaurung 2.0.12697                             
29Glaurung 1.2.12637                             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameELO1234567891011121314151617181920212223242526272829
1Stockfish 123767 85.4100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Stockfish 170720375914.6 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Stockfish 1037140.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Stockfish 936710.00.00.0 99.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Stockfish 18091736440.00.00.00.3 99.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Stockfish 836180.00.00.00.00.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
7Stockfish 20051635640.00.00.00.00.00.0 99.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
8Stockfish 15031635340.00.00.00.00.00.00.3 99.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
9Stockfish 20081535010.00.00.00.00.00.00.00.1 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
10Stockfish 634630.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
11Stockfish 04051434130.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
12Stockfish DD33490.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
13Stockfish 16091333020.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
14Stockfish 332290.00.00.00.00.00.00.00.00.00.00.00.00.0 99.399.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
15Stockfish 2.3.132050.00.00.00.00.00.00.00.00.00.00.00.00.00.7 84.287.491.793.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
16Stockfish 2.2.131930.00.00.00.00.00.00.00.00.00.00.00.00.00.115.8 51.265.070.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
17Stockfish VE_0931930.00.00.00.00.00.00.00.00.00.00.00.00.00.012.648.8 64.671.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
18Stockfish 2.1.131880.00.00.00.00.00.00.00.00.00.00.00.00.00.08.335.035.4 56.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
19Stockfish 2.2.231850.00.00.00.00.00.00.00.00.00.00.00.00.00.06.129.228.943.1 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
20Stockfish 2.0.131380.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 75.395.896.5100.0100.0100.0100.0100.0100.0
21Stockfish 1.831290.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.024.7 85.588.1100.0100.0100.0100.0100.0100.0
22Stockfish 1.731130.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.04.214.5 56.9100.0100.0100.0100.0100.0100.0
23Stockfish 1.9.131100.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.03.511.943.1 100.0100.0100.0100.0100.0100.0
24Stockfish 1.630370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0
25Stockfish 1.5.129400.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0
26Glaurung 2.227950.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0
27Glaurung 2.127300.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 99.9100.0
28Glaurung 2.0.126970.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.1 100.0
29Glaurung 1.2.126370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Score with 60 common opponents

Custom engine selection
NameELOStockfish
12
Stockfish
170720
Stockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Lc0 0.26.1 w714700 GTX1050374149%
147.5/300
49%
148/300
45%
104/230
                          
Houdini 6364669%
206.5/300
68%
210.5/308
64%
192.5/300
52%
154.5/300
50%
148.5/300
43%
129.5/300
                       
Komodo 13.3361675%
224.5/300
76%
237/310
69%
206.5/300
                          
Komodo 11.2.13587  73%
73/100
66%
199.5/300
60%
180/300
54%
161/300
                       
Komodo 12.1.13583  70%
210/300
63%
189/300
                         
Ethereal 12.50357377%
231.5/300
79%
246/310
                           
Allie 0.5 nn42850 GTX1050354377%
170/222
 68%
68.5/100
                          
Komodo 14 MCTS3534 83%
249/300
77%
153.5/200
                          
Ethereal 12.00352180%
240.5/300
87%
262/302
82%
246/300
                          
SlowChess Blitz 2.2349986%
257/300
85%
272/320
82%
170/208
                          
Komodo 9.423495      60%
181.5/300
60%
181/300
53%
159.5/300
                    
Komodo 103489      62%
186.5/300
56%
168/300
                     
Fire 7.13487  82%
246/300
79%
237.5/300
                         
Komodo 9.23476        55%
166/300
45%
135.5/300
                   
Fire 6.13415   85%
254.5/300
82%
247/300
                        
Houdini 43392     86%
259.5/300
78%
234/300
74%
221/300
67%
201/300
64%
192.5/300
55%
164.5/300
40%
120.5/300
36%
108.5/300
                
Shredder 133383  91%
274/300
86%
259.5/300
86%
258/300
80%
240.5/300
                       
Fire 53372    86%
257/300
84%
250.5/300
                       
Houdini 33357            45%
135/300
30%
90.5/300
30%
90/300
 28%
83.5/300
            
Critter 1.6a3292   92%
275.5/300
89%
268/300
87%
261.5/300
84%
250.5/300
82%
247/300
78%
234/300
73%
219.5/300
68%
205/300
61%
182/300
53%
158/300
39%
117/300
36%
107.5/300
36%
35.5/100
34%
101.5/300
 33%
33/100
          
NameELOStockfish
12
Stockfish
170720
Stockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Houdini 2.03271              41%
41/100
38%
38/100
44%
43.5/100
37%
37/100
40%
40/100
          
Chiron 43265   95%
284/300
93%
278/300
90%
269/300
                       
Critter 1.23236               44%
43.5/100
 41%
41/100
           
Fire 3.03175     94%
283/300
92%
275/300
90%
269/300
88%
263/300
88%
265/300
81%
242/300
                  
Critter 1.013162               55%
55/100
 56%
55.5/100
 51%
51/100
         
Rybka 4.13162      92%
277/300
89%
267/300
88%
265.5/300
83%
250/300
82%
246/300
77%
230.5/300
70%
209.5/300
60%
179.5/300
56%
169/300
56%
56/100
51%
154/300
56%
55.5/100
57%
57/100
42%
42.5/100
         
Chiron 23106         93%
278/300
88%
264/300
82%
246.5/300
                 
Critter 0.903105                   52%
52/100
58%
57.5/100
        
Rybka 33087               68%
68.5/100
 64%
63.5/100
71%
71/100
58%
58/100
50%
50/100
49%
49/100
 47%
47/100
26%
26/100
16%
16/100
   
Chiron 1.53040           88%
264/300
83%
248/300
79%
237/300
76%
75.5/100
              
Critter 0.803037                   70%
70/100
68%
68/100
62%
61.5/100
60%
60.5/100
      
Naum 4.23034          92%
276/300
89%
267/300
81%
243/300
74%
221.5/300
73%
73/100
78%
77.5/100
70%
69.5/100
69%
69/100
70%
70/100
66%
65.5/100
70%
70.5/100
62%
62/100
53%
53/100
53%
53/100
28%
28.5/100
    
Shredder 123014          92%
276/300
88%
262.5/300
85%
254.5/300
80%
239/300
76%
76/100
72%
71.5/100
77%
77/100
76%
76.5/100
70%
70.5/100
68%
68/100
63%
63/100
62%
62/100
64%
64.5/100
50%
50.5/100
40%
40/100
    
Naum 42987                       55%
55/100
45%
45/100
22%
22.5/100
16%
16.5/100
  
Chiron 1.1a2985              76%
75.5/100
82%
82/100
74%
74/100
78%
78.5/100
73%
73/100
          
Rybka 2.3.2z32955                          26%
26.5/100
14%
14/100
16%
16/100
Spike 1.4 Leiden2945             87%
260.5/300
85%
85/100
78%
78.5/100
85%
85/100
80%
79.5/100
80%
79.5/100
74%
74/100
71%
71/100
        
Hiarcs 13.22928             88%
263/300
86%
86/100
79%
79/100
84%
84.5/100
86%
86/100
84%
84.5/100
76%
76/100
78%
77.5/100
        
Hiarcs 13.12898                   80%
80/100
74%
74/100
82%
82.5/100
78%
78/100
      
Deep Sjeng WC20082878             86%
259.5/300
86%
85.5/100
84%
84/100
88%
87.5/100
88%
87.5/100
85%
85/100
84%
84/100
81%
81/100
84%
84.5/100
84%
83.5/100
72%
72/100
59%
59/100
36%
35.5/100
25%
25/100
  
NameELOStockfish
12
Stockfish
170720
Stockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Shredder 112877                        57%
57/100
34%
34.5/100
31%
31/100
26%
26/100
25%
25/100
Naum 3.12857                          37%
37/100
26%
25.5/100
 
Hiarcs 12.12827                   85%
85/100
86%
85.5/100
84%
84.5/100
84%
83.5/100
75%
75/100
68%
67.5/100
44%
44.5/100
33%
33/100
32%
31.5/100
 
Cyclone xTreme Fear2825                   88%
87.5/100
90%
90.5/100
86%
86/100
88%
88/100
81%
81/100
68%
68/100
44%
44.5/100
   
Hiarcs 122823                         50%
50.5/100
36%
36.5/100
36%
36.5/100
 
Hiarcs Paderborn 20072823                         46%
45.5/100
34%
34.5/100
30%
29.5/100
 
Hiarcs 11.12778                         54%
54/100
 40%
40/100
26%
26/100
Naum 2.22772                           39%
39/100
40%
40.5/100
Fruit 0511032761                         52%
52.5/100
48%
48.5/100
44%
43.5/100
36%
35.5/100
Loop for Chess9602756                       83%
83/100
76%
76/100
60%
60/100
48%
48/100
38%
38/100
39%
39/100
Spike 1.2 Turin2712                        85%
85/100
64%
64.5/100
52%
51.5/100
42%
41.5/100
34%
33.5/100
Deep Sjeng 2.72711                          50%
50.5/100
52%
51.5/100
34%
34/100
Movei 00.8.4382570                         74%
74.5/100
70%
70.5/100
67%
67/100
58%
58.5/100
Pharaon 3.5.12548                         86%
86/100
76%
76.5/100
70%
70.5/100
65%
65/100
Hamsters 0.7.12517                         84%
84.5/100
82%
81.5/100
  
Hamsters 0.62495                          76%
76.5/100
75%
75/100
 
Hermann 2.42495                         82%
82.5/100
80%
80.5/100
  
Ufim 8.022486                         82%
81.5/100
82%
82/100
79%
79/100
78%
78/100
Hamsters 0.52427                           86%
86.5/100
74%
73.5/100
Hermann 2.02398                           88%
88/100
78%
78.5/100
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
White score
Number of games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in ELO range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2008 by CCRL team
Last games added on September 15, 2020