CCRL 40/2 FRC
Downloads and Statistics
June 21, 2020
Testing summary:
Total: 284'876 games
played by 222 programs

White wins: 115'667 (40.6%)
Black wins: 99'082 (34.8%)
Draws: 70'127 (24.6%)
White score: 52.9%

Custom engine selection

Comparing 27 engines!
27 selected engines played 0 games with each other

CCRL 40/2 FRC Rating List — Custom engine selection (Quote)

Ponder off, 5-men EGTB, 128MB hash, 64-bit executables where available, random openings with switched sides
Time control: Equivalent to 40 moves in 2 minutes on an Intel i7-4770k.
Computed on June 21, 2020 with Bayeselo based on 284'876 games
RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
ELO+
1Stockfish 103714+10−1076.5%−187.436.1%3918 
100.0%
 Stockfish 93672+13−1377.3%−214.534.8%2400
99.7%
 Stockfish 1809173645+15−1477.9%−221.733.0%2100
99.8%
 Stockfish 83618+11−1172.7%−181.136.9%3300
100.0%
 Stockfish 2005163564+16−1678.0%−229.827.1%1800
99.7%
 Stockfish 1503163534+15−1575.2%−199.831.6%1800
99.9%
 Stockfish 2008153501+15−1571.6%−169.031.6%1800
100.0%
 Stockfish 63463+13−1370.9%−161.032.6%2400
100.0%
 Stockfish 0405143413+16−1579.7%−245.123.0%2100
100.0%
 Stockfish DD3349+15−1574.9%−200.425.0%2100
100.0%
 Stockfish 1609133302+14−1464.6%−117.628.9%2100
100.0%
 Stockfish 33229+13−1369.2%−156.924.3%2700
99.3%
 Stockfish 2.3.13205+15−1556.7%−56.429.3%1700
84.3%
 Stockfish 2.2.13193+18−1864.1%−110.327.0%1200
51.0%
 Stockfish VE_093192+15−1553.8%−36.629.5%1600
64.8%
 Stockfish 2.1.13188+19−1966.3%−124.428.6%1100
56.9%
 Stockfish 2.2.23185+20−2066.3%−125.528.5%1000
100.0%
 Stockfish 2.0.13137+17−1768.7%−144.626.8%1300
75.3%
 Stockfish 1.83128+20−1971.7%−166.523.9%1100
85.4%
 Stockfish 1.73113+22−2271.5%−163.027.3%800
56.9%
 Stockfish 1.9.13110+25−2473.0%−179.621.7%700
100.0%
 Stockfish 1.63037+22−2264.6%−111.126.1%800
100.0%
 Stockfish 1.5.12940+19−1955.2%−40.423.8%1000
100.0%
 Glaurung 2.22795+14−1458.3%−71.419.8%2200
100.0%
 Glaurung 2.12730+14−1551.0%−10.419.8%2000
99.9%
 Glaurung 2.0.12697+14−1548.0%+8.722.6%1900
100.0%
 Glaurung 1.2.12637+13−1346.6%+23.521.4%2400
 

Results matrix

Custom engine selection
#NameELO123456789101112131415161718192021222324252627
1Stockfish 103714                           
2Stockfish 93672                           
3Stockfish 1809173645                           
4Stockfish 83618                           
5Stockfish 2005163564                           
6Stockfish 1503163534                           
7Stockfish 2008153501                           
8Stockfish 63463                           
9Stockfish 0405143413                           
10Stockfish DD3349                           
11Stockfish 1609133302                           
12Stockfish 33229                           
13Stockfish 2.3.13205                           
14Stockfish 2.2.13193                           
15Stockfish VE_093192                           
16Stockfish 2.1.13188                           
17Stockfish 2.2.23185                           
18Stockfish 2.0.13137                           
19Stockfish 1.83128                           
20Stockfish 1.73113                           
21Stockfish 1.9.13110                           
22Stockfish 1.63037                           
23Stockfish 1.5.12940                           
24Glaurung 2.22795                           
25Glaurung 2.12730                           
26Glaurung 2.0.12697                           
27Glaurung 1.2.12637                           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameELO123456789101112131415161718192021222324252627
1Stockfish 103714 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Stockfish 936720.0 99.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Stockfish 18091736450.00.3 99.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Stockfish 836180.00.00.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Stockfish 20051635640.00.00.00.0 99.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Stockfish 15031635340.00.00.00.00.3 99.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
7Stockfish 20081535010.00.00.00.00.00.1 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
8Stockfish 634630.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
9Stockfish 04051434130.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
10Stockfish DD33490.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
11Stockfish 16091333020.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
12Stockfish 332290.00.00.00.00.00.00.00.00.00.00.0 99.399.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
13Stockfish 2.3.132050.00.00.00.00.00.00.00.00.00.00.00.7 84.387.491.893.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
14Stockfish 2.2.131930.00.00.00.00.00.00.00.00.00.00.00.115.7 51.065.070.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
15Stockfish VE_0931920.00.00.00.00.00.00.00.00.00.00.00.012.649.0 64.871.2100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
16Stockfish 2.1.131880.00.00.00.00.00.00.00.00.00.00.00.08.235.035.2 56.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
17Stockfish 2.2.231850.00.00.00.00.00.00.00.00.00.00.00.06.129.228.843.1 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
18Stockfish 2.0.131370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 75.395.896.4100.0100.0100.0100.0100.0100.0
19Stockfish 1.831280.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.024.7 85.488.0100.0100.0100.0100.0100.0100.0
20Stockfish 1.731130.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.04.214.6 56.9100.0100.0100.0100.0100.0100.0
21Stockfish 1.9.131100.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.03.612.043.1 100.0100.0100.0100.0100.0100.0
22Stockfish 1.630370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0
23Stockfish 1.5.129400.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0
24Glaurung 2.227950.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0
25Glaurung 2.127300.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 99.9100.0
26Glaurung 2.0.126970.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.1 100.0
27Glaurung 1.2.126370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Score with 53 common opponents

Custom engine selection
NameELOStockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Houdini 6364964%
192.5/300
52%
154.5/300
50%
148.5/300
43%
129.5/300
                       
Komodo 11.2.1358773%
73/100
66%
199.5/300
60%
180/300
54%
161/300
                       
Komodo 12.1.1358370%
210/300
63%
189/300
                         
Komodo 9.423495    60%
181.5/300
60%
181/300
53%
159.5/300
                    
Komodo 103489    62%
186.5/300
56%
168/300
                     
Fire 7.1348782%
246/300
79%
237.5/300
                         
Komodo 9.23476      55%
166/300
45%
135.5/300
                   
Fire 6.13415 85%
254.5/300
82%
247/300
                        
Houdini 43392   86%
259.5/300
78%
234/300
74%
221/300
67%
201/300
64%
192.5/300
55%
164.5/300
40%
120.5/300
36%
108.5/300
                
Shredder 13338291%
274/300
86%
259.5/300
86%
258/300
80%
240.5/300
                       
Fire 53373  86%
257/300
84%
250.5/300
                       
Houdini 33357          45%
135/300
30%
90.5/300
30%
90/300
 28%
83.5/300
            
Critter 1.6a3292 92%
275.5/300
89%
268/300
87%
261.5/300
84%
250.5/300
82%
247/300
78%
234/300
73%
219.5/300
68%
205/300
61%
182/300
53%
158/300
39%
117/300
36%
107.5/300
36%
35.5/100
34%
101.5/300
 33%
33/100
          
Houdini 2.03271            41%
41/100
38%
38/100
44%
43.5/100
37%
37/100
40%
40/100
          
Chiron 43265 95%
284/300
93%
278/300
90%
269/300
                       
Critter 1.23235             44%
43.5/100
 41%
41/100
           
Fire 3.03175   94%
283/300
92%
275/300
90%
269/300
88%
263/300
88%
265/300
81%
242/300
                  
Critter 1.013162             55%
55/100
 56%
55.5/100
 51%
51/100
         
Rybka 4.13162    92%
277/300
89%
267/300
88%
265.5/300
83%
250/300
82%
246/300
77%
230.5/300
70%
209.5/300
60%
179.5/300
56%
169/300
56%
56/100
51%
154/300
56%
55.5/100
57%
57/100
42%
42.5/100
         
Chiron 23106       93%
278/300
88%
264/300
82%
246.5/300
                 
NameELOStockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Critter 0.903105                 52%
52/100
58%
57.5/100
        
Rybka 33087             68%
68.5/100
 64%
63.5/100
71%
71/100
58%
58/100
50%
50/100
49%
49/100
 47%
47/100
26%
26/100
16%
16/100
   
Chiron 1.53040         88%
264/300
83%
248/300
79%
237/300
76%
75.5/100
              
Critter 0.803037                 70%
70/100
68%
68/100
62%
61.5/100
60%
60.5/100
      
Naum 4.23034        92%
276/300
89%
267/300
81%
243/300
74%
221.5/300
73%
73/100
78%
77.5/100
70%
69.5/100
69%
69/100
70%
70/100
66%
65.5/100
70%
70.5/100
62%
62/100
53%
53/100
53%
53/100
28%
28.5/100
    
Shredder 123014        92%
276/300
88%
262.5/300
85%
254.5/300
80%
239/300
76%
76/100
72%
71.5/100
77%
77/100
76%
76.5/100
70%
70.5/100
68%
68/100
63%
63/100
62%
62/100
64%
64.5/100
50%
50.5/100
40%
40/100
    
Naum 42986                     55%
55/100
45%
45/100
22%
22.5/100
16%
16.5/100
  
Chiron 1.1a2985            76%
75.5/100
82%
82/100
74%
74/100
78%
78.5/100
73%
73/100
          
Rybka 2.3.2z32955                        26%
26.5/100
14%
14/100
16%
16/100
Spike 1.4 Leiden2944           87%
260.5/300
85%
85/100
78%
78.5/100
85%
85/100
80%
79.5/100
80%
79.5/100
74%
74/100
71%
71/100
        
Hiarcs 13.22928           88%
263/300
86%
86/100
79%
79/100
84%
84.5/100
86%
86/100
84%
84.5/100
76%
76/100
78%
77.5/100
        
Hiarcs 13.12898                 80%
80/100
74%
74/100
82%
82.5/100
78%
78/100
      
Deep Sjeng WC20082878           86%
259.5/300
86%
85.5/100
84%
84/100
88%
87.5/100
88%
87.5/100
85%
85/100
84%
84/100
81%
81/100
84%
84.5/100
84%
83.5/100
72%
72/100
59%
59/100
36%
35.5/100
25%
25/100
  
Shredder 112877                      57%
57/100
34%
34.5/100
31%
31/100
26%
26/100
25%
25/100
Naum 3.12857                        37%
37/100
26%
25.5/100
 
Hiarcs 12.12827                 85%
85/100
86%
85.5/100
84%
84.5/100
84%
83.5/100
75%
75/100
68%
67.5/100
44%
44.5/100
33%
33/100
32%
31.5/100
 
Cyclone xTreme Fear2825                 88%
87.5/100
90%
90.5/100
86%
86/100
88%
88/100
81%
81/100
68%
68/100
44%
44.5/100
   
Hiarcs 122823                       50%
50.5/100
36%
36.5/100
36%
36.5/100
 
Hiarcs Paderborn 20072823                       46%
45.5/100
34%
34.5/100
30%
29.5/100
 
Hiarcs 11.12778                       54%
54/100
 40%
40/100
26%
26/100
NameELOStockfish
10
Stockfish
9
Stockfish
180917
Stockfish
8
Stockfish
200516
Stockfish
150316
Stockfish
200815
Stockfish
6
Stockfish
040514
Stockfish
DD
Stockfish
160913
Stockfish
3
Stockfish
2.3.1
Stockfish
2.2.1
Stockfish
VE_09
Stockfish
2.1.1
Stockfish
2.2.2
Stockfish
2.0.1
Stockfish
1.8
Stockfish
1.7
Stockfish
1.9.1
Stockfish
1.6
Stockfish
1.5.1
Glaurung
2.2
Glaurung
2.1
Glaurung
2.0.1
Glaurung
1.2.1
Naum 2.22772                         39%
39/100
40%
40.5/100
Fruit 0511032761                       52%
52.5/100
48%
48.5/100
44%
43.5/100
36%
35.5/100
Loop for Chess9602756                     83%
83/100
76%
76/100
60%
60/100
48%
48/100
38%
38/100
39%
39/100
Spike 1.2 Turin2712                      85%
85/100
64%
64.5/100
52%
51.5/100
42%
41.5/100
34%
33.5/100
Deep Sjeng 2.72710                        50%
50.5/100
52%
51.5/100
34%
34/100
Movei 00.8.4382570                       74%
74.5/100
70%
70.5/100
67%
67/100
58%
58.5/100
Pharaon 3.5.12548                       86%
86/100
76%
76.5/100
70%
70.5/100
65%
65/100
Hamsters 0.7.12516                       84%
84.5/100
82%
81.5/100
  
Hamsters 0.62495                        76%
76.5/100
75%
75/100
 
Hermann 2.42495                       82%
82.5/100
80%
80.5/100
  
Ufim 8.022486                       82%
81.5/100
82%
82/100
79%
79/100
78%
78/100
Hamsters 0.52427                         86%
86.5/100
74%
73.5/100
Hermann 2.02398                         88%
88/100
78%
78.5/100
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
White score
Number of games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in ELO range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2008 by CCRL team
Last games added on June 21, 2020