CCRL 40/4
Downloads and Statistics
November 16, 2019
Testing summary:
Total: 2'132'153 games
played by 2'491 programs
28840 CPU days (X2 4600+)

White wins: 826'813 (38.8%)
Black wins: 668'076 (31.3%)
Draws: 637'264 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 14 engines!
14 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 16, 2019 with Bayeselo based on 2'132'153 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Bright 0.4a 4CPU2910+11−1142.4%+50.333.9%3023 
67.0%
 Bright 0.5c 4CPU2906+14−1436.5%+92.335.7%1715
94.3%
 Bright 0.3d 4CPU2890+14−1444.4%+38.635.6%1789
90.7%
 Bright 0.3b 4CPU2877+13−1342.4%+53.033.9%2093
99.4%
 Bright 0.3a 4CPU2853+14−1443.7%+40.834.6%1756
100.0%
 Bright 0.2c 4CPU2812+17−1735.5%+101.830.1%1244
99.9%
 Bright 0.4a2779+10−944.0%+43.029.2%4353
90.9%
 Bright 0.5c2771+8−847.1%+21.831.8%7034
91.1%
 Bright 0.3b2753+25−2538.0%+80.234.0%547
86.3%
 Bright 0.3d2735+19−2032.6%+129.530.3%995
100.0%
 Bright 0.2c2687+13−1350.8%−3.630.8%2039
54.4%
 Bright 0.2b2685+30−3049.6%+0.632.0%372
97.3%
 Bright 0.2a2646+27−2744.2%+38.032.2%466
60.9%
 Bright 0.1d2641+22−2251.7%−13.030.6%712
 

Results matrix

Custom engine selection
#NameElo1234567891011121314
1Bright 0.4a 4CPU2910              
2Bright 0.5c 4CPU2906              
3Bright 0.3d 4CPU2890              
4Bright 0.3b 4CPU2877              
5Bright 0.3a 4CPU2853              
6Bright 0.2c 4CPU2812              
7Bright 0.4a2779              
8Bright 0.5c2771              
9Bright 0.3b2753              
10Bright 0.3d2735              
11Bright 0.2c2687              
12Bright 0.2b2685              
13Bright 0.2a2646              
14Bright 0.1d2641              
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011121314
1Bright 0.4a 4CPU2910 67.098.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Bright 0.5c 4CPU290633.0 94.399.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Bright 0.3d 4CPU28901.25.7 90.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Bright 0.3b 4CPU28770.00.29.3 99.4100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Bright 0.3a 4CPU28530.00.00.00.6 100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Bright 0.2c 4CPU28120.00.00.00.00.0 99.9100.0100.0100.0100.0100.0100.0100.0
7Bright 0.4a27790.00.00.00.00.00.1 90.997.1100.0100.0100.0100.0100.0
8Bright 0.5c27710.00.00.00.00.00.09.1 91.1100.0100.0100.0100.0100.0
9Bright 0.3b27530.00.00.00.00.00.02.98.9 86.3100.0100.0100.0100.0
10Bright 0.3d27350.00.00.00.00.00.00.00.013.7 100.099.7100.0100.0
11Bright 0.2c26870.00.00.00.00.00.00.00.00.00.0 54.499.7100.0
12Bright 0.2b26850.00.00.00.00.00.00.00.00.00.345.6 97.399.0
13Bright 0.2a26460.00.00.00.00.00.00.00.00.00.00.32.7 60.9
14Bright 0.1d26410.00.00.00.00.00.00.00.00.00.00.01.039.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011121314
1Bright 0.4a 4CPU2910 253919842388148712561501920150152000
2Bright 0.5c 4CPU29062539 74610506985406611201001298210082
3Bright 0.3d 4CPU28901984746 35831869157321625803003299615096
4Bright 0.3b 4CPU2877238810503583 2471221321625803003299615096
5Bright 0.3a 4CPU2853148769818692471 221414519299440128819981
6Bright 0.2c 4CPU28121256540157322132214 00000000
7Bright 0.4a2779150662162161450 37954587171173262128116
8Bright 0.5c277119211225825819203795 3245351111217180156
9Bright 0.3b27530000990458324 9930000
10Bright 0.3d27351501003003004400717535993 1688210082
11Bright 0.2c26871521293293291280117311110168 651356419
12Bright 0.2b26850829696810262217082651 403269
13Bright 0.2a264601001501509901281800100356403 520
14Bright 0.1d26410829696810116156082419269520 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011121314
1Bright 0.4a 4CPU2910 53.641.246.731.129.42.01.90.03.73.00.00.00.0
2Bright 0.5c 4CPU290653.6 21.327.620.118.21.11.30.03.73.43.94.63.4
3Bright 0.3d 4CPU289041.221.3 92.352.751.93.52.90.010.88.64.46.73.8
4Bright 0.3b 4CPU287746.727.692.3 64.266.33.42.80.09.78.03.95.93.4
5Bright 0.3a 4CPU285331.120.152.764.2 73.82.42.24.316.03.43.84.53.3
6Bright 0.2c 4CPU281229.418.251.966.373.8 0.00.00.00.00.00.00.00.0
7Bright 0.4a27792.01.13.53.42.40.0 33.39.313.418.45.52.72.3
8Bright 0.5c27711.91.32.92.82.20.033.3 4.36.712.22.92.42.0
9Bright 0.3b27530.00.00.00.04.30.09.34.3 64.40.00.00.00.0
10Bright 0.3d27353.73.710.89.716.00.013.46.764.4 5.56.06.84.8
11Bright 0.2c26873.03.48.68.03.40.018.412.20.05.5 27.014.215.2
12Bright 0.2b26850.03.94.43.93.80.05.52.90.06.027.0 48.124.8
13Bright 0.2a26460.04.66.75.94.50.02.72.40.06.814.248.1 44.1
14Bright 0.1d26410.03.43.83.43.30.02.32.00.04.815.224.844.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 120 common opponents

Custom engine selection
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
Rybka 3 64-bit 4CPU316614%
13.5/100
19%
9.5/50
13%
13/100
13%
13.5/101
          
Rybka 4.1 64-bit3108      11%
3.5/32
17%
0.5/3
      
Stockfish 1.6s JA 64-bit 4CPU309327%
26.5/99
28%
13.5/49
            
Stockfish 1.6.3 64-bit 4CPU308922%
22/100
23%
11.5/50
            
Rybka 3 64-bit307826%
25.5/100
 18%
18/100
22%
22/100
  12%
6/50
6%
2/32
 9%
4.5/50
    
Naum 4.1 64-bit 4CPU307030%
15/50
20%
10/50
            
Naum 4 64-bit 4CPU306127%
27/100
25%
12.5/50
            
Stockfish 1.8 64-bit3058      18%
6/34
18%
6/34
      
Stockfish 1.7.1 64-bit3045      12%
4/32
19%
11.5/62
      
Rybka 2.3.2a 64-bit 4CPU3044  26%
25.5/99
24%
24/99
29%
14/48
15%
14/91
        
Deep Shredder 12 64-bit 4CPU304132%
63.5/200
32%
32/100
            
Naum 4.2 64-bit2987      20%
10/50
25%
12.5/50
      
Naum 3 64-bit 4CPU2986  38%
37.5/100
27%
27/100
28%
28/100
22%
22/98
        
Stockfish 1.6.3 64-bit2985      26%
13/50
19%
6/32
      
Stockfish 1.6s JA 64-bit2980      28%
14/50
28%
9/32
      
Naum 3.1 64-bit 4CPU297832%
31.5/99
 40%
40.5/100
34%
34.5/100
30%
29.5/100
         
Rybka 2.3.2a 64-bit2977    32%
15.5/49
 15%
4.5/30
20%
6.5/32
25%
12.5/50
19%
18.5/99
    
Critter 0.70 64-bit2973      22%
6.5/30
19%
6/32
      
Zappa Mexico II 64-bit 4CPU297040%
40.5/100
42%
21/50
43%
43.5/101
40%
40.5/100
48%
24/50
         
Spark 0.3 64-bit 4CPU296941%
41/100
36%
18/50
            
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
Komodo 1.2 64-bit2966      28%
7.5/27
25%
8/32
      
Thinker 5.4c Inert 64-bit 4CPU295244%
44/100
46%
23/50
            
Naum 4 64-bit2947      33%
16.5/50
31%
10/32
      
Zappa Mexico 64-bit 4CPU294546%
45.5/100
54%
27/50
 45%
45/100
32%
31.5/99
28%
38.5/138
        
Deep Junior 11.1a 64-bit 4CPU294240%
20/50
46%
37/80
            
Hiarcs 12 4CPU294140%
39.5/99
39%
19.5/50
 38%
38.5/100
38%
38/100
40%
40/100
        
Deep Sjeng WC2008 64-bit 4CPU294050%
50/100
48%
24/50
            
Hiarcs 12.1 4CPU293937%
37/100
44%
22/50
            
Deep Shredder 11 64-bit 4CPU293256%
55.5/99
 39%
37/95
45%
42.5/95
37%
18.5/50
37%
34/91
        
Deep Sjeng 3.0 64-bit 4CPU293051%
50/99
 45%
44.5/99
38%
38/100
          
Hiarcs Paderborn 2007 4CPU2929   42%
41.5/99
41%
41/100
34%
33.5/100
        
Rybka 2.3.2a 32-bit2922      27%
3/11
   15%
8/52
21%
2.5/12
  
Spike 1.4 Leiden2921      36%
13/36
50%
1/2
      
Hiarcs 11.2 4CPU2914  46%
46.5/100
41%
40.5/99
38%
18/48
36%
33.5/92
        
Naum 2.2 64-bit 4CPU2908    39%
19/49
38%
34.5/92
        
Toga II 1.4 beta5c 4CPU290446%
45.5/100
45%
22.5/50
50%
50/100
40%
39.5/100
48%
24/50
44%
21.5/49
        
Glaurung 2.1 64-bit 4CPU290051%
50.5/99
 46%
46/100
53%
53/100
36%
36.5/100
24%
24.5/100
        
Hiarcs 11.1 4CPU2900  48%
48/100
47%
47/100
          
Toga II 1.4.1SE 4CPU289953%
51.5/98
 48%
47.5/100
45%
45/100
48%
15/31
31%
9.5/31
        
Doch 1.3.4 64-bit2894      39%
12.5/32
23%
7.5/32
      
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
Fritz 11288856%
56/100
      36%
11.5/32
  24%
12.5/52
   
Thinker 5.4d Inert 64-bit2886      29%
11/38
32%
13/40
      
Thinker 5.4c Inert 64-bit2883      46%
23/50
31%
19.5/62
      
Spark 0.4 64-bit2882      28%
8.5/30
30%
24.5/82
      
Loop M1-T 64-bit 4CPU288158%
57/99
53%
26.5/50
53%
51/96
48%
48.5/100
39%
19.5/50
41%
37.5/91
        
Gaviota 1.0 64-bit2873      25%
1.5/6
37%
12.5/34
      
Loop 13.6 (Loop 2007) 64-bit 4CPU2867  49%
48.5/99
52%
52.5/100
          
Tornado 8.0 64-bit 4CPU286770%
22.5/32
59%
19/32
            
Naum 3.1 64-bit2863        36%
18/50
25%
12.5/50
    
Glaurung 2.0.1 64-bit 4CPU2861  60%
60.5/100
54%
54/100
50%
25/50
47%
37.5/80
        
Protector 1.3.5 64-bit2856      30%
9/30
42%
12.5/30
      
Naum 3 64-bit2854         25%
12.5/50
31%
4/13
   
Protector 1.3.4 64-bit2852      43%
13/30
39%
12.5/32
      
Shredder 112847      38%
23/60
   34%
11.5/34
25%
5/20
  
Spark 0.3 64-bit2844      34%
17/50
42%
27/64
      
Zappa Mexico II 64-bit2844      34%
21.5/63
32%
10.5/33
 41%
20.5/50
    
Deep Shredder 11 64-bit2842    35%
17/48
    33%
16/49
    
Deep Sjeng 3.0 64-bit2838      43%
21.5/50
48%
15.5/32
36%
17.5/49
29%
14/49
    
Onno 1.1.1 64-bit2837      37%
18.5/50
41%
13/32
      
Hiarcs 122835      39%
19.5/50
30%
9.5/32
34%
16.5/49
40%
19.5/49
    
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
Hiarcs 12.12833      45%
31.5/70
39%
12/31
      
Toga II 1.4.1SE2823      33%
10/30
45%
13.5/30
40%
20/50
     
Cheng4 0.36c 64-bit2820      51%
19.5/38
58%
18.5/32
      
Toga II 1.4 beta5c2820      44%
22/50
 34%
17/50
36%
36.5/100
    
Hiarcs Paderborn 20072819        38%
38/100
44%
22/50
    
Grapefruit 1.0 a2b2810        43%
21/49
45%
22.5/50
    
Fritz 102799          41%
14.5/35
34%
5.5/16
  
Loop M1-T 64-bit2786    68%
33.5/49
    48%
23/48
    
Glaurung 2.1 64-bit2782        52%
26/50
43%
43/99
    
Ktulu 92781      54%
26.5/49
47%
15.5/33
      
Fruit 2.3.12780      55%
5.5/10
100%
3/3
  32%
11/34
   
Octochess r5190 64-bit2778      62%
8/13
44%
14/32
      
Loop 13.6 (Loop 2007) 32-bit2775       52%
15.5/30
  40%
13.5/34
   
Toga II 1.3.12772  66%
65.5/100
70%
70.5/100
      32%
16/50
   
MinkoChess 0.9 64-bit2771      47%
14/30
42%
12.5/30
      
Naum 2.2 32-bit2770          33%
11.5/35
40%
12.5/31
45%
14.5/32
 
Twisted Logic 20090922 64-bit2770      53%
26.5/50
53%
17/32
      
Twisted Logic 20100131x 64-bit2766      53%
16/30
51%
46.5/91
      
Jonny 4.002763      62%
22.5/36
0%
0/2
      
Bison 9.11 64-bit2761      58%
17.5/30
57%
17/30
      
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
BugChess2 1.9 64-bit2758      58%
7/12
54%
18.5/34
      
Fruit 2.2.12750            39%
12.5/32
22%
7/32
SmarThink 1.20 64-bit2747      61%
30.5/50
61%
19.5/32
      
Naum 2.1 32-bit2738            41%
13/32
30%
9.5/32
Hiarcs 102736           36%
10.5/29
38%
19/50
36%
18/50
Spike 1.2 Turin2731 77%
38.5/50
72%
72/100
69%
69/100
70%
34.5/49
 61%
13.5/22
62%
38.5/62
 46%
23/50
41%
32/79
44%
14/32
34%
17/50
42%
13.5/32
Scorpio 2.0 32-bit 4CPU2730    74%
36.5/49
68%
34/50
        
Crafty 23.2 64-bit2721      50%
15/30
62%
18.5/30
      
Chess Tiger 2007.12713       50%
1/2
   50%
10.5/21
48%
15.5/32
 
Naum 2.0 32-bit2700      63%
19/30
60%
18/30
  46%
16/35
   
Frenzee Feb08 64-bit2694      65%
19.5/30
63%
19/30
  46%
15.5/34
   
Naum 2.0 64-bit2693      57%
17/30
65%
19.5/30
  62%
26.5/43
   
Delfi 5.42682      63%
26.5/42
100%
1/1
  43%
14.5/34
   
Scorpio 2.5 64-bit2682      65%
19.5/30
55%
16.5/30
      
Pharaon 3.5.1 4CPU2674    80%
37/46
65%
26.5/41
        
Daydreamer 1.75 64-bit2672      63%
19/30
52%
15.5/30
      
BugChess2 1.6.4 64-bit2670      60%
18/30
63%
19/30
      
Booot 4.15.12668      65%
19.5/30
67%
33.5/50
      
Booot 4.15.02665      65%
19.5/30
78%
23.5/30
      
SmarThink 1.00 32-bit2664           60%
18/30
50%
16/32
48%
15.5/32
NameEloBright
0.4a
4CPU
Bright
0.5c
4CPU
Bright
0.3d
4CPU
Bright
0.3b
4CPU
Bright
0.3a
4CPU
Bright
0.2c
4CPU
Bright
0.4a
Bright
0.5c
Bright
0.3b
Bright
0.3d
Bright
0.2c
Bright
0.2b
Bright
0.2a
Bright
0.1d
Alaric 7072663      79%
41/52
76%
26/34
  51%
41/80
57%
12/21
  
Glaurung 1.2.1 32-bit2657          53%
18.5/35
  42%
13.5/32
Scorpio 2.0 32-bit2656          51%
34/67
56%
18/32
  
Colossus 2008b2642      79%
32.5/41
84%
26/31
  62%
20/32
   
Cyrano 0.6b17 64-bit2641      83%
25/30
47%
14/30
  53%
18/34
   
E.T. Chess 13.01.082634      67%
28/42
75%
1.5/2
  64%
20.5/32
   
Alfil 8.1.1 Optimized2625       72%
21/29
  66%
21/32
   
Movei 00.8.438 (10 10 10)2623      63%
26.5/42
80%
24/30
  56%
18/32
   
WildCat 82623      72%
29.5/41
67%
20/30
  59%
20/34
   
Alaric 7042618            36%
11.5/32
49%
24.5/50
Sloppy 0.2.2 64-bit2617      75%
22.5/30
78%
23.5/30
      
Delfi 5.12615          66%
21/32
  58%
18.5/32
Slow Chess Blitz WV2.12615      67%
20/30
82%
25.5/31
  69%
46.5/67
   
Delfi 5.22609          70%
46/66
53%
17/32
  
ProDeo 1.22608      65%
19.5/30
78%
23.5/30
      
WildCat 72606          67%
45/67
  52%
16.5/32
Amyan 1.722604      80%
24/30
76%
23.5/31
      
Pharaon 3.5.12603      80%
24/30
80%
24/30
  65%
43.5/67
62%
20/32
50%
16/32
56%
18/32
Colossus 2007c2586          61%
19.5/32
 66%
21/32
 
Hamsters 0.7.12578       100%
1/1
  65%
22/34
   
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 16, 2019