CCRL 40/4
Downloads and Statistics
November 16, 2019
Testing summary:
Total: 2'132'153 games
played by 2'491 programs
28840 CPU days (X2 4600+)

White wins: 826'813 (38.8%)
Black wins: 668'076 (31.3%)
Draws: 637'264 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 13 engines!
13 selected engines played 15 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 16, 2019 with Bayeselo based on 2'132'153 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Gull 3 64-bit 4CPU3260+9−946.3%+23.245.1%4832 
60.2%
 Gull 2.8b 64-bit 4CPU3257+21−2170.1%−147.334.7%849
82.8%
 Gull 2.3 64-bit 4CPU3244+17−1763.8%−101.543.5%1137
93.9%
 Gull 2.2 64-bit 4CPU3224+20−2067.9%−132.436.8%945
65.6%
 Roc 0.3 64-bit3218+22−2253.6%−23.934.8%693
59.1%
 Gull 3.1 64-bit 4CPU3214+18−1840.9%+68.443.6%1090
98.5%
 Gull 3 64-bit3192+8−846.5%+25.439.8%5218
57.3%
 Gull 3.1 64-bit3190+15−1550.4%+5.044.1%1505
100.0%
 Gull 2.1 64-bit3098+13−1352.0%−16.746.3%1976
98.6%
 Gull 2.2 64-bit3074+17−1746.5%+19.748.4%1047
100.0%
 Gull 1.2 64-bit2950+15−1556.0%−42.435.5%1611
76.4%
 Gull 1.1 64-bit2943+12−1246.8%+21.734.6%2343
72.9%
 Gull 1.0a 64-bit2938+12−1256.5%−57.431.5%2724
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Gull 3 64-bit 4CPU3260             
2Gull 2.8b 64-bit 4CPU3257             
3Gull 2.3 64-bit 4CPU3244             
4Gull 2.2 64-bit 4CPU3224             
5Roc 0.3 64-bit3218             
6Gull 3.1 64-bit 4CPU3214             
7Gull 3 64-bit3192             
8Gull 3.1 64-bit3190             
9Gull 2.1 64-bit3098             
10Gull 2.2 64-bit3074             
11Gull 1.2 64-bit2950             
12Gull 1.1 64-bit2943            9.5 − 5.5
+6−2=7
+73
13Gull 1.0a 64-bit2938           5.5 − 9.5
+2−6=7
−73
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Gull 3 64-bit 4CPU3260 60.294.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Gull 2.8b 64-bit 4CPU325739.8 82.898.999.499.9100.0100.0100.0100.0100.0100.0100.0
3Gull 2.3 64-bit 4CPU32445.317.2 93.996.699.0100.0100.0100.0100.0100.0100.0100.0
4Gull 2.2 64-bit 4CPU32240.01.16.1 65.675.799.899.6100.0100.0100.0100.0100.0
5Roc 0.3 64-bit32180.00.63.434.4 59.198.497.8100.0100.0100.0100.0100.0
6Gull 3.1 64-bit 4CPU32140.00.11.024.340.9 98.597.6100.0100.0100.0100.0100.0
7Gull 3 64-bit31920.00.00.00.21.61.5 57.3100.0100.0100.0100.0100.0
8Gull 3.1 64-bit31900.00.00.00.42.22.442.7 100.0100.0100.0100.0100.0
9Gull 2.1 64-bit30980.00.00.00.00.00.00.00.0 98.6100.0100.0100.0
10Gull 2.2 64-bit30740.00.00.00.00.00.00.00.01.4 100.0100.0100.0
11Gull 1.2 64-bit29500.00.00.00.00.00.00.00.00.00.0 76.490.0
12Gull 1.1 64-bit29430.00.00.00.00.00.00.00.00.00.023.6 72.9
13Gull 1.0a 64-bit29380.00.00.00.00.00.00.00.00.00.010.027.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Gull 3 64-bit 4CPU3260 155114529670112619200006260
2Gull 2.8b 64-bit 4CPU32571551 1596109600000007490
3Gull 2.3 64-bit 4CPU324414521596 1496001001190007500
4Gull 2.2 64-bit 4CPU322496710961496 00000009460
5Roc 0.3 64-bit32180000 0143260810001144598
6Gull 3.1 64-bit 4CPU321411260000 0000000
7Gull 3 64-bit31921920100014320 23877451141954598
8Gull 3.1 64-bit319000119060802387 2201081144598
9Gull 2.1 64-bit309800001000745220 1980908186499
10Gull 2.2 64-bit30740000001141081980 233185374
11Gull 1.2 64-bit295000001140195114908233 7441297
12Gull 1.1 64-bit29436267497509464504545186185744 2076
13Gull 1.0a 64-bit29380000980989849937412972076 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Gull 3 64-bit 4CPU3260 27.324.316.70.019.01.90.00.00.00.08.70.0
2Gull 2.8b 64-bit 4CPU325727.3 80.461.10.00.00.00.00.00.00.023.50.0
3Gull 2.3 64-bit 4CPU324424.380.4 71.90.00.01.64.50.00.00.021.60.0
4Gull 2.2 64-bit 4CPU322416.761.171.9 0.00.00.00.00.00.00.028.80.0
5Roc 0.3 64-bit32180.00.00.00.0 0.024.227.73.70.04.91.52.9
6Gull 3.1 64-bit 4CPU321419.00.00.00.00.0 0.00.00.00.00.00.00.0
7Gull 3 64-bit31921.90.01.60.024.20.0 35.510.41.82.90.61.2
8Gull 3.1 64-bit31900.00.04.50.027.70.035.5 6.34.23.71.22.3
9Gull 2.1 64-bit30980.00.00.00.03.70.010.46.3 65.525.34.310.6
10Gull 2.2 64-bit30740.00.00.00.00.00.01.84.265.5 8.85.59.9
11Gull 1.2 64-bit29500.00.00.00.04.90.02.93.725.38.8 18.829.9
12Gull 1.1 64-bit29438.723.521.628.81.50.00.61.24.35.518.8 41.0
13Gull 1.0a 64-bit29380.00.00.00.02.90.01.22.310.69.929.941.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 120 common opponents

Custom engine selection
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Stockfish 9 64-bit 4CPU35465%
4.5/82
    7%
6/82
       
Stockfish 9 64-bit3482      9%
17.5/200
13%
13/100
     
Houdini 5.01 64-bit3421    12%
6/50
 17%
26/151
      
Stockfish 8 64-bit3421    21%
10.5/49
 21%
13.5/64
      
Komodo 10.3 64-bit3386    23%
11.5/50
 25%
16/63
      
Stockfish 7 64-bit3354      28%
27.5/100
32%
22/69
     
Komodo 10 64-bit3337      31%
31/100
27%
18.5/68
     
Houdini 4 64-bit 4CPU333237%
17.5/47
34%
17/50
34%
17/50
          
Deep Shredder 13 64-bit 4CPU332347%
24.5/52
    36%
21/59
       
Fizbo 1.9 64-bit 4CPU332042%
22/52
    38%
23/60
       
Houdini 3 64-bit 4CPU3320  35%
17/49
42%
21/50
         
Stockfish 6 64-bit331747%
15/32
     20%
19/94
      
Stockfish DD 64-bit 4CPU331049%
23/47
33%
16.5/50
45%
22.5/50
          
Komodo TCEC 64-bit 4CPU328761%
28.5/47
43%
21.5/50
50%
23.5/47
          
Stockfish 4 64-bit 4CPU3269  39%
19.5/50
43%
21.5/50
         
Booot 6.2 64-bit 4CPU325754%
32.5/60
    50%
30/60
       
Fire 5 64-bit3252    47%
23.5/50
 44%
22/50
      
Komodo 6 64-bit 4CPU3251  52%
26/50
38%
19/50
         
Chiron 4 64-bit 4CPU324150%
26/52
    51%
30.5/60
       
Houdini 4 64-bit3240  62%
31/50
   38%
19/50
43%
29.5/69
     
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Fizbo 1.9 64-bit3236    44%
22/50
 49%
58.5/120
      
Komodo 8 64-bit323542%
13.5/32
     49%
48.5/98
      
Critter 1.6a 64-bit 4CPU323357%
27/47
57%
28.5/50
53%
26.5/50
53%
26.5/50
         
Fritz 15 64-bit 4CPU322454%
37.5/70
    53%
32/60
       
Houdini 3 64-bit3217        36%
18/50
18%
14/77
   
Rybka 4.1 64-bit 4CPU320666%
31/47
56%
28/50
58%
29/50
59%
29.5/50
       16%
8/50
 
BlackMamba 2.0 64-bit 4CPU319753%
25.5/48
    58%
33.5/58
       
Fire 4 64-bit3191      50%
24/48
56%
37/66
     
Komodo CCT 64-bit3181        37%
18.5/50
 17%
5.5/32
  
Stockfish 4 64-bit3180        29%
46.5/162
32%
46/146
   
Houdini 1.5a 64-bit3170           17%
8/48
13%
10.5/80
Andscacs 0.89 64-bit3169    61%
30.5/50
 51%
20.5/40
      
Chiron 4 64-bit3164    54%
27/50
 61%
99/163
      
Komodo 5.1 64-bit3164        39%
28/71
33%
25.5/78
   
Equinox 3.30 64-bit3161      48%
48/99
47%
33/70
     
Critter 1.6a 64-bit3158      55%
82.5/150
50%
35/70
47%
23.5/50
33%
12.5/38
   
Fritz 15 64-bit3146      62%
39.5/64
52%
33/63
     
Komodo 5 64-bit3145           16%
10.5/64
21%
10/48
Deep Fritz 14 64-bit 4CPU314471%
35.5/50
    75%
30/40
       
PanChess 00.537 64-bit3138        36%
26/73
42%
30.5/72
   
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Bouquet 1.6 64-bit3133        39%
30/77
42%
31.5/75
   
Andscacs 0.872 64-bit3130      56%
35.5/63
56%
28/50
     
Fizbo 1.7 64-bit3128      59%
29.5/50
61%
30.5/50
     
Protector 1.9.0 64-bit 4CPU312871%
63.5/90
    47%
18.5/39
       
Stockfish 3 64-bit3128        42%
32.5/77
 28%
14/50
  
Chiron 2 64-bit 4CPU312066%
31/47
75%
37.5/50
68%
34/50
          
Critter 1.2 64-bit3120           18%
12.5/71
25%
8/32
Defenchess 1.1f 64-bit 4CPU312055%
17.5/32
    41%
13/32
       
RobboLito 0.21Q 64-bit3120        42%
33/78
56%
40/72
   
Hannibal 1.4b 64-bit 4CPU311874%
35/47
65%
32.5/50
67%
33.5/50
71%
35.5/50
         
Vitruvius 1.11C 64-bit3113        39%
31.5/80
48%
35/73
   
Hannibal 1.7 64-bit3110    61%
30.5/50
 67%
21.5/32
60%
38.5/64
     
Rybka 4.1 64-bit3108    74%
37/50
 68%
34/50
65%
32.5/50
51%
25.5/50
 30%
19.5/64
30%
4.5/15
20%
9.5/48
IvanHoe 9.46h 64-bit3107        46%
35.5/78
53%
40.5/76
   
Naum 4.2 64-bit 4CPU309979%
37/47
80%
40/50
76%
38/50
74%
37/50
       20%
10/50
 
NirvanaChess 2.3 64-bit3097    64%
29/45
  65%
32.5/50
     
Senpai 1.0 64-bit 4CPU309774%
35/47
76%
38/50
           
Chiron 3.01 64-bit3095      65%
32.5/50
65%
32.5/50
     
Texel 1.06 64-bit3095    77%
37.5/49
 71%
35.5/50
74%
37/50
     
Stockfish 2.1.1 64-bit3092           17%
2.5/15
28%
23/81
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Stockfish 2.0.1 64-bit3089          22%
7/32
23%
7/31
23%
7.5/32
Protector 1.5.0 64-bit 4CPU308783%
39/47
80%
40/50
72%
36/50
69%
34/49
         
Booot 6.1 64-bit3085    72%
36/50
 66%
16.5/25
      
Protector 1.9.0 64-bit3085    70%
35/50
 60%
30/50
71%
35.5/50
     
iCE 3.0 64-bit3081    71%
35.5/50
 62%
37/60
62%
31/50
     
Deep Fritz 14 64-bit 1CPU3078      63%
31.5/50
 55%
27.5/50
    
Critter 1.01 64-bit3077          27%
8.5/32
 25%
4/16
Komodo 2.03 64-bit3071           33%
5/15
37%
29.5/80
Critter 0.90 64-bit3049          27%
8.5/32
41%
13/32
30%
9.5/32
Deep Shredder 12 64-bit 4CPU304186%
40.5/47
78%
39/50
82%
41/50
77%
38.5/50
       34%
17/50
 
Chiron 2 64-bit3039      70%
35/50
 66%
32.5/49
    
Spike 1.4 Leiden 4CPU303984%
39.5/47
84%
41/49
86%
43/50
67%
33/49
       36%
18/50
 
Naum 4.6 64-bit3032      77%
24.5/32
75%
48/64
     
Alfil 15.7 64-bit3031      72%
23/32
68%
43.5/64
     
Spark 1.0 64-bit 4CPU302986%
40.5/47
86%
43/50
77%
38.5/50
76%
37/49
       41%
41.5/102
 
Deep Junior 13.3 64-bit 4CPU3026  75%
37.5/50
74%
37/50
         
Deep Junior Yokohama 64-bit 4CPU302583%
39/47
81%
40.5/50
80%
40/50
          
Hannibal 1.4b 64-bit3018      80%
39/49
 62%
31/50
    
Senpai 1.0 64-bit3007      69%
34/49
 74%
37/50
    
Hannibal 1.3 64-bit2998        59%
29.5/50
57%
39/68
  35%
3.5/10
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Komodo 1.3 64-bit2993          34%
10.5/31
39%
19.5/50
48%
15.5/32
Chiron 1.5 64-bit2989        68%
34.5/51
 45%
14.5/32
  
Hiarcs 142987      77%
37.5/49
 67%
33/49
 36%
11.5/32
  
Naum 4.2 64-bit2987        69%
54.5/79
58%
93/161
38%
12/32
43%
6.5/15
43%
20.5/48
Fritz 132986        65%
32.5/50
 42%
13.5/32
 58%
15/26
Protector 1.5.0 64-bit2984        68%
34/50
61%
21.5/35
55%
17.5/32
 40%
4/10
Rybka 2.3.2a 64-bit2977           39%
12/31
52%
16.5/32
Protector 1.4.0 64-bit 4CPU2972   82%
41/50
       39%
19.5/50
 
Zappa Mexico II 64-bit 4CPU297089%
42/47
84%
42/50
80%
40/50
78%
39/50
       51%
25.5/50
 
Komodo 1.2 64-bit2966           43%
22/51
50%
16/32
Deep Shredder 12 64-bit2955        75%
37.5/50
 50%
15.5/31
  
Deep Sjeng WC2008 64-bit 4CPU2940 94%
47/50
88%
44/50
85%
42.5/50
       47%
23.5/50
 
Hiarcs 13.22933          42%
13.5/32
 52%
16.5/32
Toga II 3.0 4CPU293086%
40.5/47
87%
43.5/50
84%
42/50
89%
44.5/50
         
Spark 1.0 64-bit2927         70%
26.5/38
58%
18.5/32
62%
20/32
51%
24.5/48
Booot 5.2.0 64-bit2922        85%
41.5/49
 71%
22/31
  
Spike 1.4 Leiden2921        70%
69/98
82%
31/38
 62%
20/32
54%
25/46
Toga II 1.4 beta5c 4CPU2904   92%
46/50
       56%
28/50
 
Protector 1.4.0 64-bit2889           52%
15.5/30
50%
15/30
Thinker 5.4c Inert 64-bit2883           67%
21.5/32
66%
21/32
NameEloGull
3
64-bit
4CPU
Gull
2.8b
64-bit
4CPU
Gull
2.3
64-bit
4CPU
Gull
2.2
64-bit
4CPU
Roc
0.3
64-bit
Gull
3.1
64-bit
4CPU
Gull
3
64-bit
Gull
3.1
64-bit
Gull
2.1
64-bit
Gull
2.2
64-bit
Gull
1.2
64-bit
Gull
1.1
64-bit
Gull
1.0a
64-bit
Hannibal 1.0a 64-bit2862          62%
18.5/30
 73%
23.5/32
Protector 1.3.5 64-bit2856           65%
19.5/30
61%
19.5/32
Booot 5.1.02838          67%
21.5/32
 69%
22/32
Booot 5.02784           66%
21/32
72%
23/32
Crafty 23.4 64-bit2781          70%
22.5/32
77%
24.5/32
72%
23/32
Ktulu 92781          77%
24/31
 75%
24/32
Bright 0.4a2779          72%
23/32
73%
23.5/32
73%
23.5/32
Loop 13.6 (Loop 2007) 32-bit2775           73%
23.5/32
75%
24/32
MinkoChess 0.9 64-bit2771           70%
22.5/32
78%
25/32
Twisted Logic 20090922 64-bit2770           69%
22/32
79%
24.5/31
Jonny 4.002763          73%
23.5/32
75%
24/32
 
Bison 9.11 64-bit2761           89%
28.5/32
72%
23/32
Scorpio 2.6 64-bit2756          79%
24.5/31
77%
24.5/32
81%
26/32
SmarThink 1.20 64-bit2747          80%
25.5/32
 73%
23.5/32
Chronos 1.9.9 64-bit2739          79%
24.5/31
84%
27/32
81%
26/32
Chess Tiger 2007.12713          67%
21.5/32
 79%
24.5/31
BugChess2 1.7 64-bit2707          86%
27.5/32
81%
26/32
78%
25/32
Naum 2.0 32-bit2700           77%
24.5/32
89%
28.5/32
Frenzee Feb08 64-bit2694           69%
22/32
88%
28/32
Delfi 5.42682           77%
24.5/32
81%
26/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 16, 2019