CCRL 40/4
Downloads and Statistics
April 13, 2019
Testing summary:
Total: 1'978'909 games
played by 2'316 programs
26642 CPU days (X2 4600+)

White wins: 772'756 (39.0%)
Black wins: 624'315 (31.5%)
Draws: 581'838 (29.4%)
White score: 53.8%

Open source 4-CPU engines

Comparing 124 engines!
37 best versions of selected engines played 4735 games with each other

CCRL 40/4 Rating List — Open source 4-CPU engines (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on April 13, 2019 with Bayeselo based on 1'978'909 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Stockfish 10 64-bit 4CPU3547+15−1572.2%−144.551.7%1487 
53.4%
 Stockfish 9 64-bit 4CPU3546+12−1274.1%−183.344.7%2605
79.7%
 SugaR XPrO 1.4 64-bit 4CPU3535+24−2373.3%−174.847.8%640
55.2%
 Stockfish 130118 64-bit 4CPU3532+30−2959.5%−63.665.7%315
57.9%
 SugaR XPrO 1.2 64-bit 4CPU3529+16−1667.0%−127.354.9%1306
62.8%
 asmFish 191017 64-bit 4CPU3525+17−1765.6%−112.758.9%1080
91.5%
 ShashChess 6.0 64-bit 4CPU3504+24−2470.4%−135.952.0%550
57.8%
 SugaR XPrO 1.3 64-bit 4CPU3501+24−2450.3%−16.767.4%481
70.4%
 Stockfish 8 64-bit 4CPU3493+11−1169.4%−138.249.0%2734
100.0%
 Stockfish 160716 64-bit 4CPU3455+14−1379.9%−217.435.3%2345
88.1%
 Stockfish 200516 64-bit 4CPU3441+18−1880.7%−221.134.3%1272
85.8%
 Stockfish 7 64-bit 4CPU3427+20−2078.1%−200.838.0%1008
69.0%
 Stockfish 251115 64-bit 4CPU3420+17−1770.9%−144.543.4%1208
88.6%
2Xiphos 0.5 64-bit 4CPU3403+20−2055.7%−37.550.5%778
79.1%
 Stockfish 6 64-bit 4CPU3393+15−1567.7%−118.849.8%1485
61.3%
3Ethereal 11.25 64-bit 4CPU3389+16−1649.7%+2.860.1%1200
74.6%
 Ethereal 11.00 64-bit 4CPU3382+17−1752.2%−15.355.7%1012
84.0%
4Laser 1.7 64-bit 4CPU3368+20−2047.6%+13.855.0%765
57.3%
 Stockfish 5 64-bit 4CPU3366+16−1671.8%−146.343.0%1380
99.5%
5Andscacs 0.95 64-bit 4CPU3335+16−1654.3%−27.248.7%1301
83.8%
6Booot 6.3.1 64-bit 4CPU3324+17−1741.3%+56.152.6%1144
54.6%
 Andscacs 0.94 64-bit 4CPU3323+19−1944.0%+38.751.0%855
50.4%
 Xiphos 0.4 64-bit 4CPU3323+18−1847.2%+16.946.1%1038
85.4%
 Stockfish DD 64-bit 4CPU3309+15−1566.6%−122.042.3%1559
71.8%
 Andscacs 0.921 64-bit 4CPU3302+19−1864.7%−103.239.1%1017
56.8%
 Andscacs 0.93 64-bit 4CPU3300+17−1745.6%+35.242.5%1215
97.7%
 Laser 1.6 64-bit 4CPU3275+17−1746.6%+26.352.7%1026
68.7%
 Stockfish 4 64-bit 4CPU3269+17−1769.2%−146.137.0%1346
82.2%
7Gull 3 64-bit 4CPU3260+9−946.3%+22.945.1%4832
60.4%
 Gull 2.8b 64-bit 4CPU3257+21−2170.1%−147.934.7%849
53.5%
 Booot 6.2 64-bit 4CPU3256+13−1342.7%+56.548.7%2017
67.9%
8Arasan 21.3 64-bit 4CPU3249+27−2748.8%+8.452.5%408
61.7%
 Gull 2.3 64-bit 4CPU3244+17−1763.8%−101.943.5%1137
72.5%
 Stockfish 3 64-bit 4CPU3236+19−1968.0%−133.938.5%1022
82.1%
 Gull 2.2 64-bit 4CPU3223+20−2067.9%−131.936.8%945
58.4%
 Stockfish 2.3.1 64-bit 4CPU3220+18−1859.5%−59.646.9%951
69.2%
 Gull 3.1 64-bit 4CPU3214+17−1840.9%+68.143.6%1090
76.0%
9Texel 1.07 64-bit 4CPU3206+13−1350.6%+1.143.2%1903
53.3%
 Arasan 21.2 64-bit 4CPU3205+17−1752.2%−14.850.7%1031
82.6%
 Stockfish 2.1.1 64-bit 4CPU3194+15−1566.3%−113.541.2%1489
56.6%
 Arasan 21.1 64-bit 4CPU3192+17−1751.3%−8.652.9%1015
65.2%
 Booot 6.1 64-bit 4CPU3187+15−1543.7%+44.844.7%1536
76.4%
10Vajolet2 2.6.1 64-bit 4CPU3179+16−1650.5%−2.456.6%1095
62.7%
11Senpai 2.0 64-bit 4CPU3176+12−1252.0%−13.944.0%2138
66.9%
 Laser 1.5 64-bit 4CPU3171+19−1950.3%+4.637.4%1000
50.6%
12Nemorino 5.00 64-bit 4CPU3170+14−1450.8%−4.547.8%1527
65.1%
 Stockfish 2.0.1 64-bit 4CPU3166+14−1466.8%−114.043.4%1647
79.2%
 Texel 1.06 64-bit 4CPU3158+14−1542.2%+53.043.8%1558
59.5%
 Sting SF 9 64-bit 4CPU3155+17−1751.7%−12.545.2%1047
57.9%
 Stockfish 1.9.1 64-bit 4CPU3153+13−1371.5%−149.738.1%2338
77.0%
 Arasan 20.4.1 64-bit 4CPU3144+18−1849.9%+0.140.8%974
55.6%
 Texel 1.05 64-bit 4CPU3142+14−1433.0%+125.635.4%2041
58.4%
 Stockfish 1.7.1 64-bit 4CPU3140+13−1368.1%−125.238.4%2052
62.8%
 Stockfish 1.8 64-bit 4CPU3137+16−1668.0%−124.438.4%1379
70.3%
13ChessBrainVB 3.70 4CPU3129+23−2357.4%−48.242.4%585
54.3%
14Protector 1.9.0 64-bit 4CPU3128+10−1046.4%+24.241.1%3601
59.2%
 Vajolet2 2.5 64-bit 4CPU3125+20−2048.3%+11.443.5%809
59.3%
 Arasan 20.1 64-bit 4CPU3121+24−2360.5%−67.542.3%562
51.9%
 Arasan 20.3 64-bit 4CPU3121+18−1843.2%+45.741.6%973
51.4%
 Ethereal 9.30 64-bit 4CPU3120+29−2954.5%−28.145.9%364
56.6%
15Defenchess (SCTR) 1.1f 64-bit 4CPU3117+14−1446.8%+22.140.4%1600
63.3%
 Nemorino 4.00 64-bit 4CPU3113+23−2348.0%+13.342.6%587
72.0%
16‑17Demolito 2018-10-29 64-bit 4CPU3104+19−1952.3%−16.042.8%883
47.6%
16‑17RubiChess 1.3 64-bit 4CPU3104+23−2358.7%−62.540.8%635
71.3%
 Senpai 1.0 64-bit 4CPU3096+16−1736.2%+98.635.7%1355
59.3%
18Rodent III 0.273 64-bit 4CPU3093+20−2047.6%+13.148.3%764
51.1%
 Stockfish 1.6s JA 64-bit 4CPU3093+13−1366.6%−115.738.6%2185
54.4%
 Laser 1.4 64-bit 4CPU3092+19−1948.4%+11.141.1%909
57.9%
 Ethereal 9.00 64-bit 4CPU3089+19−1950.5%−6.244.9%909
48.9%
 Stockfish 1.6.3 64-bit 4CPU3089+13−1365.3%−107.738.0%2172
60.3%
 Protector 1.5.0 64-bit 4CPU3087+14−1540.5%+63.637.3%1682
56.7%
19Pirarucu 2.9.5 64-bit 4CPU3084+30−3060.5%−67.242.1%342
53.2%
 Vajolet2 2.4 64-bit 4CPU3082+17−1743.1%+47.039.6%1202
57.7%
20chess22k 1.11 64-bit 4CPU3079+21−2143.7%+38.849.8%687
58.3%
 Xiphos 0.1 64-bit 4CPU3076+20−2043.5%+41.141.4%804
73.7%
 Vajolet2 2.2 64-bit 4CPU3067+18−1846.2%+22.942.7%1010
54.3%
21Cheng 4.39 64-bit 4CPU3066+16−1642.6%+46.245.3%1292
53.4%
 Nemorino 3.0 64-bit 4CPU3065+33−3343.6%+47.036.6%320
66.1%
22Crafty 25.2 64-bit 4CPU3057+16−1649.7%+1.639.5%1291
51.0%
23Bobcat 8.0 64-bit 4CPU3056+16−1647.5%+14.444.3%1305
53.9%
 Vajolet2 2.3 64-bit 4CPU3055+23−2350.6%−6.737.9%588
64.6%
 Rodent III 0.232 64-bit 4CPU3049+19−1940.1%+68.436.3%945
84.6%
 Bobcat 7.6 64-bit 4CPU3035+19−2043.7%+40.046.5%820
62.1%
 Ethereal 8.81 64-bit 4CPU3030+22−2244.3%+36.440.8%682
56.1%
 Stockfish 1.5.1 64-bit 4CPU3028+14−1458.9%−61.138.6%1649
89.2%
24EXchess 7.97b 64-bit 4CPU3013+18−1844.0%+41.737.5%1076
49.7%
 Nemorino 2.00 64-bit 4CPU3013+25−2543.2%+44.340.8%500
62.6%
 Rodent III 0.210 64-bit 4CPU3006+32−3233.4%+110.537.3%332
57.4%
 Demolito 2017-08-26 64-bit 4CPU3003+23−2436.1%+97.033.7%644
68.8%
25Tucano 7.00 64-bit 4CPU2995+20−2040.9%+60.639.8%809
51.9%
26Scorpio 2.8 64-bit 4CPU2994+19−1941.3%+57.436.1%942
78.4%
 Scorpio 2.7.9 64-bit 4CPU2982+25−2545.8%+27.236.9%520
66.1%
 Rodent III 0.172 64-bit 4CPU2975+23−2341.8%+54.134.1%639
48.3%
 Stockfish 1.4 64-bit 4CPU2975+15−1553.9%−29.735.2%1596
66.1%
 Protector 1.4.0 64-bit 4CPU2971+13−1332.3%+129.833.6%2343
74.5%
27Toga II 4.0 64-bit 4CPU2963+20−2036.8%+94.432.8%848
51.6%
 Protector 1.3.5 64-bit 4CPU2962+27−2736.7%+89.139.6%455
76.1%
 Protector 1.3.4 64-bit 4CPU2952+13−1340.3%+64.441.0%2122
55.6%
28Winter 0.5 64-bit 4CPU2950+24−2457.4%−50.334.8%584
75.2%
 Tucano 7.05 64-bit 4CPU2936+30−3032.2%+123.437.7%382
62.0%
 Toga II 3.0 4CPU2931+17−1725.3%+195.528.5%1459
70.8%
29MinkoChess 1.3 64-bit 4CPU2923+22−2248.0%+12.038.7%677
73.8%
30Glaurung 2.2 64-bit 4CPU2915+11−1249.7%−1.536.5%2648
72.0%
31Monolith 1.0 64-bit 4CPU2906+24−2449.8%+2.442.6%564
55.0%
32Marvin 3.2.0 64-bit 4CPU2904+22−2250.5%−2.441.5%672
52.4%
 Toga II 1.4 beta5c 4CPU2904+9−835.7%+104.933.9%5355
71.8%
 Glaurung 2.1 64-bit 4CPU2900+12−1245.9%+28.635.7%2686
53.0%
 Toga II 1.4.1SE 4CPU2899+11−1144.9%+37.535.8%3128
50.0%
 Winter 0.4a 64-bit 4CPU2899+26−2556.1%−40.438.5%488
99.4%
 Glaurung 2.0.1 64-bit 4CPU2861+13−1341.3%+60.535.0%2227
85.1%
33Topple 0.5.0 64-bit 4CPU2847+24−2353.2%−22.930.3%610
93.2%
 Winter 0.3 64-bit 4CPU2821+24−2446.7%+23.828.3%618
92.0%
34Fridolin 3.10 64-bit 4CPU2794+28−2848.8%+8.529.1%429
93.2%
 Glaurung 1.2.1 32-bit 4CPU2770+15−1543.2%+45.533.8%1495
76.6%
 Fridolin 3.00 64-bit 4CPU2756+33−3267.7%−121.428.7%345
75.3%
 Crafty 23.0 64-bit 4CPU2744+17−1728.1%+157.328.1%1436
84.1%
 Scorpio 2.0 32-bit 4CPU2730+20−2029.1%+154.329.4%1005
74.1%
 Scorpio 2.1 64-bit 4CPU2722+17−1727.5%+173.723.2%1495
97.2%
35Minic 0.40 64-bit 4CPU2684+35−3472.7%−166.022.9%328
65.7%
 Topple 0.3.4 64-bit 4CPU2674+31−3167.6%−129.121.3%400
100.0%
 Arasan 11.3 64-bit 4CPU2573+22−2312.5%+340.013.0%1386
97.8%
 Topple 0.3.1 64-bit 4CPU2533+32−3243.1%+49.222.9%341
99.6%
36Nemeton 1.7 4CPU2472+30−3149.1%+7.024.4%377
100.0%
37Invictus r228 64-bit 4CPU2376+33−3256.6%−47.624.2%335
 

Results matrix

Open source 4-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3547 53 − 19
+34−0=38
−1
23 − 9
+14−0=18
−30
33 − 10
+23−0=20
−10
28 − 4
+24−0=8
+74
88.5 − 19.5
+69−0=39
−4
      
2Xiphos 0.5 64-bit 4CPU340319 − 53
+0−34=38
+1
 13 − 12
+5−4=16
−6
40.5 − 31.5
+16−7=49
−1
13.5 − 11.5
+6−4=15
−49
13.5 − 11.5
+8−6=11
−59
      
3Ethereal 11.25 64-bit 4CPU33899 − 23
+0−14=18
+30
12 − 13
+4−5=16
+6
 20.5 − 23.5
+4−7=33
−37
44.5 − 37.5
+16−9=57
−33
49 − 33
+22−6=54
−11
 16.5 − 7.5
+10−1=13
−31
    
4Laser 1.7 64-bit 4CPU336810 − 33
+0−23=20
+10
31.5 − 40.5
+7−16=49
+1
23.5 − 20.5
+7−4=33
+37
 24 − 19
+9−4=30
−2
  18 − 5
+15−2=6
+87
    
5Andscacs 0.95 64-bit 4CPU33354 − 28
+0−24=8
−74
11.5 − 13.5
+4−6=15
+49
37.5 − 44.5
+9−16=57
+33
19 − 24
+4−9=30
+2
 17.5 − 16.5
+7−6=21
−3
 17 − 7
+12−2=10
+50
26 − 12
+14−0=24
−26
28.5 − 9.5
+21−2=15
+6
28 − 10
+21−3=14
−3
26.5 − 11.5
+19−4=15
−35
6Booot 6.3.1 64-bit 4CPU332419.5 − 88.5
+0−69=39
+4
11.5 − 13.5
+6−8=11
+59
33 − 49
+6−22=54
+11
 16.5 − 17.5
+6−7=21
+3
  15 − 9
+8−2=14
0
   36 − 14
+23−1=26
−21
7Gull 3 64-bit 4CPU3260            
8Arasan 21.3 64-bit 4CPU3249  7.5 − 16.5
+1−10=13
+31
5 − 18
+2−15=6
−87
7 − 17
+2−12=10
−50
9 − 15
+2−8=14
0
  13.5 − 9.5
+8−4=11
+9
15.5 − 8.5
+10−3=11
+21
16 − 8
+11−3=10
+33
14.5 − 9.5
+9−4=11
−13
9Texel 1.07 64-bit 4CPU3206    12 − 26
+0−14=24
+26
  9.5 − 13.5
+4−8=11
−9
 20 − 19
+10−9=20
−18
24 − 16
+14−6=20
+28
24 − 28
+13−17=22
−60
10Vajolet2 2.6.1 64-bit 4CPU3179    9.5 − 28.5
+2−21=15
−6
  8.5 − 15.5
+3−10=11
−21
19 − 20
+9−10=20
+18
 20 − 19
+13−12=14
+4
89.5 − 89.5
+34−34=111
−10
11Senpai 2.0 64-bit 4CPU3176    10 − 28
+3−21=14
+3
  8 − 16
+3−11=10
−33
16 − 24
+6−14=20
−28
19 − 20
+12−13=14
−4
 23.5 − 28.5
+10−15=27
−36
12Nemorino 5.00 64-bit 4CPU3170    11.5 − 26.5
+4−19=15
+35
14 − 36
+1−23=26
+21
 9.5 − 14.5
+4−9=11
+13
28 − 24
+17−13=22
+60
89.5 − 89.5
+34−34=111
+10
28.5 − 23.5
+15−10=27
+36
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Open source 4-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3547 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Xiphos 0.5 64-bit 4CPU34030.0 86.699.6100.0100.0100.0100.0100.0100.0100.0100.0
3Ethereal 11.25 64-bit 4CPU33890.013.4 95.6100.0100.0100.0100.0100.0100.0100.0100.0
4Laser 1.7 64-bit 4CPU33680.00.44.4 99.6100.0100.0100.0100.0100.0100.0100.0
5Andscacs 0.95 64-bit 4CPU33350.00.00.00.4 83.8100.0100.0100.0100.0100.0100.0
6Booot 6.3.1 64-bit 4CPU33240.00.00.00.016.1 100.0100.0100.0100.0100.0100.0
7Gull 3 64-bit 4CPU32600.00.00.00.00.00.0 78.2100.0100.0100.0100.0
8Arasan 21.3 64-bit 4CPU32490.00.00.00.00.00.021.8 99.8100.0100.0100.0
9Texel 1.07 64-bit 4CPU32060.00.00.00.00.00.00.00.2 99.4100.0100.0
10Vajolet2 2.6.1 64-bit 4CPU31790.00.00.00.00.00.00.00.00.6 62.779.7
11Senpai 2.0 64-bit 4CPU31760.00.00.00.00.00.00.00.00.037.3 70.3
12Nemorino 5.00 64-bit 4CPU31700.00.00.00.00.00.00.00.00.020.329.7 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on April 13, 2019