CCRL 40/4
Downloads and Statistics
August 20, 2019
Testing summary:
Total: 2'086'404 games
played by 2'425 programs
28073 CPU days (X2 4600+)

White wins: 810'229 (38.8%)
Black wins: 655'304 (31.4%)
Draws: 620'871 (29.8%)
White score: 53.7%

Open source 4-CPU engines

Comparing 140 engines!
40 best versions of selected engines played 5339 games with each other

CCRL 40/4 Rating List — Open source 4-CPU engines (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on August 20, 2019 with Bayeselo based on 2'086'404 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Stockfish 10 64-bit 4CPU3547+12−1270.5%−131.853.6%2229 
52.9%
 Stockfish 9 64-bit 4CPU3546+12−1274.1%−182.344.7%2605
79.8%
 SugaR XPrO 1.4 64-bit 4CPU3536+24−2373.3%−174.947.8%640
56.8%
 Stockfish 130118 64-bit 4CPU3532+30−2959.5%−63.665.7%315
57.1%
 SugaR XPrO 1.2 64-bit 4CPU3529+16−1567.0%−126.854.9%1306
62.8%
 asmFish 191017 64-bit 4CPU3526+17−1765.6%−113.358.9%1080
90.2%
 ShashChess 6.0 64-bit 4CPU3506+24−2470.4%−136.352.0%550
60.9%
 SugaR XPrO 1.3 64-bit 4CPU3501+24−2450.3%−16.567.4%481
69.9%
 Stockfish 8 64-bit 4CPU3494+11−1169.4%−138.749.0%2734
100.0%
 Stockfish 160716 64-bit 4CPU3455+14−1379.9%−216.935.3%2345
88.1%
 Stockfish 200516 64-bit 4CPU3442+18−1880.7%−221.634.3%1272
85.8%
 Stockfish 7 64-bit 4CPU3427+20−1978.1%−200.338.0%1008
68.9%
 Stockfish 251115 64-bit 4CPU3421+17−1770.9%−144.943.4%1208
59.0%
2Ethereal 11.50 64-bit 4CPU3418+17−1753.7%−22.358.6%977
90.0%
3Xiphos 0.5 64-bit 4CPU3403+16−1652.2%−15.952.5%1145
79.9%
 Stockfish 6 64-bit 4CPU3393+15−1567.7%−118.449.8%1485
54.3%
 Ethereal 11.25 64-bit 4CPU3392+14−1447.0%+18.259.4%1545
77.8%
 Ethereal 11.00 64-bit 4CPU3383+17−1752.2%−14.655.7%1012
93.4%
4Laser 1.7 64-bit 4CPU3367+12−1248.4%+9.052.9%2124
54.0%
 Stockfish 5 64-bit 4CPU3366+16−1671.8%−145.843.0%1380
99.7%
5Andscacs 0.95 64-bit 4CPU3336+13−1349.7%+2.347.8%1891
86.0%
6Booot 6.3.1 64-bit 4CPU3326+15−1539.8%+64.452.5%1456
53.4%
 Andscacs 0.94 64-bit 4CPU3325+19−1944.0%+38.451.0%855
51.8%
 Xiphos 0.4 64-bit 4CPU3324+18−1847.2%+17.346.1%1038
87.6%
 Stockfish DD 64-bit 4CPU3310+15−1566.6%−122.942.3%1559
70.5%
 Andscacs 0.921 64-bit 4CPU3303+19−1864.7%−103.639.1%1017
56.1%
 Andscacs 0.93 64-bit 4CPU3301+17−1745.6%+35.142.5%1215
82.5%
7Defenchess 2.1 64-bit 4CPU3289+19−1944.6%+38.044.0%941
83.0%
 Laser 1.6 64-bit 4CPU3276+17−1746.6%+26.552.7%1026
71.7%
 Stockfish 4 64-bit 4CPU3269+17−1769.2%−146.037.0%1346
53.7%
 Arasan 21.4 64-bit 4CPU3264+90−9245.6%+26.050.0%34
53.4%
8Gull 3 64-bit 4CPU3260+9−946.3%+23.345.1%4832
69.0%
 Booot 6.2 64-bit 4CPU3257+13−1342.7%+56.248.7%2017
48.5%
 Gull 2.8b 64-bit 4CPU3257+21−2170.1%−147.634.7%849
78.2%
9Arasan 21.3 64-bit 4CPU3244+26−2647.1%+18.151.3%437
49.2%
 Gull 2.3 64-bit 4CPU3244+17−1763.8%−101.843.5%1137
72.5%
 Stockfish 3 64-bit 4CPU3236+19−1968.0%−133.838.5%1022
82.2%
 Gull 2.2 64-bit 4CPU3223+20−2067.9%−131.836.8%945
58.0%
 Stockfish 2.3.1 64-bit 4CPU3221+18−1859.5%−60.446.9%951
67.8%
 Gull 3.1 64-bit 4CPU3214+18−1840.9%+68.943.6%1090
75.5%
10Texel 1.07 64-bit 4CPU3207+13−1350.7%+0.243.6%2009
52.6%
 Arasan 21.2 64-bit 4CPU3206+17−1752.2%−14.550.7%1031
84.8%
 Stockfish 2.1.1 64-bit 4CPU3194+15−1566.3%−113.341.2%1489
53.4%
 Arasan 21.1 64-bit 4CPU3193+17−1751.3%−8.452.9%1015
67.4%
 Booot 6.1 64-bit 4CPU3188+15−1543.7%+44.344.7%1536
71.6%
11Vajolet2 2.6.1 64-bit 4CPU3181+16−1651.0%−5.556.7%1195
68.4%
12Senpai 2.0 64-bit 4CPU3177+12−1251.9%−13.044.4%2270
63.4%
13Nemorino 5.00 64-bit 4CPU3173+14−1450.9%−5.548.6%1659
57.2%
 Laser 1.5 64-bit 4CPU3171+19−1950.3%+5.137.4%1000
65.1%
 Stockfish 2.0.1 64-bit 4CPU3166+14−1466.8%−113.943.4%1647
78.3%
 Texel 1.06 64-bit 4CPU3158+14−1542.2%+53.543.8%1558
58.8%
 Sting SF 9 64-bit 4CPU3156+17−1751.7%−12.845.2%1047
60.1%
 Stockfish 1.9.1 64-bit 4CPU3153+13−1371.5%−149.838.1%2338
76.2%
 Arasan 20.4.1 64-bit 4CPU3144+18−1849.9%+0.340.8%974
55.4%
 Texel 1.05 64-bit 4CPU3143+14−1433.0%+124.935.4%2041
59.7%
 Stockfish 1.7.1 64-bit 4CPU3140+13−1368.1%−125.238.4%2052
62.7%
 Stockfish 1.8 64-bit 4CPU3137+16−1668.0%−124.438.4%1379
55.6%
14RubiChess 1.4 64-bit 4CPU3135+28−2847.8%+13.452.5%366
67.1%
15Protector 1.9.0 64-bit 4CPU3128+10−1046.2%+25.541.2%3657
52.9%
16ChessBrainVB 3.70 4CPU3127+23−2356.7%−43.542.1%611
53.5%
 Vajolet2 2.5 64-bit 4CPU3126+20−2048.3%+10.743.5%809
60.2%
 Arasan 20.1 64-bit 4CPU3121+24−2460.5%−67.542.3%562
50.2%
 Arasan 20.3 64-bit 4CPU3121+18−1843.2%+46.541.6%973
54.1%
 Defenchess 1.1f 64-bit 4CPU3120+14−1447.0%+20.341.6%1701
50.0%
 Ethereal 9.30 64-bit 4CPU3120+29−2954.5%−27.945.9%364
64.9%
 Nemorino 4.00 64-bit 4CPU3113+23−2348.0%+14.042.6%587
71.3%
17Demolito 2018-10-29 64-bit 4CPU3105+18−1851.3%−9.343.3%939
51.3%
 RubiChess 1.3 64-bit 4CPU3104+23−2358.7%−63.540.8%635
69.8%
 Senpai 1.0 64-bit 4CPU3097+16−1636.2%+97.835.7%1355
63.6%
 Stockfish 1.6s JA 64-bit 4CPU3093+13−1366.6%−115.738.6%2185
53.5%
 Laser 1.4 64-bit 4CPU3092+19−1948.4%+11.441.1%909
50.1%
18Rodent III 0.273 64-bit 4CPU3092+19−1946.3%+21.547.7%818
57.3%
 Ethereal 9.00 64-bit 4CPU3089+19−1950.5%−5.844.9%909
50.2%
 Stockfish 1.6.3 64-bit 4CPU3089+13−1365.3%−107.738.0%2172
59.5%
 Protector 1.5.0 64-bit 4CPU3087+15−1440.5%+63.837.3%1682
51.6%
19Pirarucu 2.9.5 64-bit 4CPU3086+28−2856.5%−41.443.7%398
57.9%
 Vajolet2 2.4 64-bit 4CPU3083+17−1743.1%+46.539.6%1202
57.2%
20chess22k 1.11 64-bit 4CPU3080+21−2143.7%+38.349.8%687
58.8%
 Xiphos 0.1 64-bit 4CPU3077+20−2043.5%+40.541.4%804
75.0%
 Vajolet2 2.2 64-bit 4CPU3067+18−1846.2%+23.142.7%1010
58.4%
21Cheng 4.39 64-bit 4CPU3065+15−1543.1%+43.144.8%1364
51.8%
 Nemorino 3.0 64-bit 4CPU3064+33−3343.6%+47.836.6%320
64.8%
22Crafty 25.2 64-bit 4CPU3057+16−1649.7%+1.939.5%1291
53.8%
23Bobcat 8.0 64-bit 4CPU3056+15−1547.5%+13.944.3%1340
52.1%
 Vajolet2 2.3 64-bit 4CPU3055+23−2350.6%−6.637.9%588
61.4%
24Amoeba 3.0 64-bit 4CPU3050+27−2756.0%−37.841.1%443
50.4%
 Rodent III 0.232 64-bit 4CPU3050+19−1940.1%+67.836.3%945
85.8%
 Bobcat 7.6 64-bit 4CPU3035+19−2043.7%+39.946.5%820
51.0%
25Marvin 3.4.0 64-bit 4CPU3034+26−2560.4%−68.338.5%493
58.1%
 Ethereal 8.81 64-bit 4CPU3031+22−2244.3%+35.940.8%682
57.6%
 Stockfish 1.5.1 64-bit 4CPU3028+14−1458.9%−61.138.6%1649
89.0%
26EXchess 7.97b 64-bit 4CPU3013+18−1844.0%+41.837.5%1076
49.8%
 Nemorino 2.00 64-bit 4CPU3013+25−2543.2%+44.340.8%500
59.0%
27Topple 0.7.2 64-bit 4CPU3008+34−3464.8%−101.532.9%304
51.2%
 Rodent III 0.210 64-bit 4CPU3007+32−3233.4%+110.137.3%332
57.5%
 Demolito 2017-08-26 64-bit 4CPU3003+23−2436.1%+97.733.7%644
54.4%
28Winter 0.6 64-bit 4CPU3001+23−2353.8%−24.139.0%592
65.3%
29Tucano 7.00 64-bit 4CPU2995+20−2040.9%+60.339.9%844
52.7%
30Scorpio 2.8 64-bit 4CPU2994+19−1941.3%+57.136.1%977
78.7%
 Scorpio 2.7.9 64-bit 4CPU2982+25−2545.8%+27.036.9%520
66.9%
 Stockfish 1.4 64-bit 4CPU2975+15−1553.9%−29.735.2%1596
53.2%
 Rodent III 0.172 64-bit 4CPU2974+23−2341.8%+54.634.1%639
57.9%
 Protector 1.4.0 64-bit 4CPU2971+13−1332.3%+129.933.6%2343
74.8%
31Toga II 4.0 64-bit 4CPU2963+20−2136.8%+94.432.8%848
51.7%
 Protector 1.3.5 64-bit 4CPU2962+27−2736.7%+89.139.6%455
76.2%
 Protector 1.3.4 64-bit 4CPU2952+13−1340.3%+64.441.0%2122
66.8%
 Winter 0.5 64-bit 4CPU2946+23−2256.5%−44.036.2%650
65.1%
 Marvin 3.3.2 64-bit 4CPU2940+20−2053.8%−26.141.4%811
60.1%
 Tucano 7.05 64-bit 4CPU2935+30−3032.2%+124.037.7%382
58.0%
32Asymptote 0.6.3 64-bit 4CPU2931+26−2655.1%−32.937.6%460
52.3%
 Toga II 3.0 4CPU2930+17−1725.3%+196.428.5%1459
82.6%
33MinkoChess 1.3 64-bit 4CPU2918+20−2049.5%+1.836.8%819
60.3%
34Glaurung 2.2 64-bit 4CPU2915+12−1149.7%−1.536.5%2648
55.3%
35Monolith 1.0 64-bit 4CPU2913+19−1950.6%−4.141.1%872
73.2%
 Marvin 3.2.0 64-bit 4CPU2904+22−2250.5%−2.641.5%672
51.5%
 Toga II 1.4 beta5c 4CPU2904+9−935.7%+105.033.9%5355
72.5%
 Glaurung 2.1 64-bit 4CPU2900+11−1245.9%+28.535.7%2686
52.9%
 Toga II 1.4.1SE 4CPU2899+11−1144.9%+37.435.8%3128
55.7%
 Winter 0.4a 64-bit 4CPU2897+26−2656.1%−40.838.5%488
95.8%
36Igel 1.8.2 64-bit 4CPU2862+31−3147.8%+13.430.2%348
51.8%
 Glaurung 2.0.1 64-bit 4CPU2861+13−1341.3%+60.335.0%2227
70.1%
 Minic 0.47 64-bit 4CPU2850+37−3670.3%−136.326.5%291
80.9%
 Igel 1.5.1 64-bit 4CPU2830+30−2957.8%−55.626.0%400
70.4%
 Topple 0.5.0 64-bit 4CPU2821+18−1846.3%+25.530.8%1098
56.5%
 Winter 0.3 64-bit 4CPU2818+24−2446.7%+24.228.3%618
94.8%
37Fridolin 3.10 64-bit 4CPU2790+24−2447.4%+18.730.8%584
67.6%
 Asymptote 0.5 64-bit 4CPU2782+28−2853.1%−22.132.5%421
77.7%
 Glaurung 1.2.1 32-bit 4CPU2769+15−1543.2%+46.033.8%1495
67.4%
38Minic 0.65 64-bit 4CPU2762+25−2551.7%−11.926.6%557
64.4%
 Fridolin 3.00 64-bit 4CPU2755+33−3267.7%−122.128.7%345
72.5%
 Crafty 23.0 64-bit 4CPU2743+17−1728.1%+158.328.1%1436
84.6%
 Scorpio 2.0 32-bit 4CPU2730+20−2029.1%+154.129.4%1005
73.4%
 Scorpio 2.1 64-bit 4CPU2722+17−1727.5%+173.723.2%1495
92.7%
 Minic 0.40 64-bit 4CPU2694+34−3368.0%−132.023.7%367
80.9%
 Topple 0.3.4 64-bit 4CPU2674+31−3167.6%−129.721.3%400
100.0%
 Arasan 11.3 64-bit 4CPU2573+22−2212.5%+339.913.0%1386
97.8%
 Topple 0.3.1 64-bit 4CPU2533+32−3243.1%+49.022.9%341
98.0%
39Nemeton 1.81 4CPU2490+24−2451.1%−7.124.5%600
82.4%
 Nemeton 1.7 4CPU2472+30−3149.1%+6.524.4%377
100.0%
40Invictus r228 64-bit 4CPU2376+33−3256.6%−47.824.2%335
 

Results matrix

Open source 4-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3547 65.5 − 23.5
+42−0=47
+11
53 − 19
+34−0=38
−1
83.5 − 24.5
+59−0=49
−6
28 − 4
+24−0=8
+75
88.5 − 19.5
+69−0=39
−2
65 − 10
+55−0=20
+18
     
2Ethereal 11.50 64-bit 4CPU341823.5 − 65.5
+0−42=47
−11
 49 − 43
+16−10=66
+3
53 − 39
+21−7=64
−10
23.5 − 11.5
+13−1=21
+17
20.5 − 13.5
+11−4=19
−28
42.5 − 14.5
+29−1=27
+20
     
3Xiphos 0.5 64-bit 4CPU340319 − 53
+0−34=38
+1
43 − 49
+10−16=66
−3
 74 − 64
+32−22=84
−15
13.5 − 11.5
+6−4=15
−47
13.5 − 11.5
+8−6=11
−57
      
4Laser 1.7 64-bit 4CPU336724.5 − 83.5
+0−59=49
+6
39 − 53
+7−21=64
+10
64 − 74
+22−32=84
+15
 58.5 − 50.5
+25−17=67
−10
38.5 − 27.5
+20−9=37
+5
44.5 − 29.5
+23−8=43
−17
 18 − 5
+15−2=6
+83
   
5Andscacs 0.95 64-bit 4CPU33364 − 28
+0−24=8
−75
11.5 − 23.5
+1−13=21
−17
11.5 − 13.5
+4−6=15
+47
50.5 − 58.5
+17−25=67
+10
 17.5 − 16.5
+7−6=21
−2
39.5 − 35.5
+21−17=37
−31
 17 − 7
+12−2=10
+44
26 − 12
+14−0=24
−26
28.5 − 9.5
+21−2=15
+7
28 − 10
+21−3=14
−3
6Booot 6.3.1 64-bit 4CPU332619.5 − 88.5
+0−69=39
+2
13.5 − 20.5
+4−11=19
+28
11.5 − 13.5
+6−8=11
+57
27.5 − 38.5
+9−20=37
−5
16.5 − 17.5
+6−7=21
+2
   15 − 9
+8−2=14
−7
   
7Defenchess 2.1 64-bit 4CPU328910 − 65
+0−55=20
−18
14.5 − 42.5
+1−29=27
−20
 29.5 − 44.5
+8−23=43
+17
35.5 − 39.5
+17−21=37
+31
    17 − 13
+8−4=18
−42
 21.5 − 8.5
+15−2=13
+27
8Gull 3 64-bit 4CPU3260            
9Arasan 21.3 64-bit 4CPU3244   5 − 18
+2−15=6
−83
7 − 17
+2−12=10
−44
9 − 15
+2−8=14
+7
   13.5 − 9.5
+8−4=11
+15
15.5 − 8.5
+10−3=11
+28
16 − 8
+11−3=10
+39
10Texel 1.07 64-bit 4CPU3207    12 − 26
+0−14=24
+26
 13 − 17
+4−8=18
+42
 9.5 − 13.5
+4−8=11
−15
 20 − 19
+10−9=20
−17
24 − 16
+14−6=20
+28
11Vajolet2 2.6.1 64-bit 4CPU3181    9.5 − 28.5
+2−21=15
−7
   8.5 − 15.5
+3−10=11
−28
19 − 20
+9−10=20
+17
 20 − 19
+13−12=14
+3
12Senpai 2.0 64-bit 4CPU3177    10 − 28
+3−21=14
+3
 8.5 − 21.5
+2−15=13
−27
 8 − 16
+3−11=10
−39
16 − 24
+6−14=20
−28
19 − 20
+12−13=14
−3
 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Open source 4-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3547 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Ethereal 11.50 64-bit 4CPU34180.0 90.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Xiphos 0.5 64-bit 4CPU34030.010.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Laser 1.7 64-bit 4CPU33670.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
5Andscacs 0.95 64-bit 4CPU33360.00.00.00.0 86.0100.0100.0100.0100.0100.0100.0
6Booot 6.3.1 64-bit 4CPU33260.00.00.00.014.0 99.9100.0100.0100.0100.0100.0
7Defenchess 2.1 64-bit 4CPU32890.00.00.00.00.00.1 99.699.7100.0100.0100.0
8Gull 3 64-bit 4CPU32600.00.00.00.00.00.00.4 88.4100.0100.0100.0
9Arasan 21.3 64-bit 4CPU32440.00.00.00.00.00.00.311.6 99.4100.0100.0
10Texel 1.07 64-bit 4CPU32070.00.00.00.00.00.00.00.00.6 99.4100.0
11Vajolet2 2.6.1 64-bit 4CPU31810.00.00.00.00.00.00.00.00.00.6 68.4
12Senpai 2.0 64-bit 4CPU31770.00.00.00.00.00.00.00.00.00.031.6 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 20, 2019