CCRL 40/40
Downloads and Statistics
March 16, 2019
Testing summary:
Total: 1'004'662 games
played by 2'384 programs
138170 CPU days (X2 4600+)

White wins: 348'320 (34.7%)
Black wins: 258'847 (25.8%)
Draws: 397'495 (39.6%)
White score: 54.5%

Open source multi-CPU engines

Comparing 160 engines!
33 best versions of selected engines played 2662 games with each other

CCRL 40/40 Rating List — Open source multi-CPU engines (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on March 16, 2019 with Bayeselo based on 1'004'662 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Stockfish 10 64-bit 4CPU3463+23−2377.7%−190.342.9%678 
69.8%
 Stockfish 270918 64-bit 4CPU3453+28−2777.9%−188.443.3%457
85.6%
 SugaR XPrO 1.5.3 64-bit 4CPU3433+24−2471.8%−143.351.3%544
55.4%
 Stockfish 9 64-bit 4CPU3432+15−1572.3%−153.550.5%1423
95.5%
 SugaR XPrO 1.4 64-bit 4CPU3411+20−1972.3%−150.351.8%840
55.5%
 asmFish 051117 64-bit 4CPU3409+20−1969.8%−130.255.7%819
75.1%
 SugaR XPrO 1.2 64-bit 4CPU3399+21−2070.4%−135.852.5%754
62.8%
 ShashChess Pro 1.0 64-bit 4CPU3393+33−3365.6%−94.461.7%256
77.7%
 Stockfish 8 64-bit 4CPU3378+14−1465.1%−96.362.1%1647
64.7%
 SugaR XPrO 1.3 64-bit 4CPU3373+23−2266.0%−102.757.4%598
100.0%
 Stockfish 7 64-bit 4CPU3326+15−1567.0%−105.857.3%1304
98.0%
2Ethereal 11.00 64-bit 4CPU3298+20−2048.7%+8.463.9%714
55.9%
 Laser 1.7 64-bit 4CPU3295+43−4261.2%−65.360.5%152
56.0%
 Stockfish 6 64-bit 4CPU3291+14−1465.3%−94.157.3%1542
53.4%
 Ethereal 11.25 64-bit 4CPU3289+57−5843.3%+40.859.8%82
57.5%
 Andscacs 0.95 64-bit 4CPU3282+42−4251.0%−7.361.7%154
61.2%
 Ethereal 10.55 64-bit 4CPU3275+24−2549.8%−2.157.4%488
65.3%
 Stockfish 5 64-bit 4CPU3269+15−1567.9%−111.153.7%1324
65.6%
3Andscacs 0.94 64-bit 4CPU3264+19−1948.3%+9.755.1%876
54.2%
4Booot 6.3.1 64-bit 4CPU3262+19−1945.0%+31.056.0%825
78.5%
5Xiphos 0.4 64-bit 4CPU3252+19−1943.8%+39.061.1%830
82.4%
 Andscacs 0.921 64-bit 4CPU3240+16−1650.7%−6.647.5%1225
52.0%
 Andscacs 0.93 64-bit 4CPU3239+18−1842.9%+45.554.8%938
63.6%
 Stockfish DD 64-bit 4CPU3235+17−1763.5%−81.355.5%992
92.0%
 Booot 6.2 64-bit 4CPU3218+14−1542.2%+50.859.2%1427
50.7%
6Laser 1.6 64-bit 4CPU3218+17−1742.4%+50.656.1%1034
82.2%
 Stockfish 4 64-bit 4CPU3206+17−1760.9%−64.558.9%1054
88.7%
 Ethereal 10.00 64-bit 4CPU3189+20−2053.4%−22.750.8%788
52.3%
 ChessBrainVB 3.72 4CPU3188+40−4143.3%+42.150.0%180
64.1%
7Gull 3 64-bit 4CPU3180+10−1041.7%+53.354.5%3651
55.6%
 Gull 2.8b 64-bit 4CPU3179+19−1949.1%+3.551.8%797
50.1%
 Xiphos 0.3 64-bit 4CPU3179+21−2149.2%+3.154.2%660
57.5%
8Arasan 21.2 64-bit 4CPU3175+36−3651.5%−8.564.2%201
61.8%
 Arasan 21.1 64-bit 4CPU3168+27−2751.2%−8.359.5%383
50.9%
 Booot 6.1 64-bit 4CPU3167+20−2041.6%+52.060.6%708
51.7%
 Stockfish 3 64-bit 4CPU3166+21−2156.0%−34.957.8%663
74.6%
9Nemorino 5.00 64-bit 4CPU3156+20−2049.9%−0.652.1%739
74.9%
 Stockfish 2.2.2 64-bit 4CPU3147+16−1659.2%−56.253.4%1141
64.5%
 Gull 2.3 64-bit 4CPU3143+17−1747.4%+14.659.3%982
48.7%
 Laser 1.5 64-bit 4CPU3143+20−2049.4%+8.354.5%723
51.3%
 Stockfish 2.3.1 64-bit 4CPU3143+19−1955.4%−33.452.5%846
50.2%
10Texel 1.07 64-bit 4CPU3143+14−1449.9%+2.549.0%1568
65.4%
11Protector 1.9.0 64-bit 4CPU3138+15−1546.3%+26.254.1%1313
63.4%
12Vajolet2 2.6.1 64-bit 4CPU3134+22−2249.5%+2.360.5%550
53.9%
 Sting SF 4.8.4 64-bit 4CPU3132+29−2953.3%−21.062.4%330
49.1%
 Sting SF 6 64-bit 4CPU3132+28−2850.8%−6.261.0%354
51.3%
 Texel 1.06 64-bit 4CPU3132+20−2046.1%+24.953.6%739
59.7%
 Stockfish 2.0.1 64-bit 4CPU3128+24−2456.4%−40.848.6%514
56.5%
 Protector 1.8.0 64-bit 4CPU3125+27−2750.4%−2.154.7%386
51.8%
13ChessBrainVB 3.68 4CPU3124+26−2649.2%+3.851.6%428
49.6%
 Gull 3.1 64-bit 4CPU3124+30−3045.4%+33.445.1%359
58.4%
 Arasan 20.4.1 64-bit 4CPU3120+26−2551.7%−11.050.2%452
54.0%
 Sting SF 5 64-bit 4CPU3118+25−2548.1%+12.454.0%465
61.2%
14IvanHoe 9.46h 64-bit 4CPU3114+14−1453.2%−19.959.5%1542
49.3%
 Stockfish 2.1.1 64-bit 4CPU3114+27−2754.7%−29.148.3%406
54.4%
 Stockfish 1.9.1 64-bit 4CPU3112+23−2362.1%−81.046.2%580
56.2%
15Senpai 2.0 64-bit 4CPU3109+20−2050.9%−7.448.9%750
50.3%
 Sting SF 3 64-bit 4CPU3109+21−2147.7%+11.858.5%644
52.2%
 Sting SF 2 64-bit 4CPU3108+27−2748.8%+8.458.1%375
52.1%
 Stockfish 1.8 64-bit 4CPU3107+19−1962.2%−81.649.3%850
52.9%
 ChessBrainVB 3.66 4CPU3106+28−2854.2%−27.248.7%378
54.3%
 Stockfish 1.7.1 64-bit 4CPU3104+19−1960.7%−69.852.8%860
54.1%
 Xiphos 0.2.2 64-bit 4CPU3102+26−2647.3%+14.253.6%414
52.8%
 RubiChess 1.3 64-bit 4CPU3100+60−5864.1%−90.739.1%92
52.2%
 Gull 2.2 64-bit 4CPU3098+25−2544.5%+31.154.8%469
52.4%
 Vajolet2 2.5 64-bit 4CPU3097+24−2451.5%−9.854.0%493
52.5%
 Sting SF 9 64-bit 4CPU3096+34−3450.6%−4.245.5%266
50.9%
 Nemorino 4.00 64-bit 4CPU3095+22−2250.0%+1.452.9%624
50.3%
 Sting SF 4 64-bit 4CPU3095+23−2341.9%+49.048.9%562
63.1%
 Arasan 20.3 64-bit 4CPU3088+32−3252.5%−19.947.4%302
50.4%
 Laser 1.4 64-bit 4CPU3088+19−1949.6%+0.345.7%843
59.6%
 Texel 1.05 64-bit 4CPU3085+17−1747.3%+18.351.4%1016
53.0%
 Pirarucu 2.9.5 64-bit 4CPU3080+106−10941.3%+49.856.5%23
53.8%
 Protector 1.7.0 64-bit 4CPU3075+19−1944.1%+36.950.6%834
59.2%
 Nemorino 3.0 64-bit 4CPU3071+27−2747.9%+13.146.1%427
50.3%
 Protector 1.6.0 64-bit 4CPU3071+21−2243.2%+44.450.2%656
54.5%
16Rodent III 0.238 64-bit 4CPU3069+20−2047.2%+15.250.0%742
61.8%
17Defenchess (SCTR) 1.1f 64-bit 4CPU3065+19−1951.8%−12.545.0%854
68.3%
 Texel 1.04 64-bit 4CPU3058+21−2143.1%+43.147.8%722
56.0%
 Protector 1.5.0 64-bit 4CPU3056+18−1842.5%+47.747.4%952
65.2%
 Ethereal 9.00 64-bit 4CPU3050+23−2346.8%+19.045.1%570
67.0%
 Vajolet2 2.2 64-bit 4CPU3042+27−2747.0%+15.148.7%423
49.9%
 Vajolet2 2.4 64-bit 4CPU3042+19−1947.2%+18.245.7%878
52.0%
 Demolito 2018-10-29 64-bit 4CPU3041+45−4553.9%−26.252.8%142
50.3%
 Stockfish 1.6.3 64-bit 4CPU3040+22−2258.2%−54.044.8%631
53.1%
 Arasan 19.2 64-bit 4CPU3039+31−3151.7%−11.555.0%289
49.7%
 Gull R375 64-bit 4CPU3039+22−2243.4%+37.357.4%605
50.2%
 Rodent III 0.276 64-bit 4CPU3039+63−6445.3%+29.165.6%64
51.2%
 Tucano 7.06 64-bit 4CPU3035+208−21655.6%−116.844.4%9
52.7%
 Vajolet2 2.3 64-bit 4CPU3028+31−3243.7%+35.754.7%287
54.8%
 Arasan 20.0 64-bit 4CPU3025+34−3449.0%+8.457.1%240
53.1%
 Senpai 1.0 64-bit 4CPU3024+16−1646.2%+20.753.5%1095
50.8%
18Bobcat 8.0 64-bit 4CPU3023+23−2347.3%+17.553.4%566
58.7%
 Arasan 19.0.1 64-bit 4CPU3019+34−3354.2%−32.643.1%276
56.8%
19Pirarucu 2.7.4 64-bit 4CPU3015+23−2355.5%−38.246.0%567
56.8%
20‑21Crafty 25.2 64-bit 4CPU3013+16−1648.4%+9.243.6%1187
47.9%
20‑21chess22k 1.10 64-bit 4CPU3013+22−2246.7%+16.943.7%680
53.4%
 Nemorino 2.00 64-bit 4CPU3012+30−3047.0%+16.159.6%302
53.6%
22Cheng 4.39 64-bit 4CPU3010+16−1650.0%+0.249.2%1218
50.2%
 Laser 1.3 64-bit 4CPU3010+30−2947.2%+15.755.8%321
49.4%
 Texel 1.03 64-bit 4CPU3010+31−3150.3%−0.847.0%313
70.5%
 Vajolet2 2.1 64-bit 4CPU2999+25−2550.9%−3.448.5%462
54.8%
 Rodent III 0.210 64-bit 4CPU2997+28−2845.1%+32.942.5%402
50.6%
23Scorpio 2.8 64-bit 4CPU2997+30−3050.9%−9.345.2%332
76.5%
 Protector 1.4.0 64-bit 4CPU2983+19−1942.5%+49.142.9%912
55.6%
 Cheng4 0.38 64-bit 4CPU2981+24−2446.0%+23.242.4%531
51.0%
 Bobcat 7.6 64-bit 4CPU2980+32−3250.2%−0.741.7%300
61.5%
 Arasan 18.3 64-bit 4CPU2974+30−3046.6%+20.146.8%327
51.9%
24EXchess 7.97b 64-bit 4CPU2973+18−1846.6%+22.945.4%953
53.4%
 Arasan 18.2 64-bit 4CPU2971+28−2851.9%−14.650.3%388
52.1%
 Stockfish 1.5.1 64-bit 4CPU2970+25−2553.7%−22.947.7%495
62.0%
 Protector 1.3.6 64-bit 4CPU2964+33−3345.7%+24.144.7%291
51.5%
25Demolito 2017-08-26 64-bit 4CPU2963+21−2140.2%+63.540.8%748
50.2%
 Winter 0.5 64-bit 4CPU2963+57−5752.0%−16.635.4%99
55.2%
26Toga II 4.0 64-bit 4CPU2959+19−1940.8%+60.440.0%872
51.9%
 EXchess 7.88b 64-bit 4CPU2958+29−2945.4%+29.448.6%356
65.4%
 Crafty 25.0 64-bit 4CPU2950+25−2548.1%+12.847.9%468
53.4%
 Stockfish 1.4 64-bit 4CPU2949+17−1754.2%−29.142.2%1131
58.8%
 Scorpio 2.7.9 64-bit 4CPU2945+22−2246.7%+21.440.5%659
61.6%
 EXchess 7.51b 64-bit 4CPU2939+33−3350.7%−2.145.7%276
57.7%
 Arasan 17.5 64-bit 4CPU2935+27−2748.4%+10.145.1%406
54.1%
 Bobcat 7.1 64-bit 4CPU2933+33−3348.0%+12.247.1%278
50.7%
 EXchess 7.71b 64-bit 4CPU2932+28−2853.3%−22.543.2%403
54.0%
 Ethereal 8.62 64-bit 4CPU2931+22−2244.2%+35.249.7%600
58.2%
 Arasan 18.0 64-bit 4CPU2927+29−2947.2%+15.241.5%378
65.7%
 Toga II 3.0 4CPU2919+22−2345.6%+27.349.0%592
54.6%
27Marvin 3.2.0 64-bit 4CPU2917+23−2354.2%−29.642.0%609
61.6%
 Crafty 23.8 64-bit 4CPU2911+33−3447.6%+16.247.2%267
62.6%
 Toga II 1.4.1SE 4CPU2905+13−1348.5%+10.641.6%2041
67.2%
 Cheng4 0.36c 64-bit 4CPU2897+30−3048.8%+6.446.6%326
51.7%
 Glaurung 2.2 64-bit 4CPU2896+16−1647.0%+19.540.7%1259
73.1%
28Octochess r5506 64-bit 4CPU2888+21−2144.6%+34.846.9%685
55.9%
29MinkoChess 1.3 64-bit 4CPU2886+21−2146.0%+24.143.7%725
51.5%
 Toga II 1.4 beta5c 4CPU2885+18−1851.7%−11.945.8%996
63.8%
 Crafty 24.1 64-bit 4CPU2878+31−3243.5%+41.739.1%322
56.9%
 Scorpio 2.7.6 64-bit 4CPU2875+26−2647.4%+16.444.0%445
62.5%
 Glaurung 2.1 64-bit 4CPU2869+19−1942.8%+51.241.3%946
55.9%
 Bobcat 6.4b 64-bit 4CPU2867+27−2748.3%+11.346.5%415
52.1%
 EXchess 7.18b 64-bit 4CPU2866+35−3546.7%+19.837.9%256
51.3%
 Crafty 23.4 64-bit 4CPU2865+37−3747.2%+16.935.2%236
60.6%
 Arasan 16.3 64-bit 4CPU2858+34−3449.1%+4.340.2%276
51.6%
 Scorpio 2.7.5 64-bit 4CPU2857+36−3644.1%+33.950.9%230
51.5%
 Scorpio 2.7.7 64-bit 4CPU2856+32−3242.9%+44.741.3%310
78.5%
 Crafty 23.3 64-bit 4CPU2838+31−3241.5%+54.938.2%325
68.1%
 Glaurung 2.0.1 64-bit 4CPU2829+17−1743.8%+38.643.5%1100
64.3%
 Octochess r5190 64-bit 4CPU2823+24−2445.9%+24.244.5%555
73.9%
 Monolith 1.0 64-bit 4CPU2799+68−7033.3%+100.645.5%66
50.5%
 Laser 1.0 64-bit 4CPU2798+39−4037.2%+84.239.6%207
59.2%
 Crafty 23.1 64-bit 4CPU2792+36−3743.8%+42.736.9%241
89.1%
 Glaurung 1.2.1 64-bit 4CPU2766+19−1940.2%+63.638.1%967
67.7%
 Crafty 23.0 64-bit 4CPU2759+18−1839.0%+77.934.1%1042
96.7%
 Scorpio 2.0 32-bit 4CPU2732+24−2433.4%+114.936.7%607
76.2%
 Scorpio 2.1 64-bit 4CPU2719+27−2734.4%+109.431.6%490
67.9%
 Topple 0.4.0 64-bit 4CPU2691+107−12124.1%+183.927.6%29
55.8%
30RedQueen 1.1.98 64-bit 4CPU2682+27−2839.5%+80.727.8%474
87.4%
 RedQueen 1.1.97 64-bit 4CPU2661+22−2245.7%+27.333.3%726
100.0%
31Fridolin 2.00 64-bit 4CPU2588+34−3441.9%+57.631.3%297
95.9%
32Jazz 840 64-bit 4CPU2552+20−2058.6%−70.125.3%968
82.4%
33Nemeton 1.8 4CPU2536+28−2852.3%−16.528.2%464
93.2%
 Invictus r228 64-bit 4CPU2339+242−29628.6%+166.90.0%7
 

Results matrix

Open source multi-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3463 33.5 − 14.5
+19−0=29
−51
35 − 9
+26−0=18
−7
33.5 − 10.5
+24−1=19
−35
38.5 − 5.5
+33−0=11
+77
36.5 − 7.5
+29−0=15
−16
      
2Ethereal 11.00 64-bit 4CPU329814.5 − 33.5
+0−19=29
+51
 19.5 − 14.5
+11−6=17
+7
16 − 16
+1−1=30
−36
17.5 − 14.5
+4−1=27
−22
20.5 − 11.5
+10−1=21
−1
  27.5 − 8.5
+19−0=17
+21
   
3Andscacs 0.94 64-bit 4CPU32649 − 35
+0−26=18
+7
14.5 − 19.5
+6−11=17
−7
 20 − 17
+7−4=26
+21
19 − 15
+6−2=26
+18
22 − 12
+12−2=20
+38
  26.5 − 10.5
+17−1=19
+24
1.5 − 0.5
+1−0=1
+21
 1 − 1
+0−0=2
−130
4Booot 6.3.1 64-bit 4CPU326210.5 − 33.5
+1−24=19
+35
16 − 16
+1−1=30
+36
17 − 20
+4−7=26
−21
 16 − 16
+6−6=20
−12
18.5 − 13.5
+8−3=21
+1
  26 − 10
+17−1=18
+27
   
5Xiphos 0.4 64-bit 4CPU32525.5 − 38.5
+0−33=11
−77
14.5 − 17.5
+1−4=27
+22
15 − 19
+2−6=26
−18
16 − 16
+6−6=20
+12
 18.5 − 14.5
+8−4=21
−2
 7.5 − 2.5
+5−0=5
+76
21.5 − 14.5
+10−3=23
−42
   
6Laser 1.6 64-bit 4CPU32187.5 − 36.5
+0−29=15
+16
11.5 − 20.5
+1−10=21
+1
12 − 22
+2−12=20
−38
13.5 − 18.5
+3−8=21
−1
14.5 − 18.5
+4−8=21
+2
 19 − 13
+8−2=22
+13
1 − 1
+0−0=2
−43
18 − 18
+8−8=20
−63
  9.5 − 6.5
+6−3=7
−22
7Gull 3 64-bit 4CPU3180     13 − 19
+2−8=22
−13
    11.5 − 9.5
+3−1=17
−16
9.5 − 6.5
+5−2=9
+7
8Arasan 21.2 64-bit 4CPU3175    2.5 − 7.5
+0−5=5
−76
1 − 1
+0−0=2
+43
  4 − 4
+1−1=6
−14
3 − 3
+0−0=6
−32
 4 − 3
+1−0=6
−13
9Nemorino 5.00 64-bit 4CPU3156 8.5 − 27.5
+0−19=17
−21
10.5 − 26.5
+1−17=19
−24
10 − 26
+1−17=18
−27
14.5 − 21.5
+3−10=23
+42
18 − 18
+8−8=20
+63
 4 − 4
+1−1=6
+14
 22 − 20
+12−10=20
+1
 23 − 21
+11−9=24
−8
10Texel 1.07 64-bit 4CPU3143  0.5 − 1.5
+0−1=1
−21
    3 − 3
+0−0=6
+32
20 − 22
+10−12=20
−1
 28 − 33
+12−17=32
−27
3.5 − 2.5
+2−1=3
+42
11Protector 1.9.0 64-bit 4CPU3138      9.5 − 11.5
+1−3=17
+16
  33 − 28
+17−12=32
+27
  
12Vajolet2 2.6.1 64-bit 4CPU3134  1 − 1
+0−0=2
+130
  6.5 − 9.5
+3−6=7
+22
6.5 − 9.5
+2−5=9
−7
3 − 4
+0−1=6
+13
21 − 23
+9−11=24
+8
2.5 − 3.5
+1−2=3
−42
  
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Open source multi-CPU engines (best versions only), top 12
#NameElo123456789101112
1Stockfish 10 64-bit 4CPU3463 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Ethereal 11.00 64-bit 4CPU32980.0 99.599.6100.0100.0100.0100.0100.0100.0100.0100.0
3Andscacs 0.94 64-bit 4CPU32640.00.5 54.281.8100.0100.0100.0100.0100.0100.0100.0
4Booot 6.3.1 64-bit 4CPU32620.00.445.8 78.5100.0100.0100.0100.0100.0100.0100.0
5Xiphos 0.4 64-bit 4CPU32520.00.018.221.5 99.7100.0100.0100.0100.0100.0100.0
6Laser 1.6 64-bit 4CPU32180.00.00.00.00.3 100.098.1100.0100.0100.0100.0
7Gull 3 64-bit 4CPU31800.00.00.00.00.00.0 61.398.0100.0100.0100.0
8Arasan 21.2 64-bit 4CPU31750.00.00.00.00.01.938.7 80.494.195.896.9
9Nemorino 5.00 64-bit 4CPU31560.00.00.00.00.00.02.019.6 86.591.293.7
10Texel 1.07 64-bit 4CPU31430.00.00.00.00.00.00.05.913.5 65.474.6
11Protector 1.9.0 64-bit 4CPU31380.00.00.00.00.00.00.04.28.834.6 63.4
12Vajolet2 2.6.1 64-bit 4CPU31340.00.00.00.00.00.00.03.16.325.436.6 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on March 16, 2019