CCRL 40/4
Downloads and Statistics
October 12, 2019
Testing summary:
Total: 2'115'766 games
played by 2'468 programs
28564 CPU days (X2 4600+)

White wins: 821'094 (38.8%)
Black wins: 663'997 (31.4%)
Draws: 630'675 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 14 engines!
14 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on October 12, 2019 with Bayeselo based on 2'115'766 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent		DrawsGamesLOS
Elo+−
1Bright 0.4a 4CPU2910+11−1142.4%+51.033.9%3023 
67.1%
 Bright 0.5c 4CPU2906+14−1436.5%+93.035.7%1715
94.4%
 Bright 0.3d 4CPU2890+14−1444.4%+39.135.6%1789
90.7%
 Bright 0.3b 4CPU2878+13−1342.4%+52.633.9%2093
99.4%
 Bright 0.3a 4CPU2854+14−1443.7%+40.534.6%1756
100.0%
 Bright 0.2c 4CPU2813+17−1735.5%+101.630.1%1244
99.9%
 Bright 0.4a2780+10−944.0%+42.329.2%4353
90.0%
 Bright 0.5c2772+8−847.1%+21.031.8%7003
91.4%
 Bright 0.3b2753+25−2538.0%+80.534.0%547
86.3%
 Bright 0.3d2736+19−2032.6%+128.830.3%995
100.0%
 Bright 0.2c2688+13−1350.8%−4.330.8%2039
54.4%
 Bright 0.2b2686+30−3049.6%−0.232.0%372
97.3%
 Bright 0.2a2646+27−2744.2%+38.232.2%466
60.9%
 Bright 0.1d2641+22−2251.7%−12.730.6%712
 

Results matrix

Custom engine selection
#NameElo1
Brigh
2
Brigh
3
Brigh
4
Brigh
5
Brigh
6
Brigh
7
Brigh
8
Brigh
9
Brigh
10
Brigh
11
Brigh
12
Brigh
13
Brigh
14
Brigh
1Bright 0.4a 4CPU2910              
2Bright 0.5c 4CPU2906              
3Bright 0.3d 4CPU2890              
4Bright 0.3b 4CPU2878              
5Bright 0.3a 4CPU2854              
6Bright 0.2c 4CPU2813              
7Bright 0.4a2780              
8Bright 0.5c2772              
9Bright 0.3b2753              
10Bright 0.3d2736              
11Bright 0.2c2688              
12Bright 0.2b2686              
13Bright 0.2a2646              
14Bright 0.1d2641              
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 67.198.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Bright 0.5c 4CPU290632.9 94.499.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Bright 0.3d 4CPU28901.25.6 90.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Bright 0.3b 4CPU28780.00.29.3 99.4100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Bright 0.3a 4CPU28540.00.00.00.6 100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Bright 0.2c 4CPU28130.00.00.00.00.0 99.9100.0100.0100.0100.0100.0100.0100.0
7Bright 0.4a27800.00.00.00.00.00.1 90.097.1100.0100.0100.0100.0100.0
8Bright 0.5c27720.00.00.00.00.00.010.0 91.4100.0100.0100.0100.0100.0
9Bright 0.3b27530.00.00.00.00.00.02.98.6 86.3100.0100.0100.0100.0
10Bright 0.3d27360.00.00.00.00.00.00.00.013.7 100.099.7100.0100.0
11Bright 0.2c26880.00.00.00.00.00.00.00.00.00.0 54.499.7100.0
12Bright 0.2b26860.00.00.00.00.00.00.00.00.00.345.6 97.399.0
13Bright 0.2a26460.00.00.00.00.00.00.00.00.00.00.32.7 60.9
14Bright 0.1d26410.00.00.00.00.00.00.00.00.00.00.01.039.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 253919842388148712561501920150152000
2Bright 0.5c 4CPU29062539 74610506985406611201001298210082
3Bright 0.3d 4CPU28901984746 35831869157321625803003299615096
4Bright 0.3b 4CPU2878238810503583 2471221321625803003299615096
5Bright 0.3a 4CPU2854148769818692471 221414519299440128819981
6Bright 0.2c 4CPU28131256540157322132214 00000000
7Bright 0.4a2780150662162161450 37954587171173262128116
8Bright 0.5c277219211225825819203795 3245351111217180156
9Bright 0.3b27530000990458324 9930000
10Bright 0.3d27361501003003004400717535993 1688210082
11Bright 0.2c26881521293293291280117311110168 651356419
12Bright 0.2b26860829696810262217082651 403269
13Bright 0.2a264601001501509901281800100356403 520
14Bright 0.1d26410829696810116156082419269520 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 53.641.246.731.129.42.01.90.03.73.00.00.00.0
2Bright 0.5c 4CPU290653.6 21.327.620.118.21.11.30.03.73.43.94.63.4
3Bright 0.3d 4CPU289041.221.3 92.352.751.93.52.90.010.88.64.46.73.8
4Bright 0.3b 4CPU287846.727.692.3 64.266.33.42.80.09.78.03.95.93.4
5Bright 0.3a 4CPU285431.120.152.764.2 73.82.42.24.316.03.43.84.53.3
6Bright 0.2c 4CPU281329.418.251.966.373.8 0.00.00.00.00.00.00.00.0
7Bright 0.4a27802.01.13.53.42.40.0 33.49.313.418.45.52.72.3
8Bright 0.5c27721.91.32.92.82.20.033.4 4.36.712.32.92.42.0
9Bright 0.3b27530.00.00.00.04.30.09.34.3 64.40.00.00.00.0
10Bright 0.3d27363.73.710.89.716.00.013.46.764.4 5.56.06.84.8
11Bright 0.2c26883.03.48.68.03.40.018.412.30.05.5 27.014.215.2
12Bright 0.2b26860.03.94.43.93.80.05.52.90.06.027.0 48.124.8
13Bright 0.2a26460.04.66.75.94.50.02.72.40.06.814.248.1 44.1
14Bright 0.1d26410.03.43.83.43.30.02.32.00.04.815.224.844.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 120 common opponents

Custom engine selection
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Rybka 3 64-bit 4CPU316714%
13.5/100		19%
9.5/50		13%
13/100		13%
13.5/101		          
Rybka 4.1 64-bit3109      11%
3.5/32		17%
0.5/3		      
Stockfish 1.6s JA 64-bit 4CPU309427%
26.5/99		28%
13.5/49		            
Stockfish 1.6.3 64-bit 4CPU309022%
22/100		23%
11.5/50		            
Rybka 3 64-bit307826%
25.5/100		 18%
18/100		22%
22/100		  12%
6/50		6%
2/32		 9%
4.5/50		    
Naum 4.1 64-bit 4CPU307030%
15/50		20%
10/50		            
Naum 4 64-bit 4CPU306327%
27/100		25%
12.5/50		            
Stockfish 1.8 64-bit3058      18%
6/34		18%
6/34		      
Rybka 2.3.2a 64-bit 4CPU3045  26%
25.5/99		24%
24/99		29%
14/48		15%
14/91		        
Stockfish 1.7.1 64-bit3045      12%
4/32		19%
11.5/62		      
Deep Shredder 12 64-bit 4CPU304232%
63.5/200		32%
32/100		            
Naum 4.2 64-bit2988      20%
10/50		25%
12.5/50		      
Naum 3 64-bit 4CPU2987  38%
37.5/100		27%
27/100		28%
28/100		22%
22/98		        
Stockfish 1.6.3 64-bit2986      26%
13/50		19%
6/32		      
Stockfish 1.6s JA 64-bit2980      28%
14/50		28%
9/32		      
Naum 3.1 64-bit 4CPU297932%
31.5/99		 40%
40.5/100		34%
34.5/100		30%
29.5/100		         
Rybka 2.3.2a 64-bit2978    32%
15.5/49		 15%
4.5/30		20%
6.5/32		25%
12.5/50		19%
18.5/99		    
Critter 0.70 64-bit2974      22%
6.5/30		19%
6/32		      
Zappa Mexico II 64-bit 4CPU297140%
40.5/100		42%
21/50		43%
43.5/101		40%
40.5/100		48%
24/50		         
Spark 0.3 64-bit 4CPU297041%
41/100		36%
18/50		            
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Komodo 1.2 64-bit2967      28%
7.5/27		25%
8/32		      
Thinker 5.4c Inert 64-bit 4CPU295244%
44/100		46%
23/50		            
Naum 4 64-bit2948      33%
16.5/50		31%
10/32		      
Zappa Mexico 64-bit 4CPU294646%
45.5/100		54%
27/50		 45%
45/100		32%
31.5/99		28%
38.5/138		        
Deep Junior 11.1a 64-bit 4CPU294340%
20/50		46%
37/80		            
Hiarcs 12 4CPU294240%
39.5/99		39%
19.5/50		 38%
38.5/100		38%
38/100		40%
40/100		        
Deep Sjeng WC2008 64-bit 4CPU294150%
50/100		48%
24/50		            
Hiarcs 12.1 4CPU293937%
37/100		44%
22/50		            
Deep Shredder 11 64-bit 4CPU293256%
55.5/99		 39%
37/95		45%
42.5/95		37%
18.5/50		37%
34/91		        
Deep Sjeng 3.0 64-bit 4CPU293051%
50/99		 45%
44.5/99		38%
38/100		          
Hiarcs Paderborn 2007 4CPU2930   42%
41.5/99		41%
41/100		34%
33.5/100		        
Rybka 2.3.2a 32-bit2923      27%
3/11		   15%
8/52		21%
2.5/12		  
Spike 1.4 Leiden2922      36%
13/36		50%
1/2		      
Hiarcs 11.2 4CPU2915  46%
46.5/100		41%
40.5/99		38%
18/48		36%
33.5/92		        
Naum 2.2 64-bit 4CPU2908    39%
19/49		38%
34.5/92		        
Toga II 1.4 beta5c 4CPU290446%
45.5/100		45%
22.5/50		50%
50/100		40%
39.5/100		48%
24/50		44%
21.5/49		        
Glaurung 2.1 64-bit 4CPU290051%
50.5/99		 46%
46/100		53%
53/100		36%
36.5/100		24%
24.5/100		        
Hiarcs 11.1 4CPU2900  48%
48/100		47%
47/100		          
Toga II 1.4.1SE 4CPU290053%
51.5/98		 48%
47.5/100		45%
45/100		48%
15/31		31%
9.5/31		        
Doch 1.3.4 64-bit2894      39%
12.5/32		23%
7.5/32		      
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Fritz 11288856%
56/100		      36%
11.5/32		  24%
12.5/52		   
Thinker 5.4d Inert 64-bit2886      29%
11/38		32%
13/40		      
Thinker 5.4c Inert 64-bit2883      46%
23/50		31%
19.5/62		      
Loop M1-T 64-bit 4CPU288258%
57/99		53%
26.5/50		53%
51/96		48%
48.5/100		39%
19.5/50		41%
37.5/91		        
Spark 0.4 64-bit2882      28%
8.5/30		30%
24.5/82		      
Gaviota 1.0 64-bit2873      25%
1.5/6		37%
12.5/34		      
Tornado 8.0 64-bit 4CPU286870%
22.5/32		59%
19/32		            
Loop 13.6 (Loop 2007) 64-bit 4CPU2867  49%
48.5/99		52%
52.5/100		          
Naum 3.1 64-bit2863        36%
18/50		25%
12.5/50		    
Glaurung 2.0.1 64-bit 4CPU2862  60%
60.5/100		54%
54/100		50%
25/50		47%
37.5/80		        
Protector 1.3.5 64-bit2856      30%
9/30		42%
12.5/30		      
Naum 3 64-bit2855         25%
12.5/50		31%
4/13		   
Protector 1.3.4 64-bit2853      43%
13/30		39%
12.5/32		      
Shredder 112847      38%
23/60		   34%
11.5/34		25%
5/20		  
Spark 0.3 64-bit2844      34%
17/50		42%
27/64		      
Zappa Mexico II 64-bit2844      34%
21.5/63		32%
10.5/33		 41%
20.5/50		    
Deep Shredder 11 64-bit2843    35%
17/48		    33%
16/49		    
Deep Sjeng 3.0 64-bit2838      43%
21.5/50		48%
15.5/32		36%
17.5/49		29%
14/49		    
Onno 1.1.1 64-bit2838      37%
18.5/50		41%
13/32		      
Hiarcs 122835      39%
19.5/50		30%
9.5/32		34%
16.5/49		40%
19.5/49		    
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Hiarcs 12.12833      45%
31.5/70		39%
12/31		      
Toga II 1.4.1SE2824      33%
10/30		45%
13.5/30		40%
20/50		     
Cheng4 0.36c 64-bit2820      51%
19.5/38		58%
18.5/32		      
Toga II 1.4 beta5c2820      44%
22/50		 34%
17/50		36%
36.5/100		    
Hiarcs Paderborn 20072819        38%
38/100		44%
22/50		    
Grapefruit 1.0 a2b2810        43%
21/49		45%
22.5/50		    
Fritz 102800          41%
14.5/35		34%
5.5/16		  
Loop M1-T 64-bit2786    68%
33.5/49		    48%
23/48		    
Glaurung 2.1 64-bit2783        52%
26/50		43%
43/99		    
Ktulu 92782      54%
26.5/49		47%
15.5/33		      
Fruit 2.3.12781      55%
5.5/10		100%
3/3		  32%
11/34		   
Octochess r5190 64-bit2778      62%
8/13		44%
14/32		      
Loop 13.6 (Loop 2007) 32-bit2776       52%
15.5/30		  40%
13.5/34		   
Toga II 1.3.12773  66%
65.5/100		70%
70.5/100		      32%
16/50		   
MinkoChess 0.9 64-bit2771      47%
14/30		42%
12.5/30		      
Naum 2.2 32-bit2770          33%
11.5/35		40%
12.5/31		45%
14.5/32		 
Twisted Logic 20090922 64-bit2770      53%
26.5/50		53%
17/32		      
Twisted Logic 20100131x 64-bit2767      53%
16/30		51%
46.5/91		      
Jonny 4.002763      62%
22.5/36		0%
0/2		      
Bison 9.11 64-bit2762      58%
17.5/30		57%
17/30		      
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
BugChess2 1.9 64-bit2759      58%
7/12		54%
18.5/34		      
Fruit 2.2.12751            39%
12.5/32		22%
7/32
SmarThink 1.20 64-bit2748      61%
30.5/50		61%
19.5/32		      
Naum 2.1 32-bit2739            41%
13/32		30%
9.5/32
Hiarcs 102736           36%
10.5/29		38%
19/50		36%
18/50
Scorpio 2.0 32-bit 4CPU2731    74%
36.5/49		68%
34/50		        
Spike 1.2 Turin2731 77%
38.5/50		72%
72/100		69%
69/100		70%
34.5/49		 61%
13.5/22		62%
38.5/62		 46%
23/50		41%
32/79		44%
14/32		34%
17/50		42%
13.5/32
Crafty 23.2 64-bit2721      50%
15/30		62%
18.5/30		      
Chess Tiger 2007.12713       50%
1/2		   50%
10.5/21		48%
15.5/32		 
Naum 2.0 32-bit2700      63%
19/30		60%
18/30		  46%
16/35		   
Frenzee Feb08 64-bit2695      65%
19.5/30		63%
19/30		  46%
15.5/34		   
Naum 2.0 64-bit2694      57%
17/30		65%
19.5/30		  62%
26.5/43		   
Delfi 5.42683      63%
26.5/42		100%
1/1		  43%
14.5/34		   
Scorpio 2.5 64-bit2683      65%
19.5/30		55%
16.5/30		      
Pharaon 3.5.1 4CPU2675    80%
37/46		65%
26.5/41		        
Daydreamer 1.75 64-bit2673      63%
19/30		52%
15.5/30		      
BugChess2 1.6.4 64-bit2670      60%
18/30		63%
19/30		      
Booot 4.15.12668      65%
19.5/30		67%
33.5/50		      
Booot 4.15.02666      65%
19.5/30		78%
23.5/30		      
SmarThink 1.00 32-bit2664           60%
18/30		50%
16/32		48%
15.5/32
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Alaric 7072663      79%
41/52		76%
26/34		  51%
41/80		57%
12/21		  
Glaurung 1.2.1 32-bit2657          53%
18.5/35		  42%
13.5/32
Scorpio 2.0 32-bit2656          51%
34/67		56%
18/32		  
Colossus 2008b2642      79%
32.5/41		84%
26/31		  62%
20/32		   
Cyrano 0.6b17 64-bit2642      83%
25/30		47%
14/30		  53%
18/34		   
E.T. Chess 13.01.082634      67%
28/42		75%
1.5/2		  64%
20.5/32		   
Alfil 8.1.1 Optimized2626       72%
21/29		  66%
21/32		   
Movei 00.8.438 (10 10 10)2623      63%
26.5/42		80%
24/30		  56%
18/32		   
WildCat 82623      72%
29.5/41		67%
20/30		  59%
20/34		   
Alaric 7042618            36%
11.5/32		49%
24.5/50
Sloppy 0.2.2 64-bit2617      75%
22.5/30		78%
23.5/30		      
Delfi 5.12615          66%
21/32		  58%
18.5/32
Slow Chess Blitz WV2.12615      67%
20/30		82%
25.5/31		  69%
46.5/67		   
Delfi 5.22609          70%
46/66		53%
17/32		  
ProDeo 1.22609      65%
19.5/30		78%
23.5/30		      
WildCat 72606          67%
45/67		  52%
16.5/32
Amyan 1.722604      80%
24/30		76%
23.5/31		      
Pharaon 3.5.12604      80%
24/30		80%
24/30		  65%
43.5/67		62%
20/32		50%
16/32		56%
18/32
Colossus 2007c2586          61%
19.5/32		 66%
21/32		 
Hamsters 0.7.12579       100%
1/1		  65%
22/34		   
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2013 by CCRL team
Last games added on October 12, 2019