CCRL 40/4
Downloads and Statistics
August 17, 2019
Testing summary:
Total: 2'085'472 games
played by 2'422 programs
28065 CPU days (X2 4600+)

White wins: 809'852 (38.8%)
Black wins: 654'916 (31.4%)
Draws: 620'704 (29.8%)
White score: 53.7%

Custom engine selection

Comparing 14 engines!
14 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on August 17, 2019 with Bayeselo based on 2'085'472 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent		DrawsGamesLOS
Elo+−
1Bright 0.4a 4CPU2910+11−1142.4%+50.633.9%3023 
67.0%
 Bright 0.5c 4CPU2906+14−1436.5%+92.635.7%1715
94.5%
 Bright 0.3d 4CPU2890+14−1444.4%+38.635.6%1789
90.7%
 Bright 0.3b 4CPU2877+13−1342.4%+53.133.9%2093
99.4%
 Bright 0.3a 4CPU2853+14−1443.7%+41.034.6%1756
100.0%
 Bright 0.2c 4CPU2812+17−1735.5%+102.030.1%1244
100.0%
 Bright 0.4a2779+10−1044.0%+42.829.2%4353
88.3%
 Bright 0.5c2772+7−847.3%+20.031.7%6921
92.0%
 Bright 0.3b2753+25−2538.0%+80.234.0%547
86.3%
 Bright 0.3d2735+19−2032.6%+129.530.3%995
100.0%
 Bright 0.2c2687+13−1350.8%−3.830.8%2039
54.3%
 Bright 0.2b2685+30−3049.6%+0.532.0%372
97.3%
 Bright 0.2a2646+27−2744.2%+38.032.2%466
60.9%
 Bright 0.1d2641+22−2251.7%−13.030.6%712
 

Results matrix

Custom engine selection
#NameElo1
Brigh
2
Brigh
3
Brigh
4
Brigh
5
Brigh
6
Brigh
7
Brigh
8
Brigh
9
Brigh
10
Brigh
11
Brigh
12
Brigh
13
Brigh
14
Brigh
1Bright 0.4a 4CPU2910              
2Bright 0.5c 4CPU2906              
3Bright 0.3d 4CPU2890              
4Bright 0.3b 4CPU2877              
5Bright 0.3a 4CPU2853              
6Bright 0.2c 4CPU2812              
7Bright 0.4a2779              
8Bright 0.5c2772              
9Bright 0.3b2753              
10Bright 0.3d2735              
11Bright 0.2c2687              
12Bright 0.2b2685              
13Bright 0.2a2646              
14Bright 0.1d2641              
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 67.098.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Bright 0.5c 4CPU290633.0 94.599.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Bright 0.3d 4CPU28901.25.5 90.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Bright 0.3b 4CPU28770.00.29.3 99.4100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Bright 0.3a 4CPU28530.00.00.00.6 100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Bright 0.2c 4CPU28120.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
7Bright 0.4a27790.00.00.00.00.00.0 88.397.1100.0100.0100.0100.0100.0
8Bright 0.5c27720.00.00.00.00.00.011.7 92.0100.0100.0100.0100.0100.0
9Bright 0.3b27530.00.00.00.00.00.02.98.0 86.3100.0100.0100.0100.0
10Bright 0.3d27350.00.00.00.00.00.00.00.013.7 100.099.7100.0100.0
11Bright 0.2c26870.00.00.00.00.00.00.00.00.00.0 54.399.7100.0
12Bright 0.2b26850.00.00.00.00.00.00.00.00.00.345.7 97.399.0
13Bright 0.2a26460.00.00.00.00.00.00.00.00.00.00.32.7 60.9
14Bright 0.1d26410.00.00.00.00.00.00.00.00.00.00.01.039.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 253919842388148712561501920150152000
2Bright 0.5c 4CPU29062539 74610506985406611201001298210082
3Bright 0.3d 4CPU28901984746 35831869157321625803003299615096
4Bright 0.3b 4CPU2877238810503583 2471221321625803003299615096
5Bright 0.3a 4CPU2853148769818692471 221414519299440128819981
6Bright 0.2c 4CPU28121256540157322132214 00000000
7Bright 0.4a2779150662162161450 37954587171173262128116
8Bright 0.5c277219211225825819203795 3245351111217180156
9Bright 0.3b27530000990458324 9930000
10Bright 0.3d27351501003003004400717535993 1688210082
11Bright 0.2c26871521293293291280117311110168 651356419
12Bright 0.2b26850829696810262217082651 403269
13Bright 0.2a264601001501509901281800100356403 520
14Bright 0.1d26410829696810116156082419269520 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
13
Bri
14
Bri
1Bright 0.4a 4CPU2910 53.641.246.731.129.42.01.90.03.73.00.00.00.0
2Bright 0.5c 4CPU290653.6 21.327.620.118.21.11.30.03.73.43.94.63.4
3Bright 0.3d 4CPU289041.221.3 92.352.751.93.53.00.010.88.64.46.73.8
4Bright 0.3b 4CPU287746.727.692.3 64.266.33.42.90.09.78.03.95.93.4
5Bright 0.3a 4CPU285331.120.152.764.2 73.82.42.24.316.03.43.84.53.3
6Bright 0.2c 4CPU281229.418.251.966.373.8 0.00.00.00.00.00.00.00.0
7Bright 0.4a27792.01.13.53.42.40.0 33.79.313.418.45.52.72.3
8Bright 0.5c27721.91.33.02.92.20.033.7 4.36.812.43.02.42.0
9Bright 0.3b27530.00.00.00.04.30.09.34.3 64.40.00.00.00.0
10Bright 0.3d27353.73.710.89.716.00.013.46.864.4 5.56.06.84.8
11Bright 0.2c26873.03.48.68.03.40.018.412.40.05.5 27.014.215.2
12Bright 0.2b26850.03.94.43.93.80.05.53.00.06.027.0 48.124.8
13Bright 0.2a26460.04.66.75.94.50.02.72.40.06.814.248.1 44.1
14Bright 0.1d26410.03.43.83.43.30.02.32.00.04.815.224.844.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 120 common opponents

Custom engine selection
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Rybka 3 64-bit 4CPU316614%
13.5/100		19%
9.5/50		13%
13/100		13%
13.5/101		          
Rybka 4.1 64-bit3108      11%
3.5/32		17%
0.5/3		      
Stockfish 1.6s JA 64-bit 4CPU309327%
26.5/99		28%
13.5/49		            
Stockfish 1.6.3 64-bit 4CPU308922%
22/100		23%
11.5/50		            
Rybka 3 64-bit307826%
25.5/100		 18%
18/100		22%
22/100		  12%
6/50		6%
2/32		 9%
4.5/50		    
Naum 4.1 64-bit 4CPU307030%
15/50		20%
10/50		            
Naum 4 64-bit 4CPU306327%
27/100		25%
12.5/50		            
Stockfish 1.8 64-bit3058      18%
6/34		18%
6/34		      
Stockfish 1.7.1 64-bit3045      12%
4/32		19%
11.5/62		      
Rybka 2.3.2a 64-bit 4CPU3044  26%
25.5/99		24%
24/99		29%
14/48		15%
14/91		        
Deep Shredder 12 64-bit 4CPU304232%
63.5/200		32%
32/100		            
Naum 4.2 64-bit2987      20%
10/50		25%
12.5/50		      
Naum 3 64-bit 4CPU2986  38%
37.5/100		27%
27/100		28%
28/100		22%
22/98		        
Stockfish 1.6.3 64-bit2985      26%
13/50		19%
6/32		      
Stockfish 1.6s JA 64-bit2979      28%
14/50		28%
9/32		      
Naum 3.1 64-bit 4CPU297832%
31.5/99		 40%
40.5/100		34%
34.5/100		30%
29.5/100		         
Rybka 2.3.2a 64-bit2977    32%
15.5/49		 15%
4.5/30		20%
6.5/32		25%
12.5/50		19%
18.5/99		    
Critter 0.70 64-bit2973      22%
6.5/30		19%
6/32		      
Zappa Mexico II 64-bit 4CPU297140%
40.5/100		42%
21/50		43%
43.5/101		40%
40.5/100		48%
24/50		         
Spark 0.3 64-bit 4CPU296941%
41/100		36%
18/50		            
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Komodo 1.2 64-bit2966      28%
7.5/27		25%
8/32		      
Thinker 5.4c Inert 64-bit 4CPU295244%
44/100		46%
23/50		            
Naum 4 64-bit2947      33%
16.5/50		31%
10/32		      
Zappa Mexico 64-bit 4CPU294646%
45.5/100		54%
27/50		 45%
45/100		32%
31.5/99		28%
38.5/138		        
Deep Junior 11.1a 64-bit 4CPU294340%
20/50		46%
37/80		            
Hiarcs 12 4CPU294140%
39.5/99		39%
19.5/50		 38%
38.5/100		38%
38/100		40%
40/100		        
Deep Sjeng WC2008 64-bit 4CPU294050%
50/100		48%
24/50		            
Hiarcs 12.1 4CPU293937%
37/100		44%
22/50		            
Deep Shredder 11 64-bit 4CPU293256%
55.5/99		 39%
37/95		45%
42.5/95		37%
18.5/50		37%
34/91		        
Deep Sjeng 3.0 64-bit 4CPU293051%
50/99		 45%
44.5/99		38%
38/100		          
Hiarcs Paderborn 2007 4CPU2930   42%
41.5/99		41%
41/100		34%
33.5/100		        
Rybka 2.3.2a 32-bit2922      27%
3/11		   15%
8/52		21%
2.5/12		  
Spike 1.4 Leiden2921      36%
13/36		50%
1/2		      
Hiarcs 11.2 4CPU2914  46%
46.5/100		41%
40.5/99		38%
18/48		36%
33.5/92		        
Naum 2.2 64-bit 4CPU2908    39%
19/49		38%
34.5/92		        
Toga II 1.4 beta5c 4CPU290446%
45.5/100		45%
22.5/50		50%
50/100		40%
39.5/100		48%
24/50		44%
21.5/49		        
Glaurung 2.1 64-bit 4CPU290051%
50.5/99		 46%
46/100		53%
53/100		36%
36.5/100		24%
24.5/100		        
Hiarcs 11.1 4CPU2900  48%
48/100		47%
47/100		          
Toga II 1.4.1SE 4CPU289953%
51.5/98		 48%
47.5/100		45%
45/100		48%
15/31		31%
9.5/31		        
Doch 1.3.4 64-bit2894      39%
12.5/32		23%
7.5/32		      
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Fritz 11288856%
56/100		      36%
11.5/32		  24%
12.5/52		   
Thinker 5.4d Inert 64-bit2885      29%
11/38		32%
13/40		      
Thinker 5.4c Inert 64-bit2883      46%
23/50		31%
19.5/62		      
Spark 0.4 64-bit2882      28%
8.5/30		30%
24.5/82		      
Loop M1-T 64-bit 4CPU288158%
57/99		53%
26.5/50		53%
51/96		48%
48.5/100		39%
19.5/50		41%
37.5/91		        
Gaviota 1.0 64-bit2872      25%
1.5/6		37%
12.5/34		      
Tornado 8.0 64-bit 4CPU286970%
22.5/32		59%
19/32		            
Loop 13.6 (Loop 2007) 64-bit 4CPU2867  49%
48.5/99		52%
52.5/100		          
Naum 3.1 64-bit2863        36%
18/50		25%
12.5/50		    
Glaurung 2.0.1 64-bit 4CPU2861  60%
60.5/100		54%
54/100		50%
25/50		47%
37.5/80		        
Protector 1.3.5 64-bit2856      30%
9/30		42%
12.5/30		      
Naum 3 64-bit2854         25%
12.5/50		31%
4/13		   
Protector 1.3.4 64-bit2852      43%
13/30		39%
12.5/32		      
Shredder 112847      38%
23/60		   34%
11.5/34		25%
5/20		  
Spark 0.3 64-bit2844      34%
17/50		42%
27/64		      
Zappa Mexico II 64-bit2844      34%
21.5/63		32%
10.5/33		 41%
20.5/50		    
Deep Shredder 11 64-bit2842    35%
17/48		    33%
16/49		    
Deep Sjeng 3.0 64-bit2838      43%
21.5/50		48%
15.5/32		36%
17.5/49		29%
14/49		    
Onno 1.1.1 64-bit2837      37%
18.5/50		41%
13/32		      
Hiarcs 122835      39%
19.5/50		30%
9.5/32		34%
16.5/49		40%
19.5/49		    
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Hiarcs 12.12833      45%
31.5/70		39%
12/31		      
Toga II 1.4.1SE2823      33%
10/30		45%
13.5/30		40%
20/50		     
Toga II 1.4 beta5c2820      44%
22/50		 34%
17/50		36%
36.5/100		    
Cheng4 0.36c 64-bit2819      51%
19.5/38		58%
18.5/32		      
Hiarcs Paderborn 20072819        38%
38/100		44%
22/50		    
Grapefruit 1.0 a2b2810        43%
21/49		45%
22.5/50		    
Fritz 102799          41%
14.5/35		34%
5.5/16		  
Loop M1-T 64-bit2786    68%
33.5/49		    48%
23/48		    
Glaurung 2.1 64-bit2782        52%
26/50		43%
43/99		    
Ktulu 92781      54%
26.5/49		47%
15.5/33		      
Fruit 2.3.12780      55%
5.5/10		100%
3/3		  32%
11/34		   
Octochess r5190 64-bit2778      62%
8/13		44%
14/32		      
Loop 13.6 (Loop 2007) 32-bit2775       52%
15.5/30		  40%
13.5/34		   
Toga II 1.3.12772  66%
65.5/100		70%
70.5/100		      32%
16/50		   
MinkoChess 0.9 64-bit2771      47%
14/30		42%
12.5/30		      
Naum 2.2 32-bit2770          33%
11.5/35		40%
12.5/31		45%
14.5/32		 
Twisted Logic 20090922 64-bit2770      53%
26.5/50		53%
17/32		      
Twisted Logic 20100131x 64-bit2766      53%
16/30		51%
46.5/91		      
Jonny 4.002762      62%
22.5/36		0%
0/2		      
Bison 9.11 64-bit2761      58%
17.5/30		57%
17/30		      
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
BugChess2 1.9 64-bit2759      58%
7/12		54%
18.5/34		      
Fruit 2.2.12750            39%
12.5/32		22%
7/32
SmarThink 1.20 64-bit2747      61%
30.5/50		61%
19.5/32		      
Naum 2.1 32-bit2738            41%
13/32		30%
9.5/32
Hiarcs 102736           36%
10.5/29		38%
19/50		36%
18/50
Spike 1.2 Turin2731 77%
38.5/50		72%
72/100		69%
69/100		70%
34.5/49		 61%
13.5/22		62%
38.5/62		 46%
23/50		41%
32/79		44%
14/32		34%
17/50		42%
13.5/32
Scorpio 2.0 32-bit 4CPU2730    74%
36.5/49		68%
34/50		        
Crafty 23.2 64-bit2721      50%
15/30		62%
18.5/30		      
Chess Tiger 2007.12713       50%
1/2		   50%
10.5/21		48%
15.5/32		 
Naum 2.0 32-bit2699      63%
19/30		60%
18/30		  46%
16/35		   
Frenzee Feb08 64-bit2694      65%
19.5/30		63%
19/30		  46%
15.5/34		   
Naum 2.0 64-bit2693      57%
17/30		65%
19.5/30		  62%
26.5/43		   
Delfi 5.42682      63%
26.5/42		100%
1/1		  43%
14.5/34		   
Scorpio 2.5 64-bit2682      65%
19.5/30		55%
16.5/30		      
Pharaon 3.5.1 4CPU2674    80%
37/46		65%
26.5/41		        
Daydreamer 1.75 64-bit2672      63%
19/30		52%
15.5/30		      
BugChess2 1.6.4 64-bit2670      60%
18/30		63%
19/30		      
Booot 4.15.12668      65%
19.5/30		67%
33.5/50		      
Booot 4.15.02665      65%
19.5/30		78%
23.5/30		      
SmarThink 1.00 32-bit2664           60%
18/30		50%
16/32		48%
15.5/32
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3b
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.4a		Bright
0.5c		Bright
0.3b		Bright
0.3d		Bright
0.2c		Bright
0.2b		Bright
0.2a		Bright
0.1d
Alaric 7072663      79%
41/52		76%
26/34		  51%
41/80		57%
12/21		  
Glaurung 1.2.1 32-bit2657          53%
18.5/35		  42%
13.5/32
Scorpio 2.0 32-bit2655          51%
34/67		56%
18/32		  
Colossus 2008b2641      79%
32.5/41		84%
26/31		  62%
20/32		   
Cyrano 0.6b17 64-bit2641      83%
25/30		47%
14/30		  53%
18/34		   
E.T. Chess 13.01.082634      67%
28/42		75%
1.5/2		  64%
20.5/32		   
Alfil 8.1.1 Optimized2625       72%
21/29		  66%
21/32		   
WildCat 82623      72%
29.5/41		67%
20/30		  59%
20/34		   
Movei 00.8.438 (10 10 10)2622      63%
26.5/42		80%
24/30		  56%
18/32		   
Alaric 7042618            36%
11.5/32		49%
24.5/50
Sloppy 0.2.2 64-bit2617      75%
22.5/30		78%
23.5/30		      
Delfi 5.12615          66%
21/32		  58%
18.5/32
Slow Chess Blitz WV2.12614      67%
20/30		82%
25.5/31		  69%
46.5/67		   
Delfi 5.22609          70%
46/66		53%
17/32		  
ProDeo 1.22608      65%
19.5/30		78%
23.5/30		      
WildCat 72606          67%
45/67		  52%
16.5/32
Amyan 1.722604      80%
24/30		76%
23.5/31		      
Pharaon 3.5.12603      80%
24/30		80%
24/30		  65%
43.5/67		62%
20/32		50%
16/32		56%
18/32
Colossus 2007c2586          61%
19.5/32		 66%
21/32		 
Hamsters 0.7.12578       100%
1/1		  65%
22/34		   
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2013 by CCRL team
Last games added on August 17, 2019