CCRL 40/4
Downloads and Statistics
November 14, 2019
Testing summary:
Total: 2'129'428 games
played by 2'486 programs
28790 CPU days (X2 4600+)

White wins: 825'928 (38.8%)
Black wins: 667'489 (31.3%)
Draws: 636'011 (29.9%)
White score: 53.7%

Custom engine selection

Comparing 13 engines!
13 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on November 14, 2019 with Bayeselo based on 2'129'428 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Hannibal 1.7 64-bit 4CPU3228+11−1142.7%+49.346.7%3037 
100.0%
 Hannibal 1.5 64-bit 4CPU3170+12−1234.2%+112.639.3%2349
100.0%
 Hannibal 1.4b 64-bit 4CPU3118+14−1438.3%+80.238.0%1935
81.3%
 Hannibal 1.7 64-bit3111+8−845.2%+37.739.8%6409
100.0%
 Hannibal 1.3 64-bit 4CPU3067+20−2140.3%+67.836.3%821
92.7%
 Hannibal 1.5 64-bit3049+11−1143.9%+48.838.7%2785
100.0%
 Hannibal 1.4b 64-bit3019+12−1243.4%+46.236.1%2546
98.5%
 Hannibal 1.3 64-bit2998+14−1447.8%+9.635.3%1817
100.0%
 Hannibal 1.2 64-bit2949+16−1746.8%+26.634.7%1295
100.0%
 Hannibal 1.1 64-bit2895+15−1549.2%+7.731.8%1591
99.9%
 Hannibal 1.0a 64-bit2862+14−1454.2%−31.628.9%2020
58.3%
 Hannibal 05_24_10v2 64-bit2858+31−3143.0%+46.533.4%350
94.8%
 Hannibal 05_20_10 64-bit2825+26−2641.9%+53.334.1%504
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3228             
2Hannibal 1.5 64-bit 4CPU3170             
3Hannibal 1.4b 64-bit 4CPU3118             
4Hannibal 1.7 64-bit3111             
5Hannibal 1.3 64-bit 4CPU3067             
6Hannibal 1.5 64-bit3049             
7Hannibal 1.4b 64-bit3019             
8Hannibal 1.3 64-bit2998             
9Hannibal 1.2 64-bit2949             
10Hannibal 1.1 64-bit2895             
11Hannibal 1.0a 64-bit2862             
12Hannibal 05_24_10v2 64-bit2858             
13Hannibal 05_20_10 64-bit2825             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3228 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Hannibal 1.5 64-bit 4CPU31700.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Hannibal 1.4b 64-bit 4CPU31180.00.0 81.3100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Hannibal 1.7 64-bit31110.00.018.7 100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Hannibal 1.3 64-bit 4CPU30670.00.00.00.0 92.7100.0100.0100.0100.0100.0100.0100.0
6Hannibal 1.5 64-bit30490.00.00.00.07.3 100.0100.0100.0100.0100.0100.0100.0
7Hannibal 1.4b 64-bit30190.00.00.00.00.00.0 98.5100.0100.0100.0100.0100.0
8Hannibal 1.3 64-bit29980.00.00.00.00.00.01.5 100.0100.0100.0100.0100.0
9Hannibal 1.2 64-bit29490.00.00.00.00.00.00.00.0 100.0100.0100.0100.0
10Hannibal 1.1 64-bit28950.00.00.00.00.00.00.00.00.0 99.998.3100.0
11Hannibal 1.0a 64-bit28620.00.00.00.00.00.00.00.00.00.1 58.399.3
12Hannibal 05_24_10v2 64-bit28580.00.00.00.00.00.00.00.00.01.741.7 94.8
13Hannibal 05_20_10 64-bit28250.00.00.00.00.00.00.00.00.00.00.75.2 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3228 168376104460001040000
2Hannibal 1.5 64-bit 4CPU31701683 788032800000000
3Hannibal 1.4b 64-bit 4CPU3118761788 8215001813421002040000
4Hannibal 1.7 64-bit31110082 019561018339237176136673
5Hannibal 1.3 64-bit 4CPU306744632815000 001502040000
6Hannibal 1.5 64-bit30490018119560 1863405409246262850
7Hannibal 1.4b 64-bit301900342101801863 15199657983301940
8Hannibal 1.3 64-bit2998001003391504051519 104289948797111
9Hannibal 1.2 64-bit294910402042372044099651042 153052313485
10Hannibal 1.1 64-bit289500017602467988991530 83513383
11Hannibal 1.0a 64-bit28620001360262330487523835 19581
12Hannibal 05_24_10v2 64-bit28580006708519497134133195 208
13Hannibal 05_20_10 64-bit28250003000111858381208 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3228 31.215.30.011.60.00.00.02.40.00.00.00.0
2Hannibal 1.5 64-bit 4CPU317031.2 18.40.010.30.00.00.00.00.00.00.00.0
3Hannibal 1.4b 64-bit 4CPU311815.318.4 1.054.43.87.62.76.30.00.00.00.0
4Hannibal 1.7 64-bit31110.00.01.0 0.021.311.44.13.12.21.61.00.0
5Hannibal 1.3 64-bit 4CPU306711.610.354.40.0 0.00.05.79.60.00.00.00.0
6Hannibal 1.5 64-bit30490.00.03.821.30.0 34.98.810.05.65.52.70.0
7Hannibal 1.4b 64-bit30190.00.07.611.40.034.9 34.825.119.37.26.70.0
8Hannibal 1.3 64-bit29980.00.02.74.15.78.834.8 33.526.412.74.54.8
9Hannibal 1.2 64-bit29492.40.06.33.19.610.025.133.5 53.015.88.14.7
10Hannibal 1.1 64-bit28950.00.00.02.20.05.619.326.453.0 23.16.94.0
11Hannibal 1.0a 64-bit28620.00.00.01.60.05.57.212.715.823.1 8.23.2
12Hannibal 05_24_10v2 64-bit28580.00.00.01.00.02.76.74.58.16.98.2 24.4
13Hannibal 05_20_10 64-bit28250.00.00.00.00.00.00.04.84.74.03.224.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 122 common opponents

Custom engine selection
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Stockfish 160716 64-bit 4CPU345518%
9.5/52
15%
15.5/104
           
Komodo 10 64-bit 4CPU343020%
10/51
10%
8.5/82
           
Houdini 4 64-bit 4CPU333238%
19.5/52
29%
29/100
12%
6/50
          
Houdini 3 64-bit 4CPU3320  23%
11.5/50
 13%
6.5/50
   5%
2.5/52
    
Stockfish 6 64-bit3318  22%
7/32
   16%
15.5/100
      
Stockfish 4 64-bit 4CPU3270  27%
13.5/50
 27%
13/49
        
Gull 3 64-bit 4CPU326148%
25/52
36%
36/100
26%
12/47
          
Fire 4 64-bit 4CPU325748%
25/52
36%
36.5/100
30%
29.5/100
          
Equinox 3.30 64-bit 4CPU325346%
24/52
34%
35.5/104
           
Houdini 4 64-bit3241  39%
19.5/50
25%
8/32
 19%
9.5/49
21%
21/100
      
Komodo 5.1 64-bit 4CPU3239  30%
15/50
 25%
27.5/109
  16%
8/50
     
Komodo 8 64-bit3236  30%
9.5/32
  27%
13.5/50
24%
23.5/100
      
Critter 1.6a 64-bit 4CPU323342%
22/52
42%
42/100
37%
18/49
 32%
22/68
        
Fritz 15 64-bit 4CPU322452%
27/52
39%
27.5/70
           
Gull 2.2 64-bit 4CPU3224  29%
14.5/50
 22%
11/49
        
Houdini 3 64-bit3217      24%
12/50
28%
9/32
     
Rybka 4.1 64-bit 4CPU320654%
28/52
40%
40.5/100
40%
20/50
 32%
19/60
        
BlackMamba 2.0 64-bit 4CPU319766%
34.5/52
56%
27/48
           
Gull 3 64-bit3192   33%
10.5/32
 32%
16/50
20%
10/49
      
Fire 4 64-bit3191   30%
9.5/32
 19%
9.5/50
23%
7.5/32
      
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Fizbo 1.7 64-bit 4CPU318552%
27/52
58%
30/52
           
Komodo CCT 64-bit3181      24%
12/50
23%
7.5/32
14%
4.5/32
    
Stockfish 4 64-bit3180      22%
11/50
24%
19.5/80
     
Equinox 3.30 64-bit3162   43%
21.5/50
  34%
34/100
      
Critter 1.6a 64-bit3158   44%
65.5/150
 33%
16.5/50
26%
18.5/70
22%
7/32
     
Equinox 3.20 64-bit3156     28%
14/50
23%
11.5/50
      
Andscacs 0.88 64-bit3147   41%
35.5/87
 25%
3.5/14
       
Critter 1.4 64-bit3142        20%
6.5/32
23%
7/31
   
Strelka 5.5 64-bit314164%
33.5/52
51%
51/100
           
Fizbo 1.7 64-bit3129   44%
22/50
 39%
19.5/50
       
Komodo 4 64-bit3127        16%
5/32
12%
6/50
   
Stockfish 2.2.2 64-bit3115       27%
8.5/32
27%
8.5/32
20%
10/50
   
Rybka 4.1 64-bit3109   48%
25.5/53
 42%
21/50
32%
16/50
42%
13.5/32
25%
8/32
9%
3/32
27%
13.5/50
  
Hiarcs 14 4CPU310863%
33/52
       36%
18.5/52
    
Naum 4.2 64-bit 4CPU3099  47%
23/49
 51%
30/59
        
Gull 2.1 64-bit3098      38%
19/50
41%
20.5/50
     
NirvanaChess 2.3 64-bit3098   47%
23.5/50
 48%
42/88
       
Chiron 3.01 64-bit3095   46%
22/48
 35%
17.5/50
       
Texel 1.06 64-bit3095   52%
26/50
 41%
20.5/50
       
Stockfish 2.1.1 64-bit3092         17%
5.5/32
10%
3/31
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Protector 1.5.0 64-bit 4CPU308777%
40/52
 50%
25/50
 46%
27.5/60
        
Protector 1.9.0 64-bit3085   49%
26.5/54
 51%
25.5/50
       
iCE 3.0 64-bit3081   47%
35.5/75
 30%
9.5/32
       
Deep Fritz 14 64-bit 1CPU3078     43%
21.5/50
31%
15.5/50
      
Critter 1.01 64-bit3077         25%
8/32
14%
4.5/32
  
Komodo 2.03 64-bit3071         19%
6/32
17%
5.5/32
  
Texel 1.05 64-bit3053     62%
31/50
53%
26.5/50
      
Deep Shredder 12 64-bit 4CPU304275%
40/53
 70%
35/50
 51%
25/49
        
Booot 6.0.2 64-bit3041   50%
16/32
 47%
15/32
       
Protector 1.7.0 64-bit3040     51%
25.5/50
48%
15.5/32
      
Chiron 2 64-bit3039     48%
24/50
53%
26.5/50
      
Spike 1.4 Leiden 4CPU3039  58%
29/50
 50%
29.5/59
        
Naum 4.6 64-bit3032   67%
21.5/32
 61%
30.5/50
42%
13.5/32
      
Spark 1.0 64-bit 4CPU3030  70%
35/50
 67%
33.5/50
        
Deep Junior 13.3 64-bit 4CPU3026  68%
34/50
 49%
24.5/50
   48%
25/52
    
SmarThink 1.96 64-bit3026   63%
31.5/50
 43%
21.5/50
       
Senpai 1.0 64-bit3007   71%
23.5/33
 62%
31/50
55%
27.5/50
      
Chiron 1.5 64-bit2989      56%
28/50
64%
20.5/32
45%
14.5/32
    
Hiarcs 142988   70%
22.5/32
 54%
26.5/49
59%
29.5/50
50%
16/32
48%
15.5/32
    
Naum 4.2 64-bit2988      53%
26.5/50
35%
3.5/10
42%
13.5/32
34%
10.5/31
   
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Pedone 1.4.1 64-bit2988   75%
24/32
 66%
21/32
       
Fritz 132986      51%
25/49
47%
14/30
50%
16/32
41%
25/61
   
Hakkapeliitta 3.0 64-bit2985   75%
24/32
 56%
18/32
       
Protector 1.5.0 64-bit2985      58%
11/19
45%
9/20
42%
13.5/32
    
Rybka 2.3.2a 64-bit2978       50%
5/10
  32%
9.5/30
  
NirvanaChess 2.0a 64-bit2975     61%
30.5/50
50%
25/50
      
Zappa Mexico II 64-bit 4CPU2971  65%
32.5/50
 55%
27/49
        
Komodo 1.2 64-bit2967          38%
11.5/30
39%
13.5/35
35%
4.5/13
Chiron 1.1a 64-bit2966        36%
11.5/32
33%
10.5/32
   
Vajolet2 2.2 64-bit2961   69%
36.5/53
 59%
19/32
       
Deep Shredder 12 64-bit2955   62%
20/32
 60%
30/50
52%
10.5/20
70%
22.5/32
44%
14/32
36%
11.5/32
 39%
13.5/35
 
Gull 1.2 64-bit2951        41%
13/32
39%
12.5/32
38%
11.5/30
  
Cheng 4.39 64-bit2946   82%
28/34
 69%
22/32
       
Deep Sjeng WC2008 64-bit 4CPU2941  76%
38/50
 66%
33/50
        
Gull 1.0a 64-bit2938       65%
6.5/10
  27%
8.5/32
  
Rybka 2.2 64-bit2937           41%
14.5/35
35%
17.5/50
Hiarcs 13.22933        61%
19.5/32
47%
14.5/31
34%
11/32
  
Spark 1.0 64-bit2927     71%
35.5/50
68%
13.5/20
69%
9/13
50%
16/32
47%
15/32
39%
12.5/32
  
Booot 5.2.0 64-bit2922      82%
16.5/20
70%
7/10
56%
18/32
    
Fizbo 1.31 64-bit2922     71%
35.5/50
72%
23/32
      
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Spike 1.4 Leiden2922   50%
1.5/3
 70%
35/50
63%
31.5/50
58%
7.5/13
55%
17.5/32
 37%
11/30
  
Quazar 0.4 64-bit2901   75%
3/4
  68%
13/19
63%
12/19
56%
18/32
52%
16.5/32
   
Deep Junior 12.5 64-bit2898      71%
35.5/50
  48%
15.5/32
   
Deep Junior 13 64-bit2896        55%
17.5/32
42%
13.5/32
   
Protector 1.4.0 64-bit2890       45%
4.5/10
63%
19.5/31
 62%
18.5/30
  
Thinker 5.4d Inert 64-bit2886        53%
17/32
59%
19/32
   
Deep Junior 13.3 64-bit2885       71%
22/31
62%
20/32
    
Thinker 5.4c Inert 64-bit2883      71%
13.5/19
50%
5/10
  53%
16/30
47%
16.5/35
 
Murka 3 64-bit2882      73%
36.5/50
64%
20.5/32
     
Spark 0.4 64-bit2882          43%
13/30
46%
16/35
32%
4.5/14
Gaviota 1.0 64-bit2873   50%
0.5/1
  64%
20.5/32
      
Critter 0.60 64-bit2866           40%
14/35
39%
5.5/14
Nemo 1.0.1 64-bit2857      80%
16/20
64%
14/22
69%
22/32
56%
18/32
   
Onno 1.2.70 64-bit2845       62%
20/32
67%
21.5/32
59%
19/32
   
Zappa Mexico II 64-bit2844   100%
1/1
   75%
7.5/10
67%
21.5/32
67%
20/30
  44%
23.5/53
Deep Sjeng WC2008 64-bit2843       66%
20.5/31
    47%
23.5/50
MinkoChess 1.2 64-bit2842       60%
6/10
59%
19/32
66%
21/32
   
Booot 5.1.02839       59%
13/22
69%
22/32
66%
21/32
56%
18/32
  
Deep Sjeng 3.0 64-bit2838      78%
39/50
 64%
20.5/32
50%
15.5/31
 64%
22.5/35
 
Toga II 1.4.1SE2824       85%
8.5/10
  58%
17.5/30
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Tornado 4.88 64-bit2810      65%
13/20
72%
14.5/20
     
Scorpio 2.7.5 64-bit2805      82%
16.5/20
77%
17/22
     
Gaviota 0.86 64-bit2799      70%
14/20
71%
67.5/95
     
Texel 1.01 64-bit2797       65%
6.5/10
73%
23.5/32
53%
17/32
   
Loop 13.6 (Loop 2007) 64-bit2796       80%
24/30
 61%
19/31
   
Crafty 23.5 64-bit2794      68%
13.5/20
78%
29.5/38
     
Crafty 23.4 64-bit2782        77%
24.5/32
72%
23/32
72%
23/32
  
Ktulu 92782        72%
23/32
66%
20.5/31
   
Bright 0.4a2780       70%
7/10
 78%
25/32
   
Bright 0.5c2772   100%
2/2
      72%
21.5/30
  
Twisted Logic 20090922 64-bit2771       65%
6.5/10
  53%
16/30
  
Frenzee 3.5.19 64-bit2770      80%
16/20
75%
7.5/10
 61%
19.5/32
   
Twisted Logic 20100131x 64-bit2767   100%
1/1
      67%
20/30
  
Jonny 4.002763   100%
2/2
  88%
17.5/20
  63%
19.5/31
67%
19.5/29
  
BugChess2 1.9 64-bit2759   100%
1/1
  85%
17/20
80%
8/10
 67%
21.5/32
   
Scorpio 2.6 64-bit2756         75%
24/32
75%
22.5/30
  
Chronos 1.9.9 64-bit2740       90%
9/10
 69%
21.5/31
65%
19.5/30
  
Bobcat 3.25 64-bit2713      80%
16/20
95%
9.5/10
     
Delfi 5.42683   100%
1/1
   62%
7.5/12
 80%
25.5/32
78%
23.5/30
  
Daydreamer 1.75 64-bit2673       72%
6.5/9
  62%
18.5/30
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Movei 00.8.438 (10 10 10)2623   100%
1/1
      82%
24.5/30
  
Slow Chess Blitz WV2.12615   100%
1/1
      82%
24.5/30
  
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on November 14, 2019