CCRL 40/4
Downloads and Statistics
December 7, 2019
Testing summary:
Total: 2'143'600 games
played by 2'509 programs
29100 CPU days (X2 4600+)

White wins: 830'432 (38.7%)
Black wins: 670'629 (31.3%)
Draws: 642'539 (30.0%)
White score: 53.7%

Custom engine selection

Comparing 13 engines!
13 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on December 7, 2019 with Bayeselo based on 2'143'600 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Hannibal 1.7 64-bit 4CPU3229+10−1143.2%+45.746.6%3107 
100.0%
 Hannibal 1.5 64-bit 4CPU3170+13−1334.2%+112.339.3%2349
100.0%
 Hannibal 1.4b 64-bit 4CPU3118+14−1438.3%+79.938.0%1935
82.1%
 Hannibal 1.7 64-bit3110+8−845.3%+37.739.8%6440
100.0%
 Hannibal 1.3 64-bit 4CPU3067+21−2140.3%+67.536.3%821
92.6%
 Hannibal 1.5 64-bit3049+11−1143.9%+48.638.7%2785
100.0%
 Hannibal 1.4b 64-bit3019+12−1243.4%+45.936.1%2546
98.5%
 Hannibal 1.3 64-bit2998+14−1447.8%+9.435.3%1817
100.0%
 Hannibal 1.2 64-bit2949+17−1746.8%+26.434.7%1295
100.0%
 Hannibal 1.1 64-bit2895+15−1549.2%+7.631.8%1591
99.9%
 Hannibal 1.0a 64-bit2862+14−1454.2%−32.028.9%2020
58.2%
 Hannibal 05_24_10v2 64-bit2858+31−3143.0%+46.433.4%350
94.7%
 Hannibal 05_20_10 64-bit2825+26−2641.9%+53.034.1%504
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3229             
2Hannibal 1.5 64-bit 4CPU3170             
3Hannibal 1.4b 64-bit 4CPU3118             
4Hannibal 1.7 64-bit3110             
5Hannibal 1.3 64-bit 4CPU3067             
6Hannibal 1.5 64-bit3049             
7Hannibal 1.4b 64-bit3019             
8Hannibal 1.3 64-bit2998             
9Hannibal 1.2 64-bit2949             
10Hannibal 1.1 64-bit2895             
11Hannibal 1.0a 64-bit2862             
12Hannibal 05_24_10v2 64-bit2858             
13Hannibal 05_20_10 64-bit2825             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3229 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Hannibal 1.5 64-bit 4CPU31700.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Hannibal 1.4b 64-bit 4CPU31180.00.0 82.1100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Hannibal 1.7 64-bit31100.00.017.9 100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Hannibal 1.3 64-bit 4CPU30670.00.00.00.0 92.6100.0100.0100.0100.0100.0100.0100.0
6Hannibal 1.5 64-bit30490.00.00.00.07.4 100.0100.0100.0100.0100.0100.0100.0
7Hannibal 1.4b 64-bit30190.00.00.00.00.00.0 98.5100.0100.0100.0100.0100.0
8Hannibal 1.3 64-bit29980.00.00.00.00.00.01.5 100.0100.0100.0100.0100.0
9Hannibal 1.2 64-bit29490.00.00.00.00.00.00.00.0 100.0100.0100.0100.0
10Hannibal 1.1 64-bit28950.00.00.00.00.00.00.00.00.0 99.998.3100.0
11Hannibal 1.0a 64-bit28620.00.00.00.00.00.00.00.00.00.1 58.299.3
12Hannibal 05_24_10v2 64-bit28580.00.00.00.00.00.00.00.00.01.741.8 94.7
13Hannibal 05_20_10 64-bit28250.00.00.00.00.00.00.00.00.00.00.75.3 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3229 168376104460001040000
2Hannibal 1.5 64-bit 4CPU31701683 788032800000000
3Hannibal 1.4b 64-bit 4CPU3118761788 8215001813421002040000
4Hannibal 1.7 64-bit31100082 019561018339237176136673
5Hannibal 1.3 64-bit 4CPU306744632815000 001502040000
6Hannibal 1.5 64-bit30490018119560 1863405409246262850
7Hannibal 1.4b 64-bit301900342101801863 15199657983301940
8Hannibal 1.3 64-bit2998001003391504051519 104289948797111
9Hannibal 1.2 64-bit294910402042372044099651042 153052313485
10Hannibal 1.1 64-bit289500017602467988991530 83513383
11Hannibal 1.0a 64-bit28620001360262330487523835 19581
12Hannibal 05_24_10v2 64-bit28580006708519497134133195 208
13Hannibal 05_20_10 64-bit28250003000111858381208 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Hannibal 1.7 64-bit 4CPU3229 30.815.10.011.40.00.00.02.40.00.00.00.0
2Hannibal 1.5 64-bit 4CPU317030.8 18.40.010.30.00.00.00.00.00.00.00.0
3Hannibal 1.4b 64-bit 4CPU311815.118.4 1.054.43.87.62.76.30.00.00.00.0
4Hannibal 1.7 64-bit31100.00.01.0 0.021.211.34.13.12.21.61.00.0
5Hannibal 1.3 64-bit 4CPU306711.410.354.40.0 0.00.05.79.60.00.00.00.0
6Hannibal 1.5 64-bit30490.00.03.821.20.0 34.98.810.05.65.52.70.0
7Hannibal 1.4b 64-bit30190.00.07.611.30.034.9 34.825.119.37.26.70.0
8Hannibal 1.3 64-bit29980.00.02.74.15.78.834.8 33.526.412.74.54.8
9Hannibal 1.2 64-bit29492.40.06.33.19.610.025.133.5 53.015.88.14.7
10Hannibal 1.1 64-bit28950.00.00.02.20.05.619.326.453.0 23.16.94.0
11Hannibal 1.0a 64-bit28620.00.00.01.60.05.57.212.715.823.1 8.23.2
12Hannibal 05_24_10v2 64-bit28580.00.00.01.00.02.76.74.58.16.98.2 24.4
13Hannibal 05_20_10 64-bit28250.00.00.00.00.00.00.04.84.74.03.224.4 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 122 common opponents

Custom engine selection
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Stockfish 160716 64-bit 4CPU345518%
9.5/52
15%
15.5/104
           
Komodo 10 64-bit 4CPU343020%
10/51
10%
8.5/82
           
Houdini 4 64-bit 4CPU333238%
19.5/52
29%
29/100
12%
6/50
          
Houdini 3 64-bit 4CPU3320  23%
11.5/50
 13%
6.5/50
   5%
2.5/52
    
Stockfish 6 64-bit3317  22%
7/32
   16%
15.5/100
      
Stockfish 4 64-bit 4CPU3269  27%
13.5/50
 27%
13/49
        
Gull 3 64-bit 4CPU326048%
25/52
36%
36/100
26%
12/47
          
Fire 4 64-bit 4CPU325648%
25/52
36%
36.5/100
30%
29.5/100
          
Equinox 3.30 64-bit 4CPU325246%
24/52
34%
35.5/104
           
Houdini 4 64-bit3241  39%
19.5/50
25%
8/32
 19%
9.5/49
21%
21/100
      
Komodo 5.1 64-bit 4CPU3239  30%
15/50
 25%
27.5/109
  16%
8/50
     
Komodo 8 64-bit3235  30%
9.5/32
  27%
13.5/50
24%
23.5/100
      
Critter 1.6a 64-bit 4CPU323242%
22/52
42%
42/100
37%
18/49
 32%
22/68
        
Fritz 15 64-bit 4CPU322452%
27/52
39%
27.5/70
           
Gull 2.2 64-bit 4CPU3224  29%
14.5/50
 22%
11/49
        
Houdini 3 64-bit3217      24%
12/50
28%
9/32
     
Rybka 4.1 64-bit 4CPU320754%
28/52
40%
40.5/100
40%
20/50
 32%
19/60
        
BlackMamba 2.0 64-bit 4CPU319766%
34.5/52
56%
27/48
           
Gull 3 64-bit3192   33%
10.5/32
 32%
16/50
20%
10/49
      
Fire 4 64-bit3191   30%
9.5/32
 19%
9.5/50
23%
7.5/32
      
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Fizbo 1.7 64-bit 4CPU318452%
27/52
58%
30/52
           
Komodo CCT 64-bit3181      24%
12/50
23%
7.5/32
14%
4.5/32
    
Stockfish 4 64-bit3180      22%
11/50
24%
19.5/80
     
Equinox 3.30 64-bit3161   43%
21.5/50
  34%
34/100
      
Critter 1.6a 64-bit3158   44%
65.5/150
 33%
16.5/50
26%
18.5/70
22%
7/32
     
Equinox 3.20 64-bit3156     28%
14/50
23%
11.5/50
      
Andscacs 0.88 64-bit3147   41%
35.5/87
 25%
3.5/14
       
Critter 1.4 64-bit3141        20%
6.5/32
23%
7/31
   
Strelka 5.5 64-bit314164%
33.5/52
51%
51/100
           
Fizbo 1.7 64-bit3129   44%
22/50
 39%
19.5/50
       
Komodo 4 64-bit3127        16%
5/32
12%
6/50
   
Stockfish 2.2.2 64-bit3115       27%
8.5/32
27%
8.5/32
20%
10/50
   
Hiarcs 14 4CPU310863%
33/52
       36%
18.5/52
    
Rybka 4.1 64-bit3108   48%
25.5/53
 42%
21/50
32%
16/50
42%
13.5/32
25%
8/32
9%
3/32
27%
13.5/50
  
Naum 4.2 64-bit 4CPU3099  47%
23/49
 51%
30/59
        
Gull 2.1 64-bit3098      38%
19/50
41%
20.5/50
     
NirvanaChess 2.3 64-bit3097   47%
23.5/50
 48%
42/88
       
Chiron 3.01 64-bit3095   46%
22/48
 35%
17.5/50
       
Texel 1.06 64-bit3095   52%
26/50
 41%
20.5/50
       
Stockfish 2.1.1 64-bit3092         17%
5.5/32
10%
3/31
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Protector 1.5.0 64-bit 4CPU308777%
40/52
 50%
25/50
 46%
27.5/60
        
Protector 1.9.0 64-bit3085   49%
26.5/54
 51%
25.5/50
       
iCE 3.0 64-bit3081   47%
35.5/75
 30%
9.5/32
       
Deep Fritz 14 64-bit 1CPU3078     43%
21.5/50
31%
15.5/50
      
Critter 1.01 64-bit3077         25%
8/32
14%
4.5/32
  
Komodo 2.03 64-bit3071         19%
6/32
17%
5.5/32
  
Texel 1.05 64-bit3053     62%
31/50
53%
26.5/50
      
Booot 6.0.2 64-bit3041   50%
16/32
 47%
15/32
       
Deep Shredder 12 64-bit 4CPU304175%
40/53
 70%
35/50
 51%
25/49
        
Protector 1.7.0 64-bit3040     51%
25.5/50
48%
15.5/32
      
Chiron 2 64-bit3039     48%
24/50
53%
26.5/50
      
Spike 1.4 Leiden 4CPU3039  58%
29/50
 50%
29.5/59
        
Naum 4.6 64-bit3032   67%
21.5/32
 61%
30.5/50
42%
13.5/32
      
Spark 1.0 64-bit 4CPU3028  70%
35/50
 67%
33.5/50
        
Deep Junior 13.3 64-bit 4CPU3026  68%
34/50
 49%
24.5/50
   48%
25/52
    
SmarThink 1.96 64-bit3026   63%
31.5/50
 43%
21.5/50
       
Senpai 1.0 64-bit3007   71%
23.5/33
 62%
31/50
55%
27.5/50
      
Chiron 1.5 64-bit2989      56%
28/50
64%
20.5/32
45%
14.5/32
    
Pedone 1.4.1 64-bit2988   75%
24/32
 66%
21/32
       
Hiarcs 142987   70%
22.5/32
 54%
26.5/49
59%
29.5/50
50%
16/32
48%
15.5/32
    
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Naum 4.2 64-bit2987      53%
26.5/50
35%
3.5/10
42%
13.5/32
34%
10.5/31
   
Fritz 132986      51%
25/49
47%
14/30
50%
16/32
41%
25/61
   
Hakkapeliitta 3.0 64-bit2984   75%
24/32
 56%
18/32
       
Protector 1.5.0 64-bit2984      58%
11/19
45%
9/20
42%
13.5/32
    
Rybka 2.3.2a 64-bit2977       50%
5/10
  32%
9.5/30
  
NirvanaChess 2.0a 64-bit2975     61%
30.5/50
50%
25/50
      
Zappa Mexico II 64-bit 4CPU2971  65%
32.5/50
 55%
27/49
        
Chiron 1.1a 64-bit2966        36%
11.5/32
33%
10.5/32
   
Komodo 1.2 64-bit2966          38%
11.5/30
39%
13.5/35
35%
4.5/13
Vajolet2 2.2 64-bit2961   69%
36.5/53
 59%
19/32
       
Deep Shredder 12 64-bit2955   62%
20/32
 60%
30/50
52%
10.5/20
70%
22.5/32
44%
14/32
36%
11.5/32
 39%
13.5/35
 
Gull 1.2 64-bit2951        41%
13/32
39%
12.5/32
38%
11.5/30
  
Cheng 4.39 64-bit2945   82%
28/34
 69%
22/32
       
Deep Sjeng WC2008 64-bit 4CPU2940  76%
38/50
 66%
33/50
        
Gull 1.0a 64-bit2938       65%
6.5/10
  27%
8.5/32
  
Rybka 2.2 64-bit2937           41%
14.5/35
35%
17.5/50
Hiarcs 13.22933        61%
19.5/32
47%
14.5/31
34%
11/32
  
Spark 1.0 64-bit2927     71%
35.5/50
68%
13.5/20
69%
9/13
50%
16/32
47%
15/32
39%
12.5/32
  
Booot 5.2.0 64-bit2922      82%
16.5/20
70%
7/10
56%
18/32
    
Fizbo 1.31 64-bit2922     71%
35.5/50
72%
23/32
      
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Spike 1.4 Leiden2921   50%
1.5/3
 70%
35/50
63%
31.5/50
58%
7.5/13
55%
17.5/32
 37%
11/30
  
Quazar 0.4 64-bit2901   75%
3/4
  68%
13/19
63%
12/19
56%
18/32
52%
16.5/32
   
Deep Junior 12.5 64-bit2898      71%
35.5/50
  48%
15.5/32
   
Deep Junior 13 64-bit2896        55%
17.5/32
42%
13.5/32
   
Protector 1.4.0 64-bit2889       45%
4.5/10
63%
19.5/31
 62%
18.5/30
  
Thinker 5.4d Inert 64-bit2886        53%
17/32
59%
19/32
   
Deep Junior 13.3 64-bit2885       71%
22/31
62%
20/32
    
Thinker 5.4c Inert 64-bit2883      71%
13.5/19
50%
5/10
  53%
16/30
47%
16.5/35
 
Murka 3 64-bit2882      73%
36.5/50
64%
20.5/32
     
Spark 0.4 64-bit2882          43%
13/30
46%
16/35
32%
4.5/14
Gaviota 1.0 64-bit2873   50%
0.5/1
  64%
20.5/32
      
Critter 0.60 64-bit2866           40%
14/35
39%
5.5/14
Nemo 1.0.1 64-bit2857      80%
16/20
64%
14/22
69%
22/32
56%
18/32
   
Zappa Mexico II 64-bit2845   100%
1/1
   75%
7.5/10
67%
21.5/32
67%
20/30
  44%
23.5/53
Onno 1.2.70 64-bit2844       62%
20/32
67%
21.5/32
59%
19/32
   
Deep Sjeng WC2008 64-bit2842       66%
20.5/31
    47%
23.5/50
MinkoChess 1.2 64-bit2842       60%
6/10
59%
19/32
66%
21/32
   
Booot 5.1.02839       59%
13/22
69%
22/32
66%
21/32
56%
18/32
  
Deep Sjeng 3.0 64-bit2838      78%
39/50
 64%
20.5/32
50%
15.5/31
 64%
22.5/35
 
Toga II 1.4.1SE2823       85%
8.5/10
  58%
17.5/30
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Tornado 4.88 64-bit2810      65%
13/20
72%
14.5/20
     
Scorpio 2.7.5 64-bit2804      82%
16.5/20
77%
17/22
     
Gaviota 0.86 64-bit2799      70%
14/20
71%
67.5/95
     
Texel 1.01 64-bit2797       65%
6.5/10
73%
23.5/32
53%
17/32
   
Loop 13.6 (Loop 2007) 64-bit2796       80%
24/30
 61%
19/31
   
Crafty 23.5 64-bit2794      68%
13.5/20
78%
29.5/38
     
Crafty 23.4 64-bit2782        77%
24.5/32
72%
23/32
72%
23/32
  
Ktulu 92781        72%
23/32
66%
20.5/31
   
Bright 0.4a2779       70%
7/10
 78%
25/32
   
Bright 0.5c2771   100%
2/2
      72%
21.5/30
  
Frenzee 3.5.19 64-bit2770      80%
16/20
75%
7.5/10
 61%
19.5/32
   
Twisted Logic 20090922 64-bit2770       65%
6.5/10
  53%
16/30
  
Twisted Logic 20100131x 64-bit2767   100%
1/1
      67%
20/30
  
Jonny 4.002763   100%
2/2
  88%
17.5/20
  63%
19.5/31
67%
19.5/29
  
BugChess2 1.9 64-bit2759   100%
1/1
  85%
17/20
80%
8/10
 67%
21.5/32
   
Scorpio 2.6 64-bit2756         75%
24/32
75%
22.5/30
  
Chronos 1.9.9 64-bit2740       90%
9/10
 69%
21.5/31
65%
19.5/30
  
Bobcat 3.25 64-bit2712      80%
16/20
95%
9.5/10
     
Delfi 5.42683   100%
1/1
   62%
7.5/12
 80%
25.5/32
78%
23.5/30
  
Daydreamer 1.75 64-bit2673       72%
6.5/9
  62%
18.5/30
  
NameEloHannibal
1.7
64-bit
4CPU
Hannibal
1.5
64-bit
4CPU
Hannibal
1.4b
64-bit
4CPU
Hannibal
1.7
64-bit
Hannibal
1.3
64-bit
4CPU
Hannibal
1.5
64-bit
Hannibal
1.4b
64-bit
Hannibal
1.3
64-bit
Hannibal
1.2
64-bit
Hannibal
1.1
64-bit
Hannibal
1.0a
64-bit
Hannibal
05_24_10v2
64-bit
Hannibal
05_20_10
64-bit
Movei 00.8.438 (10 10 10)2623   100%
1/1
      82%
24.5/30
  
Slow Chess Blitz WV2.12615   100%
1/1
      82%
24.5/30
  
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on December 7, 2019