Thursday, March 05, 2026

downloading from a server via http (no SSL) with auth

Downloading some planetarium files from a server in Sweden, which had password protected directories but no SSL (no https) - 
  1. Directly downloading via the browser - slow, prompts us to "Keep" or delete the file every time due to being downloaded unsecurely

  2. Using aria2

     aria2c -x16 -s16 --http-user=USERNAME --http-passwd=PASSWORD url

    Need ProtonVPN, since without it, http downloads are severely throttled to less than 100 kbps.

  3. Better option, running 

    aria2c -x16 -s16 --http-user=USERNAME --http-passwd=PASSWORD -i urls.txt

    on one of our AWS servers - all the URLs get downloaded in a jiffy, then we can use Filezilla and download to our local machine over sftp without throttling issues.

No comments:

Post a Comment