InsideDarkWeb.com

'wget --continue' does not work with '--no-clobber'

I am working under Windows 7, and I want to download all new files from a Windows server directory over HTTPS using wget. In addition, I want to resume the download of large files in case of connection loss during transfer.

When I run

wget.exe --continue --recursive https://<host>:<port>/<some path>/pdf.dll

everything works fine.

But using

wget.exe --continue --no-clobber --recursive https://<host>:<port>/<some path>/pdf.dll

the download is not resumed after a connection loss, but the incomplete file remains on my local file system. The message of wget being:

File ‘//pdf.dll’ already there; not retrieving.

(We want to use the --no-clobber option in order to avoid sending HEAD requests for all files that are already transferred.)

Does this mean that --continue does not work well together with --no-clobber?

Super User Asked on November 22, 2021

2 Answers

2 Answers

Very late to the party but I just came across this problem and have a solution:

If you use the -N Timestamp flag in conjunction with the -c / --continue flag, on resuming, the file sizes of incomplete files will differ from the remote and the file will continue to download as expected. It will also not re-download completed files.

From https://www.gnu.org/software/wget/manual/wget.html#Time_002dStamping

If the local file does not exist, or the sizes of the files do not match, Wget will download the remote file no matter what the time-stamps say.

Answered by Tessa Nardieu on November 22, 2021

That is because you are combining two options (--no-clobber and --continue):

  • --continue : Continue getting a partially-downloaded file
  • --no-clobber: This will clobber/overwrite the previously downloaded file before restarting to download again

As you can see, these two options ask Wget to perform quite opposite tasks, so it does not know what to do by the end. Do not combine them. You can read about download Options in details.

Answered by user414649 on November 22, 2021

Add your own answers!

Related Questions

Send email from gmail alias with ssmtp or other

0  Asked on February 23, 2021 by cclloyd

       

Unable to set or remove a login PIN on Windows 10

2  Asked on February 22, 2021 by scott-severance

     

Open PDFs in Adobe instead of in Google Chrome

5  Asked on February 22, 2021 by ramzi-kahil

   

command not found after switching users

0  Asked on February 22, 2021 by dor00012

     

PC starts, but no display from the monitor

1  Asked on February 20, 2021 by micjaakson

     

how flash memory/SSD write dta internally?

0  Asked on February 20, 2021

   

Lock screen vs Signing out

2  Asked on February 20, 2021 by uba

       

Ask a Question

Get help from others!

© 2021 InsideDarkWeb.com. All rights reserved.