Copy from HTTP server to B2 without downloading the file in my PC first?

Help and Support
1

What is the problem you are having with rclone?

I was transferring a large file from HTTP to B2, I noticed that it is quite slow.
I was wondering is the file is being downloaded first to my PC (from HTTP) before it gets uploaded to B2?
If yes, is there a way to bypass my PC and copy the file straight to B2?

What is your rclone version (output from rclone version)

rclone v1.51.0

  • os/arch: windows/386
  • go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

W7 64

Which cloud storage system are you using? (eg Google Drive)

B2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy <remote-http>:<path-to-file> <remote-b2>:<bucket>/
2

hello and welcome to the forum,

you can try --magic :upside_down_face:
but seriously, in your situation, there is no way to bypass your pc.

the file is being downloaded a chunk at time from http and then uploaded to b2.

3

Ok thanks. I guess the same is true for all other remote storage? e.g., FTP to B2 and even B2 to B2?

4

copying/moving between two remotes with different backends requires a download.
tho with gdrive there is an possible exception.

copying/moving between two folders in same remote does not require a download

copying between two remotes with the same backend generally does not require a download.
this is called a server side copy or server side move
you can look into the logs to know for sure.
2020/06/08 17:42:40 INFO : 01.kdbx: Copied (server side copy)

1 Like
5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.