Copyurl error from aws s3 bucket to google drive: "is not a regular file"

What is the problem you are having with rclone?

I'm getting this error when attempting to execute a copyurl command:

Post request put error: is not a regular file

What is your rclone version (output from rclone version)

1.53.3

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Ubuntu 18.04, most likely 64 bit

Which cloud storage system are you using? (eg Google Drive)

Google drive, but the URL is from an AWS s3 bucket

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copyurl http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf Hold2:/test

The rclone config contents with secrets removed.

The only relevant part:

[Hold2]
type = drive
client_id = 252262558434-p1u8qlaii4k3k03cp41rh5muaki50sce.apps.googleusercontent.com
scope = drive
team_drive = 0AOze_Os78BBeUk9PVA
root_folder_id =

A log from the command with the -vv flag

2020/12/01 08:32:07 DEBUG : rclone: Version "v1.53.3" starting with parameters ["rclone" "copyurl" "http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephen
s-manual-lrg.pdf" "Hold2:/test" "-vv"]
2020/12/01 08:32:07 DEBUG : Creating backend with remote "Hold2:/"
2020/12/01 08:32:07 DEBUG : Using config file from "/home/muu_3583/.config/rclone/rclone.conf"
2020/12/01 08:32:07 DEBUG : fs cache: renaming cache item "Hold2:/" to be canonical "Hold2:"
2020/12/01 08:32:08 ERROR : test: Post request put error: is not a regular file
2020/12/01 08:32:08 ERROR : Attempt 1/3 failed with 2 errors and: is not a regular file
2020/12/01 08:32:08 ERROR : test: Post request put error: is not a regular file
2020/12/01 08:32:08 ERROR : Attempt 2/3 failed with 2 errors and: is not a regular file
2020/12/01 08:32:08 ERROR : test: Post request put error: is not a regular file
2020/12/01 08:32:08 ERROR : Attempt 3/3 failed with 2 errors and: is not a regular file
2020/12/01 08:32:08 INFO  : 
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 2 (retrying may help)
Elapsed time:         1.0s
2020/12/01 08:32:08 DEBUG : 4 go routines active
2020/12/01 08:32:08 Failed to copyurl with 2 errors: last error was: is not a regular file

You need to call it something on the other side.

felix@gemini:~$ rclone copyurl http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf GD: -vv
2020/12/01 07:07:10 DEBUG : rclone: Version "v1.53.3" starting with parameters ["rclone" "copyurl" "http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf" "GD:" "-vv"]
2020/12/01 07:07:10 "GD:" is a directory
felix@gemini:~$ rclone copyurl http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf GD:test.
pdf -vv
2020/12/01 07:07:22 DEBUG : rclone: Version "v1.53.3" starting with parameters ["rclone" "copyurl" "http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf" "GD:test.pdf" "-vv"]
2020/12/01 07:07:22 DEBUG : Creating backend with remote "GD:"
2020/12/01 07:07:22 DEBUG : Using config file from "/opt/rclone/rclone.conf"
2020/12/01 07:07:24 INFO  :
Transferred:        2.121M / 2.121 MBytes, 100%, 1023.421 kBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         2.2s

2020/12/01 07:07:24 DEBUG : 6 go routines active

and

felix@gemini:~$ rclone ls GD:test.pdf
  2224380 test.pdf

try this

rclone copyurl http://01-public.s3.amazonaws.com/02-Interview/HM01-Jeff-Stephens-manual-lrg.pdf Hold2:/test -a
1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.