Unable to access

Help and Support
1

What is the problem you are having with rclone?

I am unable to list or copy to "folders" in a remote. See below:

nyc3b, host id:
-1 2020-10-15 17:44:12 -1 remoteNameOne
-1 2020-10-17 11:38:39 -1 remote_name_two

What is your rclone version (output from rclone version)

rclone v1.53.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Linux, Mac OSX

Which cloud storage system are you using? (eg Google Drive)

DigitalOcean S3

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Not working:

/usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone lsd 1606315049:youdsmedia

Working

/usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone lsd 1606315049:

The latter displays:

nyc3b, host id: 
          -1 2020-10-15 17:44:12        -1 remoteNameOne
          -1 2020-10-17 11:38:39        -1 remote_name_one

The rclone config contents with secrets removed.

[my_remote]
type = s3
provider = DigitalOcean
env_auth = false
upload_cutoff = 200M
leave_parts_on_error = true
memory_pool_flush_time = 1m0s
mainProvider = s3
access_key_id = ***
secret_access_key = *********
bucket_acl = private
disable_checksum = true
upload_concurrency = 4
no_check_bucket = true
memory_pool_use_mmap = true
endpoint = nyc3.digitaloceanspaces.com
location_constraint = us-standard
acl = default
v2_auth = true
region = nl-ams
server_side_encryption = AES256
chunk_size = 5M
max_upload_parts = 10000
copy_cutoff = 4.656G
force_path_style = true
use_accelerate_endpoint = true
list_chunk = 1000
encoding = Slash,InvalidUtf8,Dot

A log from the command with the -vv flag

[admin@staging1 scripts]$ /path/to/rclone/rclone lsd 1606315049: remote_name_two -vv
2020/11/25 10:01:15 DEBUG : rclone: Version "v1.53.2" starting with parameters ["/usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone" "lsd" "1606315049:remote_name_two" "-vv"]
2020/11/25 10:01:15 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2020/11/25 10:01:15 DEBUG : Creating backend with remote "1606315049: remote_name_two"
2020/11/25 10:01:15 DEBUG : Using v2 auth
2020/11/25 10:01:16 ERROR : : error listing: SignatureDoesNotMatch: 
	status code: 403, request id: tx00000000000017f1a2616-005fbe71bc-ada04a-nyc3b, host id: 
2020/11/25 10:01:16 DEBUG : 4 go routines active
2020/11/25 10:01:16 Failed to lsd with 2 errors: last error was: SignatureDoesNotMatch: 
	status code: 403, request id: tx00000000000017f1a2616-005fbe71bc-ada04a-nyc3b, host id:

Thanks in advance.

2

there is a space character between the remote and path.

1606315049: remote_name_two

Creating backend with remote "1606315049: remote_name_two"

tho rclone seems to fix that up
"1606315049:remote_name_two"

3

That could be my editing of the log. See below, I don't mind sharing the details.

[admin@staging1 scripts]$ /usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone ls 1606315049: -vv
2020/11/25 11:17:09 DEBUG : rclone: Version "v1.53.2" starting with parameters ["/usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone" "ls" "1606315049:" "-vv"]
2020/11/25 11:17:09 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2020/11/25 11:17:09 DEBUG : Creating backend with remote "1606315049:"
2020/11/25 11:17:09 DEBUG : Using v2 auth
2020/11/25 11:17:10 DEBUG : 6 go routines active
2020/11/25 11:17:10 Failed to ls: SignatureDoesNotMatch: 
	status code: 403, request id: tx0000000000000561b1fd3-005fbe8386-23efb96-nyc3b, host id: 
[admin@staging1 scripts]$

Also some vague errors for copy:

[admin@staging1 scripts]$ /usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone copy /home/admin/admin_backups 1606315049:
2020/11/25 11:20:31 ERROR : admin.root.admin.tar.gz: Failed to copy: s3 upload: sign request: InvalidParameter: 1 validation error(s) found.
- minimum field size of 1, PutObjectInput.Key.
4

is that type of signature required for digitalocean?

5

I don't think so.

This is what my DO config looks like

[do]
type = s3
provider = DigitalOcean
env_auth = false
access_key_id = XXX
secret_access_key = XXX
endpoint = sfo2.digitaloceanspaces.com
6

Can anyone help, seemingly stuck here.

7

Trying matching your config to @ncw's post above.

8

So here is that log, with the same conf values:

[admin@staging1 scripts]$ /usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone copy /home/admin/admin_backups/admin.root.admin.tar.gz 1606315049: -vv
2020/11/26 16:25:12 DEBUG : rclone: Version "v1.53.2" starting with parameters ["/usr/local/directadmin/plugins/backup-utility/scripts/rclone/rclone" "copy" "/home/admin/admin_backups/admin.root.admin.tar.gz" "1606315049:" "-vv"]
2020/11/26 16:25:12 DEBUG : Creating backend with remote "/home/admin/admin_backups/admin.root.admin.tar.gz"
2020/11/26 16:25:12 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2020/11/26 16:25:12 DEBUG : fs cache: adding new entry for parent of "/home/admin/admin_backups/admin.root.admin.tar.gz", "/home/admin/admin_backups"
2020/11/26 16:25:12 DEBUG : Creating backend with remote "1606315049:"
2020/11/26 16:25:12 ERROR : Attempt 1/3 failed with 1 errors and: InvalidParameter: 1 validation error(s) found.
- minimum field size of 1, HeadObjectInput.Key.
2020/11/26 16:25:12 ERROR : Attempt 2/3 failed with 1 errors and: InvalidParameter: 1 validation error(s) found.
- minimum field size of 1, HeadObjectInput.Key.
2020/11/26 16:25:12 ERROR : Attempt 3/3 failed with 1 errors and: InvalidParameter: 1 validation error(s) found.
- minimum field size of 1, HeadObjectInput.Key.
2020/11/26 16:25:12 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.0s

2020/11/26 16:25:12 DEBUG : 2 go routines active
2020/11/26 16:25:12 Failed to copy: InvalidParameter: 1 validation error(s) found.
- minimum field size of 1, HeadObjectInput.Key.
[admin@staging1 scripts]$
9

please post the updated config file.

try rclone ls 1606315049: -vv

10

It appears to be working. Must of been a bad config entry.

Thanks for your help guys, kudos to you.

1 Like
11

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.