What is the problem you are having with rclone?
For a week or three ago I did some moving of my files on gdrive But now I get input/output errors
when trying to access the files!
Here is a paste when I tried to ffprobe a file: A file by RumlePot#6673 (773988821561638953) in the Servarr (264387956343570434) guild (github.com)
Can it be fixed or am I fucked?!
Run the command 'rclone version' and share the full output of the command.
rclone version
rclone v1.61.1
os/version: ubuntu 22.04 (64 bit)
os/kernel: 5.15.0-60-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.19.4
go/linking: static
go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone move "tcrypt:"/X-MAS "dst"$COUNTER"-crypt:"/X-MAS --log-file="$HOME"/logs/x-mas_$TIMESTAMP.log --drive-server-side-across-configs --server-side-across-configs --delete-after --delete-empty-src-dirs --max-transfer 700G --config=/home/xxx/scripts/movies-conf.conf --drive-acknowledge-abuse=true -v --transfers=2 --drive-pacer-min-sleep=10ms -vv
The rclone config contents with secrets removed.
Boh paste belove are within the same file!
From:
[tdrive]
client_id = xxxx
client_secret = xxxx
type = drive
token = xxxx
team_drive = xxxx
[tcrypt]
type = crypt
remote = tdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = xxxx
password2 = xxxx
TO:
[tv]
type = drive
client_id = xxxx
client_secret = xxxx
scope = drive
token = xxxx
team_drive = xxxx
root_folder_id =
[tv_crypt]
type = crypt
remote = tv:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = xxxx
password2 = xxxx
[dst1]
type = drive
scope = drive
service_account_file = /opt/sa/all/1.json
team_drive = xxxx
[dst1-crypt]
type = crypt
remote = dst1:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = xxxx
password2 = xxxx
asdffdsa
(jojothehumanmonkey)
February 19, 2023, 1:54pm
2
hi,
using rclone ls
and rclone copy
, can you access the files?
are you running a rclone mount command, if so, please post the debug log.
rclone ls movies_crypt:
17867210703 MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv
48802 MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.sv.srt
47911 MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.da.srt
47497 MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.no.srt
47462 MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.fi.srt
rclone copy movies_crypt:MOVIES-REMUX/'Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv' /home/klapvogn/
2023/02/19 15:11:07 ERROR : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:11:07 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:11:08 ERROR : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:11:08 ERROR : Attempt 2/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
Can I somehow change the password?
asdffdsa
(jojothehumanmonkey)
February 19, 2023, 2:44pm
4
strange that you can list files, but not copy them
whatever password(s) used to crypt the files, need to be used to decrypt the file.
can you re-run the last command with -vv
and post the full output.
klapvogn@skyvault:~$ rclone copy movies_crypt:MOVIES-REMUX/'Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv' /home/klapvogn/ -vv
2023/02/19 15:44:55 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "copy" "movies_crypt:MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv" "/home/klapvogn/" "-vv"]
2023/02/19 15:44:55 DEBUG : Creating backend with remote "movies_crypt:MOVIES-REMUX/Orbiter 9 (2017) [imdb:tt3469798] [tmdb:437311]/Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv"
2023/02/19 15:44:55 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/02/19 15:44:55 DEBUG : Creating backend with remote "movies:/encrypt/xxxx/xxxx/xxxx"
2023/02/19 15:44:58 DEBUG : fs cache: adding new entry for parent of "movies:/encrypt/xxxx/xxxx/xxxx", "movies:encrypt/xxxx/xxxx"
2023/02/19 15:44:58 DEBUG : Creating backend with remote "/home/klapvogn/"
2023/02/19 15:44:58 DEBUG : fs cache: renaming cache item "/home/klapvogn/" to be canonical "/home/klapvogn"
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Need to transfer - File not found at Destination
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Starting multi-thread copy with 4 parts of size 4.160Gi
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 (4466802688-8933605376) size 4.160Gi starting
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 (13400408064-17867210703) size 4.160Gi starting
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 (0-4466802688) size 4.160Gi starting
2023/02/19 15:44:58 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 (8933605376-13400408064) size 4.160Gi starting
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopening on read failure after 0 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/02/19 15:44:59 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=554938250982, userRateLimitExceeded)
2023/02/19 15:44:59 DEBUG : pacer: Rate limited, increasing sleep to 1.021145483s
2023/02/19 15:44:59 DEBUG : pacer: Reducing sleep to 0s
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: context canceled
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: couldn't reopen file with offset and limit: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopen failed after 0 bytes read: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:44:59 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/02/19 15:44:59 ERROR : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:44:59 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Sizes differ (src 17867210703 vs dst 0)
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Starting multi-thread copy with 4 parts of size 4.160Gi
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 (0-4466802688) size 4.160Gi starting
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 (13400408064-17867210703) size 4.160Gi starting
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 (4466802688-8933605376) size 4.160Gi starting
2023/02/19 15:45:00 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 (8933605376-13400408064) size 4.160Gi starting
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopening on read failure after 0 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopening on read failure after 0 bytes: retry 2/10: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopen failed after 0 bytes read: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: couldn't reopen file with offset and limit: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:01 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: couldn't reopen file with offset and limit: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:45:01 ERROR : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:01 ERROR : Attempt 2/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Sizes differ (src 17867210703 vs dst 0)
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Starting multi-thread copy with 4 parts of size 4.160Gi
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 (13400408064-17867210703) size 4.160Gi starting
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 (4466802688-8933605376) size 4.160Gi starting
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 (8933605376-13400408064) size 4.160Gi starting
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 (0-4466802688) size 4.160Gi starting
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopening on read failure after 0 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: context canceled
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: context canceled
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Reopen failed after 0 bytes read: open file failed: Get "https://www.googleapis.com/drive/v3/files/1OYnDqYWmty6-kXykSxeyUXmzARVwCA5D?alt=media": context canceled
2023/02/19 15:45:02 DEBUG : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: multi-thread copy: stream 1/4 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 ERROR : Orbiter 9 (2017) [imdb-tt3469798] [NORDIC] [Remux-1080p]-CDB.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 ERROR : Attempt 3/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/02/19 15:45:02 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 7.2s
2023/02/19 15:45:02 DEBUG : 3 go routines active
2023/02/19 15:45:02 Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
If I can browse the drive from Rclone Browser then the password would imo not be bad?
asdffdsa
(jojothehumanmonkey)
February 19, 2023, 3:53pm
6
yes, i agree. i am not sure what is going on. but now we have a debug log.
hopefully, someone will stop by soon and comment.
Im just looking at things can you tell me where to find:
https://i.stack.imgur.com/t9QYL.png
asdffdsa
(jojothehumanmonkey)
February 19, 2023, 3:58pm
8
klapvogn:
tell me where to find:
the website you want, can be found by reading the debug log.
Strange :
Error – APIs and services – Google Cloud console
You do not have sufficient permissions to view this page
But when I do : project name : 6607074409xx
I get a hit
https://prnt.sc/cvyrIOmfZwmq
No one have and idea to what can be wrong?
Ole
(Ole Frost)
February 20, 2023, 8:15pm
11
Perhaps you are not using the remote/config you think.
The command in your initial post uses tcrypt: and dst##-crypt:
The command used to make the debug log uses movies_crypt: but this remote isn't shown in the rclone config shown in your initial post.
I therefore suggest you try rclone config show movies_crypt:
and rclone config file
, to check your setup.
I believe I use the right remote. As it is mounted on my system I just cant download from the drive but I'll test what you wrote tomorrow
rclone config show movies_crypt:
[movies_crypt]
type = crypt
remote = movies:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
rclone config file
Configuration file is stored at:
/home/klapvogn/.config/rclone/rclone.conf
Ole
(Ole Frost)
February 21, 2023, 7:42pm
14
Thanks!
I see your remote has both filename and directory encryption, so your passwords seems to be correct since you can see the decrypted filenames with rclone ls.
The error therefore means that the data in the file is somehow corrupted, or it is encrypted with another set of passwords than your filenames (perhaps as part of moving your files).
I cannot see any way to fix it, sorry
I'd doubt it's corrupted as that seems strange.
The goal would be to ensure you have using all the same settings for all the passwords along the way.
If something doesn't match up, it won't decrypt properly.
The best way to ensure this is to make a copy of your rclone.conf somewhere in a keyvault or password manager so you have it and can always go back to it.
That generally means the salt / password is wrong or something in your config isn't matching up.
system
(system)
Closed
March 23, 2023, 9:13pm
17
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.