What is the problem you are having with rclone?
While syncing (same with copying) several files to a Mega remote, some files fail to sync/copy. I have tried the same files with a different remote (eg pcloud) without any problems.
After initialization, a chunk fails to upload 10 times (with each retry taking about a second), then a few seconds later another chunk fails the same way, until the file upload Error after "10 low level retries" (output truncated after the beginning of the 2/10 low level retries.
The same thing happens with other file types (eg .pdf) and in a total of 19.651 files, 234 fail in this specific way.
In the command/output given I have selected just one of those files for simplicity.
Run the command 'rclone version' and share the full output of the command.
rclone v1.57.0
- os/version: debian 10.13
- os/kernel: 4.19.0-23-686-pae (i686)
- os/type: linux
- os/arch: 386
- go/version: go1.17.2
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Mega
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy /home/data/files/PapyrosUtilities2020Setup.exe mega:files -vv --mega-debug
The rclone config contents with secrets removed.
[mega]
type = mega
user = <email>
pass = <secret>
A log from the command with the -vv
flag
2023/05/05 13:12:04 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "copy" "/home/data/files/PapyrosUtilities2020Setup.exe" "mega:files" "-vv" "--mega-debug"]
2023/05/05 13:12:04 DEBUG : Creating backend with remote "/home/data/files/PapyrosUtilities2020Setup.exe"
2023/05/05 13:12:04 DEBUG : Using config file from "/home/ckoul/.config/rclone/rclone.conf"
2023/05/05 13:12:04 DEBUG : fs cache: adding new entry for parent of "/home/data/files/PapyrosUtilities2020Setup.exe", "/home/data/files"
2023/05/05 13:12:04 DEBUG : Creating backend with remote "mega:files"
2023/05/05 13:12:04 DEBUG : mega: detected overridden config - adding "{v6fxV}" suffix to name
2023/05/05 13:12:28 DEBUG : *go-mega*: Waiting for events to be finished for 5s
2023/05/05 13:12:28 DEBUG : *go-mega*: pollEvents: Parsing event "ua": {"a":"ua","st":"IC^5vG","u":"MhoNhVeTltE","ua":["^!stbmp"],"v":["rTm4CZ8lGhQ"]}
2023/05/05 13:12:28 DEBUG : *go-mega*: Signalling events received
2023/05/05 13:12:28 DEBUG : *go-mega*: Events received
2023/05/05 13:12:28 DEBUG : fs cache: renaming cache item "mega:files" to be canonical "mega{v6fxV}:files"
2023/05/05 13:12:28 DEBUG : PapyrosUtilities2020Setup.exe: Need to transfer - File not found at Destination
2023/05/05 13:12:37 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 0/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:38 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 1/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:38 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 2/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:38 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 3/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:39 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 4/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:39 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 5/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:40 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 6/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:41 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 7/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:42 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 8/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:45 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 9/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:50 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 10/10: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF
2023/05/05 13:12:55 DEBUG : PapyrosUtilities2020Setup.exe: Received error: upload file failed to upload chunk: Post "http://gfs262n352.userstorage.mega.co.nz/ul/8VlPKU7-WcSjAgfr1nzX1V_f1vZS-6gCthYKRi8tMra241W51Q0TXw2boIEeRXkM1lEprkQaK_XHequbXFLf2Q/1966080": EOF - low level retry 1/10
2023/05/05 13:13:04 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 0/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:04 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 1/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:05 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 2/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:05 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 3/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:06 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 4/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:06 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 5/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:07 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 6/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:08 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 7/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:09 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 8/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:12 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 9/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:17 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 10/10: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF
2023/05/05 13:13:22 DEBUG : PapyrosUtilities2020Setup.exe: Received error: upload file failed to upload chunk: Post "http://gfs270n357.userstorage.mega.co.nz/ul/EdLMmfwl7v6ePQLN3gpY76LSEON7IQT_4Pn96krMa_ZZU8cirSp_y5B-nrd29xdnWaJN-gkWENAplNSokmHR7g/1966080": EOF - low level retry 2/10
2023/05/05 13:13:28 INFO :
Transferred: 7.125 MiB / 47.039 MiB, 15%, 141.923 KiB/s, ETA 4m47s
Transferred: 0 / 1, 0%
Elapsed time: 1m24.1s
Transferring:
* PapyrosUtilities2020Setup.exe: 4% /41.789Mi, 319.946Ki/s, 2m7s
2023/05/05 13:13:31 DEBUG : *go-mega*: PapyrosUtilities2020Setup.exe: Retry upload chunk 0/10: Post "http://gfs204n140.userstorage.mega.co.nz/ul/jVFTHNz8CuYkygLvowft1ItmRMamnh3uLFE_JJbjjN9rd559un5SLKkrx9a9OXxuE_h4BshIfNstryk43YiSDA/1966080": EOF