Hi,
I’m running rclone 1.40 on both a raspberry pi 3 and a linux mint laptop.
I use it to have a local copy of a hubic account on both machines.
For this, I’m running daily a cron job with the following command: on the pi: rclone --fast-list --tpslimit 18 --tpslimit-burst 2 sync hubiC:default/ /hdd/hubiC
on the mint laptop: rclone --fast-list sync hubiC:default/ /hdd/hubiC
As you can see, the only difference is on tpslimit as I had a lot of 'Unsolicited response receive d on idle HTTP channel’ messages on the pi and the tpslimit helped a lot in reducing these messages BUT
On the laptop, everything works fine every night whereas on the pi I get a list (always the same) of files not found:
e.g.: 2018/03/25 00:17:57 ERROR : Photos/2004/Myrtille/DSCN0713.JPG: Failed to copy: failed to open source object: Object Not Found
The files exist both on hubiC and on the pi (I copied them manually one day to check if it would solve the issue)
(I tried to run the command w/o the tpslimit stuff but same result)
The full -vv log is huge so I worked only on one directory.
Looking for DSCN0713 in the log, I got:
2018/03/28 11:10:15 DEBUG : Photos/2004/Myrtille/DSCN0713.JPG: Sizes differ (src 687053 vs dst 6721)
and, indeed the size of the file on the pi was wrong (6721 instead of 687053).
So I removed the file and restarted the sync only on this file and here is the log
For clarity sake, I removed all the lines like this: 2018/03/28 11:34:38 DEBUG : DSCN0706.JPG: Excluded from sync (and deletion)
pi@raspberrypi ~ $ rclone -vv --fast-list --tpslimit 18 --tpslimit-burst 2 sync hubiC:default/Photos/2004/Myrtille/DSCN0713.JPG /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG 2>&1 > rclone-1.log
2018/03/28 11:34:11 DEBUG : rclone: Version "v1.40" starting with parameters ["rclone" "-vv" "--fast-list" "--tpslimit" "18" "--tpslimit-burst" "2" "sync" "hubiC:default/Photos/2004/Myrtille/DSCN0713.JPG" "/hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG"]
2018/03/28 11:34:11 DEBUG : Using config file from "/home/pi/.config/rclone/rclone.conf"
2018/03/28 11:34:11 INFO : Starting HTTP transaction limiter: max 18 transactions/s with burst 2
2018/03/28 11:34:12 DEBUG : Hubic: Got swift credentials (expiry 2018-03-29 00:13:30 +0200 CEST in 12h39m17.803634845s)
2018/03/28 11:34:13 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Modify window is 1ns
2018/03/28 11:34:13 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for checks to finish
2018/03/28 11:34:13 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for transfers to finish
2018/03/28 11:34:17 ERROR : DSCN0713.JPG: Failed to copy: failed to open source object: Object Not Found
2018/03/28 11:34:17 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting files as there were IO errors
2018/03/28 11:34:17 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting directories as there were IO errors
2018/03/28 11:34:17 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: Object Not Found
2018/03/28 11:34:17 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for checks to finish
2018/03/28 11:34:17 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for transfers to finish
2018/03/28 11:34:38 ERROR : DSCN0713.JPG: Failed to copy: failed to open source object: Object Not Found
2018/03/28 11:34:38 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting files as there were IO errors
2018/03/28 11:34:38 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting directories as there were IO errors
2018/03/28 11:34:38 ERROR : Attempt 2/3 failed with 1 errors and: failed to open source object: Object Not Found
2018/03/28 11:34:38 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for checks to finish
2018/03/28 11:34:38 INFO : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: Waiting for transfers to finish
2018/03/28 11:34:43 ERROR : DSCN0713.JPG: Failed to copy: failed to open source object: Object Not Found
2018/03/28 11:34:43 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting files as there were IO errors
2018/03/28 11:34:43 ERROR : Local file system at /hdd/hubiC/Photos/2004/Myrtille/DSCN0713.JPG: not deleting directories as there were IO errors
2018/03/28 11:34:43 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: Object Not Found
2018/03/28 11:34:43 Failed to sync: failed to open source object: Object Not Found
I have the same problem and the error is of hubic, if you go to website and try to download the file, you will see cant download the file, like one hard drive died and and the files were there.
I found this when i was trying to download 126 videos but always 4 never download.
Thanks @alfred
It looks like you’re right, I cannot access this particular photo on the hubic website.
Although I don’t understand why I get no error message on my laptop (on which the photo is intact).
Anyway, I’ll try tomorrow to copy the laptop’s file on the pi and check if it solves the error message.
And I’ll force a re upload to hubic…
