Error in temp_data upload

Help and Support
1

Hello,
I’m using this version on ubuntu 16.04
rclone v1.41-089-g05edb5f5β

  • os/arch: linux/amd64
  • go version: go1.10.1

Mounted crypted gdrive this way:
rclone -v mount --allow-other --vfs-cache-mode writes --rc --cache-tmp-upload-path /root/data --cache-tmp-wait-time 60m --log-file /root/logs/rclone.log cachecrypt:/ /media/google_crypt

I had many datas in /root/data that after 3 days was not uploaded on gdrive so i uploaded them manually with this command:
rclone move “$FROM” “$TO” --transfers=20 --checkers=20 --delete-after

After that all my files where on gdrive but looking at rclone log i see the rclone i going to give me all this error continuously.
What can i do?

2018/06/11 10:06:29 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: started upload
2018/06/11 10:06:29 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: object not found
2018/06/11 10:06:29 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: started upload
2018/06/11 10:06:29 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: object not found
2018/06/11 10:06:29 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: started upload
2018/06/11 10:06:29 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/2qsiknrv9hr98hafcu7i0qlg9drvk1frq8emv6kvm704mr2bb700/pfc47ra314i91fljaj4000deklovpcs78aaj9li5tn69hkotj4adaeonnnc3hoa1m129s3h0ici1m: background upload: object not found

2

I think this should probably drop the object from the pending queue - what do you think @remus.bunduc ?

3

Where is queue stored?
Also after a reboot and after --cache-db-purge i have the same error.

4

Hmm, ok. I need to fix this.

In the meantime, @fbrassin you can delete the cache db completely and it will reset all temporary uploads. The cache db is listed at the start of a command (with -v):

Cache DB path: /Users/…/Library/Caches/rclone/cache-backend/TestCacheGdrive.db

5

Ok, i deleted .db file, now it seems to be ok.
Doing this the files in --cache-tmp-upload-path are supposed to be moved in gdrive?

–cache-db-purge doesn’t delete .db file?

6

By deleting those files there’s no longer a queue so you will need to manually move files that were in there at that time.
I’ll work on improving this scenario.

One thing that could help, would you have some logs since when the files stopped moving?

And no, --cache-db-purge will not delete the DB file. The queue needs to be permanent

7

I’m sorry, i haven’t got log file anymore.
It was 69Gb so i deleted it.

8

I’ve just realize that i have i file not being uploaded.
Now my log is about 90Mb.

My last messages are:
2018/06/13 08:39:48 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:48 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: started upload
2018/06/13 08:39:48 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: Failed to copy: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:48 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: Not deleting source as copy failed: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:48 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:48 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: started upload
2018/06/13 08:39:49 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: Failed to copy: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:49 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: Not deleting source as copy failed: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:49 ERROR : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: googleapi: Error 404: File not found: 1Dc_VGTQc5xS-LUVxuWZe2nAsCYNQi0vh., notFound
2018/06/13 08:39:49 INFO : 56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/jm5mj3rpsort4pv6mgproced2ttg2a5gvv5lnomur9fgqqe2k170/qud3l7hnm1ag3ihl8ii9nb5bq6g6417b6vfk49ncaqd24ss1hnf9ro2di4gjpt58uv64ctcbfno6i: background upload: started upload

9

This looks like you’ve moved the files from the temp path again. Is that correct?

10

Actually, i don’t think so.
Now i reboot my machine.
In logs i don’t see that error anymore, let’s if it will upload the file.
I’ll let you know.

Then Error was a bit different from the previous one.
Now it was:
background upload: googleapi: Error 404

11

I have this same error on rclone v1.42