Thanks, I am going to monitor everything meanwhile one thing more, How can I force the cache drive to be opened by non-root users as well so that, I could check what's inside vfsMeta and vfs folders of the rclone cache folder from the SAMBA (SMB) Share?
Thanks!
That's more Unraid / Samba than rclone so not sure I have any advice as you really don't want other things mucking around in the cache or removing stuff as that could cause problems.
Thanks makes sense, so I just checked one thing.
Command: rclone mount --allow-other --buffer-size 256M --dir-cache-time 96h --timeout 1h --default-permissions --uid 99 --gid 100 --umask 002 --vfs-cache-mode full --vfs-cache-max-age 24h --cache-dir /mnt/disks/ua_hdd1/rclone/cache -vv --log-file /mnt/disks/ua_hdd1/rclone.log gdrive: /mnt/disks/ua_hdd1/gdrive &
I only watched "Ocean's Eleven" but then, Cache has a lot of other movies/shows into the cache now even though, I didn't watch them. What could be the reason?
root@unraid:/mnt/disks/ua_hdd1/rclone/cache/vfs/gdrive/media_swizzin/radarr# ls -la
total 4
drwx------ 16 root root 4096 Dec 29 03:57 ./
drwx------ 5 root root 48 Dec 29 03:16 ../
drwx------ 2 root root 60 Dec 29 02:20 A\ Wednesday!\ (2008)/
drwx------ 2 root root 57 Dec 29 02:27 AK\ vs\ AK\ (2020)/
drwx------ 2 root root 50 Dec 29 02:01 First\ Man\ (2018)/
drwx------ 2 root root 57 Dec 29 03:18 Home\ Alone\ (1990)/
drwx------ 2 root root 68 Dec 29 03:57 Home\ Alone\ 3\ (1997)/
drwx------ 2 root root 67 Dec 29 03:35 Home\ Alone\ 4\ (2002)/
drwx------ 2 root root 77 Dec 29 03:30 Home\ Alone\ The\ Holiday\ Heist\ (2012)/
drwx------ 2 root root 59 Dec 29 02:02 Jolly\ LLB\ 2\ (2017)/
drwx------ 2 root root 64 Dec 29 02:13 Life\ in\ a\ Metro\ (2007)/
drwx------ 2 root root 69 Dec 29 02:45 Never\ Say\ Never\ Again\ (1983)/
drwx------ 2 root root 61 Dec 28 19:05 Ocean's\ Eleven\ (2001)/
drwx------ 2 root root 71 Dec 29 02:33 The\ Midnight\ Sky\ (2020)/
drwx------ 2 root root 72 Dec 29 02:01 Tom\ and\ Jerry\ Blast\ Off\ to\ Mars!\ (2005)/
drwx------ 2 root root 65 Dec 29 03:04 Wonder\ Woman\ 1984\ (2020)/
root@unraid:/mnt/disks/ua_hdd1/rclone/cache/vfs/gdrive/media_swizzin/radarr# du -sh *
4.2G A Wednesday! (2008)
3.2G AK vs AK (2020)
20M First Man (2018)
2.0G Home Alone (1990)
2.0G Home Alone 3 (1997)
3.3G Home Alone 4 (2002)
1.8G Home Alone The Holiday Heist (2012)
5.8G Jolly LLB 2 (2017)
4.2G Life in a Metro (2007)
12G Never Say Never Again (1983)
1.8G Ocean's Eleven (2001)
6.5G The Midnight Sky (2020)
17M Tom and Jerry Blast Off to Mars! (2005)
5.9G Wonder Woman 1984 (2020)
This is just for Radarr, I have it same happening for Sonarr as well. No, Sonarr/Radarr didn't download anything since December 26.
Log is pretty big, that is why I have not provided, if you need it, I will provide in the next reply.
Rclone only delivers what it is asked so something requested it so you did, plex did, something did.
Super helpful to read through the docs and rclone's cache uses sparse files and that's documented here:
How can I know the actual size of the file, rclone has downloaded?
Yes, I have just read the sparse files.
You can check:
du -h filename
That shows actual size.
Command: rclone mount --allow-other --buffer-size 256M --dir-cache-time 96h --timeout 1h --default-permissions --uid 99 --gid 100 --umask 002 --vfs-cache-mode full --vfs-cache-max-age 24h -v --progress --cache-dir /mnt/disks/ua_hdd1/rclone/cache gdrive: /mnt/disks/ua_hdd1/gdrive &
I'm noticing one error:
2021/01/01 13:25:01 INFO : vfs cache: cleaned: objects 219 (was 219) in use 2, to upload 0, uploading 0, total size 217.126G (was 217.126G)
2021/01/01 13:26:01 INFO : vfs cache: cleaned: objects 219 (was 219) in use 2, to upload 0, uploading 0, total size 220.827G (was 220.827G)
2021/01/01 13:27:01 INFO : vfs cache: cleaned: objects 219 (was 219) in use 2, to upload 0, uploading 0, total size 224.293G (was 224.293G)
2021/01/01 13:28:01 INFO : vfs cache: cleaned: objects 219 (was 219) in use 2, to upload 0, uploading 0, total size 227.749G (was 227.749G)
2021/01/01 13:28:04 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:53 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:53 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:53 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:54 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:54 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:54 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:55 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:28:55 INFO : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: queuing for upload in 5s
2021/01/01 13:29:01 INFO : vfs cache: cleaned: objects 220 (was 220) in use 2, to upload 0, uploading 1, total size 227.781G (was 227.781G)
2021/01/01 13:29:29 ERROR : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: Failed to copy: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UxgNalE4qRogAk0rPJWUvp42_mdsCiIpmwq8kj9_UZFYvtufeo6b4at0l2mPqkVmmTtvANbENVbJ0agPg4ishe_gf7wlA": can't copy - source file is being updated (mod time changed from 2021-01-01 13:20:52.167074608 +0530 IST to 2021-01-01 13:28:54.429244645 +0530 IST)
2021/01/01 13:29:29 ERROR : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UxgNalE4qRogAk0rPJWUvp42_mdsCiIpmwq8kj9_UZFYvtufeo6b4at0l2mPqkVmmTtvANbENVbJ0agPg4ishe_gf7wlA": can't copy - source file is being updated (mod time changed from 2021-01-01 13:20:52.167074608 +0530 IST to 2021-01-01 13:28:54.429244645 +0530 IST)Not sure I see any issues from the log you shared, what do you feel is an error?
2021/01/01 13:29:29 ERROR : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: Failed to copy: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UxgNalE4qRogAk0rPJWUvp42_mdsCiIpmwq8kj9_UZFYvtufeo6b4at0l2mPqkVmmTtvANbENVbJ0agPg4ishe_gf7wlA": can't copy - source file is being updated (mod time changed from 2021-01-01 13:20:52.167074608 +0530 IST to 2021-01-01 13:28:54.429244645 +0530 IST)
2021/01/01 13:29:29 ERROR : media_swizzin/radarr/El Camino A Breaking Bad Movie (2019)/El Camino A Breaking Bad Movie (2019) [WEBRip-1080p Proper x264 EAC3 Atmos].mkv: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UxgNalE4qRogAk0rPJWUvp42_mdsCiIpmwq8kj9_UZFYvtufeo6b4at0l2mPqkVmmTtvANbENVbJ0agPg4ishe_gf7wlA": can't copy - source file is being updated (mod time changed from 2021-01-01 13:20:52.167074608 +0530 IST to 2021-01-01 13:28:54.429244645 +0530 IST)That's telling you rclone is trying to copy a file that's actively being written to. That is normal if you are writing to a file.
But, the question is, Why is it happening though? It happened again.
2021/01/02 11:59:28 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E06 - King Cobra [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 11:59:29 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E06 - King Cobra [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 11:59:39 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E10 - December 19 [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 11:59:43 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E08 - The Good, The Bad, and The Badass [WEBDL-1080p x264 EAC3].mkv: Failed to copy: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-Uwa4HIwr-uj8K1O7BPrm9nZ0c32V4aTtfYKyCgVOzg7WPxZwtKvzkO7Q-92KUv8SKYfjhewk9FZbSGR6sNwuyU": can't copy - source file is being updated (mod time changed from 2021-01-01 00:08:43.751563 +0530 IST to 2021-01-02 11:57:59.706881667 +0530 IST)
2021/01/02 11:59:43 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E08 - The Good, The Bad, and The Badass [WEBDL-1080p x264 EAC3].mkv: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-Uwa4HIwr-uj8K1O7BPrm9nZ0c32V4aTtfYKyCgVOzg7WPxZwtKvzkO7Q-92KUv8SKYfjhewk9FZbSGR6sNwuyU": can't copy - source file is being updated (mod time changed from 2021-01-01 00:08:43.751563 +0530 IST to 2021-01-02 11:57:59.706881667 +0530 IST)
2021/01/02 11:59:58 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E10 - December 19 [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 11:59:58 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E10 - December 19 [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 11:59:58 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E10 - December 19 [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 12:00:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 5, uploading 4, total size 212.364G (was 212.364G)
2021/01/02 12:00:09 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E05 - Miyagi-Do [WEBDL-1080p x264 EAC3].mkv: Failed to copy: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UzxZqD8mOjA_CAQYv_yFlpJANG1QsEf9NacV7FnB2IlfVRPPJhaHqqnPaWVrcfrs97gPtOYOZ_b-mB2rf8I8kkuOISl3w": can't copy - source file is being updated (mod time changed from 2021-01-01 13:34:40.581032 +0530 IST to 2021-01-02 11:58:27.137923437 +0530 IST)
2021/01/02 12:00:09 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E05 - Miyagi-Do [WEBDL-1080p x264 EAC3].mkv: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UzxZqD8mOjA_CAQYv_yFlpJANG1QsEf9NacV7FnB2IlfVRPPJhaHqqnPaWVrcfrs97gPtOYOZ_b-mB2rf8I8kkuOISl3w": can't copy - source file is being updated (mod time changed from 2021-01-01 13:34:40.581032 +0530 IST to 2021-01-02 11:58:27.137923437 +0530 IST)
2021/01/02 12:00:18 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E04 - The Right Path [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 12:00:27 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E04 - The Right Path [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 12:00:27 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E04 - The Right Path [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 12:00:27 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E04 - The Right Path [WEBDL-1080p x264 EAC3].mkv: vfs cache: queuing for upload in 5s
2021/01/02 12:01:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:02:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:03:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:04:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:05:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:06:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:07:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:08:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 10, to upload 6, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:08:21 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E01 - Aftermath [WEBDL-1080p x264 EAC3].mkv: Copied (new)
2021/01/02 12:08:21 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E01 - Aftermath [WEBDL-1080p x264 EAC3].mkv: vfs cache: upload succeeded try #2
2021/01/02 12:09:01 INFO : vfs cache: cleaned: objects 1258 (was 1258) in use 9, to upload 5, uploading 4, total size 213.426G (was 213.426G)
2021/01/02 12:09:15 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E03 - Now Youâre Gonna Pay [WEBDL-1080p h264 AAC].mkv: Copied (new)
2021/01/02 12:09:16 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E03 - Now Youâre Gonna Pay [WEBDL-1080p h264 AAC].mkv: vfs cache: upload succeeded try #2
2021/01/02 12:09:46 INFO : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E07 - ObstĂĄculos [WEBDL-1080p x264 EAC3].mkv: Copied (new)
What is this?
2021/01/02 12:00:09 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E05 - Miyagi-Do [WEBDL-1080p x264 EAC3].mkv: Failed to copy: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UzxZqD8mOjA_CAQYv_yFlpJANG1QsEf9NacV7FnB2IlfVRPPJhaHqqnPaWVrcfrs97gPtOYOZ_b-mB2rf8I8kkuOISl3w": can't copy - source file is being updated (mod time changed from 2021-01-01 13:34:40.581032 +0530 IST to 2021-01-02 11:58:27.137923437 +0530 IST)
2021/01/02 12:00:09 ERROR : media_swizzin/sonarr/Cobra Kai/Season 03/Cobra Kai - S03E05 - Miyagi-Do [WEBDL-1080p x264 EAC3].mkv: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UzxZqD8mOjA_CAQYv_yFlpJANG1QsEf9NacV7FnB2IlfVRPPJhaHqqnPaWVrcfrs97gPtOYOZ_b-mB2rf8I8kkuOISl3w": can't copy - source file is being updated (mod time changed from 2021-01-01 13:34:40.581032 +0530 IST to 2021-01-02 11:58:27.137923437 +0530 IST)It happens when you have a process/piece of software/application writing to a file, closing the file, writing to the file again. Could be any piece of software you have so pretty hard to guess which piece. Rclone just copies the file later when it has not changed as it not an issue.
Hi,
I wanted to update you over this after 2 months of usage, I have been able to make rclone work for me properly now and it's working fine for now except for one thing for which I have made the new thread:
Meanwhile, for now I'm marking this thread as solved until further (if I face any similar issue).
Thanks for your help. It was really helping.
Note for anyone having the same issue: Please read the full thread and there are solutions partially divided into the multiple posts of @Animosity022 hence, this issue isn't resolved in one single post but rather multiple of them.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.