Google Drive - Files deleted every morning

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS -

What is the problem you are having with rclone?

Every morning around 5AM my google workspace team shared drive logs that I have deleted a big chunk of files - like hundreds of gigs. I'm not even sure it is related to rclone, but I wanted to see if anyone had any suggestions.

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0

  • os/version: ubuntu 23.10 (64 bit)
  • os/kernel: 6.5.0-44-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.22.4
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Workspace shared team drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

My mount command:

 /usr/bin/rclone mount cloudcrypt: /local/storage/cloud \
 --allow-non-empty \
 --poll-interval=15s \
 --dir-cache-time 96h \
 --drive-chunk-size 32M \
 --vfs-cache-max-size 80G \
 --vfs-cache-mode=full \
 --vfs-cache-max-age=1h \
 --vfs-cache-min-free-space=20g \
 --umask 002 \
 --log-file /local/storage/cloud_logs.log \
 --log-level INFO \
 --config /local/storage/rclone.conf \
 --timeout 1h \
 --allow-other \
 --cache-dir /local/storage/cache/cloud

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[cloud]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
token = XXX
team_drive = XXX
root_folder_id = 
stop_on_upload_limit = true
stop_on_download_limit = true
description = cloud

[cloudcrypt]
type = crypt
remote = cloud:crypt
filename_encryption = standard
directory_name_encryption = true
password = XXX
password2 = XXX

A log from the command that you were trying to run with the -vv flag

My command works fine. I am able to add, delete, sync, move, etc with no issue.

welcome to the forum,

things to try:

  • kill the mount before 5:00AM, then you will know if it is a rclone issue.
  • check gdrive website activity logs.
  • use a debug log, check the timestamps for any activity at 5:00AM
    if activity: check scheduled tasks running on your system.

fwiw,

  • run rclone selfupdate
  • --allow-non-empty allows for over-mounting.
    should be avoided unless 1000% sure it is required.

I appreciate your reply! I'll nix the allow-non-empty part and I really like the idea of killing the mount before to see if it happens... you are absolutely right, that would help me isolate the storage from my server to help direct where next to look. Great idea!!

Damn why can't this happen at 9AM, now I have to wake up early on a Saturday :frowning:

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.