Unable to overwrite files in Google Bucket from Windows

DNC · April 14, 2023, 4:03pm

What is the problem you are having with rclone?

Unable to overwrite files in Google Cloud Storage bucket from Windows VM in GCP. Also, occasionally, when copying files it creates 0KB files and then gets Access Denied error overwriting.

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

os/version: Microsoft Windows Server 2019 Datacenter 1809 (64 bit)
os/kernel: 10.0.17763.4252 Build 17763.4252.4252 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.20.2
go/linking: static
go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Google Cloud Storage

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

copy-paste
copy <sourcefile> <destination> /Y

The rclone config contents with secrets removed.

[BUCKET]
type = google cloud storage
project = <project>
service_account_file = <json>
object_acl = projectPrivate
bucket_acl = projectPrivate
location = us
project_number = <project>
bucket_policy_only = true

asdffdsa · April 14, 2023, 5:49pm

hello and welcome to the forum,

https://rclone.org/googlecloudstorage/#gcs-bucket-policy-only
did you follow all those instructions, including all requirements from the google link?

need to post a rclone debug log that shows the problem.

DNC · April 14, 2023, 6:47pm

Sorry, wasn't sure how to go about doing that. (Noob) Hopefully this works:

2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Opendir:
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >OpenFile: fd=IR_Output/Test/ (r), err=
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Opendir: errc=0, fh=0x3
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Opendir:
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >OpenFile: fd=IR_Output/Test/ (r), err=
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Opendir: errc=0, fh=0x4
2023/04/14 18:36:39 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /: Opendir:
2023/04/14 18:36:39 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:39 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 18:36:39 DEBUG : /: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:39 DEBUG : /IR_Output: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /: Releasedir: fh=0x5
2023/04/14 18:36:39 DEBUG : /: >Releasedir: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output: Opendir:
2023/04/14 18:36:39 DEBUG : /IR_Output: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:39 DEBUG : /IR_Output: >OpenFile: fd=IR_Output/ (r), err=
2023/04/14 18:36:39 DEBUG : /IR_Output: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:39 DEBUG : /IR_Output: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /IR_Output/Test: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /IR_Output: Releasedir: fh=0x5
2023/04/14 18:36:39 DEBUG : /IR_Output: >Releasedir: errc=0
2023/04/14 18:36:39 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:39 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:39 DEBUG : /: Opendir:
2023/04/14 18:36:39 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:39 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 18:36:39 DEBUG : /: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:39 DEBUG : /: Statfs:
2023/04/14 18:36:39 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2023/04/14 18:36:39 DEBUG : /: Releasedir: fh=0x5
2023/04/14 18:36:39 DEBUG : /: >Releasedir: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Opendir:
2023/04/14 18:36:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:40 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 18:36:40 DEBUG : /: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:40 DEBUG : /: Statfs:
2023/04/14 18:36:40 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2023/04/14 18:36:40 DEBUG : /: Releasedir: fh=0x5
2023/04/14 18:36:40 DEBUG : /: >Releasedir: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Opendir:
2023/04/14 18:36:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:40 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 18:36:40 DEBUG : /: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:40 DEBUG : /: Releasedir: fh=0x5
2023/04/14 18:36:40 DEBUG : /: >Releasedir: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 18:36:40 DEBUG : /: >Getattr: errc=0
2023/04/14 18:36:40 DEBUG : /: Opendir:
2023/04/14 18:36:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 18:36:40 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 18:36:40 DEBUG : /: >Opendir: errc=0, fh=0x5
2023/04/14 18:36:40 DEBUG : /: Releasedir: fh=0x5
2023/04/14 18:36:40 DEBUG : /: >Releasedir: errc=0
2023/04/14 18:36:41 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item IR_Output/Test/362949642_123270465_304841631_382955340 - Copy.TXT not removed, freed 0 bytes
2023/04/14 18:36:41 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item IR_Output/Test/362949642_123270465_304841631_382955340.TXT not removed, freed 0 bytes
2023/04/14 18:36:41 INFO : vfs cache: cleaned: objects 2 (was 2) in use 1, to upload 0, uploading 0, total size 131 (was 131)

asdffdsa · April 14, 2023, 6:53pm

oh, you are using rclone mount?

imho, best to test using a simple command rclone copy, not rclone mount

re-create the issue by copying a single small text file.
post the full rclone debug log.

DNC · April 14, 2023, 7:16pm

Apologies, I'm not sure I understand. I am using mount to mount a bucket as a drive within Windows as we are running a utility to convert files and write to the bucket. However, sometimes, it needs to update that already converted file which is where this error occurs.

Hopefully this log is better:

2023/04/14 19:11:11 DEBUG : rclone: Version "v1.62.2" starting with parameters ["C:\rclone\rclone.exe" "mount" "ds-mma-attach-1:\ds-mma-attach-1" "d:" "--vfs-cache-mode" "writes" "--log-file=rclone.log" "--log-level" "DEBUG"]
2023/04/14 19:11:11 DEBUG : Creating backend with remote "ds-mma-attach-1:\ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : Using config file from "C:\rclone\rclone.conf"
2023/04/14 19:11:11 DEBUG : fs cache: renaming cache item "ds-mma-attach-1:\ds-mma-attach-1" to be canonical "ds-mma-attach-1:ds-mma-attach-1"
2023/04/14 19:11:11 INFO : GCS bucket ds-mma-attach-1: poll-interval is not supported by this remote
2023/04/14 19:11:11 DEBUG : vfs cache: root is "C:\Windows\system32\config\systemprofile\AppData\Local\rclone"
2023/04/14 19:11:11 DEBUG : vfs cache: data root is "\\?\C:\Windows\system32\config\systemprofile\AppData\Local\rclone\vfs\ds-mma-attach-1\ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : vfs cache: metadata root is "\\?\C:\Windows\system32\config\systemprofile\AppData\Local\rclone\vfsMeta\ds-mma-attach-1\ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : Creating backend with remote "C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfs/ds-mma-attach-1/ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : fs cache: renaming cache item "C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfs/ds-mma-attach-1/ds-mma-attach-1" to be canonical "//?/C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfs/ds-mma-attach-1/ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : Creating backend with remote "C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfsMeta/ds-mma-attach-1/ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : fs cache: renaming cache item "C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfsMeta/ds-mma-attach-1/ds-mma-attach-1" to be canonical "//?/C:/Windows/system32/config/systemprofile/AppData/Local/rclone/vfsMeta/ds-mma-attach-1/ds-mma-attach-1"
2023/04/14 19:11:11 DEBUG : Network mode mounting is disabled
2023/04/14 19:11:11 DEBUG : Mounting on "d:" ("ds-mma-attach-1 ds-mma-attach-1")
2023/04/14 19:11:11 DEBUG : GCS bucket ds-mma-attach-1: Mounting with options: ["-o" "attr_timeout=1" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "-o" "volname=ds-mma-attach-1 ds-mma-attach-1"]
2023/04/14 19:11:11 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item IR_Output/Test/362949642_123270465_304841631_382955340 - Copy.TXT not removed, freed 0 bytes
2023/04/14 19:11:11 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 131 (was 131)
2023/04/14 19:11:11 DEBUG : GCS bucket ds-mma-attach-1: Init:
2023/04/14 19:11:11 DEBUG : GCS bucket ds-mma-attach-1: >Init:
2023/04/14 19:11:11 DEBUG : /: Statfs:
2023/04/14 19:11:11 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Readlink:
2023/04/14 19:11:11 DEBUG : /: >Readlink: linkPath="", errc=-40
2023/04/14 19:11:11 DEBUG : /: Getxattr: name="non-existant-a11ec902d22f4ec49003af15282d3b00"
2023/04/14 19:11:11 DEBUG : /: >Getxattr: errc=-40, value=""
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Opendir:
2023/04/14 19:11:11 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:11 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 19:11:11 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/04/14 19:11:11 DEBUG : /: Releasedir: fh=0x0
2023/04/14 19:11:11 DEBUG : /: >Releasedir: errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Opendir:
2023/04/14 19:11:11 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:11 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 19:11:11 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/04/14 19:11:11 DEBUG : /: Releasedir: fh=0x0
2023/04/14 19:11:11 DEBUG : /: >Releasedir: errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:11 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:11 DEBUG : /: Opendir:
2023/04/14 19:11:11 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:11 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 19:11:11 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/04/14 19:11:11 DEBUG : /: Releasedir: fh=0x0
2023/04/14 19:11:11 DEBUG : /: >Releasedir: errc=0
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /autorun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:14 DEBUG : /: Opendir:
2023/04/14 19:11:14 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:14 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 19:11:14 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/04/14 19:11:14 DEBUG : /: Releasedir: fh=0x0
2023/04/14 19:11:14 DEBUG : /: >Releasedir: errc=0
2023/04/14 19:11:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /: >Getattr: errc=0
2023/04/14 19:11:14 DEBUG : /: Opendir:
2023/04/14 19:11:14 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:14 DEBUG : /: >OpenFile: fd=/ (r), err=
2023/04/14 19:11:14 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/04/14 19:11:14 DEBUG : /: Releasedir: fh=0x0
2023/04/14 19:11:14 DEBUG : /: >Releasedir: errc=0
2023/04/14 19:11:14 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2023/04/14 19:11:14 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:14 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: OpenEx: flags=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:18 DEBUG : Darwynn-test/assets1.txt: Open: flags=O_RDONLY
2023/04/14 19:11:18 DEBUG : Darwynn-test/assets1.txt: >Open: fd=Darwynn-test/assets1.txt (r), err=
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >OpenFile: fd=Darwynn-test/assets1.txt (r), err=
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >OpenEx: errc=0, fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Flush: fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Flush: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Release: fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Release: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: OpenEx: flags=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/04/14 19:11:18 DEBUG : Darwynn-test/assets1.txt: Open: flags=O_RDONLY
2023/04/14 19:11:18 DEBUG : Darwynn-test/assets1.txt: >Open: fd=Darwynn-test/assets1.txt (r), err=
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >OpenFile: fd=Darwynn-test/assets1.txt (r), err=
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >OpenEx: errc=0, fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Flush: fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Flush: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Release: fh=0x0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Release: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test/assets1.txt: >Getattr: errc=0
2023/04/14 19:11:18 DEBUG : /Darwynn-test: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/04/14 19:11:18 DEBUG : /Darwynn-test: >Getattr: errc=0
2023/04/14 19:11:25 DEBUG : GCS bucket ds-mma-attach-1: Destroy:
2023/04/14 19:11:25 DEBUG : GCS bucket ds-mma-attach-1: >Destroy:
2023/04/14 19:11:25 DEBUG : Not calling host.Unmount as mount already Destroyed
2023/04/14 19:11:25 DEBUG : Unmounted successfully
2023/04/14 19:11:25 DEBUG : vfs cache: cleaner exiting
2023/04/14 19:11:25 ERROR : d:: Unmounted rclone mount
2023/04/14 19:11:25 DEBUG : rclone: Version "v1.62.2" finishing with parameters ["C:\rclone\rclone.exe" "mount" "ds-mma-attach-1:\ds-mma-attach-1" "d:" "--vfs-cache-mode" "writes" "--log-file=rclone.log" "--log-level" "DEBUG"]

asdffdsa · April 14, 2023, 7:37pm

if unable to overwrite files, test these two commands. the second command should error out.

rclone copy c:\path\to\file.ext ds-mma-attach-1:ds-mma-attach-1 -vv
rclone copy c:\path\to\file.ext ds-mma-attach-1:ds-mma-attach-1 -vv

DNC · April 14, 2023, 9:00pm

I'm unable to recreate the error right using the rclone copy command! Doing some more testing but as of now, this is much better than using the Window copy command.

asdffdsa · April 14, 2023, 9:05pm

good, might mean the issue is with rclone mount

looks like you are running rclone mount as system user?
access denied system error 5 can be a user rights permissions issue.

DNC · April 14, 2023, 9:17pm

TBH, I was not sure what user to run it as since it's a Windows VM in GCP (I'm also a noob on the GCP front). Should it be run using a local admin account?

asdffdsa · April 14, 2023, 9:33pm

this is not a GCP issue.
check the username, same as you would on any windowz machine.

DNC · April 14, 2023, 10:26pm

Again, not totally following. Are you saying not to run it as System account (which I am)? I just found this now which says not to run it as System because of the problem creating 4 folders at once (which I have).
And/Or
Should I be using -o uid=-1,gid=11 in the mount command (from the same article) to present the bucket as owned by the System account? Perhaps I should mention that I am mounting the bucket as a service in order for all users to access.

asdffdsa · April 14, 2023, 10:37pm

that is known to have problems.

why not try it?

DNC · April 14, 2023, 10:56pm

I'll try it on Monday. Thanks for your assistance. Really appreciated!

asdffdsa · April 14, 2023, 11:02pm

sure,

another option might be:
create a group, let's call it rclonegroup
create a user rcloneuser as a member of rclonegroup

run rclone mount as rcloneuser using -o UserName=rmounter -o GroupName=rclonegroup

run your utility as rcloneuser or add the user to rclonegroup

whatever other users needs access the mount, add them to rclonegroup

system · May 14, 2023, 11:03pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.