What is the problem you are having with rclone?
Issue # 1: We have installed rclone on one of the SAP systems and mounted azure blob as Drive.
We have triggered batch jobs to write 100MB,50MB and 25 MB files.
Initially we have enabled cache option (--vfs-cache-mode minimal) and more than 75 percent of jobs getting failed with error "File opening error"
Initially we have enabled cache option (--vfs-cache-mode writes) and was but better that earlier but we also jobs getting failed with error "File opening error".
Issue # 2:
Also, we trying to mount azure blob as Drive with Managed Identity.
But rclone is picking system managed identity though we have user managed identity enabled. We cannot turn off system managed identity for some reasons and need rlcone to use UMI.
Run the command 'rclone version' and share the full output of the command.
rclone v1.69.0
- os/version: Microsoft Windows Server 2022 Datacenter 21H2 21H2 (64 bit)
- os/kernel: 10.0.20348.3091 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.23.4
- go/linking: static
- go/tags: cmount
Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads
YES
Which cloud storage system are you using?
Azure
The command you were trying to run (eg rclone copy /tmp remote:tmp)
We have mounted the azure blob as drive and we are using SAP program to drive data into this drive
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
; empty config
A log from the command that you were trying to run with the -vv flag
INFO : Azure root: vfs cache: cleaned: objects 8 (was 8) in use 0, to upload 0, uploading 0, total size 129.906Mi (was 129.906Mi)
INFO : Azure root: vfs cache: cleaned: objects 8 (was 8) in use 0, to upload 0, uploading 0, total size 129.906Mi (was 129.906Mi)
INFO : container1/FILE_20250211_151344.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151344.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151344.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151344.txt: Copied (new)
INFO : container1/FILE_20250211_151344.txt: vfs cache: upload succeeded try #1
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : Azure root: vfs cache: cleaned: objects 9 (was 9) in use 0, to upload 0, uploading 0, total size 130.006Mi (was 130.006Mi)
INFO : container1/FILE_20250211_151800.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151800.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151800.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_151800.txt: Copied (new)
INFO : container1/FILE_20250211_151800.txt: vfs cache: upload succeeded try #1
INFO : Azure root: vfs cache: cleaned: objects 10 (was 10) in use 0, to upload 0, uploading 0, total size 235.342Mi (was 235.342Mi)
INFO : Azure root: vfs cache: cleaned: objects 10 (was 10) in use 0, to upload 0, uploading 0, total size 235.342Mi (was 235.342Mi)
INFO : Azure root: vfs cache: cleaned: objects 10 (was 10) in use 0, to upload 0, uploading 0, total size 235.342Mi (was 235.342Mi)
INFO : Azure root: vfs cache: cleaned: objects 10 (was 10) in use 0, to upload 0, uploading 0, total size 235.342Mi (was 235.342Mi)
INFO : Azure root: vfs cache: cleaned: objects 10 (was 10) in use 0, to upload 0, uploading 0, total size 235.342Mi (was 235.342Mi)
INFO : container1/FILE_20250211_142541.txt: vfs cache: removed cache file as Removing old cache file not in use
INFO : Azure root: vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item container1/FILE_20250211_142541.txt was removed, freed 2733837 bytes
INFO : Azure root: vfs cache: cleaned: objects 9 (was 10) in use 0, to upload 0, uploading 0, total size 232.735Mi (was 235.342Mi) ```
zure root: vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item container1/FILE_20250211_163541.txt was removed, freed 110452158 bytes
INFO : Azure root: vfs cache: cleaned: objects 25 (was 26) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.623Gi)
INFO : Azure root: vfs cache: cleaned: objects 25 (was 25) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.520Gi)
INFO : container1/FILE_20250211_173742.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_173742.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_173742.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_173742.txt: Copied (new)
INFO : container1/FILE_20250211_173742.txt: vfs cache: upload succeeded try #1
INFO : container1/FILE_20250211_163741.txt: vfs cache: removed cache file as Removing old cache file not in use
INFO : Azure root: vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item container1/FILE_20250211_163741.txt was removed, freed 110452158 bytes
INFO : Azure root: vfs cache: cleaned: objects 25 (was 26) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.623Gi)
INFO : Azure root: vfs cache: cleaned: objects 25 (was 25) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.520Gi)
INFO : Azure root: vfs cache: cleaned: objects 25 (was 25) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.520Gi)
INFO : Azure root: vfs cache: cleaned: objects 25 (was 25) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.520Gi)
INFO : container1/FILE_20250211_174142.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174142.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174142.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174142.txt: Copied (new)
INFO : container1/FILE_20250211_174142.txt: vfs cache: upload succeeded try #1
INFO : container1/FILE_20250211_164141.txt: vfs cache: removed cache file as Removing old cache file not in use
INFO : Azure root: vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item container1/FILE_20250211_164141.txt was removed, freed 110452158 bytes
INFO : Azure root: vfs cache: cleaned: objects 25 (was 26) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.623Gi)
INFO : Azure root: vfs cache: cleaned: objects 25 (was 25) in use 0, to upload 0, uploading 0, total size 2.520Gi (was 2.520Gi)
INFO : container1/FILE_20250211_174342.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174342.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174342.txt: vfs cache: queuing for upload in 5s
INFO : container1/FILE_20250211_174342.txt: Copied (new)
INFO : container1/FILE_20250211_174342.txt: vfs cache: upload succeeded try #1
INFO : container1/FILE_20250211_164341.txt: vfs cache: removed cache file as Removing old cache file not in use