RClone Mount with Azure Blob Archive Tier

What is the problem you are having with rclone?

  • Folks, I have a "rclone mount" to Azure Blob Storage for application file backup. The application is little old school, so it needs local/SMB type drive to backup.

  • In rclone config, I have set the Azure Blob access tier to "Archive" (not Hot or Cool), as I rarely need the backup. Just for compliance purpose.

  • Since, I have this mounted as a System Drive in Window Server, it's available to our all programs.

  • What I'm worried is Antivirus/Antimalware or Random program scanning this drive, and causing hugh number of reads on the Archive tier, resulting in hugh bill. Any suggestions?

What is your rclone version (output from rclone version)

rclone v1.53.1

  • os/arch: windows/amd64
  • go version: go1.15
  • winfsp 1.7.20172

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows Server 2019 Datacenter (Azure)

Which cloud storage system are you using? (eg Google Drive)

Azure Blob Storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

.\rclone.exe mount azure-container-1:container1 X: --vfs-cache-mode full --config="C:\Users\XXXX\.config\rclone\rclone.conf" --log-level INFO --log-file="c:\rclone\log.txt"

The rclone config contents with secrets removed.

[azure-container-1]
type = azureblob
account = storageAccountName
key = XXXXXXXXXXXXXXX
access_tier = Archive

A log from the command with the -vv flag

2020/09/28 14:34:55 INFO  : 10MB.zip: vfs cache: downloader: error count now 1: vfs reader: failed to write to cache file: **Blob in archive tier**, you need to set tier to hot or cool first
2020/09/28 14:34:55 ERROR : 10MB.zip: vfs cache: failed to download: vfs reader: failed to write to cache file: **Blob in archive tier**, you need to set tier to hot or cool first

hello and welcome to the forum,

  • add an exlude rule to the anti-virus software.
    or
  • do not use mount for backup. i never do. keep in mind that if your computer is hacked with ransomware, it will encrypt files on the rclone mount.
    so you can do a save and simple rclone copy localpath azure-container-1:container1

You could set --bwlimit or --tpslimit to slow the access down. You could also set a --max-transfer limit which will exit rclone if that limit is reached as a sort of firebreak.

Good point on ransomware. Even though, I'm using "immutable storage" policy on azure side, which will prevent overwrite or deletion of data, this would be good for other cloud storage.

i use this flag as protection against ransomware.
https://rclone.org/docs/#backup-dir-dir using a timestamp

each time i run rclone, i use a command like this, removed the non-relevant parts.

rclone.exe sync v:\EN07\en07.rcloner aws01:vserver03.en07.rcloner/en07.rcloner/rclone/backup --backup-dir=aws01:vserver03.en07.rcloner/en07.rcloner/rclone/archive/20200918.193016

I like the --bwlimit option, and works as expected.

Something which I have noticed while writing data to azure blob, that --no-modtime / --use-server-modtime doesn't work with Archive Tier. I'm seeing the following error even with the above flags set:

2020/09/28 21:23:38 ERROR : 10MB.zip: Failed to apply pending mod time 2020-09-28 21:23:29.5253313 +0000 GMT: -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, github.com/Azure/azure-storage-blob-go@v0.10.0/azblob/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=BlobArchived) =====
Description=This operation is not permitted on an archived blob.
RequestId:1b8120c9-b01e-0009-54dd-950a40000000
Time:2020-09-28T21:23:38.1101725Z, Details: 
   Code: BlobArchived

thanks for the tip. I can see how this can be helpful.

That looks like you are writing to azure blob storage - rclone is attempting to set the modification time of a file.

Do you happen to know what sequence of operations you did to cause that?

It might be that you need to increase

  --vfs-write-back duration                Time to writeback files after last use when using cache. (default 5s)

So that rclone doesn't upload the file until it is really finished with.

Hi Nick,

I tried the --vfs-write-back 15s flag, it didn't help. The error still popup, everytime a new file is written. I think the issue is even with --no-modtime flag set, rclone is still trying to update the metadata of file or the "Mtime"

As with blob is in "Archive" tier, Azure doen't allow updating the modtime. Context from Azure website:

Setting or modifying the blob metadata while in archive is not allowed; however you may set and modify the blob index tags.

RClone Error:

    2020/09/29 15:23:25 ERROR : 10MB.zip: Failed to apply pending mod time 2020-09-29 15:23:10.3566015 +0000 GMT: -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, github.com/Azure/azure-storage-blob-go@v0.10.0/azblob/zc_storage_error.go:42
    ===== RESPONSE ERROR (ServiceCode=BlobArchived) =====
    Description=This operation is not permitted on an archived blob.
    RequestId:e39de0c1-601e-000a-6c96-96eb24000000
    Time:2020-09-29T15:23:25.7424497Z, Details: 
       Code: BlobArchived

On Azure Portal, I can see the blob displaying LAST MODIFIED 29/09/2020, 3:23:25 pm

The 15 sec delay between write time is because of --vfs-write-back.

If you try the above config on a Azure Blob with rclone config set to "Archive" tier, you will be able to reproduce the error.

here are the DEBUG logs:

2020/09/29 20:09:51 DEBUG : rclone: Version "v1.53.1" starting with parameters ["C:\\rclone\\rclone.exe" "mount" "azure-container-1:container3" "X:" "--vfs-cache-mode" "full" "--log-level" "DEBUG" "--log-file=d:\\rclone\\log3.txt" "--no-modtime" "--fuse-flag" "--VolumePrefix=\\server\\share"]
2020/09/29 20:09:51 DEBUG : Creating backend with remote "azure-container-1:container3"
2020/09/29 20:09:51 DEBUG : Using config file from "C:\\Users\\specterz\\.config\\rclone\\rclone.conf"
2020/09/29 20:09:51 INFO  : Azure container container3: poll-interval is not supported by this remote
2020/09/29 20:09:51 DEBUG : vfs cache: root is "\\\\?\\C:\\Users\\specterz\\AppData\\Local\\rclone\\vfs\\azure-container-1\\container3"
2020/09/29 20:09:51 DEBUG : vfs cache: metadata root is "\\\\?\\C:\\Users\\specterz\\AppData\\Local\\rclone\\vfs\\azure-container-1\\container3"
2020/09/29 20:09:51 DEBUG : Creating backend with remote "\\\\?\\C:\\Users\\specterz\\AppData\\Local\\rclone\\vfs\\azure-container-1\\container3"
2020/09/29 20:09:51 DEBUG : fs cache: renaming cache item "\\\\?\\C:\\Users\\specterz\\AppData\\Local\\rclone\\vfs\\azure-container-1\\container3" to be canonical "//?/C:/Users/specterz/AppData/Local/rclone/vfs/azure-container-1/container3"
2020/09/29 20:09:51 DEBUG : fs cache: switching user supplied name "\\\\?\\C:\\Users\\specterz\\AppData\\Local\\rclone\\vfs\\azure-container-1\\container3" for canonical name "//?/C:/Users/specterz/AppData/Local/rclone/vfs/azure-container-1/container3"
2020/09/29 20:09:51 DEBUG : Azure container container3: Mounting on "X:"
2020/09/29 20:09:51 DEBUG : Azure container container3: Mounting with options: ["-o" "fsname=azure-container-1:container3" "-o" "subtype=rclone" "-o" "max_readahead=131072" "-o" "attr_timeout=1" "-o" "atomic_o_trunc" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "-o" "volname=azure-container-1 container3" "--VolumePrefix=\\server\\share"]
2020/09/29 20:09:51 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2020/09/29 20:09:51 DEBUG : Azure container container3: Init: 
2020/09/29 20:09:51 DEBUG : Azure container container3: >Init: 
2020/09/29 20:09:51 DEBUG : /: Statfs: 
2020/09/29 20:09:51 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/29 20:09:51 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:09:51 DEBUG : /: >Getattr: errc=0
2020/09/29 20:09:51 DEBUG : /: Readlink: 
2020/09/29 20:09:51 DEBUG : /: >Readlink: linkPath="", errc=-40
The service rclone has been started.
2020/09/29 20:09:51 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:09:51 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:09:51 DEBUG : /: >Getattr: errc=0
2020/09/29 20:09:51 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:09:51 DEBUG : /: >Getattr: errc=0
2020/09/29 20:09:51 DEBUG : /: Opendir: 
2020/09/29 20:09:51 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:09:52 DEBUG : /: Statfs: 
2020/09/29 20:09:52 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/29 20:09:52 DEBUG : /: Releasedir: fh=0x0
2020/09/29 20:09:52 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:06 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:06 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:06 DEBUG : /: Opendir: 
2020/09/29 20:10:06 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:06 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:06 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/29 20:10:06 DEBUG : /: Releasedir: fh=0x0
2020/09/29 20:10:06 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:06 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:06 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f640): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f640): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f640): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f640): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f680): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f680): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f680): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f680): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x3
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x3
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f700): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x3
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f700): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f700): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f700): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f6c0): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f6c0): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f6c0): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f6c0): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f740): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f740): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f740): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f740): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f780): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f780): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f780): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc00028f780): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x2
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Getattr: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenEx: flags=0x0
2020/09/29 20:10:07 DEBUG : /10MB.zip: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:07 DEBUG : 10MB.zip: Open: flags=O_RDONLY
2020/09/29 20:10:07 DEBUG : 10MB.zip: newRWFileHandle: 
2020/09/29 20:10:07 DEBUG : 10MB.zip: >newRWFileHandle: err=<nil>
2020/09/29 20:10:07 DEBUG : 10MB.zip: >Open: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenFile: fd=10MB.zip (rw), err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >OpenEx: errc=0, fh=0x3
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x3
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc000064a00): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x3
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc000064a00): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc000064a00): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc000064a00): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Flush: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc0000649c0): RWFileHandle.Flush
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Flush: errc=0
2020/09/29 20:10:07 DEBUG : /10MB.zip: Release: fh=0x2
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc0000649c0): RWFileHandle.Release
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc0000649c0): close: 
2020/09/29 20:10:07 DEBUG : 10MB.zip(0xc0000649c0): >close: err=<nil>
2020/09/29 20:10:07 DEBUG : /10MB.zip: >Release: errc=0
2020/09/29 20:10:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:11 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:11 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:11 DEBUG : /: Opendir: 
2020/09/29 20:10:11 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:11 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:11 DEBUG : /: >Opendir: errc=0, fh=0x2
2020/09/29 20:10:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:11 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:11 DEBUG : /: Releasedir: fh=0x2
2020/09/29 20:10:11 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:11 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:11 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:11 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:11 DEBUG : /: Opendir: 
2020/09/29 20:10:11 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:11 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:11 DEBUG : /: >Opendir: errc=0, fh=0x2
2020/09/29 20:10:11 DEBUG : /: Releasedir: fh=0x2
2020/09/29 20:10:11 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:12 DEBUG : 10MB.zip: vfs cache: starting upload
2020/09/29 20:10:12 DEBUG : 10MB.zip: Successfully changed object tier to Archive
2020/09/29 20:10:12 DEBUG : 10MB.zip: MD5 = 3aa55f03c298b83cd7708e90d289afbd OK
2020/09/29 20:10:12 INFO  : 10MB.zip: Copied (new)
2020/09/29 20:10:12 DEBUG : 10MB.zip: vfs cache: fingerprint now "10485760,2020-09-29 20:00:15.5144199 +0000 UTC,3aa55f03c298b83cd7708e90d289afbd"
2020/09/29 20:10:12 DEBUG : 10MB.zip: vfs cache: writeback object to VFS layer
2020/09/29 20:10:12 ERROR : 10MB.zip: Failed to apply pending mod time 2020-09-29 20:00:15.5144199 +0000 GMT: -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, github.com/Azure/azure-storage-blob-go@v0.10.0/azblob/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=BlobArchived) =====
Description=This operation is not permitted on an archived blob.
RequestId:8df6336f-901e-0085-6a9c-96bc5f000000
Time:2020-09-29T20:10:12.8527675Z, Details: 
   Code: BlobArchived
   PUT https://teststorage5957655.blob.core.windows.net/container3/10MB.zip?comp=metadata&timeout=31536001
   Authorization: REDACTED
   User-Agent: [rclone/v1.53.1]
   X-Ms-Client-Request-Id: [0eabf946-da9b-4c40-7b49-e4cf58416872]
   X-Ms-Date: [Tue, 29 Sep 2020 20:10:12 GMT]
   X-Ms-Meta-Mtime: [2020-09-29T20:00:15.514419900Z]
   X-Ms-Version: [2019-02-02]
   --------------------------------------------------------------------------------
   RESPONSE Status: 409 This operation is not permitted on an archived blob.
   Content-Length: [233]
   Content-Type: [application/xml]
   Date: [Tue, 29 Sep 2020 20:10:12 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Client-Request-Id: [0eabf946-da9b-4c40-7b49-e4cf58416872]
   X-Ms-Error-Code: [BlobArchived]
   X-Ms-Request-Id: [8df6336f-901e-0085-6a9c-96bc5f000000]
   X-Ms-Version: [2019-02-02]


2020/09/29 20:10:12 DEBUG : : Added virtual directory entry vAdd: "10MB.zip"
2020/09/29 20:10:12 INFO  : 10MB.zip: vfs cache: upload succeeded try #1
2020/09/29 20:10:36 DEBUG : /: Opendir: 
2020/09/29 20:10:36 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:36 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:36 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/29 20:10:36 DEBUG : /: Statfs: 
2020/09/29 20:10:36 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/29 20:10:36 DEBUG : /: Releasedir: fh=0x0
2020/09/29 20:10:36 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:36 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:36 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:36 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:36 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:36 DEBUG : /: Opendir: 
2020/09/29 20:10:36 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:36 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:36 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/29 20:10:36 DEBUG : /: Releasedir: fh=0x0
2020/09/29 20:10:36 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:36 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:36 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:36 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/29 20:10:36 DEBUG : /: >Getattr: errc=0
2020/09/29 20:10:36 DEBUG : /: Opendir: 
2020/09/29 20:10:36 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/29 20:10:36 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/29 20:10:36 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/29 20:10:36 DEBUG : /: Releasedir: fh=0x0
2020/09/29 20:10:36 DEBUG : /: >Releasedir: errc=0
2020/09/29 20:10:51 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item 10MB.zip not removed, freed 0 bytes
2020/09/29 20:10:51 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 10M (was 0)
The service rclone has been stopped.
2020/09/29 20:11:44 DEBUG : Azure container container3: Destroy: 
2020/09/29 20:11:44 DEBUG : Azure container container3: >Destroy: 
2020/09/29 20:11:44 DEBUG : Calling host.Unmount
2020/09/29 20:11:44 DEBUG : host.Unmount failed
2020/09/29 20:11:44 DEBUG : vfs cache: cleaner exiting
2020/09/29 20:11:44 DEBUG : rclone: Version "v1.53.1" finishing with parameters ["C:\\rclone\\rclone.exe" "mount" "azure-container-1:container3" "X:" "--vfs-cache-mode" "full" "--log-level" "DEBUG" "--log-file=d:\\rclone\\log3.txt" "--no-modtime" "--fuse-flag" "--VolumePrefix=\\server\\share"]

Hmm. The --no-modtime flag is about not reading the modtime from the backend, not so much about setting it.

Probably the Azure blob backend needs to return that it can't set the modtime for archive tier.

If you just use rclone copy to upload to an archive tier blob, do you get the same error?

I use Azure blob storage for database backups from SQL Server. We don't use rclone for this, but instead use the native support SQL Server has for Azure blob storage.

anyway, we upload to the cool tier, and then after 30 days we tag the file and move it to the archive tier. At the time we set this up, it was not possible to upload directly to the archive tier. Also, if you pull a file back from archive tier there is a significant 'rehydration' cost. I would suggest that you explore uploading to hot or cool and then with a serverless solution move the files to archive after some time.

there is a 30 day minimum on cool tier also - so we keep our backups in cool tier for 30 days and then move to archive to avoid additional charges.

Interestingly, I tried the copy function, and it didn't give the same error.

One of the things I have noticed with "mount" option, that it's uses the Azure's SetBlobMetadata API. Prehaps, we can have a flag under rclone's AzureBlob option, something like --skip-set-blobmetadata?

Logs from copy function (very straight forward, don't see any issue):

2020/09/30 11:58:13 DEBUG : rclone: Version "v1.53.1" starting with parameters ["C:\\rclone\\rclone.exe" "copy" "C:\\Users\\specterz\\Desktop\\1GB-1.zip" "azure-container-1:container1" "--log-level" "DEBUG" "--log-file=c:\\rclone\\log8.txt"]
        2020/09/30 11:58:13 DEBUG : Creating backend with remote "C:\\Users\\specterz\\Desktop\\1GB-1.zip"
        2020/09/30 11:58:13 DEBUG : Using config file from "C:\\Users\\specterz\\.config\\rclone\\rclone.conf"
        2020/09/30 11:58:13 DEBUG : fs cache: adding new entry for parent of "C:\\Users\\specterz\\Desktop\\1GB-1.zip", "//?/C:/Users/specterz/Desktop"
        2020/09/30 11:58:13 DEBUG : Creating backend with remote "azure-container-1:container1"
        2020/09/30 11:58:13 DEBUG : 1GB-1.zip: Need to transfer - File not found at Destination
        2020/09/30 11:59:13 INFO  : 
        Transferred:   	         0 / 1 GBytes, 0%, 0 Bytes/s, ETA -
        Transferred:            0 / 1, 0%
        Elapsed time:       1m0.1s
        Transferring:
         *                                     1GB-1.zip:  0% /1G, 0/s, -

2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Multipart upload session started for 256 parts of size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 1/256 offset 0/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 2/256 offset 4M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 3/256 offset 8M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 4/256 offset 12M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 5/256 offset 16M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 6/256 offset 20M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 7/256 offset 24M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 8/256 offset 28M/1G part size 4M
2020/09/30 12:00:06 DEBUG : 1GB-1.zip: Uploading part 9/256 offset 32M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 10/256 offset 36M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 11/256 offset 40M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 12/256 offset 44M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 13/256 offset 48M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 14/256 offset 52M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 15/256 offset 56M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 16/256 offset 60M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 17/256 offset 64M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 18/256 offset 68M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 19/256 offset 72M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 20/256 offset 76M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 21/256 offset 80M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 22/256 offset 84M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 23/256 offset 88M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 24/256 offset 92M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 25/256 offset 96M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 26/256 offset 100M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 27/256 offset 104M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 28/256 offset 108M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 29/256 offset 112M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 30/256 offset 116M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 31/256 offset 120M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 32/256 offset 124M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 33/256 offset 128M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 34/256 offset 132M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 35/256 offset 136M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 36/256 offset 140M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 37/256 offset 144M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 38/256 offset 148M/1G part size 4M
2020/09/30 12:00:07 DEBUG : 1GB-1.zip: Uploading part 39/256 offset 152M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 40/256 offset 156M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 41/256 offset 160M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 42/256 offset 164M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 43/256 offset 168M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 44/256 offset 172M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 45/256 offset 176M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 46/256 offset 180M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 47/256 offset 184M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 48/256 offset 188M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 49/256 offset 192M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 50/256 offset 196M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 51/256 offset 200M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 52/256 offset 204M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 53/256 offset 208M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 54/256 offset 212M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 55/256 offset 216M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 56/256 offset 220M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 57/256 offset 224M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 58/256 offset 228M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 59/256 offset 232M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 60/256 offset 236M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 61/256 offset 240M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 62/256 offset 244M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 63/256 offset 248M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 64/256 offset 252M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 65/256 offset 256M/1G part size 4M
2020/09/30 12:00:08 DEBUG : 1GB-1.zip: Uploading part 66/256 offset 260M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 67/256 offset 264M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 68/256 offset 268M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 69/256 offset 272M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 70/256 offset 276M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 71/256 offset 280M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 72/256 offset 284M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 73/256 offset 288M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 74/256 offset 292M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 75/256 offset 296M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 76/256 offset 300M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 77/256 offset 304M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 78/256 offset 308M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 79/256 offset 312M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 80/256 offset 316M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 81/256 offset 320M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 82/256 offset 324M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 83/256 offset 328M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 84/256 offset 332M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 85/256 offset 336M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 86/256 offset 340M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 87/256 offset 344M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 88/256 offset 348M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 89/256 offset 352M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 90/256 offset 356M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 91/256 offset 360M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 92/256 offset 364M/1G part size 4M
2020/09/30 12:00:09 DEBUG : 1GB-1.zip: Uploading part 93/256 offset 368M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 94/256 offset 372M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 95/256 offset 376M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 96/256 offset 380M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 97/256 offset 384M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 98/256 offset 388M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 99/256 offset 392M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 100/256 offset 396M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 101/256 offset 400M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 102/256 offset 404M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 103/256 offset 408M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 104/256 offset 412M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 105/256 offset 416M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 106/256 offset 420M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 107/256 offset 424M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 108/256 offset 428M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 109/256 offset 432M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 110/256 offset 436M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 111/256 offset 440M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 112/256 offset 444M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 113/256 offset 448M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 114/256 offset 452M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 115/256 offset 456M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 116/256 offset 460M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 117/256 offset 464M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 118/256 offset 468M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 119/256 offset 472M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 120/256 offset 476M/1G part size 4M
2020/09/30 12:00:10 DEBUG : 1GB-1.zip: Uploading part 121/256 offset 480M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 122/256 offset 484M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 123/256 offset 488M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 124/256 offset 492M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 125/256 offset 496M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 126/256 offset 500M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 127/256 offset 504M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 128/256 offset 508M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 129/256 offset 512M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 130/256 offset 516M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 131/256 offset 520M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 132/256 offset 524M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 133/256 offset 528M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 134/256 offset 532M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 135/256 offset 536M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 136/256 offset 540M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 137/256 offset 544M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 138/256 offset 548M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 139/256 offset 552M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 140/256 offset 556M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 141/256 offset 560M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 142/256 offset 564M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 143/256 offset 568M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 144/256 offset 572M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 145/256 offset 576M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 146/256 offset 580M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 147/256 offset 584M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 148/256 offset 588M/1G part size 4M
2020/09/30 12:00:11 DEBUG : 1GB-1.zip: Uploading part 149/256 offset 592M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 150/256 offset 596M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 151/256 offset 600M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 152/256 offset 604M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 153/256 offset 608M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 154/256 offset 612M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 155/256 offset 616M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 156/256 offset 620M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 157/256 offset 624M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 158/256 offset 628M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 159/256 offset 632M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 160/256 offset 636M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 161/256 offset 640M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 162/256 offset 644M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 163/256 offset 648M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 164/256 offset 652M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 165/256 offset 656M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 166/256 offset 660M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 167/256 offset 664M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 168/256 offset 668M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 169/256 offset 672M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 170/256 offset 676M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 171/256 offset 680M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 172/256 offset 684M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 173/256 offset 688M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 174/256 offset 692M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 175/256 offset 696M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 176/256 offset 700M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 177/256 offset 704M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 178/256 offset 708M/1G part size 4M
2020/09/30 12:00:12 DEBUG : 1GB-1.zip: Uploading part 179/256 offset 712M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 180/256 offset 716M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 181/256 offset 720M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 182/256 offset 724M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 183/256 offset 728M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 184/256 offset 732M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 185/256 offset 736M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 186/256 offset 740M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 187/256 offset 744M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 188/256 offset 748M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 189/256 offset 752M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 190/256 offset 756M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 191/256 offset 760M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 192/256 offset 764M/1G part size 4M
2020/09/30 12:00:13 INFO  : 
Transferred:   	  766.781M / 1 GBytes, 75%, 6.395 MBytes/s, ETA 40s
Transferred:            0 / 1, 0%
Elapsed time:       2m0.1s
Transferring:
 *                                     1GB-1.zip: 74% /1G, 35.632M/s, 7s

2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 193/256 offset 768M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 194/256 offset 772M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 195/256 offset 776M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 196/256 offset 780M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 197/256 offset 784M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 198/256 offset 788M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 199/256 offset 792M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 200/256 offset 796M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 201/256 offset 800M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 202/256 offset 804M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 203/256 offset 808M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 204/256 offset 812M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 205/256 offset 816M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 206/256 offset 820M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 207/256 offset 824M/1G part size 4M
2020/09/30 12:00:13 DEBUG : 1GB-1.zip: Uploading part 208/256 offset 828M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 209/256 offset 832M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 210/256 offset 836M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 211/256 offset 840M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 212/256 offset 844M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 213/256 offset 848M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 214/256 offset 852M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 215/256 offset 856M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 216/256 offset 860M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 217/256 offset 864M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 218/256 offset 868M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 219/256 offset 872M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 220/256 offset 876M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 221/256 offset 880M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 222/256 offset 884M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 223/256 offset 888M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 224/256 offset 892M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 225/256 offset 896M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 226/256 offset 900M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 227/256 offset 904M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 228/256 offset 908M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 229/256 offset 912M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 230/256 offset 916M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 231/256 offset 920M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 232/256 offset 924M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 233/256 offset 928M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 234/256 offset 932M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 235/256 offset 936M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 236/256 offset 940M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 237/256 offset 944M/1G part size 4M
2020/09/30 12:00:14 DEBUG : 1GB-1.zip: Uploading part 238/256 offset 948M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 239/256 offset 952M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 240/256 offset 956M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 241/256 offset 960M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 242/256 offset 964M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 243/256 offset 968M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 244/256 offset 972M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 245/256 offset 976M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 246/256 offset 980M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 247/256 offset 984M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 248/256 offset 988M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 249/256 offset 992M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 250/256 offset 996M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 251/256 offset 1000M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 252/256 offset 1004M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 253/256 offset 1008M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 254/256 offset 1012M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 255/256 offset 1016M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Uploading part 256/256 offset 1020M/1G part size 4M
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: Successfully changed object tier to Archive
2020/09/30 12:00:15 DEBUG : 1GB-1.zip: MD5 = 286e80b3b7420263038ab06d76774043 OK
2020/09/30 12:00:15 INFO  : 1GB-1.zip: Copied (new)
2020/09/30 12:00:15 INFO  : 
Transferred:   	        1G / 1 GBytes, 100%, 8.376 MBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:       2m2.4s

2020/09/30 12:00:15 DEBUG : 10 go routines active

That is on way of solving the problem. With the amount of video logs traffic I have, will have to compare the cost b/w cold and archive tier.

Also, does Azure charges to move data from "Cool" to "Archive" Tier? Apart from Serverless function.

OK that is good.

I just read the docs... it shouldn't be setting the modtime. So this is a bug!

--no-modtime      Don't read/write the modification time (can speed things up)

Can you try this please with the mount?

v1.54.0-beta.4794.fa85a24b8.fix-vfs-no-modtime on branch fix-vfs-no-modtime (uploaded in 15-30 mins)

I did try this version, and indeed it fixed the issue. I no longer see the modtime error in logs, infact no errors at all. :slight_smile: Thanks very much for this quick fix.

Just a suggestion, A note next to the --azureblob-access-tier flag under Azureblob rclone page, advising user to use --no-modtime flag to prevent this error.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.

Thanks for testing!

I've merged this to master now which means it will be in the latest beta in 15-30 mins and released in v1.53.2

1 Like