I'm using rClone to sync my NAS to a Storage Server (20TB storage server maximum) so I have 5x20TB, each storage server is accessible by ssh, webdav or samba so I created 5 configurations for each and used rClone Union to upload all my files to all of them BUT it seem's that rClone or Union protocol can't get the quota of my storage server as I get the same errorserrors :
"Failed to copy: 1 error: HetznerCloud: mkdir "/xxx/xxx.xxx" failed: sftp: "Quota exceeded" (SSH_FX_FAILURE)"
Run the command 'rclone version' and share the full output of the command.
rclone v1.67.0
os/version: qts 5.2.0 (64 bit)
os/kernel: 5.10.60-qnap (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.22.4
go/linking: static
go/tags: none
I know that it's not the latest version but I don't think it's related to version of rClone, I just don't know how to set manually the limit as all my storage servers have the same size.
Which cloud storage system are you using? (eg Google Drive)
Hetzner Storage Server
The command you were trying to run (eg rclone copy /tmp remote:tmp)
I tried to do the exact same command using Windows PowerShell connecting throught SSH to my NAS and ran the command without any issues. But when running it from my Raspberry Pi, I get theses errors, very strange and so it's not a rClone issue anymore I think !
Hash is not used for transfer but for validation if two files are the same - for example source and destination to check if nothing was corrupted during transfers.
well, after rclone completes the transfer a file, rclone can compute and compare the hash of the dest file and compare it to the hash of the source file.
those are the command, on the dest server, that computes the hash.
you can find those values from the debug log.
I'm now using the @asdffdsa configuration with port 23 and it seems to be better as I get less errors but I still get some and the files with theses errors are not uploaded at all on the remote (except some with "Bad message") :
And last thing after running the command I get "Failed to sync with 933 errors: last error was: failed to set directory modtime: 173 errors: last error: 3 errors: Hetzner2Encrypted: SetModTime failed: sftp: "Failure" (SSH_FX_FAILURE); Hetzner1Encrypted: SetModTime failed: sftp: "Failure" (SSH_FX_FAILURE); HetznerEncrypted: SetModTime failed: sftp: "Failure" (SSH_FX_FAILURE)"
I'm talking alone I know but I really need help as I'm stuck and I want to help other people in my case so I write all my findings.
After searching more informations on the forum I've seen that maybe it can be a storage space issue so just to remind the configuration, now I have 6 Hetzner Storage Box (Hetzner:, Hetzner1:, ..., Hetzner5:).
I configure them on rClone using SFTP on port 23 then I use encrypt to encrypt all files on Hetzner (HetznerEncrypt:, Hetzner1Encrypt:, ..., Hetzner5Encrypt:).
Because of all theses Storage Boxes, I use rClone Union to get something that looks like 1 Storage (HetznerCloud) so I have this :
Unfortunately it is not obvious for me what the issue is.
First you can try some simple tweaks - do not use IPV6 (often causes problems) and lower number of connections (Hetzner allows only 10). Add --bind 0.0.0.0 --checkers 2 --transfers 2.
If it fails then you have to try to isolate what is causing the issue. Stop using union. Test sync with every single Hetzenr account - maybe one is misconfigured (wrong user, wrong permissions)?
Hetzner is not some exotic provider and there are multiple users here using it without any issues (or we would see more issues similar to yours). It points into your setup specific thing.
I tried to do with the options you sent me, same issue.
All my accounts are working fine as I tested all rclone ls HetznerX and rclone ls HetznerXEncrypted, they show me my files.
I can't try to sync each Hetzner account as all the Hetzner are full except the last one (Hetzner5):
I contacted Hetzner about the issue and they told me that maybe it's because the Storage Box is full and maybe creating the error but I can't get it as Union should be doing the job and send the files to the one that is not right ?
I'm in the same case as you, I just don't understand why, I sent 100To days before using Union but the few last datas that I need to send are making me crazy.
All good when I sync to the Hetzner5Encrypted : Logs · GitHub
Theses exact same files are in Failed status when using Union.
If I'm right, Snapshot are included in quotas but should be seen by the rclone about if activated on Hetzner panel, I just don't use it (and no snapshot created) :
Default union's create policy is epmfs which means that new content is written to a remote where the path already exist. Which is not necessary remote with the most free space (it was when it was written first time to a new path).
Default epmfs works only when content is nicely distributed between many dirs in root. E.g. some backup software using files sharding. IMO it is not the best choice for default. But it is too late to change it as it would break many people's setup (even I am sure that most do not even realise that what they've got is not what they wanted).