Slow Upload Speed (Crypt+WebDav(Nextcloud)

What is the problem you are having with rclone?

I have very slow Upload Speeds when using WebDav(NextCloud) + Crypt Module.
I use it to upload my Backup Encrypted.
But i only get about 11 kBytes which is very, very slow.

What is your rclone version (output from rclone version)

rclone v1.52.3

  • os/arch: windows/amd64
  • go version: go1.14.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10 x64

Which cloud storage system are you using? (eg Google Drive)

WebDav(NextCloud) and Crypt

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone --progress --checkers="50" --transfers="20" --exclude-from=$ExcludeFilePath copy x:Path crypt:Backup\Path

(in powershell)

The rclone config contents with secrets removed.

[crypt]
type = crypt
remote = nextcloud:
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
directory_name_encryption = false

and

[nextcloud]
type = webdav
url = https://nextcloudlink/remote.php/webdav/
vendor = nextcloud
user = [EMAIL]
pass = *** ENCRYPTED ***

A log from the command with the -vv flag

2020/09/08 22:05:24 DEBUG : rclone: Version "v1.52.3" starting with parameters ["W:\\Programs\\rclone-v1.52.3-windows-amd64\\rclone.exe" "-vv" "--checkers=50" "--transfers=20" "--log-file=C:\\Users\\User\\Desktop\\log.txt" "--exclude-from=W:\\Files\\AutoStartSkripts\\rclone-Backup\\exclude-file.txt" "sync" "C:\\Users\\user\\Downloads\\TreeSizeFree-Portable\\" "crypt:Test"]
2020/09/08 22:05:25 DEBUG : Using config file from "C:\\Users\\user\\.config\\rclone\\rclone.conf"
2020/09/08 22:05:25 DEBUG : fs cache: renaming cache item "C:\\Users\\user\\Downloads\\TreeSizeFree-Portable\\" to be canonical "//?/C:/Users/user/Downloads/TreeSizeFree-Portable/"
2020/09/08 22:05:27 DEBUG : Encrypted drive 'crypt:Test': Waiting for checks to finish
2020/09/08 22:05:27 DEBUG : Encrypted drive 'crypt:Test': Waiting for transfers to finish
2020/09/08 22:05:28 DEBUG : TreeSizeFree.exe: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:28 DEBUG : RibbonOptions.xml: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:28 DEBUG : GlobalOptions.bak0.xml: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:28 DEBUG : TreeSizeFree_DE.chm: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:28 DEBUG : TreeSizeFree.chm: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:28 DEBUG : GlobalOptions.xml: Computing SHA-1 hash of encrypted source
2020/09/08 22:05:30 INFO  : GlobalOptions.bak0.xml: Copied (new)
2020/09/08 22:05:30 INFO  : RibbonOptions.xml: Copied (new)
2020/09/08 22:05:30 INFO  : TreeSizeFree_DE.chm: Copied (new)
2020/09/08 22:05:30 INFO  : GlobalOptions.xml: Copied (new)
2020/09/08 22:05:31 INFO  : TreeSizeFree.chm: Copied (new)
2020/09/08 22:05:36 INFO  : TreeSizeFree.exe: Copied (new)
2020/09/08 22:05:36 DEBUG : Waiting for deletions to finish
2020/09/08 22:05:36 INFO  : 
Transferred:   	    8.534M / 8.534 MBytes, 100%, 1.003 MBytes/s, ETA 0s
Transferred:            6 / 6, 100%
Elapsed time:         8.5s

2020/09/08 22:05:36 DEBUG : 3 go routines active

At this test i get higher speed for some reason....

Here is the complete Powershell Skript if you want a look at it. ( i am not very good at skripting xD)


#region config
$Date = Get-Date -Format dd.MM.yyyy
$ExcludeFilePath = "W:\Files\AutoStartSkripts\rclone-Backup\exclude-file.txt"
#endregion config

function main {
    $UploadLocations = @("Files", "PWDB", "Monero", "Users", "Handy\Upload")
    $DownloadLocations = @("Handy\Download")
    $Locations = $DownloadLocations + $UploadLocations
    #Get-WmiObject Win32_process -filter 'name = "powershell.exe"' | foreach-object { $_.SetPriority(256) }
    #Get-WmiObject Win32_process -filter 'name = "rclone.exe"' | foreach-object { $_.SetPriority(256) }
    foreach ($Location in $UploadLocations) {
        Invoke-Copy -Path $Location
    }
    foreach ($Location in $DownloadLocations) {
        Invoke-Download -Path $Location
    }
    foreach($Location in $Locations){
    Invoke-Backup -Path $Location
    }
}

#region functions
function Invoke-Copy($Path) {
    Clear-Host
    $host.ui.RawUI.WindowTitle = "$Path upload"
    Write-Output "$Path Upload"
    rclone --progress --checkers="50" --transfers="20" --exclude-from=$ExcludeFilePath sync x:$Path crypt:Backup\"$Path"
}
function Invoke-Download($Path) {
    Clear-Host
    $host.ui.RawUI.WindowTitle = "$Path download"
    rclone --progress --checkers="50" --transfers="20" copy crypt:Backup\"$Path" x:$Path
}
function Invoke-Backup($Path) {
    Clear-Host
    $host.ui.RawUI.WindowTitle = "Backing Up..."
    ssh -i C:\Users\user\.ssh\150opssh "pi@192.168.178.150" rclone --progress --checkers="50" --transfers="12" --password-command="sudo cat /root/pw.txt" -v copy crypt: nextcloud:$Date > ~/rclone.log
}
#endregion functions


main
[Environment]::Exit(0)

You might want to try a few less --transfers sometimes it is counter productive to have too many especially if you have a spinny disk.

Can you show a debug log where it is going wrong? There might be more in it?

Hello, i already tryed less / more transfers.
I am trying to get more logs as fast as i can.
I also get something like a html code returned sometimes. I´ll try to post that here too.
I am Uploading about 40MB right now and then i will post the log here. (if its not to big)

Here is the log of a 39MB Upload

https://anonfiles.com/xbX8paT9oa/rclone_log

I hope its ok that i Uploaded it there but it was too big for Pastebin and the forum.

You are getting HTML errors like this in the log

<title>Requested page locked - Storage Share - Hetzner Online GmbH</title>

Which probably indicates you are overloading the storage or it is rate limiting you.

I'd try cutting --transfers right back to --transfers 4 and --checkers 4 also and see if that helps.

Can you try an upload from somewhere else - maybe you have a VPS or dedicated server you could try from?

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.