Dear All,
I’m trying to rclone from google drive to adrive …( making backup )
but i found that always received error
Failed to copy: Update mkParentDir failed: 400 Bad request
but some file able to transfer to adrive without issue , how to get this fix ?
Could you post the full rclone command being used, more of the logs (preferably with -v as a command flag) and some more information about what’s being copied?
Thanks for your reply,
my command is
rclone -v sync vpsping: adrive: --log-file=123.log
after checking 123.log
it showing following error
P.S i’m trying to backup my team drive to adrive ( webdav) , also for google drive, i’m able download those file via drive.google.com
2018/04/02 19:14:52 NOTICE: unlimited/123/123/IMG_1134.JPG: Duplicate object found in source - ignoring
2018/04/02 19:14:52 NOTICE: unlimited/123/123/IMG_1855.JPG: Duplicate object found in source - ignoring
2018/04/02 19:14:52 NOTICE: unlimited/123/123/IMG_2599.JPG: Duplicate object found in source - ignoring
2018/04/02 19:14:54 ERROR : unlimited/abc.mkv: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:54 ERROR : unlimited/234.mkv: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:54 ERROR : unlimited/peter.mkv: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:55 ERROR : unlimited/my.Series.extra.2.-.Incubo.avi: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:55 ERROR : unlimited/now.avi: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:55 ERROR : unlimited/we.avi: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:55 ERROR : unlimited/h6.avi: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:56 ERROR : unlimited/may.avi: Failed to copy: Update mkParentDir failed: 400 Bad request
2018/04/02 19:14:56 ERROR : unlimited/software.exe: Failed to copy: Update mkParentDir failed: 400 Bad
some more information about what’s being copied? <
i have stored film / video / software in google drive long time ago, trying to backup to somewhere else.
Thanks
Not sure exactly what is going on there. It looks like some webdav oddness.
I made a free adrive account and what seems to be happening is that when rclone makes a folder, it doesn’t appear to become ready for a minute or two - after that then rclone can upload to it fine. I emailled support about it.
In the mean time I note that adrive also support SFTP which rclone has a backend for - that may work better?
Thanks for your suggestion, i have tried to use SFTP or FTP …it is same…
also the remove is not working either…
IE, google drive removed the folder…but adrive not remove that folder too…
What errors did you get with SFTP?
By the way, i have order another cloud in onedrive…
i found that if transfer lot of files/data ( around 3TB in google drive ) it will use lot of ram…i have tried to do the research, none is working…
Now, i have tried in windows here is my command
i have tried to set the transfers and checkers to 1, all the same, i have 2GB on the windows server ( only rclone running )
C:\Users\Administrator\Downloads\rclone-v1.40-windows-amd64\rclone-v1.40-windows
-amd64>rclone -vv sync googledrive: onedrive: --transfers=3 --checkers=3 --drive-chunk
-size 256K --bwlimit=5000
d, 0xc0e3e11b98, 0x42cef0)
C:/go/src/net/http/transport.go:1453 +0x13d
bufio.(*Reader).fill(0xc053543b60)
C:/go/src/bufio/bufio.go:100 +0x125
bufio.(*Reader).Peek(0xc053543b60, 0x1, 0xc07a927bc0, 0xc0e3e11c80, 0xc116bdd1b8
, 0xc0e3e11d98, 0xc0e3e11d68)
C:/go/src/bufio/bufio.go:132 +0x41
net/http.(*persistConn).readLoop(0xc0e4581560)
C:/go/src/net/http/transport.go:1601 +0x18c
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5587 [select]:
net/http.(*persistConn).readLoop(0xc0a2639680)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5675 [IO wait]:
internal/poll.runtime_pollWait(0x4bd0e28, 0x72, 0x1065a40)
C:/go/src/runtime/netpoll.go:173 +0x5e
internal/poll.(*pollDesc).wait(0xc086069508, 0x72, 0x1565500, 0x0, 0x0)
C:/go/src/internal/poll/fd_poll_runtime.go:85 +0xa2
internal/poll.(*ioSrv).ExecIO(0x15d0258, 0xc086069358, 0xfc7358, 0xd5a79147c6e00
bf3, 0x1429296706ca6351, 0x0)
C:/go/src/internal/poll/fd_windows.go:223 +0x13a
internal/poll.(*FD).Read(0xc086069340, 0xc116bde400, 0x400, 0x400, 0x0, 0x0, 0x0
)
C:/go/src/internal/poll/fd_windows.go:484 +0x248
net.(*netFD).Read(0xc086069340, 0xc116bde400, 0x400, 0x400, 0xc05c52f500, 0x199,
0xc05c52f500)
C:/go/src/net/fd_windows.go:151 +0x56
net.(*conn).Read(0xc0420047d8, 0xc116bde400, 0x400, 0x400, 0x0, 0x0, 0x0)
C:/go/src/net/net.go:176 +0x71
net.(Conn).Read-fm(0xc116bde400, 0x400, 0x400, 0x300, 0xebef20, 0x1)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:84 +0x54
github.com/ncw/rclone/fs/fshttp.(*timeoutConn).readOrWrite(0xc0975bfb40, 0xc0e3e
13858, 0xc116bde400, 0x400, 0x400, 0xd5b, 0x0, 0xc0e3e13880)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:72 +0x4f
github.com/ncw/rclone/fs/fshttp.(*timeoutConn).Read(0xc0975bfb40, 0xc116bde400,
0x400, 0x400, 0xeea920, 0x0, 0x3c1478)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:84 +0x89
crypto/tls.(*block).readFromUntil(0xc088d57f80, 0x3c1478, 0xc0975bfb40, 0x5, 0xc
0975bfb40, 0xc086069340)
C:/go/src/crypto/tls/conn.go:493 +0x9d
crypto/tls.(*Conn).readRecord(0xc117a63880, 0xfc7d17, 0xc117a639a0, 0xfd7294e1cf
619138)
C:/go/src/crypto/tls/conn.go:595 +0xe7
crypto/tls.(*Conn).Read(0xc117a63880, 0xc0c0113000, 0x1000, 0x1000, 0x0, 0x0, 0x
0)
C:/go/src/crypto/tls/conn.go:1156 +0x107
net/http.(*persistConn).Read(0xc0e4580ea0, 0xc0c0113000, 0x1000, 0x1000, 0x40497
d, 0xc0e3e13b98, 0x42cef0)
C:/go/src/net/http/transport.go:1453 +0x13d
bufio.(*Reader).fill(0xc05d8a5020)
C:/go/src/bufio/bufio.go:100 +0x125
bufio.(*Reader).Peek(0xc05d8a5020, 0x1, 0xc07a927a40, 0xc0e3e13c80, 0x1756b2d577
433da7, 0x6f43f5a5fe46d207, 0xa4506ceb90befffa)
C:/go/src/bufio/bufio.go:132 +0x41
net/http.(*persistConn).readLoop(0xc0e4580ea0)
C:/go/src/net/http/transport.go:1601 +0x18c
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5619 [select]:
net/http.(*persistConn).writeLoop(0xc07eb0b320)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5611 [select]:
net/http.(*persistConn).writeLoop(0xc0a2639e60)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5627 [select]:
net/http.(*persistConn).writeLoop(0xc07eb0b8c0)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5618 [select]:
net/http.(*persistConn).readLoop(0xc07eb0b320)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5626 [select]:
net/http.(*persistConn).readLoop(0xc07eb0b8c0)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5640 [select]:
net/http.(*persistConn).writeLoop(0xc0df768ea0)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5631 [select]:
net/http.(*persistConn).readLoop(0xc086066fc0)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5632 [select]:
net/http.(*persistConn).writeLoop(0xc086066fc0)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5683 [select]:
net/http.(*persistConn).readLoop(0xc0df769c20)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5639 [select]:
net/http.(*persistConn).readLoop(0xc0df768ea0)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5684 [select]:
net/http.(*persistConn).writeLoop(0xc0df769c20)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5714 [runnable]:
github.com/ncw/rclone/vendor/golang.org/x/time/rate.(*Limiter).waitN(0xc0422be23
0, 0x3c00c0, 0xc042072140, 0x1000, 0x0, 0x0)
C:/gopath/src/github.com/ncw/rclone/vendor/golang.org/x/time/rate/rate.g
o:259 +0x2e0
github.com/ncw/rclone/vendor/golang.org/x/time/rate.(*Limiter).WaitN(0xc0422be23
0, 0x106cd40, 0xc042072140, 0x1000, 0xc04fced868, 0x75e9f2)
C:/gopath/src/github.com/ncw/rclone/vendor/golang.org/x/time/rate/rate_g
o17.go:20 +0x74
github.com/ncw/rclone/fs/accounting.limitBandwidth(0x1000)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/token_bucket.go:109 +0
x89
github.com/ncw/rclone/fs/accounting.(*Account).read(0xc04212de00, 0x1063280, 0xc
0422631f0, 0xc0d58e4000, 0x1000, 0x1000, 0x10, 0xc116bdcf00, 0xfc5728)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/accounting.go:151 +0x1
99
github.com/ncw/rclone/fs/accounting.(*Account).Read(0xc04212de00, 0xc0d58e4000,
0x1000, 0x1000, 0x0, 0x0, 0x0)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/accounting.go:159 +0xb
0
io.(*LimitedReader).Read(0xc067c650a0, 0xc0d58e4000, 0x1000, 0x1000, 0x18, 0xc11
6bdcf00, 0xfc7d58)
C:/go/src/io/io.go:446 +0x6a
github.com/ncw/rclone/lib/readers.(*RepeatableReader).Read(0xc0967a20f0, 0xc0d58
e4000, 0x1000, 0x1000, 0xc0d716a560, 0xc0d716a550, 0xc04fcedaa0)
C:/gopath/src/github.com/ncw/rclone/lib/readers/repeatable.go:51 +0x11a
net/http.transferBodyReader.Read(0xc0975de5a0, 0xc0d58e4000, 0x1000, 0x1000, 0x1
000, 0x0, 0xc0b9afa4c8)
C:/go/src/net/http/transfer.go:60 +0x5d
io.(*LimitedReader).Read(0xc067c652e0, 0xc0d58e4000, 0x1000, 0x1000, 0x1000, 0x0
, 0x0)
C:/go/src/io/io.go:446 +0x6a
bufio.(*Writer).ReadFrom(0xc0b9afa4c0, 0x1063c80, 0xc067c652e0, 0x3cb100, 0xc0b9
afa4c0, 0x1)
C:/go/src/bufio/bufio.go:703 +0xd4
io.copyBuffer(0x1062d80, 0xc0b9afa4c0, 0x1063c80, 0xc067c652e0, 0x0, 0x0, 0x0, 0
xe75c00, 0xc0a9ff2601, 0xc067c652e0)
C:/go/src/io/io.go:386 +0x321
io.Copy(0x1062d80, 0xc0b9afa4c0, 0x1063c80, 0xc067c652e0, 0xc0d58e4b63, 0xf72cba
, 0x2)
C:/go/src/io/io.go:362 +0x61
net/http.(*transferWriter).WriteBody(0xc0975de5a0, 0x1062d80, 0xc0b9afa4c0, 0x2,
0x2)
C:/go/src/net/http/transfer.go:337 +0x601
net/http.(*Request).write(0xc0e58ee500, 0x1062d80, 0xc0b9afa4c0, 0x0, 0xc0967a27
b0, 0x0, 0x0, 0x0)
C:/go/src/net/http/request.go:622 +0x6b9
net/http.(*persistConn).writeLoop(0xc0e4581560)
C:/go/src/net/http/transport.go:1825 +0x1f1
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5691 [select]:
net/http.(*persistConn).readLoop(0xc0e58fa360)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5692 [select]:
net/http.(*persistConn).writeLoop(0xc0e58fa360)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5676 [semacquire]:
sync.runtime_SemacquireMutex(0x15f1a0c, 0xc0ca863800)
C:/go/src/runtime/sema.go:71 +0x44
sync.(*Mutex).Lock(0x15f1a08)
C:/go/src/sync/mutex.go:134 +0x10f
github.com/ncw/rclone/fs/accounting.limitBandwidth(0x1000)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/token_bucket.go:105 +0
x38
github.com/ncw/rclone/fs/accounting.(*Account).read(0xc04212cfc0, 0x1063280, 0xc
042262700, 0xc0d715e000, 0x1000, 0x1000, 0x10, 0xc116bdd980, 0xfc5728)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/accounting.go:151 +0x1
99
github.com/ncw/rclone/fs/accounting.(*Account).Read(0xc04212cfc0, 0xc0d715e000,
0x1000, 0x1000, 0x0, 0x0, 0x0)
C:/gopath/src/github.com/ncw/rclone/fs/accounting/accounting.go:159 +0xb
0
io.(*LimitedReader).Read(0xc05d89cf60, 0xc0d715e000, 0x1000, 0x1000, 0x18, 0xc11
6bdd980, 0xfc7d58)
C:/go/src/io/io.go:446 +0x6a
github.com/ncw/rclone/lib/readers.(*RepeatableReader).Read(0xc088d56540, 0xc0d71
5e000, 0x1000, 0x1000, 0xc117a63a60, 0xc117a63a50, 0xc0ca863aa0)
C:/gopath/src/github.com/ncw/rclone/lib/readers/repeatable.go:51 +0x11a
net/http.transferBodyReader.Read(0xc0975de500, 0xc0d715e000, 0x1000, 0x1000, 0x1
000, 0x0, 0xc0b9afa308)
C:/go/src/net/http/transfer.go:60 +0x5d
io.(*LimitedReader).Read(0xc0d71699e0, 0xc0d715e000, 0x1000, 0x1000, 0x1000, 0x0
, 0x0)
C:/go/src/io/io.go:446 +0x6a
bufio.(*Writer).ReadFrom(0xc0b9afa300, 0x1063c80, 0xc0d71699e0, 0x3cb100, 0xc0b9
afa300, 0x1)
C:/go/src/bufio/bufio.go:703 +0xd4
io.copyBuffer(0x1062d80, 0xc0b9afa300, 0x1063c80, 0xc0d71699e0, 0x0, 0x0, 0x0, 0
xe75c00, 0xc0a9ff2401, 0xc0d71699e0)
C:/go/src/io/io.go:386 +0x321
io.Copy(0x1062d80, 0xc0b9afa300, 0x1063c80, 0xc0d71699e0, 0xc0d715eb62, 0xf72cba
, 0x2)
C:/go/src/io/io.go:362 +0x61
net/http.(*transferWriter).WriteBody(0xc0975de500, 0x1062d80, 0xc0b9afa300, 0x2,
0x2)
C:/go/src/net/http/transfer.go:337 +0x601
net/http.(*Request).write(0xc0e58ee100, 0x1062d80, 0xc0b9afa300, 0x0, 0xc0967a20
60, 0x0, 0x0, 0x0)
C:/go/src/net/http/request.go:622 +0x6b9
net/http.(*persistConn).writeLoop(0xc0e4580ea0)
C:/go/src/net/http/transport.go:1825 +0x1f1
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5699 [select]:
net/http.(*persistConn).readLoop(0xc0e58fa900)
C:/go/src/net/http/transport.go:1717 +0x74a
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
goroutine 5700 [select]:
net/http.(*persistConn).writeLoop(0xc0e58fa900)
C:/go/src/net/http/transport.go:1822 +0x152
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1238 +0x986
goroutine 5707 [IO wait]:
internal/poll.runtime_pollWait(0x4bd0ef8, 0x72, 0x1065a40)
C:/go/src/runtime/netpoll.go:173 +0x5e
internal/poll.(*pollDesc).wait(0xc0debcf7c8, 0x72, 0x1565500, 0x0, 0x0)
C:/go/src/internal/poll/fd_poll_runtime.go:85 +0xa2
internal/poll.(*ioSrv).ExecIO(0x15d0258, 0xc0debcf618, 0xfc7358, 0x0, 0x0, 0x0)
C:/go/src/internal/poll/fd_windows.go:223 +0x13a
internal/poll.(*FD).Read(0xc0debcf600, 0xc10ee16c00, 0x400, 0x400, 0x0, 0x0, 0x0
)
C:/go/src/internal/poll/fd_windows.go:484 +0x248
net.(*netFD).Read(0xc0debcf600, 0xc10ee16c00, 0x400, 0x400, 0x0, 0x0, 0x0)
C:/go/src/net/fd_windows.go:151 +0x56
net.(*conn).Read(0xc042093070, 0xc10ee16c00, 0x400, 0x400, 0x0, 0x0, 0x0)
C:/go/src/net/net.go:176 +0x71
net.(Conn).Read-fm(0xc10ee16c00, 0x400, 0x400, 0x0, 0x0, 0x0)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:84 +0x54
github.com/ncw/rclone/fs/fshttp.(*timeoutConn).readOrWrite(0xc04a370400, 0xc0c06
2f858, 0xc10ee16c00, 0x400, 0x400, 0x0, 0x0, 0x0)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:72 +0x4f
github.com/ncw/rclone/fs/fshttp.(*timeoutConn).Read(0xc04a370400, 0xc10ee16c00,
0x400, 0x400, 0xeea920, 0x0, 0x3c1478)
C:/gopath/src/github.com/ncw/rclone/fs/fshttp/http.go:84 +0x89
crypto/tls.(*block).readFromUntil(0xc08c611bf0, 0x3c1478, 0xc04a370400, 0x5, 0xc
04a370400, 0x0)
C:/go/src/crypto/tls/conn.go:493 +0x9d
crypto/tls.(*Conn).readRecord(0xc117a7ea80, 0xfc7d17, 0xc117a7eba0, 0x0)
C:/go/src/crypto/tls/conn.go:595 +0xe7
crypto/tls.(*Conn).Read(0xc117a7ea80, 0xc0c0634000, 0x1000, 0x1000, 0x0, 0x0, 0x
0)
C:/go/src/crypto/tls/conn.go:1156 +0x107
net/http.(*persistConn).Read(0xc0e58faea0, 0xc0c0634000, 0x1000, 0x1000, 0x40497
d, 0xc0c062fb98, 0x42cef0)
C:/go/src/net/http/transport.go:1453 +0x13d
bufio.(*Reader).fill(0xc0e5932ba0)
C:/go/src/bufio/bufio.go:100 +0x125
bufio.(*Reader).Peek(0xc0e5932ba0, 0x1, 0xc08605e540, 0xc0c062fc80, 0xc081a32d90
, 0xc0a2220f60, 0xc047fa5c20)
C:/go/src/bufio/bufio.go:132 +0x41
net/http.(*persistConn).readLoop(0xc0e58faea0)
C:/go/src/net/http/transport.go:1601 +0x18c
created by net/http.(*Transport).dialConn
C:/go/src/net/http/transport.go:1237 +0x961
here is another update, after couple of days to try get it fix, i have tried different version, rclone-v1.40-040-g03912102-fix-2206-windows-amd64 , i’m able to sync to onedrive without any error or “killed” itself.
Yes I fixed this bug recently!