Move, copy and sync trouble (opendrive)

What is the problem you are having with rclone?

I'm getting errors when using rclone move/copy/sync
I could upload a few files with no problem, but yesterday it started.

What is your rclone version (output from rclone version)

rclone v1.50.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Linux 20.04

Which cloud storage system are you using? (eg Google Drive)

Opendrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone move File-X /root/xxx/opendrive/ --log-level=DEBUG --log-file=/root/rclone.log --progress
rclone move /root/file/File-X /root/xxx/opendrive/ --log-level=DEBUG --log-file=/root/rclone.log --progress

The rclone config contents with secrets removed.

[Name_server]
type = opendrive
username = XXXXX
password = XXXXX

A log from the command with the -vv flag

2021/05/26 16:34:50 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "move" "File-X" "/root/file/open/" "--log-level=DEBUG" "--log-file=/root/rclone.log" "-P" "--progress"]
2021/05/26 16:34:50 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/05/26 16:34:50 DEBUG : File-X: Need to transfer - File not found at Destination
2021/05/26 16:34:50 DEBUG : File-X: Can't move: rename /root/file/File-X>
2021/05/26 16:34:50 DEBUG : File-X: Can't move: rename /root/file/File-X /root/file/open/File-X: invalid cross-device link: trying copy
2021/05/26 16:34:50 DEBUG : File-X: Can't move, switching to copy
2021/05/26 16:34:50 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2021/05/26 16:34:50 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported


2021/05/26 16:50:09 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "move" "/root/file/File-X" "/root/file/open/" "--log-level=DEBUG" "--log-file=/root/rclone.log" "-P" "--progress"]
2021/05/26 16:50:09 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/05/26 16:50:09 DEBUG : File-X: Sizes differ (src 108791174008 vs dst 768602112)
2021/05/26 16:50:18 INFO  : File-X: Deleted
2021/05/26 16:50:18 DEBUG : File-X: Can't move: rename /root/plot/File-X /root/file/open/File-X: invalid cross-device link: trying copy
2021/05/26 16:50:18 DEBUG : File-X: Can't move, switching to copy
2021/05/26 16:50:18 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2021/05/26 16:50:18 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported

I'm new to rclone, but i'm in love with it... Idk why it stopped working.
BTW, the files I'm trying send to opendrive are huge, like 30~70gb.

hello and welcome to the forum,

need to update rclone as documented here

1 Like

Hello, mate! Thank you for the welcome!

I did update it and seems like it worked well, I mean, now the "File-X" is going to /root/file/open/, which is the folder that I did mount rclone. I can see that the whole file went to de folder, but there's something odd happening;
Even with the file in the right remote:folder (in my pc), I can't see the file in other pcs neither in the opendrive website... Does it take time to show up? The other files that I uploaded I was AFK, so I'm not sure how long does it take to show to other pcs and in the site, but feels odd to me, than I'd rather ask about.

My new logs:

2021/05/26 18:22:23 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/05/26 18:22:23 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "move" "File-X" "/root/file/open/" "--log-level=DEBUG" "--> "--log-file=/root/rclone1.log" "--progress"]
2021/05/26 18:22:23 DEBUG : Creating backend with remote "File-X"
2021/05/26 18:22:23 DEBUG : fs cache: adding new entry for parent of "File-X", "/root/file"
2021/05/26 18:22:23 DEBUG : Creating backend with remote "/root/file/open/"
2021/05/26 18:22:23 DEBUG : File-X: Need to transfer - File not found at Destination
2021/05/26 18:22:23 DEBUG : File-X: Can't move: rename /root/file/File-X /root/file/open/File-X: invalid cross-device link: trying copy
2021/05/26 18:22:23 DEBUG : File-X: Can't move, switching to copy
2021/05/26 18:22:23 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2021/05/26 18:22:23 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported
2021/05/26 19:38:28 DEBUG : File-X: MD5 = 1c4aade8fb16544c1559f6b7a8c9e0af OK
2021/05/26 19:38:28 INFO  : File-X: Copied (new)
2021/05/26 19:38:40 INFO  : File-X: Deleted

2021/05/26 19:38:40 INFO  :
Transferred:      101.320G / 101.320 GBytes, 100%, 22.668 MBytes/s, ETA 0s
Checks:                 2 / 2, 100%
Deleted:                1 (files), 0 (dirs)
Renamed:                1
Transferred:            1 / 1, 100%
Elapsed time:   1h16m16.9s

2021/05/26 19:38:40 DEBUG : 2 go routines active

yeah, nothing like an update.

i think the problem is with the source
File-X - rclone thinks that is a local folder as per the log
adding new entry for parent of "File-X", "/root/file
and
/root/file/File-X

a remote needs a colon in it, like this File-X:
as documented here

and when learning rclone and using a operation that can and will delete files, test with --dry-run

1 Like

I think you just fixed my problem, mate!
I'm not sure yet, cuz it's uploading... But looking to speed it's going, I'm pretty sure it's not the "HD speed" as it was before, actually now it looks like "uploading speed". It will take about 5h to upload, but I will give you the feedback once it's done!

  • No errors in the log.

Thank you so much for your help!

you never posted the config flie so i have to assume that File-X is opendrive
as i understand it, your command is downloading, not uploading
source is opendrive and the dest is /root/file/open/

you can kill the rclone command, do a check, and then re-run the rclone command.

Ops! Sorry about that, I'm not sure about the config files cuz I did the 'normal' configuration only, I mean, run rclone config and put the stuff there.

n) new remote
name: remote
type: opendrive
Login: xx
Pass: xx

It was the only configuration I really did.
My opendrive is mounted in /root/file/open

I'm transfering a file from /root/file to /root/file/open
I thought it was an upload, since the source is the local pc.
The command I ran this last time was:

rclone move /root/file/File-X remote:root/file/open/ --log-level=DEBUG --log-file=/root/rclone1.log --progress

File-X is the file I'm sending to /root/file/open (opendrive)

really not understanding your setup?
what do you mean mounted, are you running a rclone mount?

Yes! rclone mount is in the directory /open
The command I ran to mount was: - rclone mount remote:op open
"op" is the folder inside my opendrive.

When I go inside the folder /root/file/open/ I can see all the files that I've uploaded in opendrive 'op' folder, so I think it's working correcty. But now I'm curious, shouldn't the opendrive be mount to transfer it or there's no need to mount?

Anyway, I did mount rclone because I always need to use those files, so it felt easier that way.

but you wrote that you already mounted remote:op to /root/file/open/

so not sure what you are asking?

The mount is working, my problem was getting errors while uploading to "open"
Problems like:
Whenever I ran rclone move/copy/sync, the files I was trying to send were going to the temporary folder, but wasn't uploading to opendrive. I know that rclone/opendrive makes a temporary file, but I wasn't sure why it wasn't uploading the files when the temporary was done.

I did upload about 2 files with the Linux terminal, but since yesterday I wasn't able to upload anymore. I didn't change any configs. Also, today, the file went to "open", but I could see it only locally, when I tried to see the files with my VPS or in the website (opendrive).
Actually, I think I've 'reported' this case, but anyway, these were my problems.

I think it's fixed, but I'll be sure when the upload is done

just copy a small test file, then you will know immediately

1 Like

Nice idea, I've sent the txt! :smiley:
Worked like a charm! Thank you!

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.