Jottacloud move with delete after

SlashGIP · October 14, 2021, 6:31pm

"Move" doesnt delete after it is finished after it works a year without any change

latest Version of rclone 1.56.2

I use Jottacloud

Command:

rclone move /mnt/abc/dce jottasecure:FGH/JKL --ignore-errors --create-empty-src-dirs --delete-empty-src-dirs --transfers 5 --rc


# /etc/systemd/system/rclonejotta.service
[Unit]
Description=rclone mount
#Documentation=http://rclone.org/docs/
After=network-online.target
Wants=network-online.target


[Service]
#ExecStartPre=/bin/sleep 30
Type=simple
User=pi
Group=xxx
ExecStart=/usr/bin/rclone mount jottasecure: /jotta \
--allow-other \
--allow-non-empty \
--buffer-size 1G \
#--dir-cache-time 96h \
--fast-list \
--log-level INFO \
--timeout 1h \
--umask 002 \
--rc

ExecStop=/bin/fusermount -uz /jotta

#Restart=always
RestartSec=10
Restart=on-failure
#Restart=on-abort


[Install]
WantedBy=default.target

So, my problem is, I already used this command and it worked for a year without any problems. I think till I updated this problem comes up.

The move command works very well but it doesnt delete anymore after its finished. Maybe someone have the same thing here and can help me a little bit.

thx

asdffdsa · October 14, 2021, 6:50pm

hello,

so that rclone move command has worked for a year and all of sudden, the exact same command does not work as expected.
can you post a debug log?

about that mount command, tho that has nothing to do with the rclone move command.
--fast-list does nothing on a mount.

SlashGIP · October 14, 2021, 8:40pm

Hi,

yes the same command works for a year without any trouble. From now to then it does not remove the moved files at the source anmore without changing a bit. "move" commant still works as it should without deleting afterwards
2021/10/07 04:03:06 ERROR : xyz.jpg: Couldn't delete: remove /abc/def/Media/Movies/xyz.jpg: no such file or directory (The dir or the files are still there, even after refreshing or rebooting the NAS)

thx i will delete the fast-list ...

asdffdsa · October 14, 2021, 9:06pm

what happens if you try rclone delete that xyz.jpg?

please post a full debug log, perhaps to keep the log small, try to move that single file xyz.jpg

SlashGIP · October 23, 2021, 7:00pm

Hi, sorry for not answering but i still waiting for finishing the upload to test the things you asked for. 5 mbit upload at jottacloud is not very fast actually

SlashGIP · October 23, 2021, 7:03pm

Meantime one more question. Is there a workaround for rclone move ?

Something like step by step?

copy 5 files from Src to dest
check after the copy is finished if the src files are at dst

i mean something like: if there are 200 files at dest + 5 new from src the command ignore the 200 files and just say "ok everything(5 files) are copied"

delete the 5 src files

asdffdsa · October 23, 2021, 7:05pm

just curious, the reason to use a provider that limits uploads to 5mbps?
how much data do you have stored?
how much does that cost you?

asdffdsa · October 23, 2021, 7:10pm

might take a look at

SlashGIP · October 23, 2021, 7:15pm

Just 72€ per year for real unlimited storage. Thats the reason why. 17 TB till now. After 5 TB the upload is limited to 5 Mbit. I didnt took the chance for gsuite with unlimited storage for 10€ now its limited to 2 TB. Thats why I asked for some ppl for Dropbox business without any limit for the uploads.

SlashGIP · November 1, 2021, 11:13am

No its finished and i tried it again with samples in the dir. So I hope you can help me out here.

2021/11/01 12:07:09 DEBUG : rclone: Version "v1.56.2" starting with parameters ["rclone" "move" "/mnt/media/Media/Movies" "jottasecure:abc/def" "--ignore-errors" "--create-empty-src-dirs" "--delete-empty-src-dirs" "--transfers" "5" "--log-file=/mnt/media/logs/rpilog.txt" "--rc" "-vv"]
2021/11/01 12:07:09 NOTICE: Serving remote control on http://localhost:5572/
2021/11/01 12:07:09 DEBUG : Creating backend with remote "/mnt/media/Media/Movies"
2021/11/01 12:07:09 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/11/01 12:07:09 DEBUG : Creating backend with remote "jottasecure:abc/def"
2021/11/01 12:07:10 DEBUG : Creating backend with remote "jotta:crypt/orgpebfcg0h6smfetf6hsait88/4l4sig0oisv83cdmu6dmcaqnbs"
2021/11/01 12:07:10 DEBUG : jotta: Loaded invalid token from config file - ignoring
2021/11/01 12:07:10 DEBUG : Saving config "token" in section "jotta" of the config file
2021/11/01 12:07:10 DEBUG : Keeping previous permissions for config file: -rwxrwxrwx
2021/11/01 12:07:10 DEBUG : jotta: Saved new token in config file
2021/11/01 12:07:11 DEBUG : test/xyz: Computing md5 hash of encrypted source
2021/11/01 12:07:11 DEBUG : test/clearart.png: Computing md5 hash of encrypted source
2021/11/01 12:07:11 DEBUG : test/xyz.nfo: Computing md5 hash of encrypted source
2021/11/01 12:07:11 DEBUG : test/disc.png: Computing md5 hash of encrypted source
2021/11/01 12:07:11 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for checks to finish
2021/11/01 12:07:11 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for transfers to finish
2021/11/01 12:07:11 DEBUG : test/fanart.jpg: Computing md5 hash of encrypted source
2021/11/01 12:07:12 DEBUG : test/xyz: md5 = ff473e0baa5ae1ac3f70eeb07a1a78cc OK
2021/11/01 12:07:12 INFO  : test/xyz: Copied (new)
2021/11/01 12:07:12 INFO  : test/xyz: Deleted
2021/11/01 12:07:12 DEBUG : test/folder.jpg: Computing md5 hash of encrypted source
2021/11/01 12:07:12 DEBUG : test/xyz.nfo: md5 = a170f0431210086463642ef01e439ae6 OK
2021/11/01 12:07:12 INFO  : test/xyz.nfo: Copied (new)
2021/11/01 12:07:12 ERROR : test/xyz.nfo: Couldn't delete: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:12 DEBUG : test/logo.png: Computing md5 hash of encrypted source
2021/11/01 12:07:13 DEBUG : test/logo.png: md5 = d5c64eed3988777b4c411b6d4d949f1d OK
2021/11/01 12:07:13 INFO  : test/logo.png: Copied (new)
2021/11/01 12:07:13 INFO  : test/logo.png: Deleted
2021/11/01 12:07:13 DEBUG : test/movie.nfo: Computing md5 hash of encrypted source
2021/11/01 12:07:14 DEBUG : test/movie.nfo: md5 = 62ecb8f550488b2d8aa8d1e0f05946fc OK
2021/11/01 12:07:14 INFO  : test/movie.nfo: Copied (new)
2021/11/01 12:07:14 INFO  : test/movie.nfo: Deleted
2021/11/01 12:07:14 DEBUG : test/poster.jpg: Computing md5 hash of encrypted source
2021/11/01 12:07:14 DEBUG : test/fanart.jpg: md5 = b9ef9addecaeb2370eacbc27d30a10ce OK
2021/11/01 12:07:14 INFO  : test/fanart.jpg: Copied (new)
2021/11/01 12:07:14 INFO  : test/fanart.jpg: Deleted
2021/11/01 12:07:14 DEBUG : test/folder.jpg: md5 = d6efbd1f6aa73003fae9f6738e503c6c OK
2021/11/01 12:07:14 INFO  : test/folder.jpg: Copied (new)
2021/11/01 12:07:14 INFO  : test/folder.jpg: Deleted
2021/11/01 12:07:15 DEBUG : test/clearart.png: md5 = b2e15f9c830646aaf407ed369d4635c6 OK
2021/11/01 12:07:15 INFO  : test/clearart.png: Copied (new)
2021/11/01 12:07:15 INFO  : test/clearart.png: Deleted
2021/11/01 12:07:15 DEBUG : test/poster.jpg: md5 = d3289d57ff8708e168f5b1bab27d3aa8 OK
2021/11/01 12:07:15 INFO  : test/poster.jpg: Copied (new)
2021/11/01 12:07:15 INFO  : test/poster.jpg: Deleted
2021/11/01 12:07:22 DEBUG : test/disc.png: md5 = f77a2052fb814faeca84aff8d9c9d3b6 OK
2021/11/01 12:07:22 INFO  : test/disc.png: Copied (new)
2021/11/01 12:07:22 INFO  : test/disc.png: Deleted
2021/11/01 12:07:22 DEBUG : test: Making directory
2021/11/01 12:07:22 DEBUG : Encrypted drive 'jottasecure:abc/def': failed to copy 1 directories
2021/11/01 12:07:22 DEBUG : Encrypted drive 'jottasecure:abc/def': copied 1 directories
2021/11/01 12:07:22 DEBUG : test: Removing directory
2021/11/01 12:07:22 DEBUG : test: Failed to Rmdir: remove /mnt/media/test: directory not empty
2021/11/01 12:07:22 DEBUG : Local file system at /mnt/media/Media/Movies: failed to delete 1 directories
2021/11/01 12:07:22 ERROR : Attempt 1/3 failed with 1 errors and: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:23 DEBUG : test/xyz.nfo: Size and modification time the same (differ by -490.585ms, within tolerance 1s)
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for checks to finish
2021/11/01 12:07:23 DEBUG : test/xyz.nfo: Unchanged skipping
2021/11/01 12:07:23 ERROR : test/xyz.nfo: Couldn't delete: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for transfers to finish
2021/11/01 12:07:23 DEBUG : test: Making directory
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': failed to copy 1 directories
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': copied 1 directories
2021/11/01 12:07:23 DEBUG : test: Removing directory
2021/11/01 12:07:23 DEBUG : test: Failed to Rmdir: remove /mnt/media/test: directory not empty
2021/11/01 12:07:23 DEBUG : Local file system at /mnt/media/Media/Movies: failed to delete 1 directories
2021/11/01 12:07:23 ERROR : Attempt 2/3 failed with 1 errors and: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for checks to finish
2021/11/01 12:07:23 DEBUG : test/xyz.nfo: Size and modification time the same (differ by -490.585ms, within tolerance 1s)
2021/11/01 12:07:23 DEBUG : test/xyz.nfo: Unchanged skipping
2021/11/01 12:07:23 ERROR : test/xyz.nfo: Couldn't delete: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': Waiting for transfers to finish
2021/11/01 12:07:23 DEBUG : test: Making directory
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': failed to copy 1 directories
2021/11/01 12:07:23 DEBUG : Encrypted drive 'jottasecure:abc/def': copied 1 directories
2021/11/01 12:07:23 DEBUG : test: Removing directory
2021/11/01 12:07:23 DEBUG : test: Failed to Rmdir: remove /mnt/media/test: directory not empty
2021/11/01 12:07:23 DEBUG : Local file system at /mnt/media/Media/Movies: failed to delete 1 directories
2021/11/01 12:07:23 ERROR : Attempt 3/3 failed with 1 errors and: remove /mnt/media/test/xyz.nfo: no such file or directory
2021/11/01 12:07:23 INFO  : 
Transferred:   	    2.265Mi / 2.265 MiByte, 100%, 213.072 KiByte/s, ETA 0s
Errors:                 1 (retrying may help)
Checks:                22 / 22, 100%
Deleted:               11 (files), 3 (dirs)
Renamed:                8
Transferred:            9 / 9, 100%
Elapsed time:        13.6s

2021/11/01 12:07:23 DEBUG : 25 go routines active
2021/11/01 12:07:23 Failed to move: remove /mnt/media/test/xyz.nfo: no such file or directory

The result after this command is, that it moved everything but one file.

asdffdsa · November 1, 2021, 1:03pm

if you run the exact same command again, does it fail on the same file test/xyz.nfo?

SlashGIP · November 1, 2021, 1:45pm

yes. always the same. I tried a different files. no problem at all. Now i try another upload without a nfo file. I cannot imagin why the .nfo file should be the problem.

asdffdsa · November 1, 2021, 1:47pm

it happens with file extensions other than .nfo, correct?

SlashGIP · November 2, 2021, 5:51pm

Hi,

so heres the thing, I think, thats the problem is my Synology NAS in the backround. 'There was a major update and since then, this thing doesnt work anymore. I tried a simple "rm" on my Pi and it does not work. So this shouldnt be a problem with rclone. I think the problem is "PICNIC" Problem in Chair not in Computer" I will try to figure out, what has changed with my synology. Thx for supporting me asdffdsa

asdffdsa · November 2, 2021, 6:00pm

yeah, that synbox massive update created all kinds of problems for many users.
in my case, using tailscale vpn, what a nightmare to fix.

system · November 5, 2021, 6:00pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.