Issue copying files to Google Drive

lubelgo · March 27, 2023, 7:20am

What is the problem you are having with rclone?

It shows:

DEBUG : Local file system at /mnt/GoogleDriveNew/TV/SERIES/Let the Right One In: Waiting for checks to finish
2023/03/24 13:47:56 DEBUG : Local file system at /mnt/GoogleDriveNew/TV/SERIES/Let the Right One In: Waiting for transfers to finish
2023/03/24 13:47:56 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2023/03/24 13:47:56 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported

Run the command 'rclone version' and share the full output of the command.

rclone v1.61.1

os/version: debian 11.6 (64 bit)
os/kernel: 5.10.0-21-amd64 (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.19.4
go/linking: static
go/tags: none

Yes. I am.

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

 copy /mnt/HDD12TB/Deluge/El\ agente\ nocturno\ \(2023\)\ S01\ \[PACK\]\[NF\ WEB-DL\ 1080p\ AVC\ ES\ DD+\ 5.1\ -\ EN\ DD+\ 5.1\ Atmos\ Subs\]\[HDO\]/ /mnt/GoogleDriveNew/TV/SERIES/The\ Night\ Agent/ -vv

The rclone config contents with secrets removed.


[Unit]
Description=Google Drive (rclone)
Wants=network-online.target
# /etc/systemd/system/rclone.service
[Unit]
Description=Google Drive
Requires=systemd-networkd.service
AssertPathIsDirectory=/mnt/GoogleDriveNew
After=network-online.target

[Service]
Type=simple
ExecStart=/usr/bin/rclone mount \
        --config /root/.config/rclone/rclone.conf \
        --allow-other \
                --log-file /mnt/HDD12TB/Rclone/logs/rclone2.log \
                --log-level INFO \
                --cache-dir /mnt/HDD12TB/Rclone/vfs2 \
        --cache-db-path /mnt/HDD12TB/Rclone/db2 \
                --vfs-cache-mode full \
                --vfs-cache-max-size 400G \
                --vfs-cache-max-age 5000h \
                --vfs-cache-poll-interval 5m \
                --drive-use-trash \
        --dir-perms=777 \
        --umask=002 \
        --stats=0 \
        --dir-cache-time=5000h \
        --cache-info-age=60m GoogleDriveNew:/ /mnt/GoogleDriveNew
ExecStop=/bin/fusermount -u /mnt/GoogleDriveNew
Restart=always
RestartSec=10
TimeoutSec=45

[Install]
WantedBy=multi-user.target

A log from the command with the `-vv` flag

2023/03/27 08:54:29 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "copy" "/mnt/HDD12TB/Deluge/El agente nocturno (2023) S01 [PACK][NF WEB-DL 1080p AVC ES DD+ 5.1 - EN DD+ 5.1 Atmos Subs][HDO]/" "/mnt/GoogleDriveNew/TV/SERIES/The Night Agent/" "-vv"]
2023/03/27 08:54:29 DEBUG : Creating backend with remote "/mnt/HDD12TB/Deluge/El agente nocturno (2023) S01 [PACK][NF WEB-DL 1080p AVC ES DD+ 5.1 - EN DD+ 5.1 Atmos Subs][HDO]/"
2023/03/27 08:54:29 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/27 08:54:29 DEBUG : fs cache: renaming cache item "/mnt/HDD12TB/Deluge/El agente nocturno (2023) S01 [PACK][NF WEB-DL 1080p AVC ES DD+ 5.1 - EN DD+ 5.1 Atmos Subs][HDO]/" to be canonical "/mnt/HDD12TB/Deluge/El agente nocturno (2023) S01 [PACK][NF WEB-DL 1080p AVC ES DD+ 5.1 - EN DD+ 5.1 Atmos Subs][HDO]"
2023/03/27 08:54:29 DEBUG : Creating backend with remote "/mnt/GoogleDriveNew/TV/SERIES/The Night Agent/"
2023/03/27 08:54:29 DEBUG : fs cache: renaming cache item "/mnt/GoogleDriveNew/TV/SERIES/The Night Agent/" to be canonical "/mnt/GoogleDriveNew/TV/SERIES/The Night Agent"
 2023/03/27 08:54:37 DEBUG : Local file system at /mnt/GoogleDriveNew/TV/SERIES/The Night Agent: Waiting for checks to finish
2023/03/27 08:54:37 DEBUG : Local file system at /mnt/GoogleDriveNew/TV/SERIES/The Night Agent: Waiting for transfers to finish
2023/03/27 08:54:37 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2023/03/27 08:54:37 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported
2023/03/27 08:55:29 INFO  :
Transferred:        3.511 GiB / 21.107 GiB, 17%, 67.152 MiB/s, ETA 4m28s
Transferred:            0 / 10, 0%
Elapsed time:       1m0.0s
Transferring:
 * El agente nocturno S01…1 Atmos Subs][HDO].mkv: 36% /2.378Gi, 16.845Mi/s, 1m31s
 * El agente nocturno S01…1 Atmos Subs][HDO].mkv: 40% /2.063Gi, 15.579Mi/s, 1m20s
 * El agente nocturno S01…1 Atmos Subs][HDO].mkv: 42% /2.065Gi, 16.953Mi/s, 1m12s
 * El agente nocturno S01…1 Atmos Subs][HDO].mkv: 37% /2.444Gi, 17.771Mi/s, 1m27s

Animosity022 · March 27, 2023, 10:02am

Looks like you have a file system that does not support preallocate. What is the file system?

lubelgo · March 27, 2023, 10:46am

In my server file system is ext4.

Thanks in advance.

Animosity022 · March 27, 2023, 10:47am

The source of the copy, which is not ext4. What is that?

lubelgo · March 27, 2023, 10:57am

sdb
└─sdb1 ext4 1.0 da95f058-2f42-4d0e-a42d-b9805c1d55a2 5,2T 52% /mnt/HDD12TB
sr0

Isn´t it ext4?

Animosity022 · March 27, 2023, 11:04am

The issue is saying the file system doesn't support preallocate and ext4 does.

In the end, it's a soft error and not much to do other than fix the offending file system, ignore it or turn off sparse files to remove the error.

lubelgo · March 27, 2023, 11:09am

How can i turn off sparse files? It finally copies the files, but I see that error every time I copy anything.

Thanks!

Animosity022 · March 27, 2023, 11:13am

Try

--local-no-preallocate

Not sure as I wouldn't ever copy to the mount like that as I'd copy right to the remote to avoid an extra layer so have to do some trial and error I'd imagine.

lubelgo · March 27, 2023, 11:25am

i tried to type --local-no-preallocate on mount but it does not work, when I try it, the system doesn´t mount. The thing is that I cannot copy the files myself, because im using a software that copies files to google drive. I was having some issues and I tried to make some test with -vv to check if there was any errors. The problem I have is that I think the software cannot create folders remotely.

Animosity022 · March 27, 2023, 11:32am

Not on your mount.

On the copy command.

lubelgo · March 27, 2023, 11:38am

Is there any chance of setting it in the mount file?

Animosity022 · March 27, 2023, 12:02pm

Nope.

It would not work.

lubelgo · March 27, 2023, 2:42pm

Now I try to mount everything like before, and doesnt mount!!

lubelgo · March 28, 2023, 11:51am

Im getting this error now:

root@DietPi:~# systemctl status rclone.service
● rclone.service - Google Drive (rclone)
Loaded: loaded (/etc/systemd/system/rclone.service; enabled; vendor preset:
enabled)
Active: activating (auto-restart) (Result: exit-code) since Tue 2023-03-28
13:50:09 CEST; 2s ago
Process: 1868 ExecStart=/usr/bin/rclone mount --config=/root/.config/rclone/
rclone.conf --allow-other --cache-tmp-upload-path=/mnt/HDD12TB/Rclone/tmp/rclone
/upload --cache-chunk-path=/mnt/HDD12TB/Rclone/tmp/chunks --cache-workers=8 --ca
che-writes --cache-dir=/mnt/HDD12TB/Rclone/tmp/rclone/vfs --cache-db-path=/mnt/H
DD12TB/Rclone/tmp/rclone/db --no-modtime --drive-use-trash --stats=0 --dir-perms
=770 --umask=002 --checkers=16 --bwlimit=40M --dir-cache-time=60m --cache-info-a
ge=60m GoogleDriveNew: /mnt/GoogleDriveNew (code=exited, status=1/FAILUR
E)
Main PID: 1868 (code=exited, status=1/FAILURE)
CPU: 355ms

Animosity022 · March 28, 2023, 11:57am

You'd have to include the whole service file.

Put it in 3 backtics

like
this

and make you have a log file configured in there.

system · April 27, 2023, 11:58am

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.