Problem with uploading to Mega

w.v · October 2, 2024, 2:30pm

What is the problem you are having with rclone?

After uploading (replace) local file to mega it downloads back if reverse direction. But the file of course wadnt changed so it is nothing to do.
P.S. commands ls and check for debug

Run the command 'rclone version' and share the full output of the command.

rclone v1.66.0-termux

os/version: unknown
os/kernel: 4.14.197-Xtended (armv8l)
os/type: android
os/arch: arm64 (ARMv8 compatible)
go/version: go1.21.6
go/linking: dynamic
go/tags: noselfupdate

Which cloud storage system are you using? (eg Google Drive)

Mega

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

/ # echo + >"/storage/emulated/0/Скрипты/1/test.txt"
/ # "rclone" "copy" "-u" "-vv" "/storage/emulated/0/Скрипты/1" "BKPm:/Скрипты/1"
2024/10/02 14:14:02 DEBUG : Setting --config "/storage/emulated/0/Скрипты/rclone.conf" from environment variable RCLONE_CONFIG="/storage/emulated/0/Скрипты/rclone.conf"
2024/10/02 14:14:02 DEBUG : rclone: Version "v1.66.0-termux" starting with parameters ["rclone" "copy" "-u" "-vv" "/storage/emulated/0/Скрипты/1" "BKPm:/Скрипты/1"]
2024/10/02 14:14:02 DEBUG : Creating backend with remote "/storage/emulated/0/Скрипты/1"
2024/10/02 14:14:02 DEBUG : Using config file from "/storage/emulated/0/Скрипты/rclone.conf"
2024/10/02 14:14:02 DEBUG : Creating backend with remote "BKPm:/Скрипты/1"
2024/10/02 14:14:04 DEBUG : fs cache: renaming cache item "BKPm:/Скрипты/1" to be canonical "BKPm:Скрипты/1"
2024/10/02 14:14:04 DEBUG : mega root 'Скрипты/1': Waiting for checks to finish
2024/10/02 14:14:04 DEBUG : mega root 'Скрипты/1': Waiting for transfers to finish
2024/10/02 14:14:05 INFO  : test.txt: Copied (replaced existing)
2024/10/02 14:14:05 INFO  :
Transferred:              2 B / 2 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         2.8s

2024/10/02 14:14:05 DEBUG : 16 go routines active
/ # "rclone" "check" "BKPm:/Скрипты/1" "/storage/emulated/0/Скрипты/1"
2024/10/02 14:14:42 ERROR : No common hash found - not using a hash for checks
2024/10/02 14:14:42 NOTICE: Local file system at /storage/emulated/0/Скрипты/1: 0 differences found
2024/10/02 14:14:42 NOTICE: Local file system at /storage/emulated/0/Скрипты/1: 1 hashes could not be checked
2024/10/02 14:14:42 NOTICE: Local file system at /storage/emulated/0/Скрипты/1: 1 matching files
/ # "rclone" ls "BKPm:/Скрипты/1"
        2 test.txt
/ # "rclone" "copy" "-u" "-vv" "BKPm:/Скрипты/1" "/storage/emulated/0/Скрипты/1"
2024/10/02 14:16:01 DEBUG : Setting --config "/storage/emulated/0/Скрипты/rclone.conf" from environment variable RCLONE_CONFIG="/storage/emulated/0/Скрипты/rclone.conf"
2024/10/02 14:16:01 DEBUG : rclone: Version "v1.66.0-termux" starting with parameters ["rclone" "copy" "-u" "-vv" "BKPm:/Скрипты/1" "/storage/emulated/0/Скрипты/1"]
2024/10/02 14:16:01 DEBUG : Creating backend with remote "BKPm:/Скрипты/1"
2024/10/02 14:16:01 DEBUG : Using config file from "/storage/emulated/0/Скрипты/rclone.conf"
2024/10/02 14:16:04 DEBUG : fs cache: renaming cache item "BKPm:/Скрипты/1" to be canonical "BKPm:Скрипты/1"
2024/10/02 14:16:04 DEBUG : Creating backend with remote "/storage/emulated/0/Скрипты/1"
2024/10/02 14:16:04 DEBUG : Local file system at /storage/emulated/0/Скрипты/1: Waiting for checks to finish
2024/10/02 14:16:04 DEBUG : Local file system at /storage/emulated/0/Скрипты/1: Waiting for transfers to finish
2024/10/02 14:16:04 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2024/10/02 14:16:04 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported
2024/10/02 14:16:05 DEBUG : test.txt.gibofij0.partial: renamed to: test.txt
2024/10/02 14:16:05 INFO  : test.txt: Copied (replaced existing)
2024/10/02 14:16:05 INFO  :
Transferred:              2 B / 2 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         3.9s

2024/10/02 14:16:05 DEBUG : 14 go routines active
/ #

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[BKPm]
type = mega
user = XXX
pass = XXX

asdffdsa · October 2, 2024, 2:37pm

mega does not support modtime, rclone is using the upload/create time.
so the times do not match.

can you post the ouput of rclone lsl for the source file and the dest file?

w.v · October 2, 2024, 3:17pm

/ # "rclone" lsl "BKPm:/Скрипты/1"
        2 2024-10-02 15:09:12.000000000 test.txt
/ # ls -l /storage/emulated/0/Скрипты/1
total 0
-rw-rw---- 1 root sdcard_rw 2 2024-10-02 18:07 test.txt

timezone (+3h) is bug so time is 2 min different. Really mega uses upload time. So with mega i cant handle that?
Used gdrive before but im fed up with 403 quota exceed so going to change cloud to other

asdffdsa · October 2, 2024, 3:19pm

first, i would update by rclone selfupdate

do you need -u ?

not sure your use-case.
might be able to write a script using rclone touch to workaround that

kapitainsky · October 2, 2024, 3:23pm

Depending on what is your usage you might want to add hashing to mega. It can be achieved either by using rclone overlay hasher or chunker (it can be used to only add hash without any files chunking). This way you can get much more robust storage solution from mega.

With hashes supported lack of mtime is not so critical.

w.v · October 2, 2024, 3:37pm

Error: unknown command (i think because it is Android)
I tried to use 1.68 also but result is the same

yes, it is important for my crossdirection profiles (i use copy -u f1 f2 and then backwards)

no, it wont help, rclone see systime without timezone so it dont know real time. This is not problem (not for this topic), it just gives logs with bad time (i can fix by awk) but sync, copy works well (with gdrive i e g). By the way this problem was discussed but still nothing

w.v · October 2, 2024, 3:40pm

hash is good but in this case it cant say if the file is newer or not but i need this to not touch newer files on dest

asdffdsa · October 2, 2024, 3:58pm

yeah, i just tried on termux, got same error.

w.v · October 2, 2024, 4:21pm

Which free cloud storage i can use that supports modtime and 15+Gb space? Better without oauth

asdffdsa · October 2, 2024, 4:26pm

google drive

can you post rclone config redacted for the remote ?

w.v · October 2, 2024, 4:32pm

[BKP]
type = drive
scope = drive
token = XXX
team_drive =

This error is due to google limitations for rclone project. The crutch is to make own project to get own credential and quota but dont want to play this game

no, not google, something else
The best is provider without oauth (browser confirm)

kapitainsky · October 2, 2024, 4:41pm

asdffdsa · October 2, 2024, 4:52pm

interesting, 25GiB free...

do you use Uloz.to, what do you think about it?

kapitainsky · October 2, 2024, 4:58pm

Yes I use them. Limited trust for how long it can last with existing prices. But at the moment it is very good value as a second backup location. rclone works reliably. Their service does not like many small files but otherwise all works.

They used to be one of the biggest files (torrents:)) sharing services in Eastern Europe. But when authorities cracked on illegal content finally they switched to data hosting - probably to at least pay bills for tones of hardware they have running...

They host stuff only in Czech Republic so speed differs depending where you connect from. In Europe it is quite fast but people from across the pond complained that it is slow. At least based on Reddit chatter.

If you want to try them here you are needed rclone parameter for their free acccount:
app_token = ;HG%7jW6@6/8vx">R;f(

It is not secret but PITA to find in their FAQ (which is not fully in english yet).

w.v · October 2, 2024, 5:13pm

thanks, i will try
Hope it wont delete files during not using.
It's a pity that mega cant handle time, my old 20 accounts will be sadly standing apart

w.v · October 2, 2024, 5:16pm

nearby country

dont get it. I must write it during adding account or where/when? If i wont write it cloud wont work?

kapitainsky · October 2, 2024, 5:20pm

To use API you need app token. For paid accounts you can generate it yourself. For free it is fixed. You have to add it to rclone config. Check docs.

If you are thinking about using union then be warned that uloz does not support any quota info (rclone about) hence most policies, including default create, won't work.

w.v · October 2, 2024, 5:37pm

no, i just use each drive for one main folder(pics, bkps, music etc) Used "rclone about" to get free space and do some cleaning work if need. But i think if storage will be full some error message will be displayed and i can parse that

w.v · October 2, 2024, 5:42pm

Configuration complete.
Options:
# couldn't find type of fs for "BKPu"
- app_token: ;HG%7jW6@6/8vx">R;f(
- username: van.***.bkp@gmail.com
- password: ***
Keep this "BKPu" remote?
...
Current remotes:

Name                 Type
====                 ====
APK                  drive
APP                  drive
BKP                  drive
BKPm                 mega
BKPu
DB                   drive

Something wrong (selected 52 (ulozto)

kapitainsky · October 2, 2024, 5:58pm

Here you are working config:

[uloz_test]
type = ulozto
app_token = ;HG%7jW6@6/8vx">R;f(
username = dio***@***.com
password = ****

as always with rclone, password in config file has to be obscured:

rclone obscure uloz_password