OneDrive - ls/lsl without --onedrive-delta misses some files

What is the problem you are having with rclone?

OneDrive - ls/lsl without --onedrive-delta misses some files.

# zero results
$ rclone ls .od01_d: --include "*tmp*"

# file listes
$ rclone ls .od01_d: --include "*tmp*" --onedrive-delta
        0 d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟/~tmp42_歭擜䮩祠籸拣惚吱ᕖ䁇颫䈘畣㯘➀䵻扢䇩⎶梥旘䟫鶌枲蒅彻踡嫒偵鴏ᛅ䜴狘⬯硛㐅檈腂ቩ㽁覿㟸埿

Run the command 'rclone version' and share the full output of the command.

$ rclone version
rclone v1.68.1
- os/version: darwin 15.0.1 (64 bit)
- os/kernel: 24.0.0 (x86_64)
- os/type: darwin
- os/arch: amd64
- go/version: go1.23.1
- go/linking: dynamic
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The rclone config contents with secrets removed.

$ rclone config redacted .od01_d:
[.od01_d]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = personal
### Double check the config for sensitive info before posting publicly

A log from the command with the -vv flag

To shorten log I list specific directory only (as drive contains 1000s of files). Results are the same:

$ rclone ls ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟" -vv
2024/10/22 18:40:31 DEBUG : rclone: Version "v1.68.1" starting with parameters ["rclone" "ls" ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟" "-vv"]
2024/10/22 18:40:31 DEBUG : Creating backend with remote ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟"
2024/10/22 18:40:31 DEBUG : Using config file from "/Users/kptsky/.config/rclone/rclone.conf"
2024/10/22 18:40:33 DEBUG : 7 go routines active

$ rclone ls ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟" --onedrive-delta -vv
2024/10/22 18:40:59 DEBUG : rclone: Version "v1.68.1" starting with parameters ["rclone" "ls" ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟" "--onedrive-delta" "-vv"]
2024/10/22 18:40:59 DEBUG : Creating backend with remote ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟"
2024/10/22 18:40:59 DEBUG : Using config file from "/Users/kptsky/.config/rclone/rclone.conf"
2024/10/22 18:40:59 DEBUG : .od01_d: detected overridden config - adding "{HkZ8H}" suffix to name
2024/10/22 18:41:01 DEBUG : fs cache: renaming cache item ".od01_d:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟" to be canonical ".od01_d{HkZ8H}:d/䬣齹踇㳿筌蜦缲豜䄺錒邂蔆彖蜂轥䞘勛ʟ/䥞牜鯧仏甜咊坔擛陟"
        0 ~tmp42_歭擜䮩祠籸拣惚吱ᕖ䁇颫䈘畣㯘➀䵻扢䇩⎶梥旘䟫鶌枲蒅彻踡嫒偵鴏ᛅ䜴狘⬯硛㐅檈腂ቩ㽁覿㟸埿
2024/10/22 18:41:03 DEBUG : 7 go routines active

Hmm...

Can you see anything interesting if you do -vv --dump bodies?

How many entries in the directory? Maybe the paging isn't working properly?

I think OneDrive has a list chunk parameter you could experiment with

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.