Error using rclone dedupe locally | Windows 10

What is the problem you are having with rclone?

Cant use it to delete duplicates on a location of my own local drive. Windows 10.

Run the command 'rclone version' and share the full output of the command.

2022/09/25 15:32:52 Failed to create file system for "local:D:\Downloads\ChatExport_2022-09-25\FotosyVideos": didn't find section in config file

Which cloud storage system are you using? (eg Google Drive)

Local

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone dedupe local:D:\Downloads\ChatExport_2022-09-25\FotosyVideos

The rclone config contents with secrets removed.

PS C:\Users\PC> rclone config
Current remotes:

Name                 Type
====                 ====
Local                local

e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q>

config file is on C:\Users\PC\AppData\Roaming\rclone, the content of rclone.conf is just:

[Local]
type = local

A log from the command with the -vv flag

PS C:\Users\PC> rclone dedupe local:D:\Downloads\ChatExport_2022-09-25\FotosyVideos -vv
2022/09/25 15:36:42 DEBUG : rclone: Version "v1.59.2" starting with parameters ["C:\\rclone\\rclone.exe" "dedupe" "local:D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos" "-vv"]
2022/09/25 15:36:42 DEBUG : Creating backend with remote "local:D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos"
2022/09/25 15:36:42 DEBUG : Using config file from "C:\\Users\\PC\\AppData\\Roaming\\rclone\\rclone.conf"
2022/09/25 15:36:42 Failed to create file system for "local:D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos": didn't find section in config file

You don't need to pass the remote for a local file. Just use

rclone dedupe D:\Downloads\ChatExport_2022-09-25\FotosyVideos

Do i wait now?

PS C:\Users\PC> rclone dedupe D:\Downloads\ChatExport_2022-09-25\FotosyVideos
2022/09/25 15:54:24 NOTICE: Local file system at //?/D:/Downloads/ChatExport_2022-09-25/FotosyVideos: Can't have duplicate names here. Perhaps you wanted --by-hash ? Continuing anyway.
PS C:\Users\PC> rclone dedupe D:\Downloads\ChatExport_2022-09-25\FotosyVideos -vv
2022/09/25 15:55:08 DEBUG : rclone: Version "v1.59.2" starting with parameters ["C:\\rclone\\rclone.exe" "dedupe" "D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos" "-vv"]
2022/09/25 15:55:08 DEBUG : Creating backend with remote "D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos"
2022/09/25 15:55:08 DEBUG : Using config file from "C:\\Users\\PC\\AppData\\Roaming\\rclone\\rclone.conf"
2022/09/25 15:55:08 DEBUG : fs cache: renaming cache item "D:\\Downloads\\ChatExport_2022-09-25\\FotosyVideos" to be canonical "//?/D:/Downloads/ChatExport_2022-09-25/FotosyVideos"
2022/09/25 15:55:08 NOTICE: Local file system at //?/D:/Downloads/ChatExport_2022-09-25/FotosyVideos: Can't have duplicate names here. Perhaps you wanted --by-hash ? Continuing anyway.
2022/09/25 15:55:08 INFO  : Local file system at //?/D:/Downloads/ChatExport_2022-09-25/FotosyVideos: Looking for duplicate names using interactive mode.
2022/09/25 15:55:08 DEBUG : 2 go routines active

I am not sure what you are trying to do as dedupe was built for backends that allow duplicate files which on a Windows / MacOS, you can't have.

You'd have to articulate what the issue is you are trying to solve/do.

The documentation page details that here -> rclone dedupe

I see, was trying to detect and delete files with the same name but ending with an additional portion, something like "000000 (1)" or "0000000 (2)".
Thanks!

Are they the exact same files with different names?

You can try with by-hash

1 Like

Thanks, it worked.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.