Upgrading from rclone v1.63.1 to 1.66 now syncing empty folders

phatmandrake · May 7, 2024, 6:49pm

Rclone is now syncing empty directories and excluded directories to Google Drive after updating. Before it was not. Same configuration in use.

New (Issue program)
rclone v1.66.0

os/version: Microsoft Windows Server 2022 Datacenter 21H2 (64 bit)
os/kernel: 10.0.20348.2031 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.22.1
go/linking: static
go/tags: cmount

Old (Working as expected)
rclone v1.63.1

os/version: Microsoft Windows Server 2022 Datacenter 21H2 (64 bit)
os/kernel: 10.0.20348.2031 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.20.6
go/linking: static
go/tags: cmount

 .\rclone.exe sync "D:\" Remote: --exclude .DS_Store --exclude "{{.*/.*/.*/exclude/.*}}" --exclude  "{{.*/.*/.*/subfolder/exclude/.*}}" --delete-excluded

kapitainsky · May 7, 2024, 6:59pm

github.com/rclone/rclone

rclone copy creating empty directories it didn't create before

opened 06:54AM - 25 Mar 24 UTC

closed 11:31AM - 03 May 24 UTC

YukiUnHappy

bug Point Release Candidate

#### What is the problem you are having with rclone? `Rclone will now sync di…rectory modification times if the backend supports it` That's a cool new feature, but I think it shouldn't be enabled by default, or it should ignore folders by default where no files need to be transferred. In the previous version, I could simply `copy` to the remote within the folder where I needed to upload files, but now I have to remove the other folders in that folder that have no files first, otherwise these empty folders will also be created on the remote due to the sync modification time. Conversely, if I only need to copy specific files from the remote to the local (using `--include`), but other irrelevant folders under that path on the remote will also be created on my local machine with the original structure. This did not exist in previous versions and is a bit annoying. #### What is your rclone version (output from `rclone version`) rclone v1.66.0 - os/version: debian 10.0 (64 bit) - os/kernel: 5.14.9 (x86_64) - os/type: linux - os/arch: amd64 - go/version: go1.22.1 - go/linking: static - go/tags: none #### Which OS you are using and how many bits (e.g. Windows 7, 64 bit) The information has already been mentioned above. #### Which cloud storage system are you using? (e.g. Google Drive) This is not related to a specific backend. #### The command you were trying to run (e.g. `rclone copy /tmp remote:tmp`) `rclone copy -vv Source Remote --include E.txt` #### A log from the command with the `-vv` flag (e.g. output from `rclone -vv copy /tmp remote:tmp`) ```shell root@localhost:~/TEST# tree . └── Source ├── A │ └── D ├── B ├── C └── E.txt 5 directories, 1 file root@localhost:~/TEST# rclone copy -vv Source Remote --include E.txt 2024/03/24 23:51:52 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "-vv" "Source" "Remote" "--include" "E.txt"] 2024/03/24 23:51:52 DEBUG : Creating backend with remote "Source" 2024/03/24 23:51:52 DEBUG : Using config file from "/root/.config/rclone/rclone.conf" 2024/03/24 23:51:52 DEBUG : fs cache: renaming cache item "Source" to be canonical "/root/TEST/Source" 2024/03/24 23:51:52 DEBUG : Creating backend with remote "Remote" 2024/03/24 23:51:52 DEBUG : fs cache: renaming cache item "Remote" to be canonical "/root/TEST/Remote" 2024/03/24 23:51:52 DEBUG : A: Making directory with metadata 2024/03/24 23:51:52 INFO : A: Made directory with metadata (mtime=2024-03-24T23:50:07.378243503-07:00) 2024/03/24 23:51:52 DEBUG : Added delayed dir = "A", newDst=A 2024/03/24 23:51:52 DEBUG : B: Making directory with metadata 2024/03/24 23:51:52 INFO : B: Made directory with metadata (mtime=2024-03-24T23:50:01.04917523-07:00) 2024/03/24 23:51:52 DEBUG : Added delayed dir = "B", newDst=B 2024/03/24 23:51:52 DEBUG : C: Making directory with metadata 2024/03/24 23:51:52 INFO : C: Made directory with metadata (mtime=2024-03-24T23:50:03.246198928-07:00) 2024/03/24 23:51:52 DEBUG : Added delayed dir = "C", newDst=C 2024/03/24 23:51:52 DEBUG : E.txt: Need to transfer - File not found at Destination 2024/03/24 23:51:52 DEBUG : A/D: Making directory with metadata 2024/03/24 23:51:52 INFO : A/D: Made directory with metadata (mtime=2024-03-24T23:50:07.378243503-07:00) 2024/03/24 23:51:52 DEBUG : Added delayed dir = "A/D", newDst=A/D 2024/03/24 23:51:52 DEBUG : Local file system at /root/TEST/Remote: Waiting for checks to finish 2024/03/24 23:51:52 DEBUG : E.txt: md5 = d8e8fca2dc0f896fd7cb4cb0031ba249 OK 2024/03/24 23:51:52 DEBUG : E.txt.cihekil4.partial: renamed to: E.txt 2024/03/24 23:51:52 INFO : E.txt: Copied (new) 2024/03/24 23:51:52 DEBUG : Local file system at /root/TEST/Remote: Waiting for transfers to finish 2024/03/24 23:51:52 INFO : A/D: Set directory modification time (using SetModTime) 2024/03/24 23:51:52 INFO : C: Set directory modification time (using SetModTime) 2024/03/24 23:51:52 INFO : A: Set directory modification time (using SetModTime) 2024/03/24 23:51:52 INFO : B: Set directory modification time (using SetModTime) 2024/03/24 23:51:52 INFO : Transferred: 5 B / 5 B, 100%, 0 B/s, ETA - Transferred: 1 / 1, 100% Elapsed time: 0.0s 2024/03/24 23:51:52 DEBUG : 7 go routines active root@localhost:~/TEST# tree . ├── Remote │ ├── A │ │ └── D │ ├── B │ ├── C │ └── E.txt └── Source ├── A │ └── D ├── B ├── C └── E.txt 10 directories, 2 files ``` #### How to use GitHub * Please use the 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to show that you are affected by the same issue. * Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue. * Subscribe to receive notifications on status change and new comments.

asdffdsa · May 7, 2024, 7:00pm

correct, that is discussed in the forum and github.
fwiw, for now, i continue, still use last stable, v1.65.2

https://forum.rclone.org/t/how-to-ignore-empty-directories-when-uploading-from-windows/45057/22

https://github.com/rclone/rclone/issues/7689

phatmandrake · May 7, 2024, 7:13pm

Well I figured the empty directory thing would be the case, but I can't explain why the regex exclusions aren't working now.

system · June 6, 2024, 7:13pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.