Basic question. How can i a dedupe for directory names, as opposed to file names? the dedupe synopsis talks about file names, which is fine, but i have a directory issue. should it work for both?
Jared
Yes, you can dedupe directories.
ok. it's throwing an error at me. here's the debug log. also, you might find it interesting that i synced this existing directory, with no changes made to it, with rclone 1.54.1 and i ended up with a ton of duplicated directories.
C:\rclone 1.53.2>rclone dedupe --verbose -vv "JOfficeHome2:SL Server\Tamara\Pictures\iPhoto Library.migratedphotolibrary\Database\Versions\2012\05\16\20120516-231438"
2021/03/29 08:21:49 DEBUG : rclone: Version "v1.53.2" starting with parameters ["rclone" "dedupe" "--verbose" "-vv" "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438"]
2021/03/29 08:21:49 DEBUG : Using config file from "C:\\Users\\Administrator\\.config\\rclone\\rclone.conf"
2021/03/29 08:21:49 DEBUG : Creating backend with remote "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438"
2021/03/29 08:21:49 DEBUG : One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438': Token expired but no uploads in progress - doing nothing
2021/03/29 08:21:49 DEBUG : JOfficeHome2: Loaded invalid token from config file - ignoring
2021/03/29 08:21:50 DEBUG : Keeping previous permissions for config file: -rw-rw-rw-
2021/03/29 08:21:50 DEBUG : JOfficeHome2: Saved new token in config file
2021/03/29 08:21:55 DEBUG : fs cache: renaming cache item "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438" to be canonical "JOfficeHome2:SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438"
2021/03/29 08:21:55 INFO : One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438': Looking for duplicates using interactive mode.
2021/03/29 08:22:03 DEBUG : 5 go routines active
2021/03/29 08:22:03 Failed to dedupe: One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438': can't merge directories
When you first posted, there was a superb, well written, excellent help template that collects all the right information so help you out.
Sadly, you deleted it, did not use it and an angel did not get their wings.
If you want to include that information, we may give you a pass and still try to help you if you promise to help out that angel so they can get their wings.
i am quite sure the debug log i posted includes all of the information that the help template requests except for my windows version.
but. since you are always so helpful, i will go get the template and fill it for you 
give me a few minutes..
Missing your rclone.conf.
Missing the OS, but seems to be windows.
You are using an old version and the template asks you to update to the current version.
If you want to kill angels, that's all on you.
1 Like
i'm flattered, but i must say your opinion is too high. perhaps some day....
i will update my rclone version and try again.
What is the problem you are having with rclone?
trying to dedupe directory names, not file names.
What is your rclone version (output from rclone version)
1.54.1
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Windows Server 2019
Which cloud storage system are you using? (eg Google Drive)
OneDrive Personal
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone dedupe
The rclone config contents with secrets removed.
[JOfficeHome2]
type = onedrive
token =
drive_id = 74f3603088d021d2
drive_type = personal
[JOfficeHome2Crypt]
type = crypt
remote = JOfficeHome2:SL Server
filename_encryption = standard
directory_name_encryption = false
password =
A log from the command with the -vv flag
C:\rclone 1.54.1>rclone dedupe --verbose -vv "JOfficeHome2:SL Server\Tamara\Pictures\iPhoto Library.migratedphotolibrary\Database\Versions\2012\05\16\20120516-231438"
2021/03/29 08:41:29 DEBUG : rclone: Version "v1.54.1" starting with parameters ["rclone" "dedupe" "--verbose" "-vv" "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438"]
2021/03/29 08:41:29 DEBUG : Using config file from "C:\\Users\\Administrator\\.config\\rclone\\rclone.conf"
2021/03/29 08:41:29 DEBUG : Creating backend with remote "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438"
2021/03/29 08:41:32 DEBUG : fs cache: renaming cache item "JOfficeHome2:SL Server\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Database\\Versions\\2012\\05\\16\\20120516-231438" to be canonical "JOfficeHome2:SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438"
2021/03/29 08:41:32 NOTICE: One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438': Can't have duplicate names here. Perhaps you wanted --by-hash ? Continuing anyway.
2021/03/29 08:41:32 INFO : One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Database/Versions/2012/05/16/20120516-231438': Looking for duplicate names using interactive mode.
2021/03/29 08:41:46 DEBUG : 3 go routines active
Onedrive doesn't support duplicated directory names as far as I know hence this message
So I'm not sure what you are trying to do exactly. Can you explain with an example please?
i upgraded to rclone 1.54.1, the other day, and it found a bunch of changes in the issue directory and proceeded to update the cloud remote; OneDrive in this case. i was pretty certain the directory hadn't changed, but i was like..ok. a few hours later i had two 180GB directories filled with duplicate folders, and rclone had errored out after it had uploaded the "changed" items and started trying to delete the existing ones. here's a screenshot:
one example of a bunch.
so. i'm trying to deploy dedupe on this situation to solve it. no joy.
Jared
p.s. if you look closely you can see that even though the names are the same, the font doesn't line up. is there perhaps a character somewhere that the new rclone didn't like? in case you're wondering, this is an apple iPhoto directory, not an rclone crypt directory. the folders are also listed as shown locally.
I'm afraid you are a victim of this change
We discovered we were encoding % and # where we didn't need to so we removed the encoding. However this causes the problem that you see which is unfortunate.
If you add % and # back to the encoding then rclone will work as before but you probably don't want to do that.
How do you transfer your files - with rclone sync? I'm guessing not as rclone would have tidied up the old directories and files. Do you use rclone copy?
If you have let the sync/copy continue then you could remove all the files with the funny unicode % and # symbols with a filter.
story of my life. one small change and the cart wheels wobble and then go flying. one must appreciate the vast scenarios these file transferring tools must work for though...
i want to progress. that seems like a dumb thing to stay behind for.
i am always using sync for this particular application. the idea is to have two directories that are the same. not wondering which file is the correct one. but sync doesn't clear it up. rclone errors out, that's why i was perusing the dedupe. i will run the sync again with v1.54.1 and send you the error. give me a bit.
Jared
If you are using sync then it should fix everything. If you add the --track-renames flag then rclone won't have to upload stuff it can just rename it.
here is the error i'm running into. i grabbed what i could, but the -vv log level fills everything up quite fast
2021/03/31 08:44:26 ERROR : iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626/YBY9%1eSR7OCTu5sEEpiPg/._IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 08:44:26 ERROR : iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626/YBY9%1eSR7OCTu5sEEpiPg/._thumb_IMG_1264_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 08:44:26 ERROR : iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626/YBY9%1eSR7OCTu5sEEpiPg/._thumb_IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 08:44:26 ERROR : iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626/YBY9%1eSR7OCTu5sEEpiPg/IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
Jared
ok here's a more complete log. showing the command and all. all i did was delete a bunch of the debug logs that are just standard operation. i left a space where they were so you can see.
i notice on this log that there are also invalid character names that didn't used to be a problem...
Microsoft Windows [Version 10.0.17763.1817]
(c) 2018 Microsoft Corporation. All rights reserved.
C:\Users\Administrator>cd C:\rclone 1.54.1
C:\rclone 1.54.1>rclone sync --verbose -vv "C:\Users\Administrator\Documents\Shares\Tamara\Pictures\iPhoto Library.migratedphotolibrary\Thumbnails\2015\03\11\20150311-083626" "JOfficeHome2Crypt:Tamara\Pictures\iPhoto Library.migratedphotolibrary\Thumbnails\2015\03\11\20150311-083626"
2021/03/31 13:49:20 DEBUG : rclone: Version "v1.54.1" starting with parameters ["rclone" "sync" "--verbose" "-vv" "C:\\Users\\Administrator\\Documents\\Shares\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626" "JOfficeHome2Crypt:Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626"]
2021/03/31 13:49:20 DEBUG : Creating backend with remote "C:\\Users\\Administrator\\Documents\\Shares\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626"
2021/03/31 13:49:20 DEBUG : Using config file from "C:\\Users\\Administrator\\.config\\rclone\\rclone.conf"
2021/03/31 13:49:20 DEBUG : fs cache: renaming cache item "C:\\Users\\Administrator\\Documents\\Shares\\Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626" to be canonical "//?/C:/Users/Administrator/Documents/Shares/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626"
2021/03/31 13:49:20 DEBUG : Creating backend with remote "JOfficeHome2Crypt:Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626"
2021/03/31 13:49:20 DEBUG : Creating backend with remote "JOfficeHome2:SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/8jvsanbikvkkpkbq4nea0bp55k"
2021/03/31 13:49:20 DEBUG : One drive root 'SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/8jvsanbikvkkpkbq4nea0bp55k': Token expired but no uploads in progress - doing nothing
2021/03/31 13:49:20 DEBUG : JOfficeHome2: Loaded invalid token from config file - ignoring
2021/03/31 13:49:20 DEBUG : Keeping previous permissions for config file: -rw-rw-rw-
2021/03/31 13:49:20 DEBUG : JOfficeHome2: Saved new token in config file
2021/03/31 13:49:26 DEBUG : Creating backend with remote "JOfficeHome2:SL Server/Tamara/Pictures/iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626"
2021/03/31 13:49:29 DEBUG : fs cache: renaming cache item "JOfficeHome2Crypt:Tamara\\Pictures\\iPhoto Library.migratedphotolibrary\\Thumbnails\\2015\\03\\11\\20150311-083626" to be canonical "JOfficeHome2Crypt:Tamara/Pictures/iPhoto Library.migratedphotolibrary/Thumbnails/2015/03/11/20150311-083626"
2021/03/31 13:49:35 ERROR : xoEgH%1eT2iRnk4hrOe9jg/._thumb_IMG_1123.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._IMG_0849.jpg: Size and modification time the same (differ by -840ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._IMG_0849.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._IMG_0849_1024.jpg: Size and modification time the same (differ by -850ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._thumb_IMG_0849.jpg: Size and modification time the same (differ by -140ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/IMG_0849.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/IMG_0849_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/thumb_IMG_0849.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._thumb_IMG_0849_1024.jpg: Size and modification time the same (differ by -850ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/thumb_IMG_0849_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._IMG_0849_1024.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %CFVJsKwT9CHMicBksT9AQ/._IMG_1037.jpg: Size and modification time the same (differ by -510ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._thumb_IMG_0849.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/IMG_0849.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/IMG_0849_1024.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/thumb_IMG_0849.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %MnbwnLaTLOKiulvV+JnUw/._thumb_IMG_0849_1024.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %gao5SgKR5G+WHUiemau6A/._thumb_IMG_1260_face0.jpg: Size and modification time the same (differ by -390ms, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %gao5SgKR5G+WHUiemau6A/IMG_1260.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 ERROR : xoEgH%1eT2iRnk4hrOe9jg/._IMG_1123.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:35 DEBUG : %gao5SgKR5G+WHUiemau6A/._thumb_IMG_1260.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %gao5SgKR5G+WHUiemau6A/IMG_1260_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %gao5SgKR5G+WHUiemau6A/thumb_IMG_1260.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:35 DEBUG : %h9lHsu8S8Ok%ex2PFBYKA/IMG_0693.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %h9lHsu8S8Ok%ex2PFBYKA/IMG_0693_1024.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %h9lHsu8S8Ok%ex2PFBYKA/thumb_IMG_0693.jpg: Unchanged skipping
2021/03/31 13:49:35 DEBUG : %h9lHsu8S8Ok%ex2PFBYKA/thumb_IMG_0693_1024.jpg: Unchanged skipping
2021/03/31 13:49:35 ERROR : xoEgH%1eT2iRnk4hrOe9jg/._IMG_1123_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:35 ERROR : xoEgH%1eT2iRnk4hrOe9jg/._thumb_IMG_1123_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:35 ERROR : xoEgH%1eT2iRnk4hrOe9jg/IMG_1123.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:36 ERROR : xoEgH%1eT2iRnk4hrOe9jg/IMG_1123_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:36 DEBUG : %pm4H3%LRvKzSAaoyBsPKg/._IMG_0720.jpg: Size and modification time the same (differ by -20ms, within tolerance 1s)
2021/03/31 13:49:36 DEBUG : %pm4H3%LRvKzSAaoyBsPKg/._IMG_0720.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/._thumb_IMG_1091.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/thumb_IMG_1091_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/thumb_IMG_1091_face0.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:36 ERROR : xoEgH%1eT2iRnk4hrOe9jg/thumb_IMG_1123.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/._thumb_IMG_1091_1024.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/._thumb_IMG_1091_face0.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/IMG_1091.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +B7gSsWySzKFC2iENJXbwA/IMG_1091_1024.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +IiTiPF3SSixgw6fcWfLGQ/thumb_IMG_1013_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:36 DEBUG : +IiTiPF3SSixgw6fcWfLGQ/._IMG_1013_1024.jpg: Unchanged skipping
2021/03/31 13:49:36 ERROR : xoEgH%1eT2iRnk4hrOe9jg/thumb_IMG_1123_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:36 DEBUG : +IiTiPF3SSixgw6fcWfLGQ/._thumb_IMG_1013.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +IiTiPF3SSixgw6fcWfLGQ/._thumb_IMG_1013_1024.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +IiTiPF3SSixgw6fcWfLGQ/IMG_1013.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +HKyvrAeQbqogEsxmloDQA/thumb_IMG_0301.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +HKyvrAeQbqogEsxmloDQA/thumb_IMG_0301_face0.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:36 DEBUG : +HKyvrAeQbqogEsxmloDQA/thumb_IMG_0301_1024.jpg: Unchanged skipping
2021/03/31 13:49:36 DEBUG : +HKyvrAeQbqogEsxmloDQA/thumb_IMG_0301_face0.jpg: Unchanged skipping
2021/03/31 13:49:36 ERROR : 5svbSX9zSz6S%2aVbSABtg/._IMG_1019.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:36 ERROR : 5svbSX9zSz6S%2aVbSABtg/._IMG_1019_1024.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/._IMG_0696.jpg: Size and modification time the same (differ by -190ms, within tolerance 1s)
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/._IMG_0696.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/._thumb_IMG_0696.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/IMG_0696.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/IMG_0696_1024.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/thumb_IMG_0696_1024.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +Sv%CsJ0TyOBi5PI+g2oGQ/thumb_IMG_0696.jpg: Unchanged skipping
2021/03/31 13:49:37 ERROR : 5svbSX9zSz6S%2aVbSABtg/._thumb_IMG_1019.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:37 DEBUG : +hbzeQcKQ5ygRErlEBCp0g/._IMG_1289_1024.jpg: Size and modification time the same (differ by -40ms, within tolerance 1s)
2021/03/31 13:49:37 DEBUG : +hbzeQcKQ5ygRErlEBCp0g/._IMG_1289_1024.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +eju3041TzWRFULE9Y90Yw/thumb_IMG_1110.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +tTTYFvUQi2E8jSuSxBHGw/._IMG_0378.jpg: Size and modification time the same (differ by -440ms, within tolerance 1s)
2021/03/31 13:49:37 DEBUG : +tTTYFvUQi2E8jSuSxBHGw/._IMG_0378_1024.jpg: Size and modification time the same (differ by -950ms, within tolerance 1s)
2021/03/31 13:49:37 ERROR : 5svbSX9zSz6S%2aVbSABtg/._thumb_IMG_1019_1024.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:37 DEBUG : +eju3041TzWRFULE9Y90Yw/thumb_IMG_1110_1024.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +hg5gBGQTOeoOnI+T2N72A/thumb_IMG_1228.jpg: Unchanged skipping
2021/03/31 13:49:37 DEBUG : +hg5gBGQTOeoOnI+T2N72A/thumb_IMG_1228_1024.jpg: Unchanged skipping
2021/03/31 13:49:37 ERROR : 5svbSX9zSz6S%2aVbSABtg/IMG_1019.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:37 ERROR : 5svbSX9zSz6S%2aVbSABtg/IMG_1019_1024.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:38 ERROR : 5svbSX9zSz6S%2aVbSABtg/thumb_IMG_1019.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:38 DEBUG : 0%UOGeN4RFyDhRH80WREJQ/._IMG_0648_1024.jpg: Size and modification time the same (differ by -820ms, within tolerance 1s)
2021/03/31 13:49:38 DEBUG : 0%UOGeN4RFyDhRH80WREJQ/._IMG_0648_1024.jpg: Unchanged skipping
2021/03/31 13:49:38 DEBUG : 0eNfKEwNRX6ojOK6OVnv9Q/._thumb_IMG_0888.jpg: Size and modification time the same (differ by -200ms, within tolerance 1s)
2021/03/31 13:49:38 DEBUG : 0eNfKEwNRX6ojOK6OVnv9Q/._thumb_IMG_0888_1024.jpg: Size and modification time the same (differ by -520ms, within tolerance 1s)
2021/03/31 13:49:38 ERROR : 5svbSX9zSz6S%2aVbSABtg/thumb_IMG_1019_1024.jpg: Failed to copy: invalidRequest: nameContainsInvalidCharacters: One or more invalid characters are present in the path (/5svbSX9zSz6S*VbSABtg).
2021/03/31 13:49:38 DEBUG : 0eNfKEwNRX6ojOK6OVnv9Q/IMG_0888.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:38 DEBUG : 0eNfKEwNRX6ojOK6OVnv9Q/IMG_0888_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:38 DEBUG : 0qEc6eclSh6ajGOwYIjCzA/thumb_IMG_0807_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:38 DEBUG : 0qEc6eclSh6ajGOwYIjCzA/thumb_IMG_0807.jpg: Unchanged skipping
2021/03/31 13:49:38 DEBUG : 0qEc6eclSh6ajGOwYIjCzA/thumb_IMG_0807_1024.jpg: Unchanged skipping
2021/03/31 13:49:38 ERROR : YBY9%1eSR7OCTu5sEEpiPg/._IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:38 ERROR : YBY9%1eSR7OCTu5sEEpiPg/._IMG_1264_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/._thumb_IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/._thumb_IMG_1264_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 DEBUG : 1%dYHAB0QpStjzUUTOemoQ/._IMG_0790_1024.jpg: Size and modification time the same (differ by -670ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 1%dYHAB0QpStjzUUTOemoQ/._IMG_0790_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1HFnEUbqTNqgAXN2yyTUjA/thumb_IMG_0646.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1HFnEUbqTNqgAXN2yyTUjA/thumb_IMG_0646_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 DEBUG : 1+nNg6JiQnSt9kap%wBJWQ/._IMG_0389.jpg: Size and modification time the same (differ by -20ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 1+nNg6JiQnSt9kap%wBJWQ/._IMG_0389_1024.jpg: Size and modification time the same (differ by -680ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/thumb_IMG_0336.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/._IMG_0336.jpg: Unchanged skipping
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/IMG_1264_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/._IMG_0336_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/._thumb_IMG_0336_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/IMG_0336.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/._thumb_IMG_0336_face0.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/._thumb_IMG_0336.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/IMG_0336_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/thumb_IMG_0336_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/thumb_IMG_0336_face0.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/thumb_IMG_0336_face0.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 1Myoqn3ITwWSwOUOj6KG3g/thumb_IMG_0336_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/thumb_IMG_1264.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._IMG_0612.jpg: Size and modification time the same (differ by -510ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._IMG_0612.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._thumb_IMG_0612.jpg: Size and modification time the same (differ by -30ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/IMG_0612.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._thumb_IMG_0612_1024.jpg: Size and modification time the same (differ by -990ms, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/thumb_IMG_0612.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/thumb_IMG_0612_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._thumb_IMG_0612.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/IMG_0612.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/._thumb_IMG_0612_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/thumb_IMG_0612.jpg: Unchanged skipping
2021/03/31 13:49:39 DEBUG : 0vViffwjTbKH%vrcXW%AtQ/thumb_IMG_0612_1024.jpg: Unchanged skipping
2021/03/31 13:49:39 ERROR : YBY9%1eSR7OCTu5sEEpiPg/thumb_IMG_1264_1024.jpg: Failed to copy: UnknownError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid URL</h2>
<hr><p>HTTP Error 400. The request URL is invalid.</p>
</BODY></HTML>
2021/03/31 13:49:40 DEBUG : 1mKdOTKdQVeteb0+NweXyw/._IMG_0295.jpg: Size and modification time the same (differ by -160ms, within tolerance 1s)
2021/03/31 13:49:40 DEBUG : 1mKdOTKdQVeteb0+NweXyw/._IMG_0295.jpg: Unchanged skipping
2021/03/31 13:49:42 DEBUG : 5Rx%RdycSWeDLsEoACxOAg/IMG_0553.jpg: Unchanged skipping
2021/03/31 13:49:42 DEBUG : 5Rx%RdycSWeDLsEoACxOAg/._thumb_IMG_0553_face1.jpg: Unchanged skipping
2021/03/31 13:49:42 DEBUG : 5Rx%RdycSWeDLsEoACxOAg/IMG_0553_1024.jpg: Unchanged skipping
2021/03/31 13:49:42 DEBUG : 5Rx%RdycSWeDLsEoACxOAg/thumb_IMG_0553.jpg: Unchanged skipping
2021/03/31 13:49:42 DEBUG : 5Rx%RdycSWeDLsEoACxOAg/thumb_IMG_0553_1024.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
C:\rclone 1.54.1>
Jared
It seems to be complaining about that name probably the %1e
Which makes me think it might be related to OneDrive special character treatment (%): possible url escaping bug · Issue #5127 · rclone/rclone · GitHub which in turn is caused by a onedrive bug Double URL unescaping in uploads causing problems with files with % · Issue #1455 · OneDrive/onedrive-api-docs · GitHub which microsoft are investigating.
1 Like
alright. so at this point i can but wait?
If you could do me a log of the above test with -vv --dump responses --retries 1 I'll double check that rclone is doing the right thing.
i sent it to you in a direct message because i wasn't sure if there was any compromising info in it or not.
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.