# Issue with lsf -R --files-only - first line is blank **URL:** \ **Category:** Help and Support\ **Created:** [March 28, 2020, 2:24pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229 "2020-03-28T14:24:45Z")\ **Posts on this page:** 17\ **Page:** 1
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 2:24pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/1 "2020-03-28T14:24:45Z")
rclone v1.51.0 windows and linux `%rcmd% lsf -R --files-only remote:folder > destfiles.txt` the root folder has no files but in the output, the first line is blank. this only happens if the root folder has no files. in subfolders this does not happen > ``` > a/a.txt > b/b.txt > c/c.txt > d/dd/ddd/d.txt > > ``` ![image](https://forum.rclone.org/uploads/default/original/2X/5/5f8a771ed3fd0a89700d921e09ef73d133ed6f9d.png) ![image](https://forum.rclone.org/uploads/default/original/2X/2/263112d63c080b53de3b96c4286e365b1f6389a2.png) ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 28, 2020, 6:15pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/2 "2020-03-28T18:15:44Z")
Strange! What backend is this? If you do `rclone lsjson -R --files-only remote:folder > destfiles.json` does the first entry have an empty "Path" item? Can you post the first entry? ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 6:41pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/3 "2020-03-28T18:41:27Z")
remote: is an alias. i thought that when posting scripts for other users, it would be easier to understand. i tried to run the lsjson and pipe that output to a file but i was gettings errors on the command line that did not show in the json file. so here is the raw ouput for the alias and the actual remote. both lsf and lsjson ``` "remote": { "remote": "wasabieast2:aliasremote", "type": "alias" ``` > ------------start remote:\folder > > C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe lsf -R --files-only remote:\folder > > a/a.txt > b/b.txt > c/c.txt > ------------end remote:\folder > > ------------start wasabieast2:aliasremote\folder > > C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe lsf -R --files-only wasabieast2:aliasremote\folder > > a/a.txt > b/b.txt > c/c.txt > ------------end wasabieast2:aliasremote\folder > > ------------start remote:folder > > C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe lsjson -R --files-only remote:folder > [ > 2020/03/28 14:37:52 NOTICE: : Failed to read metadata: object not found > 2020/03/28 14:37:53 NOTICE: : Failed to read metadata: object not found > {"Path":"","Name":".","Size":0,"MimeType":"application/octet-stream","ModTime":"2020-03-28T14:37:52.610400200-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"a/a.txt","Name":"a.txt","Size":22,"MimeType":"text/plain; charset=utf-8","ModTime":"2020-03-28T10:51:27.633838900-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"b/b.txt","Name":"b.txt","Size":2,"MimeType":"text/plain","ModTime":"2020-03-27T17:21:40.772068600-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"c/c.txt","Name":"c.txt","Size":58,"MimeType":"text/plain; charset=utf-8","ModTime":"2020-03-28T10:51:32.639289600-04:00","IsDir":false,"Tier":"STANDARD"} > ] > > C:\data\rclone\scripts\rr\other\test\>echo ------------end remote:folder > ------------end remote:folder > > ------------start wasabieast2:aliasremote\folder > > C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe lsjson -R --files-only wasabieast2:aliasremote\folder > [ > 2020/03/28 14:37:57 NOTICE: : Failed to read metadata: object not found > 2020/03/28 14:37:57 NOTICE: : Failed to read metadata: object not found > {"Path":"","Name":".","Size":0,"MimeType":"application/octet-stream","ModTime":"2020-03-28T14:37:57.420412000-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"a/a.txt","Name":"a.txt","Size":22,"MimeType":"text/plain; charset=utf-8","ModTime":"2020-03-28T10:51:27.633838900-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"b/b.txt","Name":"b.txt","Size":2,"MimeType":"text/plain","ModTime":"2020-03-27T17:21:40.772068600-04:00","IsDir":false,"Tier":"STANDARD"}, > {"Path":"c/c.txt","Name":"c.txt","Size":58,"MimeType":"text/plain; charset=utf-8","ModTime":"2020-03-28T10:51:32.639289600-04:00","IsDir":false,"Tier":"STANDARD"} > ] > ------------end wasabieast2:aliasremote\folder ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 28, 2020, 6:49pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/4 "2020-03-28T18:49:58Z")
> [@asdffdsa](#): > > {"Path":"","Name":".","Size":0,"MimeType":"application/octet-stream","ModTime":"2020-03-28T14:37:52.610400200-04:00","IsDir":false,"Tier":"STANDARD"}, Is it possible you have an object called `.` in your wasabi bucket? That would certainly confuse rclone in this way! ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 7:00pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/5 "2020-03-28T19:00:52Z")
wasabi is s3 clone. what do you mean by object? i think that the minimum length for a folder is 3 characters. so i deleted the folder `folder`, created a new empty folder `newfolder` still getting > C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe lsjson -R --files-only wasabieast2:aliasremote\newfolder > [ > 2020/03/28 15:05:12 NOTICE: : Failed to read metadata: object not found > 2020/03/28 15:05:12 NOTICE: : Failed to read metadata: object not found > {"Path":"","Name":".","Size":0,"MimeType":"application/octet-stream","ModTime":"2020-03-28T15:05:12.802113600-04:00","IsDir":false,"Tier":"STANDARD"} > ] ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 7:34pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/6 "2020-03-28T19:34:18Z")
what is strange that rclone tree returns the correct info ``` / ├── a │ └── a.txt └── b └── b.txt 2 directories, 2 files ------------start wasabieast2:aliasremote\newfolder C:\data\rclone\scripts\rr\other\test>C:\data\rclone\scripts\rclone.exe lsf -R --files-only wasabieast2:aliasremote\newfolder a/a.txt b/b.txt ------------end wasabieast2:aliasremote\newfolder ------------start wasabieast2:aliasremote\newfolder C:\data\rclone\scripts\rr\other\test>C:\data\rclone\scripts\rclone.exe lsjson -R --files-only wasabieast2:aliasremote\newfolder [ 2020/03/28 15:34:42 NOTICE: : Failed to read metadata: object not found 2020/03/28 15:34:42 NOTICE: : Failed to read metadata: object not found {"Path":"","Name":".","Size":0,"MimeType":"application/octet-stream","ModTime":"2020-03-28T15:34:42.066068300-04:00","IsDir":false,"Tier":"STANDARD"}, {"Path":"a/a.txt","Name":"a.txt","Size":22,"MimeType":"text/plain","ModTime":"2020-03-28T19:18:09.000000000Z","IsDir":false,"Tier":"STANDARD"}, {"Path":"b/b.txt","Name":"b.txt","Size":2,"MimeType":"text/plain","ModTime":"2020-03-28T19:31:12.000000000Z","IsDir":false,"Tier":"STANDARD"} ] ------------end wasabieast2:aliasremote\newfolder ``` ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 7:44pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/7 "2020-03-28T19:44:42Z")
`rclone ls` is returning incorrect info notice there is a file of zero length and no name ------------start wasabieast2:aliasremote\newfolder C:\data\rclone\scripts\rr\other\test\>C:\data\rclone\scripts\rclone.exe ls wasabieast2:aliasremote\newfolder 0 22 a/a.txt 2 b/b.txt ------------end wasabieast2:aliasremote\newfolder ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 28, 2020, 7:50pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/8 "2020-03-28T19:50:51Z")
rclone lsf is also returning incorrect info. notice that the timestamp of the zero length file. each time i re-run the command, that timestamps changes to the current time the command is run. ``` ------------start wasabieast2:aliasremote\newfolder C:\data\rclone\scripts\rr\other\test>C:\data\rclone\scripts\rclone.exe lsl wasabieast2:aliasremote\newfolder 2020/03/28 15:48:48 NOTICE: : Failed to read metadata: object not found 0 2020-03-28 15:48:48.985526100 22 2020-03-28 15:18:09.000000000 a/a.txt 2 2020-03-28 15:31:12.000000000 b/b.txt ------------end wasabieast2:aliasremote\newfolder ``` ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 29, 2020, 11:55am UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/9 "2020-03-29T11:55:54Z")
I tried to replicate this on wasabi but I couldn't. Can you describe exactly how you created the failing environment - how did you upload the files and create the directories - so I can try to reproduce it here? ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 29, 2020, 2:38pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/10 "2020-03-29T14:38:46Z")
i figured it out. and why you cannot recreate it. if i `rclone.exe sync c:\path\to\local\folder\ wasabieast2:aliasremote\folder\` no problem, rclone creates the folder and `rclone.exe lsf -R --files-only wasabieast2:aliasremote\folder\` outputs as expected. wasabi has a rebranded version of cloudberry explorer. a gui frontend to s3 storage. the problem happens when i use the explorer to create another folder. `rclone lsf` output has the blank line in the output. so i logged into website [wasabi.com](http://wasabi.com), created another folder, then did rclone lsf. and again same problem. i added --dump headers and there is a difference this is from the dump header based on when creating the folder via wasabi. there is an extra content in the output but the dump header based on when rclone creates the folder, does not have this ``` folder/ 2020-03-29T15:49:33.000Z "dummy etag" 0 dummy iddummy name STANDARD ``` it only happens when i `rclone lsf -R` a wasabi created folder. but when i run the same command on the remote itself, no problem ``` rclone lsf --files-only -R wasabieast2:aliasremote rclone.created.folder/a.txt wasabi.created.folder/b.txt ``` ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 30, 2020, 9:50am UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/11 "2020-03-30T09:50:23Z")
So what is going on is that cloudberry is creating objects called `directory/` probably to hold metadata. Rclone knows how to ignore these, but I think it is also creating one at the root called `.` - this is the cause of the empty line. If you use, for example, the s3cmd tool to list the bucket, you'll see exactly which objects are in there. ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 30, 2020, 1:50pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/12 "2020-03-30T13:50:39Z")
thanks, i will try s3cmd, but what would s3cmd show, that rclone dump headers would not? if a folder named `.` was created, i do no see it in the dump headers. cloudberry is not the problem. wasabi is the problem. - error - if i create folder with cloudberry - error - if i create folder via wasabi website - no error - if rclone creates the folder ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 30, 2020, 3:24pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/13 "2020-03-30T15:24:30Z")
here is the output from s3cmd. i could be wrong but noticed that there are only three entries, not four seems that `s3://aliasremote/rclone.created.folder` is missing ``` C:\data\C\s3cmd>python s3cmd ls s3://aliasremote --recursive 2020-03-29 17:50 22 s3://aliasremote/rclone.created.folder/a.txt 2020-03-29 17:27 0 s3://aliasremote/wasabi.created.folder/ 2020-03-29 17:29 2 s3://aliasremote/wasabi.created.folder/b.txt ``` * * * ``` C:\data\C\s3cmd>python s3cmd ls s3://aliasremote DIR s3://aliasremote/rclone.created.folder/ DIR s3://aliasremote/wasabi.created.folder/ ``` * * * ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 30, 2020, 4:18pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/14 "2020-03-30T16:18:32Z")
> [@asdffdsa](#): > > i will try s3cmd, but what would s3cmd show, that rclone dump headers would not? Nothing, it is just slightly easier to read output! > [@asdffdsa](#): > > seems that `s3://aliasremote/rclone.created.folder` is missing Rclone doesn't create folders - that isn't a concept s3 has. S3 can only store objects and cloudberry/wasabi are emulating that by creating 0 length objects ending in `/`. I managed to replicate the problem by createing the directory in the web app ```auto $ rclone lsf -R --files-only wasabi:rclone-test2/wasabi-folder hello.txt ``` That blank line is rclone's internal representation of the current directory. Interestingly without `-R` I get this which is probably more like I expected. ```auto $ rclone lsf --files-only wasabi:rclone-test2/wasabi-folder 2020/03/30 17:14:56 ERROR : : Entry doesn't belong in directory "" (same as directory) - ignoring hello.txt ``` So what do you think rclone should do here? - silently ignore the directory markers? - given an ERROR - something else? ---
**Author:** ![asdffdsa](https://forum.rclone.org/letter_avatar_proxy/v4/letter/a/848f3c/32.png) [@asdffdsa](https://forum.rclone.org/u/asdffdsa)\ **Post date:** [March 30, 2020, 4:31pm UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/15 "2020-03-30T16:31:29Z")
so i am not going crazy being stuck at home. is there a use-case for a blank line in the output? such output is often fed back to rclone or used by other scripts. for `lsf --file-only`, for sure, remove that directory marker. I suggest "silently ignore the directory markers" ---
**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\ **Post date:** [March 31, 2020, 10:49am UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/16 "2020-03-31T10:49:00Z")
> [@asdffdsa](#): > > so i am not going crazy being stuck at home. 🙂 > [@asdffdsa](#): > > is there a use-case for a blank line in the output? I don't think so. > [@asdffdsa](#): > > I suggest "silently ignore the directory markers" The code does attempt to do that, but it is just failing at the root. I've fixed that and you can find it here [https://beta.rclone.org/v1.51.0-142-gb5f78cd7-beta/](https://beta.rclone.org/v1.51.0-142-gb5f78cd7-beta/) (uploaded in 15-30 mins) (which is also [the latest beta](https://beta.rclone.org) when it is built!) ---
**Author:** ![system](https://forum.rclone.org/uploads/default/original/2X/3/39ad3235f6ffec76ccd0c81616bd55697b4c300d.png) [@system](https://forum.rclone.org/u/system)\ **Post date:** [April 3, 2020, 10:49am UTC](https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/17 "2020-04-03T10:49:05Z")
Closed on April 3, 2020, 10:49am UTC This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.