New files in old dir


#21

Ok, now it is mounted.

And now what should i give you of the log?


#22

If i give

grep -rnw ‘rclone.log’ -e ‘Chicago Fire/Season07’

I have

519:2019/03/11 16:43:32 DEBUG : crypt/Serie_Tv/Chicago Fire/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/, err=
520:2019/03/11 16:43:32 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Attr:
521:2019/03/11 16:43:32 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
539:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/, err=
540:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Attr:
541:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
542:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: ReadDirAll:
546:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >ReadDirAll: item=7, err=
547:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.mkv”
548:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv, err=
549:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv: Attr:
550:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv: >Attr: a=valid=1s ino=0 size=3110364044 mode=-rw-r–r--, err=
551:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.nfo”
552:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo, err=
553:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo: Attr:
554:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo: >Attr: a=valid=1s ino=0 size=5049 mode=-rw-r–r--, err=
555:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.srt”
556:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt, err=
557:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt: Attr:
558:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt: >Attr: a=valid=1s ino=0 size=43557 mode=-rw-r–r--, err=
559:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).mkv”
560:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv, err=
561:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv: Attr:
562:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv: >Attr: a=valid=1s ino=0 size=2998483701 mode=-rw-r–r--, err=
563:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).nfo”
564:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo, err=
565:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo: Attr:
566:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo: >Attr: a=valid=1s ino=0 size=3168 mode=-rw-r–r--, err=
567:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).srt”
568:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt, err=
569:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt: Attr:
570:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt: >Attr: a=valid=1s ino=0 size=43848 mode=-rw-r–r--, err=
571:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“season.nfo”
572:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/season.nfo, err=
573:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/season.nfo: Attr:
574:2019/03/11 16:43:34 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/season.nfo: >Attr: a=valid=1s ino=0 size=429 mode=-rw-r–r--, err=
592:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/, err=
593:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Attr:
594:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
595:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: ReadDirAll:
596:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >ReadDirAll: item=7, err=
597:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.mkv”
598:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv, err=
599:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv: Attr:
600:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.mkv: >Attr: a=valid=1s ino=0 size=3110364044 mode=-rw-r–r--, err=
601:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.nfo”
602:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo, err=
603:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo: Attr:
604:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.nfo: >Attr: a=valid=1s ino=0 size=5049 mode=-rw-r–r--, err=
605:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E01.A Closer Eye.srt”
606:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt, err=
607:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt: Attr:
608:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E01.A Closer Eye.srt: >Attr: a=valid=1s ino=0 size=43557 mode=-rw-r–r--, err=
609:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).mkv”
610:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv, err=
611:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv: Attr:
612:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).mkv: >Attr: a=valid=1s ino=0 size=2998483701 mode=-rw-r–r--, err=
613:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).nfo”
614:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo, err=
615:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo: Attr:
616:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).nfo: >Attr: a=valid=1s ino=0 size=3168 mode=-rw-r–r--, err=
617:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“Chicago Fire.S07E02.Going to War (1).srt”
618:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt, err=
619:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt: Attr:
620:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/Chicago Fire.S07E02.Going to War (1).srt: >Attr: a=valid=1s ino=0 size=43848 mode=-rw-r–r--, err=
621:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: Lookup: name=“season.nfo”
622:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/: >Lookup: node=crypt/Serie_Tv/Chicago Fire/Season07/season.nfo, err=
623:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/season.nfo: Attr:
624:2019/03/11 16:43:41 DEBUG : crypt/Serie_Tv/Chicago Fire/Season07/season.nfo: >Attr: a=valid=1s ino=0 size=429 mode=-rw-r–r--, err=


#23

Uhm, nothing? You’d need to clear the cache and recreate the problem with a log as you didn’t have it in debug log before so unless you can go back to 9-March via time travel, you gotta reproduce it :slight_smile:


#24

So, i have to wait the next episode added.
I’ll give you the log then.


#25

Or just copy a test file up and try to recreate the issue.


#26

Sure, i didn’t tink about it :grinning:


#27

Well, here i am back.

This kind of situation is not happening for all series but sometimes.
For example this file is not updating on my local server, but it has been uploaded to gdrive from vps.

Here is the log on my vps:

grep -rnw rclone.log -e “Chicago P.D/Season06/Chicago P.D…S06E01”
84403:2019/03/13 02:35:04 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.mkv: received cache expiry notification
86232:2019/03/13 04:33:55 ERROR : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
87001:2019/03/13 06:47:30 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.it.srt: Copied (new)
87005:2019/03/13 06:47:30 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.nfo: Copied (new)
87805:2019/03/13 07:18:04 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.it.srt: received cache expiry notification
87806:2019/03/13 07:18:04 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.nfo: received cache expiry notification
88634:2019/03/13 07:48:03 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.nfo: Removed from cache
88637:2019/03/13 07:48:03 INFO : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.it.srt: Removed from cache

While on my local machine i have not lines with this:
grep -rnw rclone.log -e “Chicago P.D/Season06/Chicago P.D…S06E01”

What could i check or give you from my log?

I see this error in my vps log:
86232:2019/03/13 04:33:55 ERROR : crypt/Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF


#28

That error is a connection error to Google Drive as they had an outage last night for a few hours. Not sure what timezone you are in.

You’d want to look at the rclone mount debug where the file is missing, which I think is your local machine.

It should have an entry around 1 minute of when the file was uploaded.

What time was it uploaded?
Where is the log from the local machine that matches the same time?


#29

Mhh,
about that time i have plenty of:
ReadFileHandle.Read error: low level retry 10/10: unexpected EOF

What does it mean?


#30

Those errors mean it couldn’t connect to your google drive, retried 10 times and eventually failed.

As I noted in my previous post, I would surmise that was related to Google’s Mail/Drive outage last night.

If you can share the timestamp you uploaded the file and the actual log, that would be awesome.


#31

I think this is the time:
33849:2019/03/13 02:35:03 INFO : Serie_Tv/Chicago P.D/Season06/Chicago P.D…S06E01.Tutto come prima.mkv: Copied (new)


#32

Can you share the local debug full log as well?


#33

The full log is impossibile as it is 1 gb big.
I pasted from 2019/03/13 02:00 to 2019/03/13 04:59 log.
Tell me if i should post something else.

https://paste2.org/OKdn1f7y

I don’t think there anything interesting in this log.


#34

Can you zip it up and just message me or something? The full log would be super helpful.


#35

I’m zipping it, but how can i send you the file?

I can wetransfer it, but to which mail?


#36

Put it in gdrive and pm him the link after adjusting permissions on the gdrive file maybe.


#37

Yes, it was so easy, but didn’t think about it :grinning:

Sent pm to @Animosity022

Tnx


#38

@ncw - Is this a bad file or something ?

2019/03/14 08:09:05 NOTICE: Encrypted drive 'cachecrypt:/': ChangeNotify was unable to decrypt "Due Bi": illegal base32 data at input byte 3

I think unfortunately, you hit problems as GD had an outage.

2019/03/13 06:05:45 ERROR : crypt/56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/hf6j0gsqtu4ptmr81n2gh1i59rd0h0i2vc31lhne3b4muq85ed2d
i4m077965cot6674ft4bub6a2/ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rco: (29270279
36/12408090462) error (chunk not found 2925527040) response
2019/03/13 06:06:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:07:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:08:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:08:30 ERROR : worker-0 <ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rc
o>: object open failed 2915041280: open file failed: googleapi: got HTTP response code 503 with body: Service Unavailable
2019/03/13 06:09:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:10:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:11:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:11:35 ERROR : worker-0 <ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rc
o>: object open failed 2915041280: open file failed: googleapi: got HTTP response code 503 with body: Service Unavailable
2019/03/13 06:12:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:13:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:14:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:15:01 ERROR : worker-0 <ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rc
o>: object open failed 2915041280: open file failed: googleapi: got HTTP response code 503 with body: Service Unavailable
2019/03/13 06:15:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:16:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:17:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:18:05 INFO  : Cleaned the cache: objects 5 (was 5), total size 6.039k (was 6.039k)
2019/03/13 06:18:31 ERROR : worker-0 <ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rc
o>: object open failed 2915041280: open file failed: googleapi: got HTTP response code 503 with body: Service Unavailable

I’m not sure how the polling would handle if GD has an outage.

The other piece that seems odd is you are seeing chunk errors:

2019/03/13 06:05:45 ERROR : crypt/56bq628lpesuhej1jugfhjidgk/e41ub3n51ua7la4j3ijtpacdt0/hf6j0gsqtu4ptmr81n2gh1i59rd0h0i2vc31lhne3b4muq85ed2di4m077965cot6674ft4bub6a2/ceq34kl8joftk79scoc7fnn025mm5jc5ma2f5cg4dtq2i67n1fvbsvoroprekci0kpf1011ka2c9u062batusdu96dtuki1jud16rco: (2927027936/12408090462) error (chunk not found 2925527040) response

I’m not sure if that is also related back to the outage or not too.

2019/03/11 16:42:27 INFO  : gcache: Chunk Size: 10M

is really small too. I’d make that 32M or 64M.


#39

Do you think a db purge can help solve some problems?


#40

I mean with the outage, I’d definitely remove all the chunks and clean the cache.db.

You can do that by stopping the process and just removing the cache directory and the cache.db file that is named as the remote.