Problem with medusa


#1

Hello, i have a problem when i post-process a file with medusa to my folder mounted with rclone.
I have a rclone cache mounted with this settings:
–allow-other
–dir-cache-time=160h
–cache-chunk-size=10M
–cache-info-age=168h
–cache-workers=5
–cache-tmp-upload-path /home/master/rclone_upload
–cache-tmp-wait-time 60m
–cache-db-purge
–buffer-size 0M
–log-file=/home/master/rclonemount.log
–log-level INFO
Log errors:
2018/05/11 20:03:58 INFO : Series/The Terror/Season 01/The Terror - S01E05 - El primero que le da, gana [1080p WEB-DL].mkv: put: uploaded in temp fs
2018/05/11 20:03:58 INFO : Series/The Terror/Season 01/The Terror - S01E05 - El primero que le da, gana [1080p WEB-DL].mkv: put: queued for upload
2018/05/11 20:03:58 INFO : Series/The Terror/Season 01: put: cache expired
2018/05/11 20:04:36 INFO : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: put: uploaded in temp fs
2018/05/11 20:04:37 INFO : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: put: queued for upload
2018/05/11 20:04:37 INFO : Series/El ilusionista/Season 01: put: cache expired
2018/05/11 20:04:37 ERROR : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: WriteFileHandle.Write: error: Bad file descriptor
2018/05/11 20:04:42 INFO : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: put: uploaded in temp fs
2018/05/11 20:04:42 INFO : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: put: queued for upload
2018/05/11 20:04:42 INFO : Series/El ilusionista/Season 01: put: cache expired
2018/05/11 20:04:42 ERROR : Series/El ilusionista/Season 01/El ilusionista - S01E08 - Múltiples salidas [1080p WEB-DL].mkv: WriteFileHandle.Write: error: Bad file descriptor
2018/05/11 01:24:04 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: put: uploaded in temp fs
2018/05/11 01:24:04 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: put: queued for upload
2018/05/11 01:24:04 INFO : Series/A.P. Bio/Season 01: put: cache expired
2018/05/11 01:24:04 ERROR : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: WriteFileHandle.Write: error: Bad file descriptor
2018/05/11 01:24:06 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: put: uploaded in temp fs
2018/05/11 01:24:06 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: put: queued for upload
2018/05/11 01:24:06 INFO : Series/A.P. Bio/Season 01: put: cache expired
2018/05/11 01:24:06 ERROR : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: WriteFileHandle.Write: error: Bad file descriptor
2018/05/11 01:24:22 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E02 - La cárcel de profesores [1080p WEB-DL].mkv: received cache expiry notification
2018/05/11 01:24:22 INFO : Series/A.P. Bio/Season 01/A.P. Bio - S01E05 - Saliendo con toledanas [1080p WEB-DL].mkv: received cache expiry notification


#2

Try adding --vfs-cache-mode writes and see if that helps.


#3

Did you run out of space in your tmp file system? What version are you running?


#4

I have 1.40 version
I had 200gb free space un HD, its a VPS
Trying with vfs cache mode writes now we will see, thanks for the help!


#5

I wouldn’t mix cache mode writes with tmp-upload.

Make sure to update the 1.41.


#6

So update and what modes you recommend?


#7

I’d leave the settings as you have it and validate the cache polling fixes do the job.

You didn’t run out of space in the cache-tmp area?


#8

No, and i have the same problem before run cache, i put cache 1 week ago trying to fix this errors uploading


#9

Can you -vvv or use the log-level DEBUG and see what the debug shows? I don’t use cache-db-purge myself and only kill -HUP the process if I need to redo the cache.


#10

No way to use Debug mode, in 10 minutes 500MB log file


#11

Just lower the tmp time settings to a few minutes and test it out. Logs are key :slight_smile:


#12
2018/05/13 06:34:56 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=<nil>

2018/05/13 06:34:56 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=4718592
2018/05/13 06:34:56 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=4849664
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=4980736
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=5111808
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=5242880
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=5373952
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=5505024
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=131072, err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Flush:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv(0xc420d9a060): close:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: Couldn’t find file - need to transfer
2018/05/13 06:34:57 DEBUG : Cache remote cache:: put data at ‘Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv’
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series/Blindspot/Season 03
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series/Blindspot
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: forgetting directory cache
2018/05/13 06:34:57 INFO : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: put: uploaded in temp fs
2018/05/13 06:34:57 INFO : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: put: queued for upload
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: pending upload found
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: put: added to cache
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series/Blindspot/Season 03
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series/Blindspot
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired Series
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: cache: expired
2018/05/13 06:34:57 INFO : Series/Blindspot/Season 03: put: cache expired
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: forgetting directory cache
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: object hash cached: 22c75a64398d654ed142f0675156111b
2018/05/13 06:34:57 INFO : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: Copied (new)
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: transferred to remote
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv(0xc420d9a060): >close: err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Flush: err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Write: len=131072, offset=5636096
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Write: written=0, err=bad file descriptor
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Flush:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv(0xc420d9a060): RWFileHandle.Flush nothing to do
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Flush: err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Flush:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv(0xc420d9a060): RWFileHandle.Flush nothing to do
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Flush: err=
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: Release:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv(0xc420d9a060): RWFileHandle.Release nothing to do
2018/05/13 06:34:57 DEBUG : &{Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv (rw)}: >Release: err=
2018/05/13 06:34:57 DEBUG : /: Lookup: name=“Series”
2018/05/13 06:34:57 DEBUG : /: >Lookup: node=Series/, err=
2018/05/13 06:34:57 DEBUG : Series/: Attr:
2018/05/13 06:34:57 DEBUG : Series/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2018/05/13 06:34:57 DEBUG : /: Lookup: name=“Series”
2018/05/13 06:34:57 DEBUG : /: >Lookup: node=Series/, err=
2018/05/13 06:34:57 DEBUG : Series/: Attr:
2018/05/13 06:34:57 DEBUG : Series/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2018/05/13 06:34:57 DEBUG : Series/: Lookup: name=“Blindspot”
2018/05/13 06:34:57 DEBUG : Series/: >Lookup: node=Series/Blindspot/, err=
2018/05/13 06:34:57 DEBUG : Series/Blindspot/: Attr:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2018/05/13 06:34:57 DEBUG : Series/Blindspot/: Lookup: name=“Season 03”
2018/05/13 06:34:57 DEBUG : Series/Blindspot/: >Lookup: node=Series/Blindspot/Season 03/, err=
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/: Attr:
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/: Lookup: name=“Blindspot - S03E15 - Deducible [720p WEB-DL].mkv”
2018/05/13 06:34:57 DEBUG : Cache remote cache:: list ‘Series/Blindspot/Season 03’
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: pending upload found
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cold listing: 2018-05-06 06:34:57.554873725 +0200 CEST
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: read 1 from temp fs
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: temp fs entries: [Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv]
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: pending upload found
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: list: cached temp object
2018/05/13 06:34:57 DEBUG : Series/Mentes Criminales/Season 13/Mentes Criminales - S13E01 - Despegamos [720p WEB-DL].mkv: Sending chunk 914358272 length 8388608
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: read 17 from source
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: source entries: [Series/Blindspot/Season 03/Blindspot - S03E16 - Maniobra de evasión [720p WEB-DL].mkv Series/Blindspot/Season 03/Blindspot - S03E14 - Sin fin [720p WEB-DL].mkv Series/Blindspot/Season 03/Blindspot - S03E18 - Una noche movida [720p WEB-DL].mkv Series/Blindspot/Season 03/Blindspot - S03E17 - Ni una palabra [720p WEB-DL].mkv Series/Blindspot/Season 03/Blindspot - S03E13 - Disparo de advertencia [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E03 - Entre nosotros vuelca un transporte [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E12 - Dos colegas legendarios [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E11 - Magos de la tecnología [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E10 - Balanza de poder [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E09 - Al rojo vivo - En llamas [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E08 - Ciudadanos encubiertos [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E07 - Un regalo contagioso [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E06 - Adorar al sospechoso [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E05 - El legado profundo [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E04 - Sigue luchando con armas [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E02 - Caja de sorpresas enemiga [720p HDTV].mkv Series/Blindspot/Season 03/Blindspot - S03E01 - Vuelta al pie del cañón [720p HDTV].mkv]
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E16 - Maniobra de evasión [720p WEB-DL].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E14 - Sin fin [720p WEB-DL].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E18 - Una noche movida [720p WEB-DL].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E17 - Ni una palabra [720p WEB-DL].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E13 - Disparo de advertencia [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E03 - Entre nosotros vuelca un transporte [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E12 - Dos colegas legendarios [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E11 - Magos de la tecnología [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E10 - Balanza de poder [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E09 - Al rojo vivo - En llamas [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E08 - Ciudadanos encubiertos [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E07 - Un regalo contagioso [720p HDTV].mkv
2018/05/13 06:34:57 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E06 - Adorar al sospechoso [720p HDTV].mkv
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E05 - El legado profundo [720p HDTV].mkv
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E04 - Sigue luchando con armas [720p HDTV].mkv
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E02 - Caja de sorpresas enemiga [720p HDTV].mkv
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03: list: cached object: Series/Blindspot/Season 03/Blindspot - S03E01 - Vuelta al pie del cañón [720p HDTV].mkv
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03: list: cached dir: ‘Series/Blindspot/Season 03’, cache ts: 2018-05-13 06:34:58.007624342 +0200 CEST
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03/: >Lookup: node=Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv, err=
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: Attr:
2018/05/13 06:34:58 DEBUG : Series/Blindspot/Season 03/Blindspot - S03E15 - Deducible [720p WEB-DL].mkv: >Attr: a=valid=1s ino=0 size=5636096 mode=-rw-rw-r–, err=
2018/05/13 06:34:59 DEBUG : /: Lookup: name=“Series”
2018/05/13 06:34:59 DEBUG : /: >Lookup: node=Series/, err=
2018/05/13 06:34:59 DEBUG : Series/: Attr:


#13

some ideas? :frowning: no way to fix this error, i update rclone too


#14

@remus.bunduc - see anything in that jumps out?