Out Of Space Error

Yamiraan · May 22, 2022, 11:47am

What is the problem you are having with rclone?

rclone v1.58.0

os/version: debian 11.1 (64 bit)
os/kernel: 5.10.0-9-amd64 (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.17.8
go/linking: static
go/tags: none

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

Dropbox

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone serve http pinoy:web/pinoy --template templatefile --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 50h --vfs-cache-max-size 300G --cache-dir /www/wwwroot/cache/pinoy --log-file /www/wwwroot/pinoy.log --vfs-read-ahead 1G --transfers 32 --checkers 32 --tpslimit 12 --tpslimit-burst 12 --no-seek --read-only --disable-http2 --addr :8082

The rclone config contents with secrets removed.

Paste config here

A log from the command with the `-vv` flag

2022/05/20 14:40:36 ERROR : videos/2022/05/01/0d2143a9edaf62f6eb9c9c253812a73e/576p_187.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/01/0d2143a9edaf62f6eb9c9c253812a73e/576p_187.ts" already open in the cache
2022/05/20 14:40:36 ERROR : videos/2022/05/01/0d2143a9edaf62f6eb9c9c253812a73e/576p_187.ts: Non-out-of-space error encountered during open
2022/05/20 16:40:56 ERROR : videos/2022/04/30/d40ebf7209d8d41ede58549ba085f644/576p_107.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/30/d40ebf7209d8d41ede58549ba085f644/576p_107.ts" already open in the cache
2022/05/20 16:40:56 ERROR : videos/2022/04/30/d40ebf7209d8d41ede58549ba085f644/576p_107.ts: Non-out-of-space error encountered during open
2022/05/21 03:56:30 ERROR : videos/2022/04/29/c97f15eb93c5a12ba82cc2a9c4461ffd/576p_230.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/29/c97f15eb93c5a12ba82cc2a9c4461ffd/576p_230.ts" already open in the cache
2022/05/21 03:56:30 ERROR : videos/2022/04/29/c97f15eb93c5a12ba82cc2a9c4461ffd/576p_230.ts: Non-out-of-space error encountered during open
2022/05/21 13:06:51 ERROR : videos/2022/05/21/29a3a798bd214a5ada307212f08c6089/360p_003.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/21/29a3a798bd214a5ada307212f08c6089/360p_003.ts" already open in the cache
2022/05/21 13:06:51 ERROR : videos/2022/05/21/29a3a798bd214a5ada307212f08c6089/360p_003.ts: Non-out-of-space error encountered during open
2022/05/21 18:13:39 ERROR : videos/2022/04/27/9e4b9dc9a5534303d89397fa4e0428eb/576p_085.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/27/9e4b9dc9a5534303d89397fa4e0428eb/576p_085.ts" already open in the cache
2022/05/21 18:13:39 ERROR : videos/2022/04/27/9e4b9dc9a5534303d89397fa4e0428eb/576p_085.ts: Non-out-of-space error encountered during open
2022/05/21 19:04:14 ERROR : videos/2022/05/01/e32279bacf5e6556a306a3e975783cb6/576p_040.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/01/e32279bacf5e6556a306a3e975783cb6/576p_040.ts" already open in the cache
2022/05/21 19:04:14 ERROR : videos/2022/05/01/e32279bacf5e6556a306a3e975783cb6/576p_040.ts: Non-out-of-space error encountered during open
2022/05/21 19:09:00 ERROR : videos/2022/05/16/66275380d404929977ec87955c3d906a/576p_111.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/16/66275380d404929977ec87955c3d906a/576p_111.ts" already open in the cache
2022/05/21 19:09:00 ERROR : videos/2022/05/16/66275380d404929977ec87955c3d906a/576p_111.ts: Non-out-of-space error encountered during open
2022/05/22 03:00:48 ERROR : videos/2022/04/24/c6d0c8885db9ff2fee3f4b8fdad0b37d/360p_111.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/24/c6d0c8885db9ff2fee3f4b8fdad0b37d/360p_111.ts" already open in the cache
2022/05/22 03:00:48 ERROR : videos/2022/04/24/c6d0c8885db9ff2fee3f4b8fdad0b37d/360p_111.ts: Non-out-of-space error encountered during open
2022/05/22 04:53:34 ERROR : videos/2022/04/22/bb85debc655d1ca30944848afc7ff472/576p_172.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/22/bb85debc655d1ca30944848afc7ff472/576p_172.ts" already open in the cache
2022/05/22 04:53:34 ERROR : videos/2022/04/22/bb85debc655d1ca30944848afc7ff472/576p_172.ts: Non-out-of-space error encountered during open
2022/05/22 07:12:50 ERROR : videos/2022/05/15/2e4fa4db32a41ab7254e8f41e438efd7/576p_001.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/15/2e4fa4db32a41ab7254e8f41e438efd7/576p_001.ts" already open in the cache
2022/05/22 07:12:50 ERROR : videos/2022/05/15/2e4fa4db32a41ab7254e8f41e438efd7/576p_001.ts: Non-out-of-space error encountered during open
2022/05/22 07:13:02 ERROR : videos/2022/04/30/d3dbfd3a5359bc38078fb92fbd63bea0/576p_429.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/30/d3dbfd3a5359bc38078fb92fbd63bea0/576p_429.ts" already open in the cache
2022/05/22 07:13:02 ERROR : videos/2022/04/30/d3dbfd3a5359bc38078fb92fbd63bea0/576p_429.ts: Non-out-of-space error encountered during open
2022/05/22 08:12:26 ERROR : videos/2022/04/30/8a88eea9b6a297ea1df8ee4387e90c6b/576p_290.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/30/8a88eea9b6a297ea1df8ee4387e90c6b/576p_290.ts" already open in the cache
2022/05/22 08:12:26 ERROR : videos/2022/04/30/8a88eea9b6a297ea1df8ee4387e90c6b/576p_290.ts: Non-out-of-space error encountered during open
2022/05/22 09:13:30 ERROR : videos/2022/04/15/39e45b71d7d55f2f08dfba612d129b17/576p_005.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/15/39e45b71d7d55f2f08dfba612d129b17/576p_005.ts" already open in the cache
2022/05/22 09:13:30 ERROR : videos/2022/04/15/39e45b71d7d55f2f08dfba612d129b17/576p_005.ts: Non-out-of-space error encountered during open
2022/05/22 09:19:49 ERROR : videos/2022/05/22/259057d4a10127f5e66880f13a7e1040/360p_004.ts: vfs cache: failed to open item: internal error: item "videos/2022/05/22/259057d4a10127f5e66880f13a7e1040/360p_004.ts" already open in the cache
2022/05/22 09:19:49 ERROR : videos/2022/05/22/259057d4a10127f5e66880f13a7e1040/360p_004.ts: Non-out-of-space error encountered during open
2022/05/22 10:15:29 ERROR : videos/2022/04/24/c792d8cb66a241106abf3188a43da0ce/360p_614.ts: vfs cache: failed to open item: internal error: item "videos/2022/04/24/c792d8cb66a241106abf3188a43da0ce/360p_614.ts" already open in the cache
2022/05/22 10:15:29 ERROR : videos/2022/04/24/c792d8cb66a241106abf3188a43da0ce/360p_614.ts: Non-out-of-space error encountered during open

why happening space error? cache space is already set.

Animosity022 · May 22, 2022, 11:57am

That usually means you have 2 rclones pointing to the same cache which you can't do.

Yamiraan · May 22, 2022, 12:00pm

thanks for your quick reply, yes im running 2 rclone but using 2 different path for cache, my cache path are below

--cache-dir /www/wwwroot/cache/bollyfun

--cache-dir /www/wwwroot/cache/pinoy

what i doing wrong? is that possible to use 1 cache folder for both rclone? or what is better option?
Thanks

Animosity022 · May 22, 2022, 12:02pm

The error indicates they are not as the error says the file is already open in another rclone process.

You probably want to double check.

Yamiraan · May 22, 2022, 12:12pm

only running 2 rclone cmds and both have different cache folders, this one reach its limit and start sending this error, i double checked my rclone cmds and both have different mount path and cache folders

Animosity022 · May 22, 2022, 12:21pm

Not sure what reaching its limit means.

Best to share a full debug log.

Your rlcone.conf is missing as well.

Yamiraan · May 22, 2022, 1:17pm

--vfs-cache-max-size 300G

this error start when cache folder reach its limit, before it was all ok,
config file is below

[pinoy]
type = dropbox
client_id = **************
client_secret = **********
token = {"access_token":"sl.BIFZXdp1ODyisuPn_eOId6S21xJAPqAIrR0H4cYe74ZiP6lBrY6mBw_yrOVBBf6vh1MB7AeWGct1zHlR1RZ8omK-":"bearer","refresh_token":"pFupQI1F5rEAAAAAAAAAAWu4Nh4dp6nQzvl7fYSIK_YFvDmp8XYOQcdv4SSQEeHa","expiry":"2022-05-22T19:02:28.141722324+02:00"}

[bollyfun]
type = dropbox
client_id = ******
client_secret =*******
token = {"access_token":"sl.BIF7pc5Yt2U6VGFZsNZ0KSvufWqaaMBijWyz4RENa6C_6wQMzD1mgFlUF0bVCO90Z5DL2mGiN3W6vXlDtWr6V1Tmf-XbZKTCmU5-22T18:10:59.670967991+02:00"}

log file is also attached
pinoy.log (200.3 KB)

Animosity022 · May 22, 2022, 1:24pm

That's still not a debug log as that's an error.

Can you stop rclone, change the log level to debug and include a full debug log with the problem.

Yamiraan · May 22, 2022, 10:55pm

debug logs are below

2022/05/23 00:53:27 INFO  : Starting transaction limiter: max 12 transactions/s with burst 12
2022/05/23 00:53:27 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "serve" "http" "pinoy:web/pinoy" "--template" "templatefile" "--dir-cache-time" "5000h" "--vfs-cache-mode" "full" "--vfs-cache-max-age" "50h" "--vfs-cache-max-size" "300G" "--cache-dir" "/www/wwwroot/cache/pinoy" "--log-file" "/www/wwwroot/pinoy.log" "--vfs-read-ahead" "1G" "--transfers" "32" "--checkers" "32" "--tpslimit" "12" "--tpslimit-burst" "12" "--no-seek" "--read-only" "--disable-http2" "--addr" ":8082" "-vv"]
2022/05/23 00:53:27 DEBUG : Creating backend with remote "pinoy:web/pinoy"
2022/05/23 00:53:27 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2022/05/23 00:53:27 DEBUG : vfs cache: root is "/www/wwwroot/cache/pinoy"
2022/05/23 00:53:27 DEBUG : vfs cache: data root is "/www/wwwroot/cache/pinoy/vfs/pinoy/web/pinoy"
2022/05/23 00:53:27 DEBUG : vfs cache: metadata root is "/www/wwwroot/cache/pinoy/vfsMeta/pinoy/web/pinoy"
2022/05/23 00:53:27 DEBUG : Creating backend with remote "/www/wwwroot/cache/pinoy/vfs/pinoy/web/pinoy"
2022/05/23 00:53:27 DEBUG : Creating backend with remote "/www/wwwroot/cache/pinoy/vfsMeta/pinoy/web/pinoy"

Animosity022 · May 22, 2022, 11:40pm

That log is a few lines..

system · June 21, 2022, 11:40pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.