File not found randomly after rclone is mounted

Help and Support
1

What is the problem you are having with rclone?

Use rclone to mount ceph s3 storage to the local computing node. A total of 50 nodes were used for offline rendering tasks of 3dsmax software.

When I run the same task repeatedly on these 50 nodes, I get "file not found" errors on individual nodes.

Renderer error log:
[V-Ray] Failed to initialize proxy object "Material #132251" with file "C:\Users\hu\Desktop\c02\Material _132251_0705151856.vrmesh": file not found

The file type where the error occurred is a ".vrmesh" file, but no error message is found in the log file.

For example, node A runs normally the first time, an error occurs the second time, and then runs normally again.

Errors are random.

Run the command 'rclone version' and share the full output of the command.

C:\Users\en>rclone version
rclone v1.66.0
- os/version: Microsoft Windows 10 Enterprise LTSC 2021 21H2 (64 bit)
- os/kernel: 10.0.19044.1288 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.22.1
- go/linking: static
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Ceph S3 Storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone.exe mount \
  --vfs-cache-mode full \
  --vfs-refresh  \
  --vfs-cache-max-size 100G \
  --multi-thread-streams 4 \
  --cache-dir d:\vfs-cache \
  --file-perms 0777 \
  --dir-perms 0777 \
  --log-file=rclone.txt \
  --log-level DEBUG \
  --buffer-size 64M \
  --transfers 16 \
  --no-modtime \
  --no-checksum \
  --vfs-fast-fingerprint \
  --vfs-read-ahead 128M \
  --vfs-read-chunk-size 16M \
  --vfs-read-chunk-size-limit 128M 
  ceph-s3:/s3/C/Users/hu c:\Users\hu

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

C:\Users\enfuzion>rclone config redacted
[ceph-s3]
env_auth = false
type = s3
provider = Ceph
access_key_id = XXX
secret_access_key = XXX
endpoint = http://s3-endpoint
location_constraint =
acl =
server_side_encryption =
storage_class =
### Double check the config for sensitive info before posting publicly

A log from the command that you were trying to run with the -vv flag

2024/05/11 12:21:46 DEBUG : /Desktop/c02/sakura_02.vrmesh: Read: ofst=49992392, fh=0x20
2024/05/11 12:21:46 DEBUG : Desktop/c02/sakura_02.vrmesh(0xc00010b640): _readAt: size=4, off=49992392
2024/05/11 12:21:46 DEBUG : vfs cache: looking for range={Pos:49992392 Size:4} in [{Pos:0 Size:68503459}] - present true
2024/05/11 12:21:46 DEBUG : Desktop/c02/sakura_02.vrmesh(0xc00010b640): >_readAt: n=4, err=<nil>
2024/05/11 12:21:46 DEBUG : /Desktop/c02/sakura_02.vrmesh: >Read: n=4
2024/05/11 12:21:46 DEBUG : /Desktop/c02/sakura_02.vrmesh: Read: ofst=49992396, fh=0x20
2024/05/11 12:21:46 DEBUG : Desktop/c02/sakura_02.vrmesh(0xc00010b640): _readAt: size=4, off=49992396
2024/05/11 12:21:46 DEBUG : vfs cache: looking for range={Pos:49992396 Size:4} in [{Pos:0 Size:68503459}] - present true
2024/05/11 12:21:46 DEBUG : Desktop/c02/sakura_02.vrmesh(0xc00010b640): >_readAt: n=4, err=<nil>
2

welcome to the forum,

so, no ERROR in the rclone debug log file?

at that exact time

  • is the file visible in rclone mountpoint?
  • what is shown in the rclone debug log.

is that correct, you are mounting to the root of a user profile?

3

Yes, since the artist's creation is referenced in his own root directory, he needs to mount the storage through the network to restore his environment.

I ran the test task again, and this time there was no file reading failure.

I think I may need to check again whether the problem is caused by the mounting parameters or the node or network.

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.