Rclone make my windows sytem not responding

What is the problem you are having with rclone?

Due to rclone operations, my system is getting not responds and it take around half and hour to complete the operations like upload, download pdf from s3 drive that drive I link with my IIS Sites

there is no need to check logs as logs is working fine

here are some addition information which might help you
bucket size : 1.8TB
system os: windows
system ram: 64GB

Run the command 'rclone version' and share the full output of the command.

1.65.1

Which cloud storage system are you using? (eg Google Drive)

AWS S3 drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount aws_s3_production:<bucketPath> N: --vfs-cache-mode full --vfs-fast-fingerprint --dir-cache-time 99999h

rclone logs

2024/02/19 13:17:12 DEBUG : /: Statfs:
2024/02/19 13:17:12 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Readlink:
2024/02/19 13:17:12 DEBUG : /: >Readlink: linkPath="", errc=-40
2024/02/19 13:17:12 DEBUG : /: Getxattr: name="non-existant-a11ec902d22f4ec49003af15282d3b00"
2024/02/19 13:17:12 DEBUG : /: >Getxattr: errc=-40, value=""
The service rclone has been started.
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Opendir:
2024/02/19 13:17:12 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:12 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:12 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:12 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:12 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Opendir:
2024/02/19 13:17:12 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:12 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:12 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:12 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:12 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:12 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:12 DEBUG : /: Opendir:
2024/02/19 13:17:12 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:12 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:12 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:12 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:12 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:15 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/02/19 13:17:15 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/02/19 13:17:15 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Opendir:
2024/02/19 13:17:15 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:15 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:15 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:15 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:15 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:15 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Opendir:
2024/02/19 13:17:15 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:15 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:15 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:15 DEBUG : /: Statfs:
2024/02/19 13:17:15 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/02/19 13:17:15 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:15 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Opendir:
2024/02/19 13:17:15 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:15 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:15 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:15 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:15 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Opendir:
2024/02/19 13:17:15 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:15 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:15 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:15 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:15 DEBUG : /: >Releasedir: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/02/19 13:17:15 DEBUG : /: >Getattr: errc=0
2024/02/19 13:17:15 DEBUG : /: Opendir:
2024/02/19 13:17:15 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/02/19 13:17:15 DEBUG : /: >OpenFile: fd=/ (r), err=
2024/02/19 13:17:15 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/02/19 13:17:15 DEBUG : /: Releasedir: fh=0x0
2024/02/19 13:17:15 DEBUG : /: >Releasedir: errc=0

Post all details as asked in the template. Nobody can guess what is your exact setup.

If all is working fine than no need to post anything. Please post log as well - it can reveal what is going on.

I have update the ticket, please check and also from logs it looks it working fine , but I am facing issues so that's why I reach to you, all required details I mentioned in the ticket

might be better/simpler to reproduce the issue rclone copy instead of rclone mount

the debug log snippet is very short, has no info about upload/downloads.
can you post a debug log that demonstrates the problem.
and what is the result of an internet speed test?


keep in mind, that for each upload, it is a two step process

  1. calculate the md5 hash of the local file. which takes time. to disable that use --s3-disable-checksum
  2. upload the file from local to S3

does it affect anything on current process and is this same work for download ?

I am facing issue in fetching the document from S3 drive, pls provide me solution for that.

no

no

i already made several suggestions???

You have not posted anything yet showing what your issue is. Whatever bits you included not indicate any problems.

Maybe simply your remote bucket has so many files that it is very slow with rclone mount? Or/and your network connection is very slow? It is impossible to guess.

Yes my bucket have so many files in folder, is there any solutions to achieve this from rclone because I am in stage I will not disturb my file folders

Maybe do not use rclone mount at all. You can always access your cloud storage directly.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.