What is the problem you are having with rclone?
rclone cmount
hangs.
BTW, I am using cmount because when I tried mount it told me to use cmount.
I made a fresh empty directory, /opt/c2561-samples/
, then tried to use rclone to mount a subdirectory in a bucket.
BTW, I also have the Minio client configured to talk to the same IBM COS instance. Here I am confirming the validity of the path and the amount of data there:
mjs11:~ mspreitzus.ibm.com$ mc du c2561/mybuck/samples
14MiB mybuck/samples
I also tried mounting the whole bucket, and it ground to a halt with the same sort of log messages.
What is your rclone version (output from rclone version
)
rclone v1.53.0
- os/arch: darwin/amd64
- go version: go1.15
Which OS you are using and how many bits (eg Windows 7, 64 bit)
MacOS 10.14.6, 64 bit
Which cloud storage system are you using? (eg Google Drive)
IBM COS
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
sudo rclone -v -v --log-file=/tmp/rcl.log cmount c2561:mybuck/samples /opt/c2561-samples
The rclone config contents with secrets removed.
[c2561]
type = s3
provider = IBMCOS
env_auth = false
access_key_id = <snip/>
secret_access_key = <snip/>
endpoint = s3.us.cloud-object-storage.appdomain.cloud
location_constraint = us-standard
acl = authenticated-read
bucket_acl = authenticated-read
A log from the command with the -vv
flag
2020/09/12 02:32:44 DEBUG : rclone: Version "v1.53.0" starting with parameters ["rclone" "-v" "-v" "--log-file=/tmp/rcl.log" "cmount" "c2561:mybuck/samples" "/opt/c2561-samples"]
2020/09/12 02:32:44 DEBUG : Creating backend with remote "c2561:mybuck/samples"
2020/09/12 02:32:44 DEBUG : Using config file from "/Users/mspreitzus.ibm.com/.config/rclone/rclone.conf"
2020/09/12 02:32:45 INFO : S3 bucket mybuck path samples: poll-interval is not supported by this remote
2020/09/12 02:32:45 DEBUG : S3 bucket mybuck path samples: Mounting on "/opt/c2561-samples"
2020/09/12 02:32:45 DEBUG : S3 bucket mybuck path samples: Mounting with options: ["-o" "fsname=c2561:mybuck/samples" "-o" "subtype=rclone" "-o" "max_readahead=131072" "-o" "attr_timeout=1" "-o" "atomic_o_trunc" "-o" "noappledouble" "-o" "volname=c2561 mybuck samples"]
2020/09/12 02:32:45 DEBUG : S3 bucket mybuck path samples: Init:
2020/09/12 02:32:45 DEBUG : S3 bucket mybuck path samples: >Init:
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /: >Getattr: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=04
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Opendir:
2020/09/12 02:32:45 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/12 02:32:45 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/12 02:32:45 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/12 02:32:45 DEBUG : /: Releasedir: fh=0x0
2020/09/12 02:32:45 DEBUG : /: >Releasedir: errc=0
2020/09/12 02:32:45 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /: >Getattr: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=04
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Opendir:
2020/09/12 02:32:45 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2020/09/12 02:32:45 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2020/09/12 02:32:45 DEBUG : /: >Opendir: errc=0, fh=0x0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /DCIM: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /DCIM: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /.Spotlight-V100: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /.Spotlight-V100: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:32:45 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Access: mask=00
2020/09/12 02:32:45 DEBUG : /: >Access: errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:45 DEBUG : /: Statfs:
2020/09/12 02:32:45 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:32:46 DEBUG : /: Statfs:
2020/09/12 02:32:46 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2020/09/12 02:33:00 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:00 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:33:00 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:00 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:33:00 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:00 DEBUG : /: >Getattr: errc=0
2020/09/12 02:33:00 DEBUG : /: Access: mask=00
2020/09/12 02:33:00 DEBUG : /: >Access: errc=0
2020/09/12 02:33:30 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:30 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:33:30 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:30 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:33:30 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:33:30 DEBUG : /: >Getattr: errc=0
2020/09/12 02:33:30 DEBUG : /: Access: mask=00
2020/09/12 02:33:30 DEBUG : /: >Access: errc=0
2020/09/12 02:34:31 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:34:31 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:34:31 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:34:31 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:34:31 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:34:31 DEBUG : /: >Getattr: errc=0
2020/09/12 02:34:31 DEBUG : /: Access: mask=00
2020/09/12 02:34:31 DEBUG : /: >Access: errc=0
2020/09/12 02:36:31 DEBUG : /.metadata_never_index: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:36:31 DEBUG : /.metadata_never_index: >Getattr: errc=-2
2020/09/12 02:36:31 DEBUG : /.metadata_never_index_unless_rootfs: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:36:31 DEBUG : /.metadata_never_index_unless_rootfs: >Getattr: errc=-2
2020/09/12 02:36:31 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2020/09/12 02:36:31 DEBUG : /: >Getattr: errc=0
2020/09/12 02:36:31 DEBUG : /: Access: mask=00
2020/09/12 02:36:31 DEBUG : /: >Access: errc=0