Mount OCI OSS bucket as shared filesystem in OCI DBCS Linux machines

What is the problem you are having with rclone?

I have done the rclone config to mount the OCI oss bucket as filesystem in both OCI DBCS linux OEL 8 machines, but issue is that files which are created inside mount not syncing with OCI OSS bucket.

Run the command 'rclone version' and share the full output of the command.

[opc@oeuspdw1 ~]$ rclone version
rclone v1.68.2

  • os/version: oracle 8.8 (64 bit)
  • os/kernel: 5.4.17-2136.326.6.el8uek.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.22.7 (Red Hat 1.22.7-1.module+el8.10.0+90426+810ab996)
  • go/linking: dynamic
  • go/tags: none
    [opc@oeuspdw1 ~]$

Which cloud storage system are you using? (eg Google Drive)

OCI Object Storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

sudo rclone mount \
    data:oss_shared_bucket /oss_shared_bucket \
    --allow-other \
    --cache-dir /tmp/rclone/cache \
    --config /etc/rclone/rclone.conf \
    --dir-perms 0770 \
    --file-perms 0660 \
    --log-file /var/log/rclone.log \
    --log-level ERROR \
    --tpslimit 50  \
    --umask 0117 \
    --vfs-cache-mode writes \
    --vfs-fast-fingerprint &

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[opc@oeuspdw1 ~]$ rclone config redacted
[oss_shared]
type = oracleobjectstorage
provider = instance_principal_auth
namespace = XXX
compartment = XXX
region = us-ashburn-1
### Double check the config for sensitive info before posting publicly
[opc@oeuspdw1 ~]$

A log from the command that you were trying to run with the -vv flag

Log data: Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
Command mount needs 2 arguments maximum: you provided 14 non flag arguments: ["\u00a0\u00a0\u00a0" "data:oss_shared_bucket" "/oss_shared_bucket" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0" "\u00a0\u00a0\u00a0"]
[root@oeuspdw1 ~]#

INFO 2024/12/10 05:58:01.163586 log.go:229: Dump Request Body:
INFO 2024/12/10 05:58:01.163670 client.go:465: Dump Response HTTP/1.1 404 Not Found
Content-Length: 141
Access-Control-Allow-Credentials: true
Access-Control-Allow-Methods: POST,PUT,GET,HEAD,DELETE,OPTIONS
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,content-type,date,opc-client-info,opc-client-request-id,opc-request-id,strict-transport-security,x-api-id,x-content-type-options
Content-Type: application/json
Date: Tue, 10 Dec 2024 12:58:01 GMT
Opc-Client-Request-Id: 657b1830781d53f3e5fe6d1a8dec75ed
Opc-Request-Id: iad-1:Q33gsX8yv-G0mIoGP4Jr499sHDuGhZ44dhwR8h5GfTx4yhlCTw1pkW8dsdVXUd20
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Api-Id: native
X-Content-Type-Options: nosniff

{"code":"NamespaceNotFound","message":"You do not have authorization to perform this request, or the requested resource could not be found."}
2024/12/10 05:58:01 NOTICE: Failed to ls: Error returned by ObjectStorage Service. Http Status Code: 404. Error Code: NamespaceNotFound. Opc request id: iad-1:Q33gsX8yv-G0mIoGP4Jr499sHDuGhZ44dhwR8h5GfTx4yhlCTw1pkW8dsdVXUd20. Message: You do not have authorization to perform this request, or the requested resource could not be found.
Operation Name: ListBuckets
Timestamp: 2024-12-10 12:58:01 +0000 GMT
Client Version: Oracle-GoSDK/65.69.2
Request Endpoint: GET https://objectstorage.us-ashburn-1.oraclecloud.com/n/idijaksqlvh4/b?compartmentId=ocid1.compartment.oc1..aaaaaaaar6z5ektwojtkqdhskn6ypaps3ot2idiebgo7eidlomgncpovg6ma
Troubleshooting Tips: See API Errors for more information about resolving this error.
Also see Oracle Cloud Infrastructure API Reference and Endpoints for details on this operation's requirements.
To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details.
If you are unable to resolve this ObjectStorage issue, please contact Oracle support and provide them this full error message.

welcome to the forum,

before trying complex rclone mount,
test simple commands such as rclone ls and rclone copy


fwiw, i access oci using the s3 interface, works well.

oh is it, S3 .

But i have configured rclone with OSS Obeject storage during rclone config.

Also , does the S3 supports for OCI OSS bucket needs to be mounted as shared filesystem in 2 linux machines ?

ok, but you need to test the remote, as i mentioned up above.

not sure what that is? something specifc unique feature of OCI OSS?

Issue fixed for me, issue it with authentication method used as instance_principal which is not authenticating from OCI DBCS Linux machine to OCI OSS bucket. After using user_principal auth method, it id working and files created in mount point synced with OCI OSS storage bucket.

Now i am trying to mount the same file system in another Linux machine.

good

afiak, rclone does not fully support that.

oh ok, but out of available options OCIFS , RCLONE i could see rclone is suitable as OCIFS doen't support shared file system.

Any other alternative for my requirement ?

afiak, rclone cannot lock in-use cloud files, so cannot fully support a shared file system.
two different instances of rclone can open the same cloud file, edit it, save it, etc..

no idea what your requirement is?

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.