Does rclone support fileshare migration ? Planning to migrate fileshare from Azure to aws s3

Help and Support
1

What is the problem you are having with rclone?

Need to know if rclone is supporting fileshare migration from azure to aws s3. If yes then request to pls share the related link

Run the command 'rclone version' and share the full output of the command.

rclone v1.60.0

  • os/version: Microsoft Windows 11 Pro 21H2 (64 bit)
  • os/kernel: 10.0.22000.1098 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.19.2
  • go/linking: static
  • go/tags: cmount
No

Which cloud storage system are you using? (eg Google Drive)

AWS

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

Paste  log here
2

Hi Jalal,

Not sure what you mean by fileshare migration, are you looking for something like

rclone move myAzure:some/folder myS3:some/other/folder

More info here:
https://rclone.org/commands/rclone_move/
https://rclone.org/azureblob/
https://rclone.org/s3/

3

Hi Ole,
Thanks for your reply.

By file share i meant migrating the FileStorage kind of data from Azure to AWS s3.
I had a requirement of migrating both Blob storage and File Storage (Azure files). For Blob storage i found related info available in rclone but couldn't find any reference for file storage migration.

Would appreciate any info or reference link on this

4

Thanks, now I understand (I hope).

You are asking about Azure Files like this:
https://azure.microsoft.com/en-us/products/storage/files/

I am not an expert in Azure (never tried it), but did a little research and found that rclone's Azure Blob backend may (read: perhaps) support Azure Files if changing the azureblob-endpoint from blob.core.windows.net to file.core.windows.net.

Here are the Microsoft documents that lead me to this:
https://learn.microsoft.com/en-us/rest/api/storageservices/file-service-rest-api
https://learn.microsoft.com/en-us/rest/api/storageservices/operations-on-shares--file-service-
https://learn.microsoft.com/en-us/rest/api/storageservices/list-shares#request

and the default endpoint used by rclone:

Perhaps somebody in the forum can give you a more definitive answer.

5

hi,

azure files can be accessed via smb and rclone can access smb servers
https://rclone.org/smb/

edit: since i already needed a reason to test rclone's shiny, new smb storage system,
i created a remote for azure files, so far, works well.

--- as remote in the config file

[azurefiles]
type = smb
host = zork.file.core.windows.net
user = zork
pass = redacted

--- as a connection string

rclone ls :smb,host="zork.file.core.windows.net",user="zork",pass="redacted":zork

or

net use to mount azure files as a local smb network share and copy from that share to aws s3.

net use z: \\zork.file.core.windows.net\zork /user:zork "password"
and then create a remote for aws, let's call it aws:
rclone sync z:\ aws:

6

Thanks Ole for your reply. Will be checking the provided links

1 Like
7

Thanks for your reply. It's pretty informative indeed. Will go through some testing on this and share update

8

tl;dr - i would not use the rclone smb remote, instead to use net use

--- the smb remote was just added to rclone.
--- for some reason, the smb remote is not labeled as experimental, alpha or beta, instead considered ready for production.
--- based on some third party library.
--- windows os and linux, already has great smb support.

9

It passes the rclone test suite with flying colours which is all a normal backend would need before being considered as production.

It is new though so there could be latent issues. I've had reports of it maxing out 1 Gbit/s LAN connections which is pleasing.

10

good to know.

and as i found out, enables rclone to access azure files via smb, nice and easy

11

Nice and great testing.

It would be worth putting that in the docs I think.

12

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.