Howto create a new (root) container in hubiC?

Hello,

I followed the documentation at http://rclone.org/hubic/ to create a new directory at the root level of hubiC but it fails:

$ rclone copy demo_hubiC hubiC:backup
2017/02/12 21:11:15 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      1m0.3s

2017/02/12 21:11:45 Attempt 1/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:12:15 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      2m0.3s

2017/02/12 21:13:15 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3m0.3s

2017/02/12 21:13:16 Attempt 2/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:14:15 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      4m0.3s

2017/02/12 21:14:45 Attempt 3/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:14:45 Failed to copy: HTTP Error: 500: 500 Internal Error

I can see my hubiC containers so my configuration is working.

$ rclone lsd hubiC:
           0 0001-01-01 00:00:00         0 252d2565-e4ab-4a75-b24f-a8e08d3b8161
           0 0001-01-01 00:00:00         0 252d2565-e4ab-4a75-b24f-a8e08d3b8161_segments
   823276078 0001-01-01 00:00:00       257 HubiC-Backup_2015-07-04T11:30:22Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100
           0 0001-01-01 00:00:00         0 HubiC-Backup_2015-07-04T11:30:22Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100_segments
  1504558214 0001-01-01 00:00:00       785 HubiC-Backup_2015-12-27T19:32:55Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100
           0 0001-01-01 00:00:00         0 HubiC-Backup_2015-12-27T19:32:55Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100_segments
  1376830437 0001-01-01 00:00:00       756 HubiC-Backup_2015-12-28T17:11:38Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100
           0 0001-01-01 00:00:00         0 HubiC-Backup_2015-12-28T17:11:38Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100_segments
  1980500033 0001-01-01 00:00:00       814 HubiC-Backup_2016-09-03T12:08:53Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100
           0 0001-01-01 00:00:00         0 HubiC-Backup_2016-09-03T12:08:53Z_6110334e-fbca-4178-80a7-ef79365a9832_GT-N7100_segments
  3978041543 0001-01-01 00:00:00     52854 HubiC-DeskBackup_Auto Entrepreneur
  1731183605 0001-01-01 00:00:00       478 HubiC-DeskBackup_Auto Entrepreneur_segments
    30487936 0001-01-01 00:00:00      1225 HubiC-DeskBackup_Auto Entrepreneur_versions
           0 0001-01-01 00:00:00         0 HubiC-DeskBackup_Auto Entrepreneur_versions_segments
123011774306 0001-01-01 00:00:00     51632 HubiC-DeskBackup_Photos
188467568113 0001-01-01 00:00:00     58754 HubiC-DeskBackup_Photos_segments
   232500089 0001-01-01 00:00:00     12081 HubiC-DeskBackup_Photos_versions
           0 0001-01-01 00:00:00         0 HubiC-DeskBackup_Photos_versions_segments
 53723250719 0001-01-01 00:00:00     11104 HubiC-DeskBackup_iTunes Music
 55634904453 0001-01-01 00:00:00     16780 HubiC-DeskBackup_iTunes Music_segments
   188834503 0001-01-01 00:00:00     17873 HubiC-DeskBackup_iTunes Music_versions
           0 0001-01-01 00:00:00         0 HubiC-DeskBackup_iTunes Music_versions_segments
  4328472421 0001-01-01 00:00:00     19272 default
           0 0001-01-01 00:00:00         0 default_segments

I can’t use mkdir to create a directory at the root level. It fails with the same error HTTP Error: 500: 500 Internal Error

$ rclone mkdir hubiC:foobar
2017/02/12 21:34:43 Attempt 1/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:36:19 Attempt 2/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:38:08 Attempt 3/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/12 21:38:08 Failed to mkdir: HTTP Error: 500: 500 Internal Error

But I can create a new directory in the default container.

I would like to create a new container and manage it using rclone.
Howto do that?

1 Like

I don’t seem to be able to create a container at all it just hangs.

A 500 internal error sounds like a problem at Hubic …

There appears to be an ongoing indicent at ovh/hubic

http://status.ovh.co.uk/?do=details&id=12305&PHPSESSID=e97829f668bed47151e9f5e38da06788

Creating a directory inside the container “default” works. I just tested so hubiC works (at least a bit).
But creating a root “directory” still fails.

Is “mkdir” the correct command to create a new container?

$ rclone mkdir  hubiC:foobar
2017/02/14 17:52:35 Attempt 1/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/14 17:54:31 Attempt 2/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/14 17:56:19 Attempt 3/3 failed with 1 errors and: HTTP Error: 500: 500 Internal Error
2017/02/14 17:56:19 Failed to mkdir: HTTP Error: 500: 500 Internal Error
$ rclone mkdir  hubiC:default/foobar
$ 

Thanks

Hi,

I have exactly the same problem. I wonder how to analyze the problem in more detail.


I want to make a backup of a big directory in hubic.
I do not want to copy my files to default, because I am using hubic syncing tool for a small set of small files but it syncs everything in default including my backup. As a result it overloads my computer.

“hubic backup create” worked on some directories but began to fail with “network error” and is thus useless.

I also installed svfs but it seemed to be on early development phase, beyond my capabilities to use it,.

I don’t think this is an rclone problem.

I tried listing containers with the swift tool (which is the official openstack client) which worked properly.

However when I tried creating a container it just hung in the same way rclone does.

Has anyone tried contacting hubic to ask them what is going on?

This works fine

swift --os-auth-token=f4..b3 --os-storage-url=https://lb9911.hubic.ovh.net/v1/AUTH_8d..51 list

This hangs

swift --os-auth-token=f4..b3 --os-storage-url=https://lb9911.hubic.ovh.net/v1/AUTH_8d..51 list test

And so does this

swift --os-auth-token=f4..b3 --os-storage-url=https://lb9911.hubic.ovh.net/v1/AUTH_8d..51 post test

NB you can get the auth token and storage URL by running rclone -vv --dump-bodes lsd hubic and looking for them in at the start in the JSON returned.

Thank you for looking at this.

You must be right that hubic has a problem.

It seems to me that many have tried to contact hubic on this and many other issues but no one has succeeded. I will continue trying to get in contact with them.

Good plan. They should take notice of the above with the offical swift client hopefully.

I created a new thread on hubiC forum at https://forums.hubic.com/showthread.php?176310

The problem is still present. Against my better judgment but for lack of options I’m trying Hubic too. The web interface is childish and barren. I managed to remove hubic.com from “Applications connected to your account” and lost access temporarily to the web interface (probably until a cron job came and eventually added the application back (most likely I’m not the first that tries to kill himself).

tried rclone, and have same problems. i do have hubic 12,5TB but havent use long time.
problem is File.Open failed: open for read: HTTP Error: 500: 500 Internal Error

support of hubic is terrible read hubic forums and you see ppl complaining about support they not answer

I don’t think hubic lets you create anything outside of the default container by design. Your account is tied to your default container, and hubic doesn’t give you access to create other containers. Hubic is a wrapper on SWIFT, not SWIFT itself.

And there’s really not reason for multiple containers, if you’re just using it for storage and rclone. The directory structure emulation works fine for file organization, IMHO.

I have created containers in the past with hubic - it definitely should work. If you are a paying customer send them the evidence above with the official swift client!

I’m running into the same issue.

Work arround by mounting your hubic root ‘hubic:’ with svfs, then do a mkdir in the root. You can check with ‘rclone lsd hubic:’ to make sure it is there.

> mount |grep hubic
hubic: on /media/hubic type fuse.svfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)

> cd /media/hubic/
/m/hubic> mkdir borg

> rclone lsd hubic:
           0 2017-08-19 12:52:18         0 borg
           0 2017-08-19 12:52:18         0 borg_segments
    54811888 2017-08-19 12:52:18        10 default
           0 2017-08-19 12:52:18         0 default_segments
.
.
.

Container creation should be done using PUT request and is working as expected at HubiC. Rclone seems to be the trouble.

https://developer.openstack.org/api-ref/object-storage/index.html?expanded=create-update-or-delete-container-metadata-detail,create-container-detail#create-container

You are right the PUT request works fine every time.

However rclone normally checks the container exists first using HEAD, like this. It does this so that a limited permission user can use a container created by a higher permission user. (This isn’t supported by hubic though.)

This is the call which is hanging, or failing, which really should work!

2017/08/30 15:21:20 DEBUG : HTTP REQUEST (req 0xc420100000)
2017/08/30 15:21:20 DEBUG : HEAD /v1/AUTH_8ddbb87xxx/new-container HTTP/1.1
Host: lb9911.hubic.ovh.net
User-Agent: rclone/v1.37-103-ga346dabb-go1.9

2017/08/30 15:21:20 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/08/30 15:22:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/08/30 15:22:00 DEBUG : HTTP RESPONSE (req 0xc420100000)
2017/08/30 15:22:00 DEBUG : HTTP/1.1 500 Internal Error
Content-Type: text/html; charset=UTF-8
Date: Wed, 30 Aug 2017 14:22:00 GMT
X-Iplb-Instance: 13748
X-Openstack-Request-Id: txd2fbbc1620e745379a065-0059a6c9e0
X-Trans-Id: txd2fbbc1620e745379a065-0059a6c9e0
Content-Length: 0

I’ve changed the hubic module to not do this check (and left the other swift providers alone), so hopefully this should fix it. I view this as a work-around for a busted swift implementation at Hubic, but if it gets rclone working for people then I’m happy :slight_smile:

https://beta.rclone.org/v1.37-104-ge96c5b5f/ (uploaded in 15-30 mins)

Let me know how you get on.

Thanks for clarification. So many weird things happens there that I stopped using it…

Thank you for the update. This should make things a bit more practical again. I’ll try to test ASAP.

Edit: Works as expected now!

rclone-v1.37-104-ge96c5b5fβ-linux-amd64> ./rclone lsd hubic: | grep test
rclone-v1.37-104-ge96c5b5fβ-linux-amd64> ./rclone mkdir hubic:rclone-test
rclone-v1.37-104-ge96c5b5fβ-linux-amd64> ./rclone lsd hubic: | grep test
           0 2017-08-31 13:44:32         0 rclone-test
rclone-v1.37-104-ge96c5b5fβ-linux-amd64>
1 Like