[Openstack] [openstack] [swift] Erasure Coding - No reconstruction to other nodes/disks on disk failure

Hello all, for my master's thesis I'm analyzing different storage policies in openstack swift. I'm manly interested in the reconstruction speed of the different EC implementations. I've noticed in my tests, that there is no reconstruction of fragments/parity to other nodes/disks if a disk fails.

Re: [Openstack] [OpenStack] [Swift] How to set maximum size of the log file?

The logs should be manged via syslog, so you can just use log rotate to rotate on time or size, keep x number of copies and compress rotated versions. On Wed, Feb 8, 2017 at 6:49 AM, Alexandr Porunov wrote: > Hello, > > I found out that my log file is almost 3GB. How to set a size limit? > > Bes

[Openstack] [OpenStack] [Swift] How to set maximum size of the log file?

Hello, I found out that my log file is almost 3GB. How to set a size limit? Best regards, Alexandr ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.ope

Re: [Openstack] [OpenStack] [Swift] Bug: Swift doesn't save last "end of file" characters

Hey Alexandr, We made a change to the `object save` command recently [1], and this issue may be resolved in v3.7.0 of OSC (released yesterday!). [1] https://github.com/openstack/python-openstackclient/commit/1cdc1319d6cbfc4087551e5bf0a9875c016eca1c # openstack --version openstack 3.7.0 # pip free

Re: [Openstack] [OpenStack] [Swift] Bug: Swift doesn't save last "end of file" characters

feel free to file a bug with https://bugs.launchpad.net/python-openstackclient and we can investigate it there, which version of OSC are you using? On Tue, Jan 17, 2017 at 3:08 PM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > Hello, > > I am using Openstack Newton. > I found a small bu

[Openstack] [OpenStack] [Swift] Bug: Swift doesn't save last "end of file" characters

Hello, I am using Openstack Newton. I found a small bug in the Swift. It doesn't copy last "end of line" characters. Here is my test (I copy my.cnf file): # cat -A my.cnf [client-server]$ !includedir /etc/my.cnf.d$ $ # openstack object create mybucket my.cnf # openstack object save mybucket my.c

Re: [Openstack] [OpenStack][Swift] problem about swift proxy easurecode

Hello Nalee, > I already installed libeasurecode. Did you install liberasurecode from source? The issue you hit looks from older version of liberasurecode which is in xenial repo. And the newest repo for liberasurecode/pyeclib is in oponstack namespace at github[1][2]. The install procedure fro

Re: [Openstack] [OpenStack][Swift] problem about swift proxy easurecode

I already installed libeasurecode. So I can find easurecode sources in the directory. /usr/included/ But I don't know why swift doesn't work. I think swift can't find library directory. 2017. 1. 4. 오후 6:50에 "Kwanghee Park" 님이 작성: > Actually pyeclib is an wrapper of liberasurecode. > > Please in

Re: [Openstack] [OpenStack][Swift] problem about swift proxy easurecode

Actually pyeclib is an wrapper of liberasurecode. Please install liberaurecode or git liberasurecode from its bitbucket If not, please refer it => https://bitbucket.org/tsg-/liberasurecode/issues/28/libshssso-no-such-file-or-director On Wed, Jan 4, 2017 at 6:13 PM, Nalee Jang wrote: > Hello >

[Openstack] [OpenStack][Swift] problem about swift proxy easurecode

Hello I have problems when I install OpenStack Swift Mitaka version in my vm. so I'd like to ask about how to solve this problem to openstack members. my vm os is ubuntu 16.04. I searched this problem on the website when I see below error messages. and I commanded like below. but I have problems

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

Interesting, Looking at my keystone log I'm seeing: 2016-10-21 18:52:43.313 1098 INFO eventlet.wsgi.server [req-652cc096-9df2-45db-84c7-cc6296c0d3ac - - - - -] 192.168.122.61 - - [21/Oct/2016 18:52:43] "POST /v2.0/tokens HTTP/1.1" 200 1920 0.269968 2016-10-21 18:52:43.360 1098 INFO keystone.co

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

I am still tackling with this issue... I appreciate if someone can help me out. I figured out that token issue(POST request) succeeds but GET request comes after is not proxied to keystone. [POST request] 1. Swift client log [root@opstack-controller src 2016.10.21 11:28:16]# swift list --debug

Re: [Openstack] [OpenStack] [Swift] Does Swift3 support v4 signature for S3?

Hello Kota, Thank you very much! Sincerely, Alexandr On Mon, Oct 17, 2016 at 9:31 AM, Kota TSUYUZAKI < tsuyuzaki.k...@lab.ntt.co.jp> wrote: > Hello Alexandr, > > Signature V4 has been supported since > > https://github.com/openstack/swift3/commit/a1cc181bd8ef891d3e3b8ed71db9b4 > 1c179ced0e > >

Re: [Openstack] [OpenStack] [Swift] Does Swift3 support v4 signature for S3?

Hello Alexandr, Signature V4 has been supported since https://github.com/openstack/swift3/commit/a1cc181bd8ef891d3e3b8ed71db9b41c179ced0e It has been restricted with only keystone authentication though. The docs in README.rst is wrong. I pushed the fix for the docs, https://review.openstack.org

Re: [Openstack] [OpenStack] [Swift] How to create alias for a container?

Btw, The Ask OpenStack would be another place for posting OPs questions. https://ask.openstack.org/questions/ Regards // Hugo 2016-10-17 11:21 GMT+08:00 Kuo Hugo : > Hi Alexandr, > > No, you can't. There's no certain implementation. The only option would be > two-ways container-sync for Contain

Re: [Openstack] [OpenStack] [Swift] How to create alias for a container?

Hi Alexandr, No, you can't. There's no certain implementation. The only option would be two-ways container-sync for ContainerA&B. Regards // Hugo 2016-10-15 22:04 GMT+08:00 Alexandr Porunov : > Hello, > > Is it possible to create aliases for a container? > I have a container "ContainerA" I need

[Openstack] [OpenStack] [Swift] How to create alias for a container?

Hello, Is it possible to create aliases for a container? I have a container "ContainerA" I need to work with (put/remove/copy/get objects) but using the name "ContainerB". Is it possible to create such aliases? If yes then how? Sincerely, Alexandr ___ M

[Openstack] [OpenStack] [Swift] Does Swift3 support v4 signature for S3?

Hello, On gitgub they tell us: Support AWS Signature Version 2 (Version 4 is not ready) But in changelog they tell that they support v4: Amazon S3 Signature V4 support I tried to use aws java s3 client and mino java client to send requests to swift but without success. Both show either 403 or 40

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

On 14/10/16 18:07, Yu Watanabe wrote: At the same time , I see connection errors in the proxy server. Oct 14 14:05:08 opstack-controller proxy-server: Deferring reject downstream Oct 14 14:05:08 opstack-controller proxy-server: - - 14/Oct/2016/05/05/08 HEAD /v1/AUTH_a31f7e8e9ecc4d0e9d0d6c1de

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

At the same time , I see connection errors in the proxy server. Oct 14 14:05:08 opstack-controller proxy-server: Deferring reject downstream Oct 14 14:05:08 opstack-controller proxy-server: - - 14/Oct/2016/05/05/08 HEAD /v1/AUTH_a31f7e8e9ecc4d0e9d0d6c1de6c4c004 HTTP/1.0 204 - Swift - - - - tx60f54

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

Thanks for the reply. I confirmed that proxy config has account_autocreate = true defined and restarted the openstack-swift-proxy.service. But still the account-server returns 404. Oct 14 13:46:40 opstack-objstorage1 account-server: 10.1.0.6 - - [14/Oct/2016:04:46:40 +] "HEAD /sdd/292/AUTH_a

Re: [Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

On 14/10/16 16:03, Yu Watanabe wrote: Hi! I am verifying the installation using the swift stat command but it returns 503 Service Unavailable. [root@opstack-controller src 2016.10.14 11:55:37]# swift stat Account HEAD failed: http://opstack-cont-manage:8080/v1/AUTH_a31f7e8e9ecc4d0e9d0d6c1de

[Openstack] [openstack][swift] swift stat ends with 503 Service Unavailable

Hi! I am verifying the installation using the swift stat command but it returns 503 Service Unavailable. [root@opstack-controller src 2016.10.14 11:55:37]# swift stat Account HEAD failed: http://opstack-cont-manage:8080/v1/AUTH_a31f7e8e9ecc4d0e9d0d6c1de6c4c004 503 Service Unavailable I have chec

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

I did it. First I need to create ec2 credentials: openstack ec2 credentials create Then I had to change "my @endpoints" parameter in s3curl.pl as following: my @endpoints = ( 'proxy'); And then just use my credentials with s3curl.pl For example. For containers list: ./s3curl.pl --id access_key

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

Thank you. You were right. Now s3curl works but I don't know how to use it.. I try to check if swift3 is working with the next command: ./s3curl.pl --id 'swift' -key '384c48d6a26244aebcfa26cff4567bc0' -get -s -v http://proxy:8080/v1/AUTH_3f842db875cc48b99d7ff246c27a2e6a and ./s3curl.pl --id

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

To get token I use the next command: curl -i \ -H "Content-Type: application/json" \ -d ' { "auth": { "identity": { "methods": ["password"], "password": { "user": { "name": "swift", "domain": { "name": "default" }, "password": "swift"

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

On Oct 13, 2016, at 9:29 AM, Alexandr Porunov wrote: > Can't locate Digest/HMAC_SHA1.pm in @INC (@INC contains: You need to install the "libdigest-hmac-perl" package.. -- Try not. Do. Or do not. There is no try! - Yoda ___ Mailing list: http://lists.

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

The same error..( Can't locate Digest/HMAC_SHA1.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at ./ s3curl.pl line 20. BEGIN failed--compilation aborted at ./s3curl.pl line 20.

Re: [Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

Hello again, I'm not familier with s3curl in detail though, > ./s3curl.pl - 'swift' -key '3d8b70ad194a4cf6857e59ec638d' -get - -s -v > http://proxy:8080/v1/AUTH_3f842db875cc48b99d7ff246c27a2e6a > could you try: ./s3curl.pl - 'swift' -key 'swift' -get - -s -v http://proxy:8080/ IIRC, secret

[Openstack] [OpenStack] [Swift] How to use s3curl or s3cmd with Swift3?

Hello, I try to use s3curl to test swift3 but I miss something. Here is the command which I use: ./s3curl.pl - 'swift' -key '3d8b70ad194a4cf6857e59ec638d' -get - -s -v http://proxy:8080/v1/AUTH_3f842db875cc48b99d7ff246c27a2e6a It shows: Can't locate Digest/HMAC_SHA1.pm in @INC (@INC contains

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

Thank you all for your help! It have started the proxy finally. Here is the configuration that I used: [filter:swift3] use = egg:swift3#swift3 [filter:s3token] paste.filter_factory = swift3.s3_token_middleware:filter_factory auth_uri = http://keystone:35357/ Also I have installed dependencies:

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

Hi Alexandr, Though I cannot see the actual reason why the proxy-server failed (your report looks just proxy-server exist with status code 1), looking at your procedure, you might need to install dependencies (e.g. lxml) for swift3. I mean, > git clone https://github.com/openstack/swift3 >>

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

No, I didn't. I ran "python setup.py install" one more time. Here is the output: http://paste.openstack.org/show/585535/ On Thu, Oct 13, 2016 at 8:21 AM, John van Ommen wrote: > To me, the errors you're receiving are indicative of the swift3 > package not installing correctly. > > When you ran

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

To me, the errors you're receiving are indicative of the swift3 package not installing correctly. When you ran that first step (setup.py), did you get errors? John On Wed, Oct 12, 2016 at 10:03 PM, Alexandr Porunov wrote: > Hello, > > It still doesn't work... The same error is shown. Maybe I mi

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

Hello, It still doesn't work... The same error is shown. Maybe I missed something? Maybe before the installation I had to done something or something else. I tried different things to run it. But when we do have swift3 or/and s3token in pipeline it doesn't work. Sincerely, Alexandr On Thu, Oct 1

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

On 13/10/16 06:26, Alexandr Porunov wrote: Hello, I want to use S3 api for Swift. I have installed swift3 as here: git clone https://github.com/openstack/swift3 cd swift3 python setup.py install Then I have configured my proxy-server.conf as here: [pipeline:main] pipeline = catch_errors ga

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

No, I have only OpenStack Swift and Keystone. I used simple installation and configuration from this tutorials: http://docs.openstack.org/mitaka/install-guide-rdo/ On Wed, Oct 12, 2016 at 8:44 PM, John van Ommen wrote: > Are you installing OpenStack from trunk? > > I've installed Swift3 on Helio

Re: [Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

Are you installing OpenStack from trunk? I've installed Swift3 on Helion Open Stack 2.0, and the published instructions didn't work for me at all. On Wed, Oct 12, 2016 at 10:26 AM, Alexandr Porunov wrote: > Hello, > > I want to use S3 api for Swift. > > I have installed swift3 as here: > > git c

[Openstack] [OpenStack] [Swift] How to install Swift3 middleware?

Hello, I want to use S3 api for Swift. I have installed swift3 as here: git clone https://github.com/openstack/swift3 cd swift3 python setup.py install Then I have configured my proxy-server.conf as here: [pipeline:main] pipeline = catch_errors gatekeeper healthcheck proxy-logging cache contai

Re: [Openstack] [OpenStack] [Swift] Does Swift3 supports SLO (Manifest creation)?

Hello, It is what I need. Thank you very much Sincerely, Alexandr On Wed, Oct 12, 2016 at 4:04 AM, Kota TSUYUZAKI < tsuyuzaki.k...@lab.ntt.co.jp> wrote: > Hello Alexandr, > > Swift3 supports Multipart Upload API for actual Amazon S3[1] which has > similar functionality with Swift SLO manifest

Re: [Openstack] [OpenStack] [Swift] Does Swift3 supports SLO (Manifest creation)?

Hello Alexandr, Swift3 supports Multipart Upload API for actual Amazon S3[1] which has similar functionality with Swift SLO manifest so that you can use any SDK for s3 multiupload api. It needs, 1. init a multipart Upload 2. upload segments (chunk you may call) 3. complete the multipart upload

[Openstack] [OpenStack] [Swift] Does Swift3 supports SLO (Manifest creation)?

Hello, I want to use S3 API for OpenStack Swift but I need chunked upload for my files. I want to save many small object (1-10 MB) and retrieve them as a single object. For it I need to be able to create a manifest file. Does Swift3 support manifest creation? If yes then where can I see an example

Re: [Openstack] [OpenStack] [Swift] Can we use tempauth with version 2 or 3 of identity?

Tempauth is really only for internal use and removing dependencies when testing. It does not support v2 or v3 auth APIs. I'd suggest using keystone instead. --John > On Sep 19, 2016, at 8:46 AM, Alexandr Porunov > wrote: > > Hello, > > I am using tempauth for authentication. Here what I us

[Openstack] [OpenStack] [Swift] Can we use tempauth with version 2 or 3 of identity?

Hello, I am using tempauth for authentication. Here what I use: curl -v -H 'X-Auth-User: admin:admin' -H 'X-Auth-Key: admin' http://192.168.0.58:8080/auth/v1.0/ But I need to use v2 or v3 because I use a Java Client (jclouds) which can use only v2 or v3 authentication. I tried: curl -H "Content-

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

On 13 Sep 2016, at 15:47, Michael Yoon wrote: > Hello Alex and Clay, > > Pardon my jumping in here, we do something similar and have a similar use > case (we chose 1MB segments for mobile, and 10MB segments for desktop). > One question I have in comparing copy/bulk-delete vs keeping the manifest

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

Hello Alex and Clay, Pardon my jumping in here, we do something similar and have a similar use case (we chose 1MB segments for mobile, and 10MB segments for desktop). One question I have in comparing copy/bulk-delete vs keeping the manifest around is what is the overhead of the manifest within swi

Re: [Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

Thanks again Clay! I will try JOSS Now I am joined to #openstack-swift Best regards, Alexandr On Wed, Sep 14, 2016 at 12:21 AM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > Thanks again Clay! > > I will try JOSS > > Now I am joined to #openstack-swift > > Best regards, > Alexandr >

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

Thank you Clay! I use ffmpeg with remote input and local output for first convertion. Here is a simplified algorithm: 1. Convert with h264 in the highest quality (till 4K) and save it in a transformer server. 2. Convert into lower quality locally. And get additional data (thumbnails and so on). 3.

Re: [Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

heh, didn't see this one when responding to the other message :P My favorite client bindings for the java's is JOSS -> http://joss.javaswift.org/ For streaming upload; maybe here: https://github.com/javaswift/tutorial-joss-streaming/blob/e97a302e42b8964b4c87749fc2a5d28a9bb4d32a/src/main/java/org

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

On Tue, Sep 13, 2016 at 10:37 AM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > > Correct me if I am wrong. Algorithm is the next: > 1. Upload 1MB sub-segments (up to 500 sub-segments per segment). After > they will be uploaded I will use "copy" request to create one 500MB > segment. Aft

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

Hello Clay, Thank you for your suggestions. I need to use Swift in several purposes. 1. As a temporary storage for uncompressed video scenes (y4m, mp4) up to 120GB. (After conversion they will be deleted). 2. As a persistent storage for compressed video scenes (mp4) up to 120GB. Most of the compre

[Openstack] [OpenStack] [Swift] Segments count minimization.

Hello, Does somebody know how to minimize segments count of a file? I have to implement an upload file service with the chunked upload feature. If a client lose connection for some time we have to be able continue to upload the file after connection is established (From the last successfuly upload

[Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

Hello, Is it possible to stream a file from a Java server to OpenStack Swift? I need to store very large files in the OpenStack swift through the Java server. Java server performs authentication, validation and other special logic after that it sends file into OpenStack Swift. The problem is tha

Re: [Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

Thank you all! I will try these methods. Sincerely, Alexandr On Tue, Aug 23, 2016 at 8:14 PM, John Dickinson wrote: > There's 2 ways you can do this: > > 1) Use chunked transfer encoding > 2) Use Swift's large object manifest objects > > > For the first, it's the standard HTTP semantics. You ca

Re: [Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

There's 2 ways you can do this: 1) Use chunked transfer encoding 2) Use Swift's large object manifest objects For the first, it's the standard HTTP semantics. You can send chunks of data to Swift to be stored as one object without knowing the full object size up front. Note that the per-object

Re: [Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

The Swift3 plugin for Swift supports multipart upload. So you could do the following: 1) install the Swift3 plugin 2) use Amazon's s3 API for multi part upload http://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html On Aug 23, 2016 9:16 AM, "Alexandr Porunov" wrote: > Hello Jay, > > U

Re: [Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

Hello Jay, Unfortunately I don't know python. I am writing on java. Could you explain me briefly what I have to use to send chunks in the Swift and then combine those chunks? Or maybe we can append bytes to file somehow? If I understand correctly I need to store my first chunk as an individual obj

Re: [Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

On 08/23/2016 10:13 AM, Alexandr Porunov wrote: Hello, My server accepts files in chunks (4 Kbytes each chunk. File's size can be till 8 GB). Is it possible somehow store those chunks in Swift like a single file? Does somebody know any solution to solve this problem? Yes, you can do this. The

[Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

Hello, My server accepts files in chunks (4 Kbytes each chunk. File's size can be till 8 GB). Is it possible somehow store those chunks in Swift like a single file? Does somebody know any solution to solve this problem? Sincerely, Alexandr ___ Mailing l

Re: [Openstack] [OpenStack] swift mitaka version is not working.

your guessing is right. Swift is working now. Thank you so much. I changed project_domain_id and user_domain_id in proxy-server.conf. and restarted swift-proxy service. so Swift is working. 😁 2016-07-13 15:44 GMT+09:00 James Clark : > Hi, > > > On Jul 13, 2016, at 3:29 PM, Nalee Jang wrote: >

Re: [Openstack] [OpenStack] swift mitaka version is not working.

Hi, > On Jul 13, 2016, at 3:29 PM, Nalee Jang wrote: > > [filter:authtoken] > > paste.filter_factory = keystonemiddleware.auth_token:filter_factory > > auth_uri = http://192.168.56.101:5000 > > auth_url = http://192.168.56.101:35357 > > memcached_servers = 192.168.56.101:11211 > > auth_plug

Re: [Openstack] [OpenStack] swift mitaka version is not working.

Thank you for answering. After I got a your reply, I checked my keystone configuration and proxy-server.conf. so I modified endpoint url of swift. but I have seen same error messages. === swift endpoint url === root@controller:~# openstack endpoint list --service swift +--

Re: [Openstack] [OpenStack] swift mitaka version is not working.

Hello, > On Jul 13, 2016, at 10:41 AM, Nalee Jang wrote: > > Nowadays, I have installed OpenStack Swift Mitaka manually referring to > OpenStack official ubuntu manual. but swift is not working. swift is erupting > below error messages. I don't understand this situation. I think swift > confi

[Openstack] [OpenStack] swift mitaka version is not working.

Hello everyone. I am NaleeJang from OpenStack Korea User Group. Nowadays, I have installed OpenStack Swift Mitaka manually referring to OpenStack official ubuntu manual. but swift is not working. swift is erupting below error messages. I don't understand this situation. I think swift configuratio

Re: [Openstack] OpenStack Swift proxy server HTTP/1.1 500 Server Error

What your logs from the application process say about this particular timeslot? On Jun 30, 2016 23:01, "Himalaya Raj" wrote: > Dear OpenStack Swift Team, > > I am deploying OpenStack Swift on Raspberry Pi cluster. I have one Proxy > node and 4 storage node. When trying to access from proxy node i

[Openstack] OpenStack Swift proxy server HTTP/1.1 500 Server Error

Dear OpenStack Swift Team, I am deploying OpenStack Swift on Raspberry Pi cluster. I have one Proxy node and 4 storage node. When trying to access from proxy node it's giving me 500 server error message. ... root@proxynode:/# curl -k -v -H 'X-Storage-User: system:root' -H '

[Openstack] openstack swift as a cache proxy for nginx, swift proxy report 401 error when authenticate

I am trying to find a way to use Openstack swift to cache static file for a web server such as nginx, the below are request step: 1.nginx is configured as a load balance proxy server and web server. 2.There are several swift , suppose there are 2, that is swift-A,swift-B ,swift-

Re: [Openstack] [openstack][swift] Question about Swift consistency and concurrent requests

inline On 22 Feb 2016, at 5:06, Kévin Bernard-Allies wrote: > Hello, > > I've some questions about the handling of concurrent requests by Swift. > Any help would be great:) > > > If I understand correctly, a PUT request on swift-proxy will be transmitted > to at least half the storage nodes plus

Re: [Openstack] openstack swift

Th short answer is that no you cannot specify a storage node for a given object. Data placement is done with the hash ring, so placement is based on the hash of the object name and the current state of the drives in the cluster. --John On 22 Feb 2016, at 4:06, pgh pgh wrote: > Hello All, > >

[Openstack] [openstack][swift] Question about Swift consistency and concurrent requests

Hello, I've some questions about the handling of concurrent requests by Swift. Any help would be great:) If I understand correctly, a PUT request on swift-proxy will be transmitted to at least half the storage nodes plus one, before returning the response. A subsequent GET request should have

[Openstack] openstack swift

Hello All, I'm a beginner with openstack but I'm mainly interested in Swift... I was wonder if in addition to use the Swift modified consistent hashing ring, is possible to manually specify the storage node, if so, how does Swift to maintain load balancing ? *Thanks and best regards,* *Pgh* __

Re: [Openstack] [openstack][swift]Got error when installing swift all in one.

Hi, Hao Did you already do the setting for where shared jerasure library located? The log message looks that Linux system doesn't have a seach path for that. Like: - Add /usr/local/lib path (if you installed libJerasure.so in another location, you should set the path here) into /etc/ld.so.conf

[Openstack] [openstack][swift]Got error when installing swift all in one.

Hi, all I was installing swift all-in-one in my virtual machine, OS is ubuntu 14.04. But I got errors when I start the swift service by using "startmain" script: liberasurecode[2969]: liberasurecode_backend_open: dynamic linking error libJerasure.so: cannot open shared object file: No such file

Re: [Openstack] Openstack swift charset problem

Thanks Samuel, I researched and windows send request with win1254 charset. So, I need to change win1254 to utf-8 character set in windows. Thank you for your help. Regards. 2015-04-03 21:29 GMT+03:00 Samuel Merritt : > On 4/3/15 1:42 AM, mehmet hacısalihoğlu wrote: > >> Hi All, >> >> When I req

Re: [Openstack] Openstack swift charset problem

On 4/3/15 1:42 AM, mehmet hacısalihoğlu wrote: Hi All, When I request send to create pseudo folder with turkish characters in windows, I get error message "Invalid UTF8 or contains NULL". curl -i -X PUT http://1X.XX.XXX.XX/v1/AUTH_test/test/çöçö

[Openstack] Openstack swift charset problem

Hi All, When I request send to create pseudo folder with turkish characters in windows, I get error message "Invalid UTF8 or contains NULL". curl -i -X PUT http://1X.XX.XXX.XX/v1/AUTH_test/test/çöçö -H "Content-Type: application/dir

Re: [Openstack] Openstack swift CORS configuration

Hi Mohammed, I use tempauth autentication for swift. Thanks. Regards. 20 Mar 2015 tarihinde 18:26 saatinde, "Mohammed Naser" şunları yazdı: > Hi Mehmet, > > That doesn’t seem like a CORS issue but more of an actual authentication > issue. What method of authentication are you using? > > T

Re: [Openstack] Openstack swift CORS configuration

Hi Mehmet, That doesn’t seem like a CORS issue but more of an actual authentication issue.  What method of authentication are you using? Thanks Mohammed On Fri, Mar 20, 2015 at 4:52 AM, mehmet hacısalihoğlu wrote: > Hi All, > I configurated CORS in Openstack swift Juno. But when I try cu

[Openstack] Openstack swift CORS configuration

Hi All, I configurated CORS in Openstack swift Juno. But when I try curl command, I get error message. Do I need to make another configuration? I attached proxy-server.conf *curl -i http://10.1.34.100/v1/AUTH_test/dene -X OPTIONS -H "X-Auth-Token: AUTH_tke9

[Openstack] [openstack][swift]-container mount into ubuntu

Hi, Do we have any facility like s3fs to mount swift container into our local server? I am trying to use cloud-fuse but facing some issues ,please let me know if you are successfully mounted swift container with cloud-fuse. Subbareddy, Persistent systems ltd. DISCLAIMER == This e-mai

Re: [Openstack] [OpenStack][Swift] Third-party client tools

Could this tools also be used together with CEPH object storage - RadosGW, since CEPH has not 100% compatible Swift/S3 API? For comparison, it would be great to have some list of similar third-party tools, which were written for CEPH RadosGW. ___ Mailing

Re: [Openstack] [OpenStack][Swift] Third-party client tools investigation

Hugo, What's the goal of this exercise? And what exactly is the kind of analysis you have in mind? Thanks in advance. -Shri On Sun, Jul 20, 2014 at 10:28 PM, Kuo Hugo wrote: > Hi Folks, > > I'd like to investigate all third-party clients for OpenStack Swift. > The requirement is the client too

Re: [Openstack] [OpenStack][Swift] Third-party client tools investigation

Rally touches Swift using the API, used for Openstack performance testing. *Adam Lawson* AQORN, Inc. 427 North Tatnall Street Ste. 58461 Wilmington, Delaware 19801-2230 Toll-free: (844) 4-AQORN-NOW ext. 702 Int'l: +1-302-268-6914 ext. 702 Cell: +1-916-990-1226 On Sun, Jul 20, 2014 at 10:28 PM,

[Openstack] [OpenStack][Swift] Third-party client tools investigation

Hi Folks, I'd like to investigate all third-party clients for OpenStack Swift. The requirement is the client tool must using native OpenStack Swift API to interact with Swift. Please let me know commercial solution, opensource solution or any private solution that you have. I glad to try any clien

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

On Apr 30, 2014, at 11:59 AM, Dimitri Maziuk wrote: > I'd say an interesting question is how many users want storage that only > lets you put, get, and delete a file. A private cloud storage is > trivially re-exportable as a filesystem, how easy is that with > commercial offerings? 1) "storage t

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

Basically, a 10TB cluster, using the above calcs, saves a client ~$3500/year compared to using AWS. And that's a pretty small cluster. Scale that out significantly and you end up with some pretty impressive cost savings. Mahalo, Adam *Adam Lawson* AQORN, Inc. 427 North Tatnall Street Ste. 58461

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

Alejandro, Maybe this will help you. It's a cost analysis we did for one of our large clients who were using S3 heavily and considering a move to Swift. We did the analysis to determine if it was worth the investment and confirm how the underlying infrastructure (phys/virt) impacted the final cost

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

On 04/30/2014 12:37 PM, John Dickinson wrote: I've asked around the office here at SwiftStack to see if we can put together some more public cost details (specifically in response to you question), so I hope we can share some more info soon. I'd say an interesting question is how many users want

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

Lovely Johon, i'll read that but hey ... beilieve me, this in-deep analysis that im going through in my company making a production proyect crumble just because lack of costs data regarding amazon will be a constant while amazon keeps droping prices. If you can share those details, that would be :

Re: [Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

Alejandro, We blogged about this recently at https://swiftstack.com/blog/2014/04/24/about-those-public-cloud-price-drops/. I've asked around the office here at SwiftStack to see if we can put together some more public cost details (specifically in response to you question), so I hope we can sh

[Openstack] [openstack][SWIFT] I want to talk about costs !! (against amazon S3)

Hi guys. After amazon dropped its prices among other things, on S3 its seems that i need in my compañy to justify/analyze if swift keeps being the most cost convenient solution (we have it in house) When we decided going with swift one year ago, one of the main constraints was "keeping the data in

Re: [Openstack] openstack swift query

Hello Ankit, The easiest way is to create a new loopback device that is 40GB in the same way the 10GB device is created. This will create a new empty device, and you will lose your data. This usually isn't a problem since the SAIO is specifically for development and learning-- not for production

[Openstack] openstack swift query

Hello Everyone I have installed openstack swift single node and i followed this tutorial http://docs.openstack.org/developer/swift/development_saio.html i have doubt regarding loopback storage. In loopback device storage i gave 10 gb of stoage for sdb1 I want it to be 40 gb How to truncate t

[Openstack] Openstack swift LOOPBACK Query

Hello Everyone I have installed openstack swift single node and i followed this tutorial http://docs.openstack.org/developer/swift/development_saio.html i have doubt regarding loopback storage. In loopback device storage i gave 10 gb of stoage for sdb1 I want it to be 40 gb How to truncate

Re: [Openstack] Openstack Swift with Azure Integration

can this effort be included in the hybrid effort? for example, the application still uses the swift in the regular way, but the middleware translation whatever needed? On Tue, Apr 22, 2014 at 1:54 PM, mehmet hacısalihoğlu wrote: > Thank you so much Everett. I understand, I will write with code t

Re: [Openstack] Openstack Swift with Azure Integration

Thank you so much Everett. I understand, I will write with code to extend swift. I must use this example documents. Regards. 2014-04-21 16:41 GMT+03:00 Everett Toews : > Hi Mehmet, > > There’s a couple of ways you can solve this problem. > > 1. Client side > > If you’re writing some sort of

Re: [Openstack] Openstack Swift with Azure Integration

Hi Mehmet, There’s a couple of ways you can solve this problem. 1. Client side If you’re writing some sort of client for a customer to solve this problem, you can use a multi-cloud SDK like jclouds, libcloud, or Fog to store their files in one cloud or the other depending on how full Swift is.

Re: [Openstack] Openstack Swift with Azure Integration

gt; *To:* Chuck Thier > *Cc:* openstack@lists.openstack.org > *Subject:* Re: [Openstack] Openstack Swift with Azure Integration > > > > Sounds like you're looking for a dump-excess cloud-to-cloud sort of thing? > > > > * Adam Lawson* > > AQORN, Inc. > &

Re: [Openstack] Openstack Swift with Azure Integration

Kinda like this? https://review.openstack.org/#/c/64430/ From: Adam Lawson [mailto:alaw...@aqorn.com] Sent: Wednesday, April 16, 2014 3:27 PM To: Chuck Thier Cc: openstack@lists.openstack.org Subject: Re: [Openstack] Openstack Swift with Azure Integration Sounds like you're looking for a

Re: [Openstack] Openstack Swift with Azure Integration

Sounds like you're looking for a dump-excess cloud-to-cloud sort of thing? *Adam Lawson* AQORN, Inc. 427 North Tatnall Street Ste. 58461 Wilmington, Delaware 19801-2230 Toll-free: (888) 406-7620 On Wed, Apr 16, 2014 at 7:00 AM, Chuck Thier wrote: > Hello, > > There is no such integration tha

  1   2   >