Re: [Openstack] Ceph vs swift

2014-06-16 Thread Chuck Thier
r journals, and thus provides very misleading results. -- Chuck On Mon, Jun 16, 2014 at 4:03 AM, Vincenzo Pii wrote: > Hi Chuck, > > Many thanks for your comments! > I have replied on the blog. > > Best regards, > Vincenzo. > > > 2014-06-12 21:10 GMT+02:00 Chuck

Re: [Openstack] Ceph vs swift

2014-06-12 Thread Chuck Thier
-for-object-storage-on-small-clusters/ > > > 2014-06-06 20:19 GMT+02:00 Matthew Farrellee : > >> On 06/02/2014 02:52 PM, Chuck Thier wrote: >> >> I have heard that there has been some work to integrate Hadoop with >>> Swift, but know very little about it. Int

Re: [Openstack] Ceph vs swift

2014-06-02 Thread Chuck Thier
s that handle? > > Thanks for you sharing I m sure everyone will take a good lesson. > > Ciao > > Inviato da iPhone () > > Il giorno May 29, 2014, alle ore 22:39, Chuck Thier ha > scritto: > > Hello Remo, > > That is quite an open ended question :) If you c

Re: [Openstack] Ceph vs swift

2014-05-29 Thread Chuck Thier
Hello Remo, That is quite an open ended question :) If you could share a bit more about your use case, then it would be easier to provide more detailed information, but I'll try to cover some of the basics. First, a disclaimer. I am one of the original Openstack Swift developers, so I *may* be

Re: [Openstack] openstack swift query

2014-04-25 Thread Chuck Thier
Hello Ankit, The easiest way is to create a new loopback device that is 40GB in the same way the 10GB device is created. This will create a new empty device, and you will lose your data. This usually isn't a problem since the SAIO is specifically for development and learning-- not for production

Re: [Openstack] [Swift] XFS Write Barriers

2014-04-22 Thread Chuck Thier
Well the short answer to that question is that it is generally a best practice to run a disk controller card with a persistent cache in front of your storage drives. When this is the case you want to turn barriers off, otherwise they would render your cache ineffective. If you are not running a

Re: [Openstack] Openstack Swift with Azure Integration

2014-04-16 Thread Chuck Thier
to integrate swift with azure. Or How can solve this problem? > > Regards. > > > 2014-04-15 20:51 GMT+03:00 Chuck Thier : > > I'm not aware of any integration between Swift and Azure. Could you >> explain more what problem you are trying to solve? >> >> T

Re: [Openstack] Openstack Swift with Azure Integration

2014-04-15 Thread Chuck Thier
I'm not aware of any integration between Swift and Azure. Could you explain more what problem you are trying to solve? Thanks, -- Chuck On Tue, Apr 15, 2014 at 6:55 AM, mehmet hacısalihoğlu wrote: > Hi All, > > I want to integrate swift with azure. But I dont find related document to > this s

Re: [Openstack] [Swift] Getting better performance by disabling container DB updates?

2014-03-20 Thread Chuck Thier
Hi Shrinand, For your use case, it would certainly lower the overall latency, and likely increase throughput. The downside is that the client has to track all of the objects, and you loose some of the other features like usage. Is it viable for swift? That's a tough question. I think could be

Re: [Openstack] [Swift] Swift on RHEL

2013-12-10 Thread Chuck Thier
My first guess is that the Redhat kernel in 5.8 may not have as many xfs improvements and may require that the inode size set to 1024 instead of the default. That would be the first thing I would try. -- Chuck On Tue, Dec 10, 2013 at 5:57 PM, John Smith wrote: > On Wed, Dec 11, 2013 at 12:53

Re: [Openstack] Swift sharding across containers

2013-10-10 Thread Chuck Thier
Hi Shri, On Thu, Oct 10, 2013 at 1:31 PM, Shrinand Javadekar wrote: > Thanks for the inputs Chuck. Please see my responses inline. > > > On Thu, Oct 10, 2013 at 7:56 AM, Chuck Thier wrote: > >> Hi Shri, >> >> I think your observations are fairly spot on.

Re: [Openstack] Swift sharding across containers

2013-10-10 Thread Chuck Thier
otational) of the servers running swift. But the > relative numbers give a better picture of the benefits of: > > i) Sharding across containers to increase throughput > ii) Restricting the number of objects per container > > Let me know if I have missed out on anything or if the

Re: [Openstack] How much partition number should be on disk

2013-09-06 Thread Chuck Thier
At a minimum, you want 100 partitions per disk. More partitions doesn't really matter unless you get way too many (for example 100K partitions on a disk is probably a bad idea). And yes, since there are 3 replicas, there will be 3 copies of every partition. When determining the part power, you r

Re: [Openstack] Swift sharding across containers

2013-09-03 Thread Chuck Thier
Hi Shri, The short answer is that sharding your data across containers in swift is generally a good idea. The limitations with containers has a lot more to do with overall concurrency rather than total objects in a container. The number of objects in a container can have an affect on that, but w

Re: [Openstack] Help - swift with low IOPS

2013-09-03 Thread Chuck Thier
Hi Pangj, First, make sure you have an updated version of swift-bench. There was a bug where it was relying on python-swiftclient to setup eventlet, but when eventlet was removed from swiftclient, that caused swift-bench to not run requests concurrently. There are quite a few things that should

Re: [Openstack] [Swift] Problems during initial configuration

2013-08-18 Thread Chuck Thier
Hi Steve, The services start with the ports defined in the configuration files. Since it looks like you want to run several servers on the same machine, I would suggest looking at the all in one docs ( http://docs.openstack.org/developer/swift/development_saio.html) as it is set up in a similar w

Re: [Openstack] Borrow a Swift Implementation

2013-07-30 Thread Chuck Thier
happy to accept pull requests or comments. > > What clients do you use against your swift implementation? Have you gotten > pyrax to work with it? > > -- Kyle > > On Tue, Jul 30, 2013 at 10:36 AM, Chuck Thier wrote: > >> Hey Kyle, >> >> I'm interested