Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Joseph Bajin
I took a look at the scripts that the CERN folks built and modified these for my specific use case.. Here is the repo: https://github.com/cernops/nova-db-purge Joe On Fri, Sep 2, 2016 at 1:57 PM, Edmund Rhudy (BLOOMBERG/ 120 PARK) < erh...@bloomberg.net> wrote: > Great post, thanks. nova is my

Re: [Openstack-operators] libvirt: make snapshot use RBD snapshot/clone when available

2016-09-02 Thread Logan V.
Have been using it since kilo. It was a clean pick into Liberty and worked great for me. Logan On Friday, September 2, 2016, Saverio Proto wrote: > Hello, > > this is merged upstream in Mitaka: > > https://review.openstack.org/#/c/287954/ > > anyone already did a cherry pick in Liberty and is r

Re: [Openstack-operators] Nova

2016-09-02 Thread Adam Lawson
The specific concern is *udev* and whether the *udev* version on the guest should match the version of *udev* running on the host to ensure reliable volume handling... //adam *Adam Lawson* AQORN, Inc. 427 North Tatnall Street Ste. 58461 Wilmington, Delaware 19801-2230 Toll-free: (844) 4-AQORN-N

Re: [Openstack-operators] Nova

2016-09-02 Thread Adam Lawson
Mike that's just as I suspected. To be super clear, does KVM in particular know how to distinguish between Ubuntu v12 versus v16? In other words, do I need to be running a specific version of KVM hypervisor so it can host guests running the latest version of Ubuntu? Again, this was brought up as b

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread Jeremy Stanley
On 2016-09-02 12:36:27 + (+), Tim Bell wrote: > Has anyone had experience running ElasticSearch on top of OpenStack VMs ? The OpenStack community infrastructure includes a modest ElasticSearch cluster indexing CI job results, behind the http://logstash.openstack.org/ and http://status.open

Re: [Openstack-operators] Nova

2016-09-02 Thread Mike Smith
Hi Adam - The OS of the guest is independent of the Openstack version. Your choice of hypervisor (KVM, VMWare, HyperV, etc) would just need to support the OS version that you want to run on your guests. Mike Smith Lead Cloud Systems Architect Overstock.com On Sep 2, 20

[Openstack-operators] Nova

2016-09-02 Thread Adam Lawson
Hey everyone, do specific versions of OpenStack necessitate specific versions of guest os's? I.e. if I'm running a mitaka cloud platform, do the guest vm operating systems need to be a specific version of Linux? My understanding is the two are totally unrelated when the VM's are running Linux but I

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread David Medberry
Nathan: The page at https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html gives you good advice on a maximum size for the elasticsearch VM's memory. Nathan: suggest you pick a flavor with 64GB RAM or less, then base other sizing things off of that (i.e. choose a flavor with

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread David Medberry
omitted on more line: give java heap 30GB, and leave the rest of the memory to the OS filesystem cache so that Lucene can make best use of it. On Fri, Sep 2, 2016 at 2:15 PM, David Medberry wrote: > From Nathan (on TWC Cloud team): > > Nathan: The page at https://www.elastic.co/guide/en/elastic

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread David Medberry
>From Nathan (on TWC Cloud team): Nathan: The page at https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html gives you good advice on a maximum size for the elasticsearch VM's memory. Nathan: suggest you pick a flavor with 64GB RAM or less, then base other sizing things off

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Great post, thanks. nova is my primary target for cleanup (to get rid of deleted instances and virtual interfaces), the other databases are mostly okay. From: m...@mattfischer.com Subject: Re: [Openstack-operators] Database cleanup scripts? Hi Ed, Good to meet you in NYC last week. And fortuna

Re: [Openstack-operators] libvirt: make snapshot use RBD snapshot/clone when available

2016-09-02 Thread Matt Riedemann
On 9/2/2016 10:11 AM, Saverio Proto wrote: Hello, this is merged upstream in Mitaka: https://review.openstack.org/#/c/287954/ anyone already did a cherry pick in Liberty and is running this in production ? I plan to test this soon. Any feedback is appreciated ! thank you Saverio ___

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Matt Riedemann
On 9/2/2016 10:20 AM, Arne Wiebalck wrote: On 02 Sep 2016, at 17:08, Matt Fischer mailto:m...@mattfischer.com>> wrote: On Fri, Sep 2, 2016 at 8:57 AM, Abel Lopez mailto:alopg...@gmail.com>> wrote: For cinder, since kilo, we've had 'cinder-manage db purge-deleted' This is the issue we s

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Arne Wiebalck
On 02 Sep 2016, at 17:08, Matt Fischer mailto:m...@mattfischer.com>> wrote: On Fri, Sep 2, 2016 at 8:57 AM, Abel Lopez mailto:alopg...@gmail.com>> wrote: For cinder, since kilo, we've had 'cinder-manage db purge-deleted' This is the issue we see with this tool in Liberty, I think this might

[Openstack-operators] libvirt: make snapshot use RBD snapshot/clone when available

2016-09-02 Thread Saverio Proto
Hello, this is merged upstream in Mitaka: https://review.openstack.org/#/c/287954/ anyone already did a cherry pick in Liberty and is running this in production ? I plan to test this soon. Any feedback is appreciated ! thank you Saverio ___ OpenStac

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Matt Fischer
On Fri, Sep 2, 2016 at 8:57 AM, Abel Lopez wrote: > For cinder, since kilo, we've had 'cinder-manage db purge-deleted' > > This is the issue we see with this tool in Liberty, I think this might be fixed in M. # cinder-manage db purge 365 (some stuff works here) ... 2016-09-02 15:07:02.196

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Abel Lopez
For cinder, since kilo, we've had 'cinder-manage db purge-deleted' On Friday, September 2, 2016, Edmund Rhudy (BLOOMBERG/ 120 PARK) < erh...@bloomberg.net> wrote: > Does anyone have any database cleanup scripts (especially for Nova/Cinder) > that they are proud of and are willing to share? Googl

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Matt Fischer
Hi Ed, Good to meet you in NYC last week. And fortunate timing for the question, I just published a summary of my experiences here: http://www.mattfischer.com/blog/?p=744 I know that the Nova DB cleanup stuff was broken in the past, and IIRC you are on Kilo, so it may not work for you until you g

[Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Does anyone have any database cleanup scripts (especially for Nova/Cinder) that they are proud of and are willing to share? Googling around didn't turn up anything I felt was trustworthy; I found one in a GitHub Gist and stopped reading as soon as it disabled foreign key constraints.

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread Van Leeuwen, Robert
Hi, I had some “interesting” issues in the past with sparse files on xfs with elasticsearch: http://engineering.spilgames.com/hypervisor-kernel-panics-hit-2014-sl6-5/ If you pre-allocate your files you should be good. Cheers, Robert van Leeuwen From: Tim Bell Date: Friday, September 2, 2016 a

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread Matt Van Winkle
We are running entire ELK clusters on our undercloud. Let me see if I can point our resident metrics expert at this as well. VW Sent from my iPhone On Sep 2, 2016, at 7:50 AM, David Medberry mailto:openst...@medberry.net>> wrote: Hey Tim, We've just started this effort. I'll see if the guy r

Re: [Openstack-operators] Delete cinder service

2016-09-02 Thread Arne Wiebalck
On 02 Sep 2016, at 11:50, Nick Jones mailto:nick.jo...@datacentred.co.uk>> wrote: On 2 Sep 2016, at 9:28, William Josefsson wrote: [..] Is there any cleanup of volumes entries with deleted=1, or is it normal these old entries lay around? thx will There’s a timely blog post from Matt Fischer o

Re: [Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread David Medberry
Hey Tim, We've just started this effort. I'll see if the guy running the service can comment today. On Fri, Sep 2, 2016 at 6:36 AM, Tim Bell wrote: > > > Has anyone had experience running ElasticSearch on top of OpenStack VMs ? > > > > Are there any tuning recommendations ? > > > > Thanks > > Ti

[Openstack-operators] ElasticSearch on OpenStack

2016-09-02 Thread Tim Bell
Has anyone had experience running ElasticSearch on top of OpenStack VMs ? Are there any tuning recommendations ? Thanks Tim ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo

Re: [Openstack-operators] Delete cinder service

2016-09-02 Thread Nick Jones
On 2 Sep 2016, at 9:28, William Josefsson wrote: [..] Is there any cleanup of volumes entries with deleted=1, or is it normal these old entries lay around? thx will There’s a timely blog post from Matt Fischer on exactly that subject: http://www.mattfischer.com/blog/?p=744 His comment regar

Re: [Openstack-operators] [OpenStack-DefCore] [OSOps] Ansible work load test for interop patch set

2016-09-02 Thread Matt Jarvis
I was going to review this, but it got merged before I got to it. There's a couple of fundamental issues with these scripts, the lack of error handling being one, but more importantly using the existence of apt or yum to check for OS version is not safe as either can exist on either platform. I'll

Re: [Openstack-operators] Delete cinder service

2016-09-02 Thread Arne Wiebalck
There is ‘cinder-manage db purge’ to delete entries which are marked as deleted. I never tried it (and suggest to start with a copy of the db before touching the prod ones). We usually do not purge databases unless we hit an issue. Cheers, Arne > On 02 Sep 2016, at 10:28, William Josefsson

Re: [Openstack-operators] Delete cinder service

2016-09-02 Thread William Josefsson
Thanks everyone for your replies! I did a safe select first to make sure there was only one match. than I updated deleted=1 for that service which seem to work. Now 'cinder service-list' shows the right output. I notice in DB 'volumes', there are plenty of old volume entries, long ago deleted, and

Re: [Openstack-operators] Converged infrastructure

2016-09-02 Thread Matt Jarvis
Hi Mohammed Could you give us an idea of what your node hardware looks like, and how you split it up ? I'm doing some work on the economics of this, so I'd like to understand the RAM and physical cores split. On 1 September 2016 at 17:58, Mohammed Naser wrote: > I proposed a talk for the Summit