Hi all, kubernetes-cloudstack-provider provides the missing link between Kubernetes and CloudStack resources (firewall, loadbalancer, node information, ...).
There is one other component that you still need, though: Suitable images. I'm not sure if this is something that CloudStack should provide, but without them, automated resizing will be difficult. Paul, do you already have an idea on how to do handle this? Require users to build their own images? Create a ready-to-use template like it's done for the system VMs? How could PaaS deployments (for example, OpenShift) be handled? What about node security? We've been deploying Kubernetes very successfully via custom Ansible scripts so far. But having CloudStack do much of the heavy lifting might allow for some very interesting use cases. If cluster scaling can be abstracted at the API level, it could also be added to the cloud provider - allowing infrastructure scaling from within k8s itself, or even based on load! In such a case, initial setup should focus first and foremost on the control plane (i.e. bootstrapping master nodes), then allowing worker scaling via k8s resources. Regards, Gregor ________________________________ From: Paul Angus <paul.an...@shapeblue.com> Sent: 25 September 2019 16:47 To: dev@cloudstack.apache.org <dev@cloudstack.apache.org> Subject: RE: [DISCUSS] CloudStack Kubernetes Service plugin The proposed implementation will create a master and n worker nodes. It will also support (graceful) cluster resizing, the next step would be to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that scaling, so that you can scale with demand rather than needing to oversize you environment to begin with. I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side VM based Kubernetes clusters. Interestingly a few people that I have spoken to have said that they prefer the use of VMs, because whole servers as the unit of scale is often very wasteful, unless you 'share' them which has all sorts of security implications... paul.an...@shapeblue.com www.shapeblue.com<http://www.shapeblue.com> Amadeus House, Floral Street, London WC2E 9DPUK @shapeblue -----Original Message----- From: Pierre-Luc Dion <pd...@cloud.ca> Sent: 25 September 2019 15:31 To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin Hi Paul, Yeah, was bad timing for the CCCNA this year unfortunately :-(, I'm not sure I'm curious to see how cloudstack could become more "other Apache products friendly" but I don't have particular use case compared to k8s integration. Has you are suggesting, would probably make sense to use Helm to deploy any other application stack. btw, we are still working on the Canonical MaaS integration, a bit more challenging than anticipated... To get back to a *Kubernetes Service plugin*: To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need to deploy monstrous instances for worker nodes. which doesn't make sense if I'm a cloud consumer. So I think we need to solve something challenging: a k8s service that would scale has needed while keeping in mind redundancy of worker nodes without sacrifice on security. Is the worker node is part of the ongoing work or it's more about offering a k8s master and api infrastructure to a user ? An easy path would be some kind of shared worker nodes pool but that involve possible security risk unless you would trust users that consume those workers. On Wed, Sep 25, 2019 at 10:15 AM Paul Angus <paul.an...@shapeblue.com> wrote: > Hi Pierre-Luc, > > (we missed you at CCCNA!) How are you seeing CloudStack being more > deployment friendly? What you do think that we could do on top of > creating the Kubenetes Cluster to begin with? > [thinking out loud - we could pre-package Tiller to make it easier to > deploy openWhisk via Helm charts ? ] > > Kind regards > > > Paul. > > > > paul.an...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > Amadeus House, Floral Street, London WC2E 9DPUK @shapeblue > > > > > -----Original Message----- > From: Pierre-Luc Dion <pd...@cloud.ca> > Sent: 25 September 2019 13:37 > To: dev@cloudstack.apache.org > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin > > Hi Rohit, Nux, > > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree > with your opinion, but there is a lot of interest for k8s and seams like a > lot of organisations are moving to container based infrastructures to > standardized their deployment. > > if we want to extent the discussion to function as a service, would you > guys see a possibility for us to be more aligned or more deployment > friendly for Openwhisk ? > > Cheers, > > > On Wed, Sep 25, 2019 at 6:54 AM Will Stevens <wstev...@cloudops.com> > wrote: > > > We see huge demand for K8s in our customer base. Just a note... > > > > On Wed, Sep 25, 2019, 4:03 AM Nux! <n...@li.nux.ro> wrote: > > > > > Do you guys see high demand for K8s? > > > From where I'm looking it seems to be going the way of Openstack, > > > loads of hype, overcomplicated, near-impossible to upgrade. > > > Not sure if it's worth investing resources for this. > > > > > > Lucian > > > > > > --- > > > Sent from the Delta quadrant using Borg technology! > > > > > > On 2019-09-24 07:41, Abhishek Kumar wrote: > > > > Hi all, > > > > > > > > I would like to propose developing a plugin for Kubernetes > > > > integration in CloudStack, can be named CloudStack Kubernetes > Service plugin. > > > > I've written down an initial design document for it here, > > > > > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kube > > rnetes+Service > > > > Please review and provide your thoughts and suggestions. > > > > > > > > Regards, > > > > > > > > > > > > Abhishek Kumar > > > > > > > > Software Engineer > > > > > > > > ShapeBlue > > > > > > > > abhishek.ku...@shapeblue.com > > > > > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > > > > > abhishek.ku...@shapeblue.com > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > Amadeus House, Floral Street, London WC2E 9DPUK @shapeblue > > > > > > > > -- > > *Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal > t 1.888.796.8364 ext. 1403 > > > < > https://cloud.ca/?utm_source=email&utm_medium=signature&utm_content=cloud-ca-logo-1&utm_campaign=general_email > > > --