Re: KVM Host overprovisioning

2017-09-11 Thread Wido den Hollander 
Hi,

> Op 10 september 2017 om 8:37 schreef Ivan Kudryavtsev 
> :
> 
> 
> Hello, community.
> 
> During the last years Linux kernel got some interesting features like KSM,
> ZSWAP, ZRAM. Hardware also steps forward and we see Intel 3d xpoint,
> extremely fast SSD drives with m.2 and PCI-E interfaces.
> 
> These facilities enable potentially interesting use of overcommited RAM for
> hosts. According to IBM's investigations Zswap with LZ4/ZBUD increases
> virtual RAM on 40%.
> 
> I investigated current Apache CloudStack memory overcommitment capabilities
> and they mostly affect VM's RAM by utilizing ballooning and I think it's
> not what necessary to open new facilities. There are many cases which can
> utilize ZSWAP and fast swap devices to efficiently provision more RAM than
> presents.
> 
> I suppose, CloudStack Agent for KVM can have configured parameter which
> "mangles" RAM reported. From the other hand it can be done by implemented
> host properties on server side. I tried manual increasing in host table:
> 
> update host set ram=ram * 1.4 where id=1;
> 
> and it seems until the next host stats update it works as expected. I think
> this workaround is useful, but it's better to have the function in core
> like standard.
> 

Can't you set memory over provisioning on a cluster basis in the GUI? I thought 
you could.

Wido

> Let me know what you think about it, it might be I don't understand
> something and ACS already has it in place? I also would like to hear your
> thoughts on ZSWAP usage in practice.
> 
> -- 
> With best regards, Ivan Kudryavtsev
> Bitworks Software, Ltd.
> Cell: +7-923-414-1515
> WWW: http://bitworks.software/

Re: KVM Host overprovisioning

2017-09-11 Thread Ivan Kudryavtsev 
Hi, Wido.

Yes, you can. But it works not the way I expect because It cuts RAM from VM
by dividing it to overprovisioning factor like VM with 2GB of RAM with
Overprovisioning factor 2.0 will get 1GB displayed with "free" command.
That's why I finished the message with words that it might be I just don't
get the idea. The behaviour is the same in my prod 4.3 and new 4.9.

2017-09-11 18:00 GMT+07:00 Wido den Hollander :

> Hi,
>
> > Op 10 september 2017 om 8:37 schreef Ivan Kudryavtsev <
> kudryavtsev...@bw-sw.com>:
> >
> >
> > Hello, community.
> >
> > During the last years Linux kernel got some interesting features like
> KSM,
> > ZSWAP, ZRAM. Hardware also steps forward and we see Intel 3d xpoint,
> > extremely fast SSD drives with m.2 and PCI-E interfaces.
> >
> > These facilities enable potentially interesting use of overcommited RAM
> for
> > hosts. According to IBM's investigations Zswap with LZ4/ZBUD increases
> > virtual RAM on 40%.
> >
> > I investigated current Apache CloudStack memory overcommitment
> capabilities
> > and they mostly affect VM's RAM by utilizing ballooning and I think it's
> > not what necessary to open new facilities. There are many cases which can
> > utilize ZSWAP and fast swap devices to efficiently provision more RAM
> than
> > presents.
> >
> > I suppose, CloudStack Agent for KVM can have configured parameter which
> > "mangles" RAM reported. From the other hand it can be done by implemented
> > host properties on server side. I tried manual increasing in host table:
> >
> > update host set ram=ram * 1.4 where id=1;
> >
> > and it seems until the next host stats update it works as expected. I
> think
> > this workaround is useful, but it's better to have the function in core
> > like standard.
> >
>
> Can't you set memory over provisioning on a cluster basis in the GUI? I
> thought you could.
>
> Wido
>
> > Let me know what you think about it, it might be I don't understand
> > something and ACS already has it in place? I also would like to hear your
> > thoughts on ZSWAP usage in practice.
> >
> > --
> > With best regards, Ivan Kudryavtsev
> > Bitworks Software, Ltd.
> > Cell: +7-923-414-1515
> > WWW: http://bitworks.software/ 
>



-- 
With best regards, Ivan Kudryavtsev
Bitworks Software, Ltd.
Cell: +7-923-414-1515
WWW: http://bitworks.software/

[ANNOUNCE][CLOUDSTACK] Apache CloudStack 4.9.3.0 (LTS)

2017-09-11 Thread Rohit Yadav 
# Apache CloudStack LTS Maintenance Release 4.9.3.0

The Apache CloudStack project is pleased to announce the release of
CloudStack 4.9.3.0 as part of its LTS 4.9.x releases. The CloudStack
4.9.3.0 release contains more than 180 fixes since the CloudStack 4.9.2.0
release. Cloudstack LTS branches are supported for 20 months, and
will receive updates for first 14 months and only security updates in its
last 6 months. The 4.9 LTS branch is supported until  1 June 2018.

Apache CloudStack is an integrated Infrastructure-as-a-Service (IaaS)
software platform that allows users to build feature-rich public and
private cloud environments. CloudStack includes an intuitive user interface
and rich API for managing the compute, networking, software, and storage
resources. The project became an Apache top level project in March, 2013.

More information about Apache CloudStack can be found at:
http://cloudstack.apache.org/

# Documentation

What's new in CloudStack 4.9.3.0:
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.9.3.0/about.html

The 4.9.3.0 release notes include a full list of issues fixed, as well
as upgrade instructions from previous versions of Apache CloudStack, and
can be found at:
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.9.3.0

The official installation, administration and API documentation for
each of the releases are available on our documentation page:
http://docs.cloudstack.apache.org/

# Downloads

The official source code for the 4.9.3.0 release can be downloaded from our
downloads page:
http://cloudstack.apache.org/downloads.html

In addition to the official source code release, individual contributors
have also made convenience binaries available on the Apache CloudStack
download page, and can be found at:

http://www.shapeblue.com/packages/
http://cloudstack.apt-get.eu/ubuntu/dists/ (packages to be published soon)
http://cloudstack.apt-get.eu/centos/6/ (packages to be published soon)
http://cloudstack.apt-get.eu/centos/7/ (packages to be published soon)

Regards,
Rohit Yadav

Re: KVM Host overprovisioning

2017-09-11 Thread Wido den Hollander 

> Op 11 september 2017 om 13:04 schreef Ivan Kudryavtsev 
> :
> 
> 
> Hi, Wido.
> 
> Yes, you can. But it works not the way I expect because It cuts RAM from VM
> by dividing it to overprovisioning factor like VM with 2GB of RAM with
> Overprovisioning factor 2.0 will get 1GB displayed with "free" command.
> That's why I finished the message with words that it might be I just don't
> get the idea. The behaviour is the same in my prod 4.3 and new 4.9.
> 

Hmm, ok.

So for the KVM Agent you can add "host reserved mb" to the agent.properties, 
but you are proposing a setting where you can multiply the memory?

Eg by 1.5 if you want to and have the Agent expose that to the MGMT server?

Wido

> 2017-09-11 18:00 GMT+07:00 Wido den Hollander :
> 
> > Hi,
> >
> > > Op 10 september 2017 om 8:37 schreef Ivan Kudryavtsev <
> > kudryavtsev...@bw-sw.com>:
> > >
> > >
> > > Hello, community.
> > >
> > > During the last years Linux kernel got some interesting features like
> > KSM,
> > > ZSWAP, ZRAM. Hardware also steps forward and we see Intel 3d xpoint,
> > > extremely fast SSD drives with m.2 and PCI-E interfaces.
> > >
> > > These facilities enable potentially interesting use of overcommited RAM
> > for
> > > hosts. According to IBM's investigations Zswap with LZ4/ZBUD increases
> > > virtual RAM on 40%.
> > >
> > > I investigated current Apache CloudStack memory overcommitment
> > capabilities
> > > and they mostly affect VM's RAM by utilizing ballooning and I think it's
> > > not what necessary to open new facilities. There are many cases which can
> > > utilize ZSWAP and fast swap devices to efficiently provision more RAM
> > than
> > > presents.
> > >
> > > I suppose, CloudStack Agent for KVM can have configured parameter which
> > > "mangles" RAM reported. From the other hand it can be done by implemented
> > > host properties on server side. I tried manual increasing in host table:
> > >
> > > update host set ram=ram * 1.4 where id=1;
> > >
> > > and it seems until the next host stats update it works as expected. I
> > think
> > > this workaround is useful, but it's better to have the function in core
> > > like standard.
> > >
> >
> > Can't you set memory over provisioning on a cluster basis in the GUI? I
> > thought you could.
> >
> > Wido
> >
> > > Let me know what you think about it, it might be I don't understand
> > > something and ACS already has it in place? I also would like to hear your
> > > thoughts on ZSWAP usage in practice.
> > >
> > > --
> > > With best regards, Ivan Kudryavtsev
> > > Bitworks Software, Ltd.
> > > Cell: +7-923-414-1515
> > > WWW: http://bitworks.software/ 
> >
> 
> 
> 
> -- 
> With best regards, Ivan Kudryavtsev
> Bitworks Software, Ltd.
> Cell: +7-923-414-1515
> WWW: http://bitworks.software/