problem when building a charm for giraph

2016-11-22 Thread Panagiotis Liakos
Hi all, I am trying to build a charm for Apache Giraph. I have used the mahout charm ( https://github.com/apache/bigtop/tree/master/bigtop-packages/src/charm/mahout ) and made the necessary changes to deploy giraph instead of mahout. Deployment seems to work fine and I am able to submit giraph j

Re: problem when building a charm for giraph

2016-11-22 Thread Merlijn Sebrechts
Hi Panagiotis Liakos Cool that you're charming Giraph! Feel free to let me know when you have a working prototype, some of my colleagues are interested in using Giraph. Now for your question; tests and actions are two different things. - Actions are similar to hooks; they run on the charm un

Re: Controllers running out of disk space

2016-11-22 Thread Jacek Nykis
On 21/11/16 23:26, Menno Smits wrote: > On 18 November 2016 at 05:07, Nate Finch wrote: > >> Resources are also stored in mongo and can be unlimited in size (not much >> different than fat charms, except that at least they're only pulled down on >> demand). >> >> We should let admins configure th

Re: problem when building a charm for giraph

2016-11-22 Thread Konstantinos Tsakalozos
Hi Panagiotis, Merlijn is right, the output of the smoke-test script is available in the juju debug logs (juju debug-log). Here is what I got when running your smoke-test: http://pastebin.ubuntu.com/23516167/ (multiple SLF4J bindings) It seems the slf4j-log4j12-1.7.5.jar jar from Giraph is slightl

Re: Controllers running out of disk space

2016-11-22 Thread John Meinel
Juju records a longer history in the database, but for ease of debugging we also save to a plain text file, which gets rotated. It is set to rotate at 300MB and save at most 2 backups. Which means it should go to potentially ~1GB but not grow beyond that. We could compress on rotation, which we don

Re: problem when building a charm for giraph

2016-11-22 Thread Panagiotis Liakos
Dear Merlijn and Konstantinos, Thanks a lot for the very valuable information. I will have another look at the documentation for writing tests and debugging and I'll try to add some logs in my test. When I execute my smoke-test (through ssh to giraph) I get the following (which is exactly what I

Re: problem when building a charm for giraph

2016-11-22 Thread Konstantinos Tsakalozos
Hi Panagiotis, The 404 error seems to be because the Giraph charm is not yet promulgated (your charm currently lives in cs:~panagiotisl/giraph). Could you try the same test only this time with a charm revision you have pushed under your namespace in line https://github.com/panagiotisl/bigtop/blob/

Re: problem when building a charm for giraph

2016-11-22 Thread Panagiotis Liakos
Thanks Konstantinos, you were right. Now the script progresses a little further: $ python3 ./tests/01-giraph-test.py E == ERROR: setUpClass (__main__.TestDeploy)

Re: problem when building a charm for giraph

2016-11-22 Thread Konstantinos Tsakalozos
Cool! The error that you are getting now says that the giraph charm has no giraph relation [0]. Looking at the metadata.yaml, you are using the mahout interface to relate to the hadoop client. So the relation call should look like: cls.d.relate('giraph:mahout', 'client:mahout') . This will work fo

Juju 1.25.8 is now available

2016-11-22 Thread Curtis Hovey-Canonical
A new supported stable release of Juju, 1.25.8, is here! ## Notable Changes * Added support for new AWS regions: ap-south-1 and us-east-2 * Fixed issue allowing you to re-provision a machine with manual provider https://bugs.launchpad.net/juju/+bug/1418139 * Improved charm garbage collecti