Review Request 16015: Add sample workflow

2013-12-04 Thread Kevin Sweeney
:). Thanks, Kevin Sweeney

Re: Review Request 16015: Add sample workflow

2013-12-04 Thread Kevin Sweeney
c0d0cab3c58ce14ee730b36c0d583da052f90b5c rbt PRE-CREATION Diff: https://reviews.apache.org/r/16015/diff/ Testing --- This was posted using it :). Thanks, Kevin Sweeney

Re: Review Request 16015: Add sample workflow

2013-12-04 Thread Kevin Sweeney
/contributing.md PRE-CREATION pants c0d0cab3c58ce14ee730b36c0d583da052f90b5c rbt PRE-CREATION Diff: https://reviews.apache.org/r/16015/diff/ Testing --- This was posted using it :). Thanks, Kevin Sweeney

Re: Review Request 16015: Add sample workflow

2013-12-04 Thread Kevin Sweeney
v PRE-CREATION docs/contributing.md PRE-CREATION pants c0d0cab3c58ce14ee730b36c0d583da052f90b5c rbt PRE-CREATION Diff: https://reviews.apache.org/r/16015/diff/ Testing --- This was posted using it :). Thanks, Kevin Sweeney

Re: Review Request 16015: Add sample workflow

2013-12-05 Thread Kevin Sweeney
rg/r/16015/diff/3/?file=394317#file394317line9> > (Diff > revision 3) > > 9 > > elif which python3 >/dev/null; then > > 10 > > PY=`which python3` > > nope -- don't do this. mesos doesn't work with python 3. > > > - Brian Wickman > >

Re: Review Request 16015: Add sample workflow

2013-12-05 Thread Kevin Sweeney
/contributing.md PRE-CREATION pants c0d0cab3c58ce14ee730b36c0d583da052f90b5c rbt PRE-CREATION Diff: https://reviews.apache.org/r/16015/diff/ Testing --- This was posted using it :). Thanks, Kevin Sweeney

Contribution Process

2013-12-06 Thread Kevin Sweeney
tps://github.com/twitter/aurora>the non-ASF GitHub mirror. Please take a look at docs/contributing.md and raise an issue (or send a review) with any feedback or corrections. Thanks, Kevin -- Kevin Sweeney @kts

Re: error from vagrant up

2013-12-06 Thread Kevin Sweeney
; cd incubator-aurora/ > vagrant up > > /*** > Joe Stein > Founder, Principal Consultant > Big Data Open Source Security LLC > http://www.stealth.ly > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > / > -- Kevin Sweeney @kts

Re: creating a job?

2013-12-06 Thread Kevin Sweeney
and > contributing once I can at least get my toes wet I can then start > submerging more =8^) > > /*** > Joe Stein > Founder, Principal Consultant > Big Data Open Source Security LLC > http://www.stealth.ly > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > / > -- Kevin Sweeney @kts

Re: Review Request 16168: Fix noSlotsFound stat in Preemptor

2013-12-10 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16168/#review30159 --- Ship it! Ship It! - Kevin Sweeney On Dec. 10, 2013, 4:38 p.m

Re: Review Request 16098: Remove ability to install a custom quota module.

2013-12-10 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16098/#review30130 --- Ship it! Ship It! - Kevin Sweeney On Dec. 6, 2013, 3:26 p.m

Review Request 16170: Revert Thrift upgrade.

2013-12-10 Thread Kevin Sweeney
rg/r/16170/diff/ Testing --- git clean -fdx build-support ./gradlew clean build Thanks, Kevin Sweeney

Re: Review Request 16170: Revert Thrift upgrade.

2013-12-10 Thread Kevin Sweeney
/SnapshotStoreImplTest.java > 506279518ba29601cfe13d20bf6ef175d1407a18 > > src/test/java/com/twitter/aurora/scheduler/thrift/SchedulerThriftInterfaceTest.java > 1e1e7b5a9c2805790ed26939e151b727a15ec88d > > Diff: https://reviews.apache.org/r/16170/diff/ > > > Testing > --- > > git clean -fdx build-support > ./gradlew clean build > > > Thanks, > > Kevin Sweeney > >

Review Request 16200: Use binaries for vagrant up.

2013-12-11 Thread Kevin Sweeney
7cce033bf9ef31d1ead3a3220d9d0c710cea73b7 Diff: https://reviews.apache.org/r/16200/diff/ Testing --- vagrant destroy vagrant up Verified that job submission and all components work. Thanks, Kevin Sweeney

Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
rver/BUILD 090d3ad33083d5ea51a34af29412134afddcc9e2 src/main/thrift/com/twitter/aurora/gen/BUILD a21f2fc796871ff74b1af4852ec298d75458d442 src/main/thrift/com/twitter/thermos/BUILD c224d8d5e87f05ea37ac8ecc4ba223228a32b8a5 Diff: https://reviews.apache.org/r/16228/diff/ Testing --- Thanks, Kevin Sweeney

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
0.2.0-SNAPSHOT" and "0.2.0-dev" to "0.2.1-SNAPSHOT" and "0.2.1-dev". - Kevin --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16228/#review30

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
be in the above comment. - Kevin --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16228/#review30306 --- On Dec. 12, 2

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
? How do we publish next version 0.0.13? > > Kevin Sweeney wrote: > Here we're skipping straight to 0.2.0 to get a consistent version number > between Java and Python components (which should be published together and > atomically). As for the publish step, it'll be as

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
on2.7 setup.py sdist" in /Users/ksweeney/workspace/aurora/dist/twitter.aurora.config-0.2.0-snapshot Wrote /Users/ksweeney/workspace/aurora/dist/twitter.aurora.config-0.2.0-snapshot.tar.gz Thanks, Kevin Sweeney

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
these 0.2.0-snapshot. Done. - Kevin --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16228/#review30313 --- On Dec. 12

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
nity. > If a component needs a hotfix (ie executor) we branch from the entire repo > and release everything together. > > Kevin Sweeney wrote: > I think we should only release the components as an atomic unit with a > single version number. This won't be painful with

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16228/#review30328 --- Thanks, submitted! - Kevin Sweeney On Dec. 12, 2013, 5:27 p.m

Re: Review Request 16228: Pin master to -SNAPSHOT and -dev versions.

2013-12-12 Thread Kevin Sweeney
tps://reviews.apache.org/r/16228/#comment58057> Pants is Python so that we can do silly things like this! - Kevin Sweeney On Dec. 12, 2013, 5:27 p.m., Kevin Sweeney wrote: > > --- > This is an automatically generated e-mail. To reply,

Re: Review Request 16054: Rewrite SchedulerLifecycle, employing a state machine.

2013-12-13 Thread Kevin Sweeney
scheduler_lifecycle_state_RUNNING 1 scheduler_lifecycle_state_* 0 - Kevin Sweeney On Dec. 13, 2013, 11:39 a.m., Bill Farner wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Review Request 16257: Fix gradle to include same version as artifact in generated distribution tarball

2013-12-13 Thread Kevin Sweeney
ora-scheduler-0.2.0-20131213.214313-1.jar com/twitter/aurora/aurora-scheduler/0.2.0-SNAPSHOT/aurora-scheduler-0.2.0-20131213.214313-1-sources.jar Thanks, Kevin Sweeney

Re: Review Request 16257: Fix gradle to include same version as artifact in generated distribution tarball

2013-12-13 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16257/#review30380 --- Thanks, submitted! - Kevin Sweeney On Dec. 13, 2013, 1:49 p.m

Review Request 16265: Script for creating tags

2013-12-13 Thread Kevin Sweeney
e verified that everything looks good, publish the new tag by running: git push origin master git push release-0.2.x master git push 0.2.0 master Thanks, Kevin Sweeney

Tagging process

2013-12-13 Thread Kevin Sweeney
l push 2 things - the new master and the tag (so origin will not have a name for the branch the tag was created on). What does everyone think of this process? -- Kevin Sweeney @kts

Re: Review Request 16054: Rewrite SchedulerLifecycle, employing a state machine.

2013-12-15 Thread Kevin Sweeney
copyright src/test/java/com/twitter/aurora/scheduler/SchedulerLifecycleTest.java <https://reviews.apache.org/r/16054/#comment58227> Mind adding a brief prose description of what's expected here? - Kevin Sweeney On Dec. 13, 2013, 12:09 p.m., Bill Farner wrote: > > ---

Re: Review Request 16267: Adding a script to run an isolated scheduler.

2013-12-23 Thread Kevin Sweeney
g/r/16267/#comment59043> Can this list be pared down further? - Kevin Sweeney On Dec. 23, 2013, 3:19 p.m., Suman Karumuri wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Review Request 16462: Protect reference to $? in embedded script.

2013-12-26 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16462/#review30870 --- Ship it! Ship It! - Kevin Sweeney On Dec. 25, 2013, 8:49 p.m

Re: Review Request 16462: Protect reference to $? in embedded script.

2013-12-26 Thread Kevin Sweeney
. Thanks for the contribution! [1] https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git;a=commit;h=4682479818d62b93033ba18b9d45ce3ae9213eb2 - Kevin Sweeney On Dec. 25, 2013, 8:49 p.m., Jason Dusek wrote: > > --- > T

Re: Review Request 16484: AURORA-14: CI tests broken due to missing egg

2013-12-27 Thread Kevin Sweeney
the build should fix it. src/test/python/twitter/aurora/executor/BUILD <https://reviews.apache.org/r/16484/#comment59152> TODOs should have owners. Feel free to assign to yourself (TODO(Jake Farrell): ) or me (TODO(Kevin Sweeney): ). Thanks for the contribution! - Kevin Sweeney On De

Re: Review Request 16484: AURORA-14: CI tests broken due to missing egg

2013-12-27 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16484/#review30921 --- Ship it! Ship It! - Kevin Sweeney On Dec. 27, 2013, 11:28 a.m

Re: Review Request 16484: AURORA-14: CI tests broken due to missing egg

2013-12-27 Thread Kevin Sweeney
=incubator-aurora.git;a=commit;h=e8a4db11ce177bfd2681da00d153a8ee44c89ec1 Please mark this review as submitted at your convenience. - Kevin Sweeney On Dec. 27, 2013, 11:28 a.m., Jake Farrell wrote: > > --- > This is an auto

Re: Review Request 16265: Script for creating tags

2014-01-02 Thread Kevin Sweeney
ow at https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git;a=tag;h=d8fef7576b4faf16d2afc96e570c19a38b4a98af Maxim, was this a manual process or did you use a script? - Kevin Sweeney On Dec. 13, 2013, 4 p.m., Kevin Sweeney

Re: Review Request 16575: Replace StorageStarted event with TaskStateChange events.

2014-01-02 Thread Kevin Sweeney
--- > > (Updated Jan. 2, 2014, 1:01 p.m.) > > > Review request for Aurora, Kevin Sweeney, Suman Karumuri, and Maxim > Khutornenko. > > > Repository: aurora > > > Description > --- > > This change makes it easier to consume events about the

Re: Review Request 16576: Global import optimize.

2014-01-02 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16576/#review31074 --- Ship it! Ship It! - Kevin Sweeney On Jan. 2, 2014, 2:04 p.m

Re: Review Request 16344: Wholesale dependency updates.

2014-01-02 Thread Kevin Sweeney
can be released with a relatively short (O(days)) turnaround time. - Kevin Sweeney On Dec. 17, 2013, 10:06 p.m., Bill Farner wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Review Request 16615: Client command hooks doc

2014-01-03 Thread Kevin Sweeney
h does not apply to 'docs/images/stderr.png' error: docs/images/stderr.png: patch does not apply error: missing binary patch data for 'docs/images/stdout.png' error: binary patch does not apply to 'docs/images/stdout.png' error: docs/im

Re: Review Request 16575: Replace StorageStarted event with TaskStateChange events.

2014-01-03 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16575/#review31185 --- Ship it! Much easier to reason about now. - Kevin Sweeney On

Re: Review Request 16615: Client command hooks doc

2014-01-03 Thread Kevin Sweeney
> On Jan. 3, 2014, 12:06 p.m., Kevin Sweeney wrote: > > Thanks a lot for your work on open-sourcing these docs Tom! > > > > I tried to apply this patch to my local working copy and was unable to due > > to the binaries in it. Do you mind creating a fork on gith

Re: Review Request 16629: Client quota check (server side)

2014-01-03 Thread Kevin Sweeney
emove extra space - Kevin Sweeney On Jan. 3, 2014, 4:03 p.m., Maxim Khutornenko wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https

Re: Review Request 16629: Client quota check (server side)

2014-01-03 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16629/#review31202 --- Ship it! Ship It! - Kevin Sweeney On Jan. 3, 2014, 4:03 p.m

Re: Review Request 16629: Client quota check (server side)

2014-01-03 Thread Kevin Sweeney
> On Jan. 3, 2014, 4:55 p.m., Kevin Sweeney wrote: > > src/main/java/org/apache/aurora/scheduler/state/LockManager.java, line 65 > > <https://reviews.apache.org/r/16629/diff/1/?file=415149#file415149line65> > > > > Is there a reason to take an Optiona

Re: Review Request 16636: Ensure SchedulerActive event is dispatched before leader is advertised.

2014-01-06 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16636/#review31246 --- Ship it! Ship It! - Kevin Sweeney On Jan. 4, 2014, 3:21 p.m

Re: Aurora announce third party service location via zookeeper serverset

2014-01-06 Thread Kevin Sweeney
Great question, one we've been getting on IRC a lot. Say you're launching a simple netcat [1] service in Aurora. The config file might look something like this: # netcat-service.aurora run_server = Process(name = 'run_server', cmdline = 'nc -l {{thermos.ports[netcat]}}') task = Task( processes

Re: Review Request 16668: Adding java code coverage reporting into Aurora build.

2014-01-06 Thread Kevin Sweeney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16668/#review31261 --- Ship it! Thanks for the context Bill! - Kevin Sweeney On Jan. 6

Review Request 16710: Support multiple simulataneous auth mechanisms.

2014-01-07 Thread Kevin Sweeney
cce27a0e37452f370a3729b6b05bf0bea29f85f6 src/test/java/org/apache/aurora/scheduler/thrift/aop/AopModuleTest.java b510bf1222961329c4eae0a17ff0dfb274ee55a8 Diff: https://reviews.apache.org/r/16710/diff/ Testing --- ./gradlew build Thanks, Kevin Sweeney

[DISCUSS] Review sign-off procedures

2014-01-17 Thread Kevin Sweeney
Hi all, >From a discussion in IRC I realized we should probably formalize the convention we've been following for accepting commits into aurora. Here's my take at formalizing the informal convention, please comment inline: In order to facilitate high-quality code contributions, all changes shoul

Re: [DISCUSS] Tagging development releases

2014-01-21 Thread Kevin Sweeney
ompatible with maven version number rules [4]. > > I'm interested in thougs people have on this. Please keep in mind that > this is provisional, and to be halted or re-evaluated after our first > release. > > [1] https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git;a=tags > [2] http://semver.org > [3] http://www.python.org/dev/peps/pep-0440/#developmental-releases > [4] http://mojo.codehaus.org/versions-maven-plugin/version-rules.html > > > -=Bill > -- Kevin Sweeney @kts

Re: [DISCUSS] Tagging development releases

2014-01-21 Thread Kevin Sweeney
(Repost from my apache address since reply #1 likely got sent to spam) +1. I think it's useful to be able to mark development snapshots that can be understood by package managers as distinct incrementing versions for pre-RC integration testing/performance testing/early adopter deployment. Creating

Re: Creating new list to track JIRA updates?

2014-01-28 Thread Kevin Sweeney
A good amount of discussion happens on JIRA, though the plaintext versions of its emails are pretty difficult to read. On Tue, Jan 28, 2014 at 3:57 PM, Henry Saputra wrote: > HI Guys, > > What about creating a new list issues@aurora to track the JIRA updates? > > Right now I am getting lost of a

Re: Creating new list to track JIRA updates?

2014-01-28 Thread Kevin Sweeney
. > > Hence the proposal to split to dev@ and issues@ lists. > > - Henry > > On Tue, Jan 28, 2014 at 4:01 PM, Kevin Sweeney wrote: > > A good amount of discussion happens on JIRA, though the plaintext > versions > > of its emails are pretty difficult to read. > >

[DISCUSS] Nightly builds?

2014-01-30 Thread Kevin Sweeney
Since both Mesos and Aurora are relatively fast-moving would it make sense to create nightly builds that use latest master from both repos and run end-to-end tests on them via CI? -- Kevin Sweeney @kts

Re: Committers: Please help keep the git log clean

2014-02-05 Thread Kevin Sweeney
Don't forget that the workflow is somewhat documented at https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git;a=blob;f=docs/contributing.md;h=434116378711f40877f6f7af15af8545b5335ec0;hb=HEAD Patches to clarify are appreciated! On Wed, Feb 5, 2014 at 12:02 PM, Bill Farner wrote: > Goo

Re: Build failed in Jenkins: Aurora #98

2014-02-05 Thread Kevin Sweeney
>From the test output: 1) An exception was caught and reported. Message: resource bower_components/jquery/jquery.js not found. at org.apache.aurora.scheduler.app.AppModule.configure(AppModule.java:102) On Wed, Feb 5, 2014 at 3:27 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote:

Pants documentation

2014-02-25 Thread Kevin Sweeney
Hey folks, A good amount of pants documentation is now available at http://pantsbuild.github.io/ If you're interested in leaning about pants, especially about Python development with it check out the Python readme [1]. [1] http://pantsbuild.github.io/python-readme.html

Re: Suitibility of Aurora for one-time tasks

2014-02-26 Thread Kevin Sweeney
A job is a group of nearly-identical tasks plus some constraints like rack diversity. The scheduler considers each task within a job equivalently schedulable, so you can't vary things like resource footprint. It's perfectly fine to have several jobs with just a single task, as long as each has a di

Re: Suitibility of Aurora for one-time tasks

2014-02-26 Thread Kevin Sweeney
h Memory), while part of the cluster sits > >> idle. > >> > >> Conceptually, in my mind we would define approximately a dozen Tasks, > >> one for each type of work we need to perform (with different resource > >> requirements), and then run Jobs, eac

Re: Suitibility of Aurora for one-time tasks

2014-02-26 Thread Kevin Sweeney
it by setting max_failures to a very high number). On Wed, Feb 26, 2014 at 5:33 PM, Bryan Helmkamp wrote: > Thanks, Kevin. That pretty much looks like exactly what I need. > > -Bryan > > On Wed, Feb 26, 2014 at 8:16 PM, Kevin Sweeney wrote: > > For a more dynamic approach t

Re: Suitibility of Aurora for one-time tasks

2014-02-26 Thread Kevin Sweeney
And after a bit of code spelunking the semantics you want already exist (just undocumented). Updated the ticket to update the documentation. On Wed, Feb 26, 2014 at 6:00 PM, Kevin Sweeney wrote: > The example I gave is somewhat syntactically invalid due to coding via > email, but that&

Re: Build failed in Jenkins: Aurora #144

2014-02-28 Thread Kevin Sweeney
ing.UserRequest.perform(UserRequest.java:48) > at hudson.remoting.Request$2.run(Request.java:328) > at > hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > -- Kevin Sweeney @kts

Re: Combining vagrant master machines

2014-04-01 Thread Kevin Sweeney
I think keeping a multi-machine setup for testing is important since it's much closer to actual deployment (and it'll catch a class of bugs that might not show up when everything's on localhost). Also as a technical note as far as I know you can't run more than one slave instance per VM when you're

Re: Client Command Hooks Proposal, v2

2014-04-03 Thread Kevin Sweeney
On Thu, Apr 3, 2014 at 2:24 PM, Mark Chu-Carroll wrote: > A while ago, I sent around a proposal for how to do hooks in the v2 command > line for Aurora. Since then, I've been talking to a variety of people about > what they'd like to be able to do with hooks, and I've revised the > proposal. Pleas

[DISCUSS] Use $(git describe) output to bake version instead of .auroraversion

2014-04-07 Thread Kevin Sweeney
Hi all, Summarizing an IRC discussion with Bhuvan Arumugam I'm convinced we should use git-describe(1) to generate the embedded version string instead of .auroraversion. This will require 2 changes. The first is to use git-descr

Re: [DISCUSS] Use $(git describe) output to bake version instead of .auroraversion

2014-04-07 Thread Kevin Sweeney
git-describe - Show the most recent tag that is reachable from a > commit > > Does this proposal fall apart if/when we start using tags for other > purposes? > > -=Bill > > > On Mon, Apr 7, 2014 at 8:05 PM, Kevin Sweeney > > > wrote: > > > Hi all,

Re: [DISCUSS] Use $(git describe) output to bake version instead of .auroraversion

2014-04-09 Thread Kevin Sweeney
is to have -rcN versions come before the unqualified release so we'd have 0.5.0-rc1, then 0.5.0-rc2, then finally 0.5.0. I guess the -snapshot could be considered superfluous here. On Wed, Apr 9, 2014 at 1:40 PM, Jay Buffington wrote: > On Mon, Apr 7, 2014 at 8:05 PM, Kevin Sweeney wrote:

Fwd: Reverted cron system

2014-04-23 Thread Kevin Sweeney
Since Brian Wickman found a pretty bad issue in https://issues.apache.org/jira/browse/AURORA-349 (that was caught by the e2e test but not the unit tests) I've reverted the cron system change. I have a fix in review already but I will hold off on committing it until I can add unit tests that fail wi

Re: Build failed in Jenkins: Aurora #325

2014-04-23 Thread Kevin Sweeney
This was me reverting the cron system On Wed, Apr 23, 2014 at 6:24 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > Changes: > > [maxim] Implementing Scheduler SLA metrics. > > [kevints] Revert "AURORA-132: Cron system bas

[VOTE] Release Apache Aurora 0.5.0 (incubating) RC0

2014-05-05 Thread Kevin Sweeney
All, I propose that we accept the following release candidate as the official Apache Aurora 0.5.0 release. Aurora 0.5.0-rc0 includes the following: --- The CHANGELOG for the release is available at: https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git;a=blob_plain;f=CHANGELOG;hb=0.5.0-r

Re: [VOTE] Release Apache Aurora 0.5.0 (incubating) RC0

2014-05-05 Thread Kevin Sweeney
35 PM, Henry Saputra wrote: > There is a jar file inside the source artifact [1]. Is this jar > generated from source code or "executable" copied from external > source? > > > Thanks, > > Henry > > > [1] gradle/wrapper/gradle-wrapper.jar > > On Mon,

Re: [VOTE] Release Apache Aurora 0.5.0 (incubating) RC0

2014-05-06 Thread Kevin Sweeney
That's not good. Mark, do you have vagrant up output you can share? On Tue, May 6, 2014 at 8:41 AM, Mark Chu-Carroll wrote: > Grabbing the RC, downloading it, running vagrant up, and then trying to > just run the end to end test fails, because the aurora client isn't found > in the vagrant image

Re: [VOTE] Release Apache Aurora 0.5.0 (incubating) RC0

2014-05-06 Thread Kevin Sweeney
me, so if I've mentioned > something that already been discussed or I've misunderstood something I > apologise in advance. The fact I was able to take the source package and > compile it will minimal effort certainly indicates to me that it's release > ready. > > Thanks for taking the time to have a look! We really appreciate the feedback. Best regards, Kevin -- Kevin Sweeney @kts

[VOTE] Release Apache Aurora 0.5.0 (incubating) RC0

2014-05-19 Thread Kevin Sweeney
Looks like -rc0 is out. Let's try to address the feedback in this thread and cut an -rc1. On Wed, May 14, 2014 at 5:04 AM, Mark Chu-Carroll wrote: > Henry: yes, if it doesn't work, I'm definitely -1. > >-Mark > > > On Tue, May 13, 2014 at 7:32 PM, Henry Saputra >wrote: > > > Hi Mark, > > >

Re: Adding shorthands, defaults, and initialization files to the aurora client

2014-05-19 Thread Kevin Sweeney
+1 to completion On Mon, May 19, 2014 at 5:21 PM, Bill Farner wrote: > Personally, i'm a much bigger fan of bash completion than shorthand. > Completion brings along none of the risk AFAICT, but has the added benefit > of improving the story for discovering subcommands. > > -=Bill > > > On Mon

Re: Updated proposal: Aurora Shorthands

2014-05-29 Thread Kevin Sweeney
ific default. > > > > > 3. Aliases - shorthand names for longer parameters. A user > could > > > > > specify shorthands > > > > > "east" and "west" for full jobkeys in two different > > datacenters. > > > > > > > > > > ### Using aliases and defaults > > > > > > > > > > A default specifies a set of _bindings_. If a parameter is omitted > > > > > from a command, and there's a binding for that parameter, it will > be > > > > > automatically inserted into the command as if the user had typed > it. > > > > > > > > > > An alias is a short equivalent for a parameter. When a command line > > is > > > > > provided by a user, aliases will be expanded inline. A user can > > > > > specifically > > > > > mark an alias for expansion by prefixing it with "@"; if an alias > > > > > appears on the command-line surrounded by whitespace, it will be > > > > > replaced even if it isn't marked with an "@". > > > > > > > > > > > > > > > ### Defining Shorthands and Defaults > > > > > > > > > > The init file is, like aurora job configurations, a python source > > file > > > > > using a Pystachio > > > > > schema. The schema is loaded, and an `Init` object is retrieved > from > > > the > > > > > top-level > > > > > variable `init` in that file. > > > > > > > > > > The pystachio schema for init files is: > > > > > > > > > > class CommandDefaults(Struct) > > > > > command = Required(String) > > > > > defaults=Map(String, String) > > > > > > > > > > class Init(Struct): > > > > > defaults=Map(String, String) > > > > > command_defaults = Optional(CommandDefaults) > > > > > aliases=Map(String, String) > > > > > > > > > > > > > > > For example, an init file could contain the following: > > > > > > > > > > init=Init( > > > > > defaults={ > > > > > "jobspec": "west/markcc/test/myservice", > > > > > "config_file": "./src/aurora/myservice.aurora" > > > > > }, > > > > > aliases={ > > > > > "east": "east/markcc/test/myservice", > > > > > "c": "east", > > > > > "me": "markchucarroll" > > > > > }, > > > > > command_defaults(command="job update", > > > > > defaults={"--batch-size": 10} > > > > > )) > > > > > > > > > > > > > > > With this configuration file, if the user ran "`aurora job create`" > > > > without > > > > > any parameters, > > > > > it would automatically be expanded to "`aurora job create > > > > > west/markcc/test/myservice ./src/aurora/myservice.aurora`". > > > > > > > > > > If a user ran "`aurora job create east`", the alias `east` would be > > > > > expanded to "east/markcc/test/myservice", and the missing config > file > > > > > parameter would > > > > > be instantiated using the default, to create a command-line: > > > > > "`aurora job create east/markcc/test/myservice > > > > > ./src/aurora/myservice.aurora`". > > > > > > > > > > If a user ran "`aurora job create @c/@me/test/myservice`", the two > > > > aliases > > > > > would > > > > > be expanded, and the omitted configuration parameter would be > added: > > > > > "`aurora job create east/markchucarroll/test/myservice > > > > > ./src/aurora/myservice.aurora`". > > > > > > > > > > If a user ran "`aurora job update`", then the `jobspec` and > > > `config_file` > > > > > parameters would > > > > > get inserted from the global defaults, and the "--batch-size=10" > > would > > > be > > > > > inserted from > > > > > the command defaults for "aurora job update". > > > > > > > > > > > > > > > -- Kevin Sweeney @kts

Re: Updated proposal: Aurora Shorthands

2014-05-29 Thread Kevin Sweeney
On Thu, May 29, 2014 at 1:23 PM, Mark Chu-Carroll wrote: > The reason that I use an alias for rbt isn't because I'm trying to save > keystrokes. It's because "-o", "-g" and "-r" mean nothing to me. More > keystrokes is fine, if it comes with clarity - that's why I went along with > dropping the

Re: No longer be able to access Aurora scheduler UI in the Vargrant vanilla after pull from master =(

2014-06-05 Thread Kevin Sweeney
Hi Henry, Were we able to help you get this working? I just tried out the tutorial on master (467f842) after vagrant destroy -f and git clean -fdx and it worked in my environment [1]. [1] % dpkg -l virtualbox Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-con

Re: No longer be able to access Aurora scheduler UI in the Vargrant vanilla after pull from master =(

2014-06-05 Thread Kevin Sweeney
t process is listening on port 8081 like this: > > $ sudo lsof -P |grep 8081 > java 19729 nobody 132u IPv6 264719 0t0 > TCP *:8081 (LISTEN) > -- Kevin Sweeney @kts

Re: Task Constraints

2014-07-14 Thread Kevin Sweeney
Slaves persist their attributes (including attributes) across restarts due to slave recovery (that's what allows you to upgrade mesos in-place without killing the tasks they're managing). Unfortunately to change attributes you need to remove persisted slave metadata (the "meta" directory). This wil

Re: Python versions (redux)

2014-07-17 Thread Kevin Sweeney
+1 to dropping 2.6 On Thu, Jul 17, 2014 at 11:46 AM, Mark Chu-Carroll wrote: > A couple of months ago, we had a discussion about which python versions to > support. (See > > http://mail-archives.apache.org/mod_mbox/incubator-aurora-dev/201404.mbox/%3CCAFGkSCk71%2BziUQCsnMfStr-ucrT52DLEgBfHA-o09

[VOTE] Release Apache Aurora 0.5.0 (incubating) RC1

2014-07-17 Thread Kevin Sweeney
All, I propose that we accept the following release candidate as the official Apache Aurora 0.5.0 release. Aurora 0.5.0-rc1 includes the following: --- The CHANGELOG for the release is available at: https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git&ba=blob_plain&f=CHANGELOG&hb=0.5.0-

[RESULT] [VOTE] Release Apache Aurora 0.5.0 (incubating) RC1

2014-07-22 Thread Kevin Sweeney
. > - IP Clearance verified on initial import of codebase > 3.5 Dependencies licenses are ok as per http://apache.org/legal/ > - 3rd party source libraries licenses in use are Apache v2 and MIT > 3.6 Release consists of source code only, no binaries. > - no binary files found > >

[VOTE] Release Apache Aurora 0.5.0 (incubating) RC2

2014-07-24 Thread Kevin Sweeney
All, I propose that we accept the following release candidate as the official Apache Aurora 0.5.0 release. Aurora 0.5.0-rc2 includes the following: --- The CHANGELOG for the release is available at: https://git-wip-us.apache.org/repos/asf?p=incubator-aurora.git&f=CHANGELOG&hb=0.5.0-rc2 The branc

Re: [VOTE] Release Apache Aurora 0.5.0 (incubating) RC2

2014-07-24 Thread Kevin Sweeney
gt; > > So the scheduler isn't getting built. > > -Mark > > > > On Thu, Jul 24, 2014 at 1:17 PM, Kevin Sweeney wrote: > > > All, > > I propose that we accept the following release candidate as the official > > Apache Aurora 0.5.0 release. > &

[RESULT] [VOTE] Release Apache Aurora 0.5.0 (incubating) RC2

2014-07-28 Thread Kevin Sweeney
all who helped make this release. On Fri, Jul 25, 2014 at 12:26 PM, Henry Saputra wrote: > Notice and license looks good > Hashes and signatures are good > Compiled > > +1 > > On Thursday, July 24, 2014, Kevin Sweeney wrote: > > > All, > > I propose

[RESULT] [VOTE] Release Apache Aurora 0.5.0 (incubating) RC2

2014-07-28 Thread Kevin Sweeney
all who helped make this release. On Fri, Jul 25, 2014 at 12:26 PM, Henry Saputra wrote: > Notice and license looks good > Hashes and signatures are good > Compiled > > +1 > > On Thursday, July 24, 2014, Kevin Sweeney wrote: > > > All, > > I propose

Fwd: [VOTE] Release Apache Aurora 0.5.0 (incubating)

2014-07-29 Thread Kevin Sweeney
In case you didn't see it, please vote on the general@incubator aurora release thread. -- Forwarded message -- From: Jake Farrell Date: Mon, Jul 28, 2014 at 8:11 PM Subject: Re: [VOTE] Release Apache Aurora 0.5.0 (incubating) To: Kevin Sweeney Cc: "gene...@incubator.

[DISCUSS] Build security

2014-07-30 Thread Kevin Sweeney
Hi all, Recently in the news there has been a lot of controversy regarding Maven Central's lack of HTTPS support (without a donation for an access key which isn't redistributable, see [1], [2], [3] for context). While Sonatype plans to deploy HTTPS for all fix it there is an exploit tool in the wi

Re: [DISCUSS] Build security

2014-07-30 Thread Kevin Sweeney
re other than git. > -Jake > > > On Wed, Jul 30, 2014 at 12:10 PM, Kevin Sweeney > wrote: > > > Hi all, > > > > Recently in the news there has been a lot of controversy regarding Maven > > Central's lack of HTTPS support (without a donation for an acce

Re: [DISCUSS] Build security

2014-07-30 Thread Kevin Sweeney
where other than git. > -Jake > > > On Wed, Jul 30, 2014 at 12:10 PM, Kevin Sweeney > wrote: > > > Hi all, > > > > Recently in the news there has been a lot of controversy regarding Maven > > Central's lack of HTTPS support (without a donation

Re: [DISCUSS] Build security

2014-07-30 Thread Kevin Sweeney
this seems like additions that are not needed > >> especially since maven central is going to ssl in the near future. > >> > >> Aurora-616: The gradle witness plugin will test against the listed > >> dependencies in our build.gradle but it does not verify any sub

[RESULT] [VOTE] Release Apache Aurora 0.5.0 (incubating)

2014-08-01 Thread Kevin Sweeney
t; > 0.5.0 passes. Thanks everyone for taking the time to review and vote > > > > -Jake > > > > > > Binding > > --- > > Benjamin Hindman > > Jake Farrell > > Justin Mclean > > Henry Saputra > > > > Non-Binding > >

Re: [jira] [Created] (AURORA-632) distZip includes a META-INF/about.txt

2014-08-01 Thread Kevin Sweeney
> > Issue Type: Bug > > Components: Build > >Reporter: Kevin Sweeney > >Priority: Minor > > > > > > > -- > This message was sent by Atlassian JIRA > (v6.2#6252) > -- Sent from Gmail Mobile

Re: Having trouble running the scheduler locally in intellij?

2014-09-04 Thread Kevin Sweeney
I think this is what he was trying to attach: [image: Inline image 1] On Thu, Sep 4, 2014 at 3:47 PM, Alexius Ludeman wrote: > you've included no image with your email. > > > On Thu, Sep 4, 2014 at 2:29 PM, Bill Farner wrote: > > > Symptom: you tried running LocalSchedulerMain in intellij and

Re: Having trouble running the scheduler locally in intellij?

2014-09-04 Thread Kevin Sweeney
ion processor to discover args. Hope this saves somebody some > > trouble! > > > > > > -=Bill > > > -- Kevin Sweeney @kts

Re: Suggested update to the Aurora homepage

2014-09-10 Thread Kevin Sweeney
+1 On Wed, Sep 10, 2014 at 2:30 PM, Bill Farner wrote: > +1 > > -=Bill > > > On Wed, Sep 10, 2014 at 10:54 AM, Dave Lester wrote: > > > Works for me; I'd suggest embedding the video starting 43 seconds in: > > http://www.youtube.com/watch?v=asd_h6VzaJc#t=0m43s to skip over the > > Twittery intr

Re: Build failed in Jenkins: Aurora #553

2014-09-12 Thread Kevin Sweeney
Sorry about this, working on a fix now. On Fri, Sep 12, 2014 at 4:41 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > Changes: > > [kevints] Use a ServletContextListener to configure servlets > > ---

Re: Build failed in Jenkins: Aurora #553

2014-09-12 Thread Kevin Sweeney
Styleguide fix committed, and resulting PMD violation from that fix also committed. On Fri, Sep 12, 2014 at 4:48 PM, Kevin Sweeney wrote: > Sorry about this, working on a fix now. > > On Fri, Sep 12, 2014 at 4:41 PM, Apache Jenkins Server < > jenk...@builds.apache.org> wrot

  1   2   3   >