Re: Web interface to submit jobs

2015-11-09 Thread Sachin Goel
@Max: Added all three things and opened a PR yesterday. :) -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Nov 9, 2015 at 3:10 PM, Maximilian Michels wrote: > Hi Sachin, > > Thank you for your work. From the screenshots it looks like you replicated > the behavior of the old

Re: Web interface to submit jobs

2015-11-09 Thread Maximilian Michels
Hi Sachin, Thank you for your work. From the screenshots it looks like you replicated the behavior of the old web client. I would like to take a look at the actual code. There are at least three things we need to work on next: 1. Introduce a config variable to disable the job submission page 2. A

Re: Web interface to submit jobs

2015-11-08 Thread Sachin Goel
Hi Flavio Yes. Multiple classes are reported properly. ​​ And having a Parameter interface sounds nice, but IMO it'll make the UI too cluttered. What can be done is to, say, search for a method named `getDescription` and display that to the user on frontend? Right now, we only do that for Program i

Re: Web interface to submit jobs

2015-11-06 Thread Flavio Pompermaier
Hi Sachin, great work and very quickly! Just a question: do you already manage a jar contain multiple jobs (multiple main classes or Program interface implementation)? I have also a suggestion for a very nice feature: right now there's the ParameterTool API that centralize and standardize the passi

Re: Web interface to submit jobs

2015-11-06 Thread Sachin Goel
Update: I've finished most of the work on this. Here are a few screenshots: https://drive.google.com/file/d/0B0Xlv1qTgpjDRlMxRkQ5OG5PRUk/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDczJwLU13ZWM5anM/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDbXlwbWhVelFFRWM/view?u

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
I plan to implement all features of the existing web client. :) I think multiple programs will be best displayed as a list in the Entry Class column. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 5:36 PM, Matthias J. Sax wrote: > Looks good. How would you d

Re: Web interface to submit jobs

2015-11-05 Thread Matthias J. Sax
Looks good. How would you display a jar that contains multiple programs and entry classes? Right now, WebClient can handle this: https://ci.apache.org/projects/flink/flink-docs-master/apis/web_client.html The Manifest entries "Main-Class" and "program-class" can have a comma separated list of entr

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Disabling the access for secure installation: Pretty easy. Writing it right now. @mxm: Thanks. I haven't implemented any handlers for actually running the job. I hope to finish it by this weekend. One quick question: The runtime monitor will be running the job itself, i.e., the main method of pro

Re: Web interface to submit jobs

2015-11-05 Thread Maximilian Michels
@Robert: I'm in favor of having a submission page which can be deactivated. My point was simply that we don't have proper security support right now. I agree with Stephan that we'll need to support it! @Stephan: Good suggestion to disable the submission page for the per-job YARN cluster. @Sachin:

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Hi Stephan I agree. However, as and when we secure the Dashboard, everything should get secured in one go. Or is a secure dashboard not much desired? [By secure, I mean some form of authentication for accessing.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Ah. Sharing the links then: https://drive.google.com/file/d/0B0Xlv1qTgpjDT0ZCd0pSU3VYMUU/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDeG51azRRc0FJYjQ/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDSHZXQ0h5S0FBS3c/view?usp=sharing -- Sachin Goel Computer Science, IIT

Re: Web interface to submit jobs

2015-11-05 Thread Stephan Ewen
Security should definitely be in our minds big time. We think we need to add secure cookies to akka very soon (makes akka connections encrypted) and use encryption on the netty as well. To that end, we should not introduce more loopholes now. We can add an upload/execute section to the dashboard,

Re: Web interface to submit jobs

2015-11-05 Thread Robert Metzger
Hey Sachin, I think you can not upload images to apache mailing lists. On Thu, Nov 5, 2015 at 11:46 AM, Sachin Goel wrote: > Okay. I think that does it. I've already designed the basic interface, > although the major part for uploading jars and actually running the job are > left. :') > Here are

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Okay. I think that does it. I've already designed the basic interface, although the major part for uploading jars and actually running the job are left. :') Here are some screenshots: [image: Inline image 2][image: Inline image 1][image: Inline image 3] -- Sachin Goel Computer Science, IIT Delhi m

Re: Web interface to submit jobs

2015-11-05 Thread Robert Metzger
I agree with Max, but still, its extremely convenient (and much easier than crafting akka messages) to have a web interface which accepts jar files and executes the main method ;) On Thu, Nov 5, 2015 at 11:42 AM, Maximilian Michels wrote: > +1 The web client needs to go. > > I don't really see

Re: Web interface to submit jobs

2015-11-05 Thread Maximilian Michels
+1 The web client needs to go. I don't really see how how a submission page on the job manager would make security worse. At the moment, anyone who sends an Akka message to the job manager, can execute arbitrary code.. On Thu, Nov 5, 2015 at 11:16 AM, Flavio Pompermaier wrote: > +1 to remove th

Re: Web interface to submit jobs

2015-11-05 Thread Flavio Pompermaier
+1 to remove the old web client in favor of an improved dashboard (not so urgent however) On Thu, Nov 5, 2015 at 11:11 AM, Robert Metzger wrote: > Hi, > I personally like the idea of allowing users to submit a job from the web > interface a lot. In particular for users new to the system, its a v

Re: Web interface to submit jobs

2015-11-05 Thread Robert Metzger
Hi, I personally like the idea of allowing users to submit a job from the web interface a lot. In particular for users new to the system, its a very convenient feature. We would also get rid of this ugly, old web client :) Regarding security: We can always add a configuration parameter which allow

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
The current authentication mechanism is via htaccess, in the webclient. The dashboard however isn't secured at all. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 2:33 PM, Aljoscha Krettek wrote: > The reason why we didn’t want to have it in the JobManager i

Re: Web interface to submit jobs

2015-11-05 Thread Aljoscha Krettek
The reason why we didn’t want to have it in the JobManager interface by default is that it could be a security concern. I also see, however, that security in general is not very strong right now. > On 05 Nov 2015, at 09:58, Matthias J. Sax wrote: > > I like the idea in general! Not sure if int

Re: Web interface to submit jobs

2015-11-05 Thread Matthias J. Sax
I like the idea in general! Not sure if integrating it into JobMangaer Webinterface is good or not... What would be the pros/cons for standalone vs. integrated? -Matthias On 11/05/2015 05:23 AM, Sachin Goel wrote: > Hi all > Are there any plans to upgrade the webclient interface? It could certain

Web interface to submit jobs

2015-11-04 Thread Sachin Goel
Hi all Are there any plans to upgrade the webclient interface? It could certainly use an upgrade compared to the much better dashboard . If so, is integrating them into one the best way to go? We can have a tab under Job Manager on the dashboard. I can share screenshots of the UI I designed last n