Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-11 Thread Trevor Grant
+1 non-binding on contribution. Separate repo, or feature branch to start maybe? I just feel like in the beginning this thing is going to have lots of breaking changes that maybe aren't going to fit well with tests / other "v1+" release code. Just my .02. On Fri, Oct 11, 2019 at 4:38 AM Stephan

For wierdos trying to use OpenCV in Flink Stream

2017-08-14 Thread Trevor Grant
I'm new with JNIs / Classloaders /etc, and had a hard time making this work right. Lots of posts referenced the Tomcat solution, but it took me a while to "get it". And so, for newbs like me, here is a quick bloggette on getting OpenCV (and theoretically any JNIs) working in your Flink stream. h

Apache IoT

2017-02-03 Thread Trevor Grant
further questions and see you in Miami! tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the causes of things." -Virgil*

Chicago Hands on Apache Flink Workshop

2017-02-01 Thread Trevor Grant
Any one who is going to be in or around Chicago 2/21: Joe Olson is putting on a workshop for our local Flink meeup- drop by if you can! https://www.meetup.com/Chicago-Apache-Flink-Meetup-CHAF/events/237385428/ Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com

Re: Apache siddhi into Flink

2016-08-28 Thread Trevor Grant
Thank you for confirming Hao, Aparup, please don't refer to it as "Apache Siddhi", that is misleading. Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able t

Re: Apache siddhi into Flink

2016-08-28 Thread Trevor Grant
Aparup, Was Siddhi recently added as an incubator project? I can't find it in the project directory or or on github.com/apache. The closest thing I can find is this: https://github.com/wso2/siddhi tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/

Re: Flink WebUI on YARN behind firewall

2016-08-26 Thread Trevor Grant
t) it may give you a hostname:port <- save that port 6) combine the port you just got , with an IP address you got when parsing in step 3 7) open ssh tunneling to that IP:port Ugly, but it does work. best tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.c

Flink WebUI on YARN behind firewall

2016-08-26 Thread Trevor Grant
://mail-archives.apache.org/mod_mbox/flink-user/201511.mbox/%3CCAGr9p8B_aKhbjLqVQQUZeO_eSz6P=ewkp+kg1sq65sb0nps...@mail.gmail.com%3E but that seems to be more related to running jobs than accessing the UI any help would be appreciated tg Trevor Grant Data Scientist https://github.com/rawkintrevo

Re: Flink long-running YARN configuration

2016-08-26 Thread Trevor Grant
Stephan, Will the jobmanager-UI exist? E.g. if I am running Flink on YARN will I be able to submit apps/see logs and DAGs through the web interface? thanks, tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org

Re: Setting up zeppelin with flink

2016-08-26 Thread Trevor Grant
ala-reflect-2.11.7.jar > scala-xml_2.11-1.0.4.jar > > actually "working" means "able to run the word count example" (i'm not > sure if that really qualifies as working ...). > > i'll follow up on this on the zeppelin user list. > > Frank > > >

Re: Setting up zeppelin with flink

2016-08-25 Thread Trevor Grant
k? I'd like to check the Zeppelin/flink/pom.xml Happy to be a sounding board if nothing else ;) tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the causes o

Re: Setting up zeppelin with flink

2016-08-24 Thread Trevor Grant
can't get Zeppelin to work in local mode either right? Just curious, is Zeppelin running in a docker too? Thanks, tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able t

Re: Setting up zeppelin with flink

2016-08-24 Thread Trevor Grant
irst, then Zeppelin. Hope that helps, will dig in later if not. tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the causes of things." -Virgil* On Wed,

Re: Anyone going to ApacheCon Big Data in Vancouver?

2016-04-29 Thread Trevor Grant
Would love to meet up with any and all from the community, and my Zeppelin notebooks will be available (already are available) on my github in the 'apachecon' repository. tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo ht

Gelly CommunityDetection in scala example

2016-04-27 Thread Trevor Grant
ittle, seems to be an issue with what Graph.run expects to see vs. what LabelPropagation returns vs. what CommunityDetection returns. Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who

Re: Simple GraphX example.

2016-04-27 Thread Trevor Grant
org.apache.flink.graph.Edge import org.apache.flink.graph.Vertex val vertices = Seq(new Vertex[Long, String](1L, "foo"), new Vertex[Long, String](2L, "bar")) val edges = Seq(new Edge[Long, String](1L, 2L, "foobar")) val graph = Graph.fromCollection( vertices, edges, env) Tre

Simple GraphX example.

2016-04-27 Thread Trevor Grant
I get a similar error when I try to make DataSets, found : org.apache.flink.api.scala.DataSet[org.apache.flink.graph.Edge[Long,Double]] required: org.apache.flink.api.java.DataSet[org.apache.flink.graph.Edge[?,?]] val graph = Graph.fromDataSet( edges, vertices) Thoughts? thanks, tg Trevor Grant Data

Re: Programatic way to get version

2016-04-21 Thread Trevor Grant
dug through the codebase, in case any others want to know: import org.apache.flink.runtime.util.EnvironmentInformation; EnvironmentInformation.getVersion() Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org

Programatic way to get version

2016-04-21 Thread Trevor Grant
Is there a programatic way to get the Flink version from the scala shell? I.e. something akin to sc.version I thought I used env.version or something like that once but I couldn't find anything in the scala docs. Trevor Grant Data Scientist https://github.com/rawkintrevo

Re: DataSet.randomSplit()

2016-04-12 Thread Trevor Grant
Hey all, Sorry I missed this thread. The related issue is: https://issues.apache.org/jira/browse/FLINK-2259 I checked it out then forgot about it. I'm cranking on it now. tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

2016-04-08 Thread Trevor Grant
I'm just about to open an issue / PR solution for 'warm-starts' Once this is in, we could just add a setter for the weight vector (and what ever iteration you're on if you're going to do more partial fits). Then all you need to save if your weight vector (and iter numb

Re: Zeppelin Integration

2015-10-21 Thread Trevor Grant
inkInterpreterTest.tearDown(FlinkInterpreterTest.java:48) Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo *"Fortunate is he, who is able to know the causes of things." -Virgil* On Wed, Oct 21, 2015 at 11:57 AM, Till Rohrmann wro

Zeppelin Integration

2015-10-21 Thread Trevor Grant
ently exists. I'm asking on the Zeppelin user mailing list too as soon as I am added. Thanks for any help tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo *"Fortunate is he, who is able to know the causes of things." -Virgil*

Extracting weights from linear regression model

2015-10-07 Thread Trevor Grant
oint me to applicable docs, because I've been struggling with this all day). Thanks! tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo *"Fortunate is he, who is able to know the causes of things." -Virgil*