Re: Dependency on non-existent org.scalamacros:quasiquotes_2.11:

2016-01-18 Thread Prez Cannady
Finally got a chance to sit down and run through a few tests. Upfront, I have been able to resolve my issue sufficiently to move forward, but seems there’s an issue with the current bits for both 1.0-SNAPSHOT and 0.10-SNAPSHOT in the remote Maven repos. Notes wordcount-processing

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Chiwan Park
How about mapping a number for each string? Maybe you can do it with custom Transformer. > On Jan 19, 2016, at 12:02 AM, Hilmi Yildirim wrote: > > Ok. In this case I will use an Array instead. > > Am 18.01.2016 um 14:56 schrieb Theodore Vasiloudis: >> I agree with Till, the data types are diff

Re: Flink ML - Vector and DenseVector

2016-01-18 Thread Till Rohrmann
Didn't we just had the discussion in another email thread? On Jan 18, 2016 8:55 PM, "Hilmi Yildirim" wrote: > Hi, > the Vector and DenseVector implementations of Flink ML only allow Double > values. But there are cases where the values are not Doubles, e.g. in NLP. > Does it make sense to make th

Flink ML - Vector and DenseVector

2016-01-18 Thread Hilmi Yildirim
Hi, the Vector and DenseVector implementations of Flink ML only allow Double values. But there are cases where the values are not Doubles, e.g. in NLP. Does it make sense to make the implementations generic, i.e. Vector[T] and DenseVector[T]? Best Regards, Hilmi -- ==

[jira] [Created] (FLINK-3257) Add Exactly-Once Processing Guarantees in Iterative DataStream Jobs

2016-01-18 Thread Paris Carbone (JIRA)
Paris Carbone created FLINK-3257: Summary: Add Exactly-Once Processing Guarantees in Iterative DataStream Jobs Key: FLINK-3257 URL: https://issues.apache.org/jira/browse/FLINK-3257 Project: Flink

[jira] [Created] (FLINK-3256) Invalid execution graph cleanup for jobs with colocation groups

2016-01-18 Thread Paris Carbone (JIRA)
Paris Carbone created FLINK-3256: Summary: Invalid execution graph cleanup for jobs with colocation groups Key: FLINK-3256 URL: https://issues.apache.org/jira/browse/FLINK-3256 Project: Flink

[jira] [Created] (FLINK-3255) Chaining behavior should not depend on parallelism

2016-01-18 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3255: --- Summary: Chaining behavior should not depend on parallelism Key: FLINK-3255 URL: https://issues.apache.org/jira/browse/FLINK-3255 Project: Flink Issue Type: Bu

Re: Dependency on non-existent org.scalamacros:quasiquotes_2.11:

2016-01-18 Thread Prez Cannady
I agree, but it also may be more than a simple project structure and dependency problems Flink currently has six files that import `scala.reflect.macros.Context`. With 2.11, Scala has deprecated this import in favor of `scala.reflect.macros.blackbox.Context` and `scala.reflect.macros.whitebox

[jira] [Created] (FLINK-3254) CombineFunction interface not respected

2016-01-18 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3254: Summary: CombineFunction interface not respected Key: FLINK-3254 URL: https://issues.apache.org/jira/browse/FLINK-3254 Project: Flink Issue Type: Bug

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Hilmi Yildirim
Ok. In this case I will use an Array instead. Am 18.01.2016 um 14:56 schrieb Theodore Vasiloudis: I agree with Till, the data types are different here so you need a custom string vector. The Vector abstraction in FlinkML is designed with numerical vectors in mind. On Mon, Jan 18, 2016 at 2:33

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Hilmi Yildirim
Ok. In this case I will use an Array instead. Am 18.01.2016 um 14:56 schrieb Theodore Vasiloudis: I agree with Till, the data types are different here so you need a custom string vector. The Vector abstraction in FlinkML is designed with numerical vectors in mind. On Mon, Jan 18, 2016 at 2:33

[jira] [Created] (FLINK-3253) deserializeObject exception on WindowOperator

2016-01-18 Thread godfrey he (JIRA)
godfrey he created FLINK-3253: - Summary: deserializeObject exception on WindowOperator Key: FLINK-3253 URL: https://issues.apache.org/jira/browse/FLINK-3253 Project: Flink Issue Type: Bug

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Theodore Vasiloudis
I agree with Till, the data types are different here so you need a custom string vector. The Vector abstraction in FlinkML is designed with numerical vectors in mind. On Mon, Jan 18, 2016 at 2:33 PM, Till Rohrmann wrote: > Hi Hilmi, > > I think in your case it makes sense to define a custom vec

[jira] [Created] (FLINK-3252) Checkpoint stats only displayed after click on graph

2016-01-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3252: -- Summary: Checkpoint stats only displayed after click on graph Key: FLINK-3252 URL: https://issues.apache.org/jira/browse/FLINK-3252 Project: Flink Issue Type: Bu

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Till Rohrmann
Hi Hilmi, I think in your case it makes sense to define a custom vector of strings. The easiest implementation could be an Array[String] or List[String]. The reason why it does not make so much sense to make Vector and DenseVector generic is that these types are algebraic data types. How would yo

[jira] [Created] (FLINK-3251) Checkpoint stats show ghost numbers

2016-01-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3251: -- Summary: Checkpoint stats show ghost numbers Key: FLINK-3251 URL: https://issues.apache.org/jira/browse/FLINK-3251 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-3250) Savepoint coordinator requires too strict parallelism match

2016-01-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3250: -- Summary: Savepoint coordinator requires too strict parallelism match Key: FLINK-3250 URL: https://issues.apache.org/jira/browse/FLINK-3250 Project: Flink Issue

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Hilmi Yildirim
Hi, how I explained it in a previous E-Mail, I need a LabeledVector where the label is also a vector. After we discussed this issue, I created a new class named LabeledSequenceVector with the labels as a Vector. In my use case, I want to train a POS-Tagger system, so the "vector" is a vector o

Re: Flink ML Vector and DenseVector

2016-01-18 Thread Chiwan Park
Hi Hilmi, In NLP, which types are used for vector values? I think we can cover typical case using double values. > On Jan 18, 2016, at 9:19 PM, Hilmi Yildirim wrote: > > Hi, > the Vector and DenseVector implementations of Flink ML only allow Double > values. But there are cases where the valu

Flink ML Vector and DenseVector

2016-01-18 Thread Hilmi Yildirim
Hi, the Vector and DenseVector implementations of Flink ML only allow Double values. But there are cases where the values are not Doubles, e.g. in NLP. Does it make sense to make the implementations generic, i.e. Vector[T] and DenseVector[T]? Best Regards, Hilmi -- ==

Re: Old Flink Graph Repository

2016-01-18 Thread Maximilian Michels
Please keep the history, just delete everything in a commit. Also, it would be helpful to update the GitHub project description with a deprecation warning. Not all people scroll to the readme. On Fri, Jan 15, 2016 at 7:26 PM, Vasiliki Kalavri wrote: > Do we want to keep the history or shall I for

Re: FileNotFoundException thrown by BlobCache when running "mvn test" against flink-runtime 0.10 for Scala 2.11

2016-01-18 Thread Till Rohrmann
A problem is that all the BlobCache/Server tests don't extend the `TestLogger` class which logs the names of the different tests. Maybe we should that add as well. On Fri, Jan 15, 2016 at 3:32 PM, Prez Cannady wrote: > I’ve included the full log of a test run against flink-runtime here: > > http

[jira] [Created] (FLINK-3249) Wrong "unknown partition state/input gate" error messages

2016-01-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3249: -- Summary: Wrong "unknown partition state/input gate" error messages Key: FLINK-3249 URL: https://issues.apache.org/jira/browse/FLINK-3249 Project: Flink Issue Typ

[jira] [Created] (FLINK-3248) RMQSource does not provide a constructor for credentials or other options

2016-01-18 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3248: - Summary: RMQSource does not provide a constructor for credentials or other options Key: FLINK-3248 URL: https://issues.apache.org/jira/browse/FLINK-3248 Pro

Re: Dependency on non-existent org.scalamacros:quasiquotes_2.11:

2016-01-18 Thread Till Rohrmann
This might be related to the problem mentioned in https://issues.apache.org/jira/browse/FLINK-3241 and http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/flink-1-0-SNAPSHOT-scala-2-11-compilation-error-td4303.html . Cheers, Till On Sun, Jan 17, 2016 at 6:26 PM, Prez Cannady wrot