Re: RawSchema as deserialization schema

2016-09-26 Thread Swapnil Chougule
Okay. Thanks for the update Robert. On Mon, Sep 26, 2016 at 3:08 PM, Robert Metzger wrote: > The RawSchema was once part of Flink's Kafka connector. I've removed it > because its implementation is trivial and I didn't expect that there are > many people who need the schema (also, I think I saw p

Re: RawSchema as deserialization schema

2016-09-26 Thread Robert Metzger
The RawSchema was once part of Flink's Kafka connector. I've removed it because its implementation is trivial and I didn't expect that there are many people who need the schema (also, I think I saw people using a map() operator after the consumer to deserialize the byte[] into their formats). As S

Re: RawSchema as deserialization schema

2016-09-26 Thread Swapnil Chougule
Hi Robert, May I know your inputs on same ? Thanks, Swapnil On Thu, Sep 22, 2016 at 7:12 PM, Stephan Ewen wrote: > /cc Robert, he is looking into extending the Kafka Connectors to support > more of Kafka's direct utilities > > On Thu, Sep 22, 2016 at 3:17 PM, Swapnil Chougule > wrote: > >> It

Re: RawSchema as deserialization schema

2016-09-22 Thread Stephan Ewen
/cc Robert, he is looking into extending the Kafka Connectors to support more of Kafka's direct utilities On Thu, Sep 22, 2016 at 3:17 PM, Swapnil Chougule wrote: > It will be good to have RawSchema as one of the deserialization schema in > streaming framework (like SimpleStringSchema). > Many u

Re: RawSchema as deserialization schema

2016-09-22 Thread Swapnil Chougule
It will be good to have RawSchema as one of the deserialization schema in streaming framework (like SimpleStringSchema). Many use cases needs data in byte array format after reading from source like kafka. Any inputs for same ? On Mon, Sep 12, 2016 at 11:42 AM, Swapnil Chougule wrote: > Thanks

Re: RawSchema as deserialization schema

2016-09-11 Thread Swapnil Chougule
Thanks Maximilian. I implemented same & it worked for me. I was under impression that RawSchema is available from flink. Regards, Swapnil On Mon, Sep 5, 2016 at 8:48 PM, Maximilian Michels wrote: > Just implement DeserializationSchema and return the byte array from > Kafka. Byte array serializa

Re: RawSchema as deserialization schema

2016-09-05 Thread Maximilian Michels
Just implement DeserializationSchema and return the byte array from Kafka. Byte array serialization poses no problem to the Flink serialization. On Mon, Sep 5, 2016 at 3:50 PM, Swapnil Chougule wrote: > I am using Kafka consumer in flink 1.1.1 with Kafka 0.8.2. I want to read > byte array as it i