You could try to use the TypeSerializerInputFormat.
On Thu, Jul 30, 2015 at 2:08 PM, Flavio Pompermaier
wrote:
> How can I create a Flink dataset given a directory path that contains a
> set of java objects serialized with kryo (one file per object)?
>
> On Thu, Jul 30, 2015 at 1:41 PM, Till R
How can I create a Flink dataset given a directory path that contains a set
of java objects serialized with kryo (one file per object)?
On Thu, Jul 30, 2015 at 1:41 PM, Till Rohrmann wrote:
> Hi Flavio,
>
> in order to use the Kryo serializer for a given type you can use the
> registerTypeWithKr
Hi Flavio,
in order to use the Kryo serializer for a given type you can use the
registerTypeWithKryoSerializer of the ExecutionEnvironment object. What you
provide to the method is the type you want to be serialized with kryo and
an implementation of the com.esotericsoftware.kryo.Serializer class.
I have a project that produce RDF quads and I have to store to read them
with Flink afterwards.
I could use thrift/protobuf/avro but this means to add a lot of transitive
dependencies to my project.
Maybe I could use Kryo to store those objects..is there any example to
create a dataset of objects s
Quick response: I am not opposed to that, but there are tuple libraries
around already.
Do you need specifically the Flink tuples, for interoperability between
Flink and other projects?
On Thu, Jul 30, 2015 at 11:07 AM, Stephan Ewen wrote:
> Should we move this to the dev list?
>
> On Thu, Jul
Should we move this to the dev list?
On Thu, Jul 30, 2015 at 10:43 AM, Flavio Pompermaier
wrote:
> Any thought about this (move tuples classes in a separate self-contained
> project with no transitive dependencies so that to be easily used in other
> external projects)?
>
> On Mon, Jul 6, 2015 a
Any thought about this (move tuples classes in a separate self-contained
project with no transitive dependencies so that to be easily used in other
external projects)?
On Mon, Jul 6, 2015 at 11:09 AM, Flavio Pompermaier
wrote:
> Do you think it could be a good idea to extract Flink tuples in a s
Do you think it could be a good idea to extract Flink tuples in a separate
project so that to allow simpler dependency management in Flin-compatible
projects?
On Mon, Jul 6, 2015 at 11:06 AM, Fabian Hueske wrote:
> Hi,
>
> at the moment, Tuples are more efficient than POJOs, because POJO fields
Hi,
at the moment, Tuples are more efficient than POJOs, because POJO fields
are accessed via Java reflection whereas Tuple fields are directly accessed.
This performance penalty could be overcome by code-generated seriliazers
and comparators but I am not aware of any work in that direction.
Best
