ES formats are pretty easy to use:
Reading:
val conf = new Configuration()
conf.set("es.resource", "index/type")
conf.set("es.query", "?q=*")
val rdd = sc.newAPIHadoopRDD(
conf,
classOf[EsInputFormat[NullWritable, LinkedMapWritable]],
classOf[NullWritable],
classOf[LinkedMapWritable]
)
The only g
I’d prefer to find good example of using saveAsNewAPIHadoopFile with different
OutputFormat implementations (not only orc, but EsOutputFormat, etc). Any
common example
On Apr 16, 2014, at 4:51 PM, Brock Bose wrote:
> Howdy all,
> I recently saw that the OrcInputFormat/OutputFormat's have
Howdy all,
I recently saw that the OrcInputFormat/OutputFormat's have been exposed
to be usable outside of hive (
https://issues.apache.org/jira/browse/HIVE-5728). Does anyone know how
one could use this with saveAsNewAPIHadoopFile to write records in orc
format?
In particular, I would lik
