What about /blah/*/blah/out*.avro? On 27 May 2015 18:08, "ÐΞ€ρ@Ҝ (๏̯͡๏)" <deepuj...@gmail.com> wrote:
> I am doing that now. > Is there no other way ? > > On Wed, May 27, 2015 at 12:40 PM, Akhil Das <ak...@sigmoidanalytics.com> > wrote: > >> How about creating two and union [ sc.union(first, second) ] them? >> >> Thanks >> Best Regards >> >> On Wed, May 27, 2015 at 11:51 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> >> wrote: >> >>> I have this piece >>> >>> sc.newAPIHadoopFile[AvroKey[GenericRecord], NullWritable, >>> AvroKeyInputFormat[GenericRecord]]( >>> "/a/b/c/d/exptsession/2015/05/22/out-r-*.avro") >>> >>> that takes ("/a/b/c/d/exptsession/2015/05/22/out-r-*.avro") this as >>> input. >>> >>> I want to give a second directory as input but this is a invalid syntax >>> >>> >>> that takes ("/a/b/c/d/exptsession/2015/05/*22*/out-r-*.avro", >>> "/a/b/c/d/exptsession/2015/05/*21*/out-r-*.avro") >>> >>> OR >>> >>> ("/a/b/c/d/exptsession/2015/05/*22*/out-r-*.avro, >>> /a/b/c/d/exptsession/2015/05/*21*/out-r-*.avro") >>> >>> >>> Please suggest. >>> >>> >>> >>> -- >>> Deepak >>> >>> >> > > > -- > Deepak > >