Hi Akhil, Thanks for your time. I appreciate .I tried this approach , but either I am getting less files or more files not exact hour files.
Is there any way I can tell the range (between this time to this time) Thanks, D On Tue, Dec 16, 2014 at 11:04 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > > Did you try something like: > > //Get the last hour > val d = (System.currentTimeMillis() - 3600 * 1000) > val ex = "abc_" + d.toString().substring(0,7) + "*.json" > > > [image: Inline image 1] > > Thanks > Best Regards > > On Wed, Dec 17, 2014 at 5:05 AM, durga <durgak...@gmail.com> wrote: >> >> Hi All, >> >> I need help with regex in my sc.textFile() >> >> I have lots of files with with epoch millisecond timestamp. >> >> ex:abc_1418759383723.json >> >> Now I need to consume last one hour files using the epoch time stamp as >> mentioned above. >> >> I tried couple of options , nothing seems working for me. >> >> If any one of you face this issue and got a solution , please help me. >> >> Appreciating your help, >> >> Thanks, >> D >> >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/S3-globbing-tp20731.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >>
