Did you try something like:

//Get the last hour
val d = (System.currentTimeMillis() - 3600 * 1000)
val ex = "abc_" + d.toString().substring(0,7) + "*.json"


[image: Inline image 1]

Thanks
Best Regards

On Wed, Dec 17, 2014 at 5:05 AM, durga <durgak...@gmail.com> wrote:
>
> Hi All,
>
> I need help with regex in my sc.textFile()
>
> I have lots of files with with epoch millisecond timestamp.
>
> ex:abc_1418759383723.json
>
> Now I need to consume last one hour files using the epoch time stamp as
> mentioned above.
>
> I tried couple of options , nothing seems working for me.
>
> If any one of you face this issue and got a solution , please help me.
>
> Appreciating your help,
>
> Thanks,
> D
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/S3-globbing-tp20731.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>

Reply via email to