Re: Output File Path- Directory Structure

2014-09-09 Thread Nishant Kelkar
Hi Anusha, 1. Well, not quite. What my solution gives you is only a way to move your data from 's3://some-bucket/pageviews/dt=20120311/key=ACME1234/site= example.com/Output-file-1' to 's3://some-bucket/pageviews/20120311/ACME1234/ example.com/Output-file-1'. You could actually do this via the linu

Re: Output File Path- Directory Structure

2014-09-09 Thread anusha Mangina
Thanks Nishanth.. I got thousands of records inserted into dynamically partitioned Tables. 1)Do you think this is ideal solution to CONVERT the path for every record or didnt i understand your answer.? 2) Is there anyway we can set up so the initial path formed as we need(only with Column value

Re: Output File Path- Directory Structure

2014-09-09 Thread Nishant Kelkar
You can use a regex to solve this. If you're using this file path in Java, you could try something like the following: String s = "s3://some-bucket/pageviews/dt=20120311/key=ACME1234/site= example.com/Output-file-1"; System.out.println(s.replaceAll("*[a-z]{2,4}=*", "")); If you'd

Output File Path- Directory Structure

2014-09-09 Thread anusha Mangina
My Table has Dynamic Partitions and creates the File Path as s3://some-bucket/pageviews/dt=20120311/key=ACME1234/site= example.com/Output-file-1 Is there something i can do so i can have the path always as s3://some-bucket/pageviews/20120311/ACME1234/example.com/Output-file-1 Please help me