Re: Windows operation orderBy desc

Hi all, i am using window function to find out the latest record using row_number; the hive table is partitioned. when i run the function it runs for 545. what is the reason for 545 task. Thanks, selvam R On Mon, Aug 1, 2016 at 8:09 PM, Mich Talebzadeh wrote: > You need to get the position

Re: Windows operation orderBy desc

You need to get the position right val wSpec = Window.partitionBy("col1").orderBy(desc("col2")) HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw