[ https://issues.apache.org/jira/browse/HIVE-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425832#comment-15425832 ]
Rui Li commented on HIVE-14554: ------------------------------- Spark has hadoop-provided profile. Maybe we can enable that to avoid the conflicts. And there is HIVE-14240 to get rid of a complete spark distribution. Regarding the download time, I think that depends on the network connectivity of the node. It can easily take over 15 min in my local environment. So I don't think all the guys would be happy to download the file each time they want to run some ptest. Is it possible that we only do the cleanup for pre-commit test? > Hive ptest should delete the itests/thirdparty directory everytime it builds > hive > --------------------------------------------------------------------------------- > > Key: HIVE-14554 > URL: https://issues.apache.org/jira/browse/HIVE-14554 > Project: Hive > Issue Type: Task > Components: Testing Infrastructure > Reporter: Sergio Peña > Assignee: Sergio Peña > > The {{itests/thridparty}} directory is created by hive on spark when > downloading the spark-assembly file. Hive ptest should delete this directory > everytime it runs a new set of tests to avoid conflicts when a new spark > tarball is submitted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)