[ 
https://issues.apache.org/jira/browse/HIVE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292052#comment-16292052
 ] 

liyunzhang commented on HIVE-18282:
-----------------------------------

[~stakiar]: 
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-2.0.0-bin-hadoop2-without-hive.tgz.md5sum
 exists. But 
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-2.2.0-bin-hadoop2-without-hive.tgz.md5sum
 does not exist. Can you help upload the md5sum for spark2.2 package otherwise 
spark tar will be downloaded even the package has been downloaded?
$HIVE_SOURCE/itests/pom.xml#Line 82
{code}
    download() {
                        url=$1;
                        finalName=$2
                        tarName=$(basename $url)
                        rm -rf $BASE_DIR/$finalName
                        if [[ ! -f $DOWNLOAD_DIR/$tarName ]]
                        then
                         curl -Sso $DOWNLOAD_DIR/$tarName $url
                        else
                          local md5File="$tarName".md5sum
                          curl -Sso $DOWNLOAD_DIR/$md5File "$url".md5sum
                          cd $DOWNLOAD_DIR
                          if type md5sum >/dev/null && ! md5sum -c 
$md5File; then  // use md5sum to check if need to update package.
                            curl -Sso $DOWNLOAD_DIR/$tarName $url || return 1
                          fi  

                          cd -
                        fi  
                        tar -zxf $DOWNLOAD_DIR/$tarName -C $BASE_DIR
                        mv 
$BASE_DIR/spark-${spark.version}-bin-hadoop2-without-hive $BASE_DIR/$finalName
                      }   


{code}

> Spark tar is downloaded every time for itest
> --------------------------------------------
>
>                 Key: HIVE-18282
>                 URL: https://issues.apache.org/jira/browse/HIVE-18282
>             Project: Hive
>          Issue Type: Test
>            Reporter: Rui Li
>
> Seems we missed the md5 file for spark-2.2.0?
> cc [~kellyzly], [~stakiar]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to