Let me look into how to do this, I'll get back to you soon. On Mon, Dec 4, 2017 at 9:10 PM, Zhang, Liyun <liyun.zh...@intel.com> wrote:
> Hi all: > > Now I am working on HIVE-18150<https://issues.apache.org/jira/browse/HIVE- > 18150>(Upgrade Spark Version to 2.2.0). I found that I need to upload the > spark-2.2.0-bin-hadoop2-without-hive.tgz to a public folder to let > hive-qa to download and > test all qfiles relating about spark. Does anyone know where I can > upload this spark-2.2.0-bin-hadoop2-without-hive.tgz(nearly 143M). I > tried to use Google Driver, but curl xxxx failed. > > > I need change the url link(http://d3jw87u4immizc. > cloudfront.net/spark-tarball/spark-${spark.version}-bin- > hadoop2-without-hive.tgz<http://d3jw87u4immizc.cloudfront. > net/spark-tarball/spark-$%7bspark.version%7d-bin-hadoop2-without-hive.tgz > >) > $HIVE_SOURCE/itests/pom.xml > <configuration> > <target> > <echo file="target/download.sh"> > set -x > /bin/pwd > BASE_DIR=./target > HIVE_ROOT=$BASE_DIR/../../../ > DOWNLOAD_DIR=./../thirdparty > download() { > url=$1; > finalName=$2 > tarName=$(basename $url) > rm -rf $BASE_DIR/$finalName > if [[ ! -f $DOWNLOAD_DIR/$tarName ]] > then > curl -Sso $DOWNLOAD_DIR/$tarName $url > else > local md5File="$tarName".md5sum > curl -Sso $DOWNLOAD_DIR/$md5File "$url".md5sum > cd $DOWNLOAD_DIR > if type md5sum >/dev/null && ! md5sum -c $md5File; then > curl -Sso $DOWNLOAD_DIR/$tarName $url || return 1 > fi > > cd - > fi > tar -zxf $DOWNLOAD_DIR/$tarName -C $BASE_DIR > mv $BASE_DIR/spark-${spark.version}-bin-hadoop2-without-hive > $BASE_DIR/$finalName > } > mkdir -p $DOWNLOAD_DIR > download "http://d3jw87u4immizc.cloudfront.net/spark-tarball/ > spark-${spark.version}-bin-hadoop2-without-hive.tgz" "spark" > cp -f $HIVE_ROOT/data/conf/spark/log4j2.properties > $BASE_DIR/spark/conf/ > > > > > Best Regards > Kelly Zhang/Zhang,Liyun > > -- Sahil Takiar Software Engineer takiar.sa...@gmail.com | (510) 673-0309
