Re: No FileSystem for scheme: wasbs

2018-10-04 Thread Metin OSMAN
org.apache.hadoop.fs.azure.NativeAzureFileSystem spark.hadoop.fs.azure.account.key..blob.core.windows.net Metin 1:29 am, Jeff Zhang > > > Do you specify SPARK_HOME or just using the local embedded mode of spark ? > Metin OSMAN mailto:mos...@mixdata.com)>于2018年10月4日周四 > 上午1:39写道: > > Hi, > > &

No FileSystem for scheme: wasbs

2018-10-03 Thread Metin OSMAN
Hi, I have downloaded and setup zeppelin on my local Ubuntu 18.04 computer, and I successfully managed to open file on Azure Storage with spark interpreter out of the box. Then I have installed the same package on a Ubuntu 14.04 server. When I try running a simple spark read parquet from an azur

Re: Leading Zeros with spark.sql interpreter

2018-09-20 Thread Metin OSMAN
Good news, thank you ! On sept. 20 2018, at 2:36 am, Jeff Zhang wrote: > > > It is fixed in ZEPPELIN-3701, I will backport it to branch-0.8. > > > > Metin OSMAN mailto:mos...@mixdata.com)>于2018年9月20日周四 > 上午12:43写道: > > Hi, > > > > I have a DataFra

Leading Zeros with spark.sql interpreter

2018-09-19 Thread Metin OSMAN
Hi, I have a DataFrame with String colums containing only numbers like values, but with leading zeros. when I query the DF through a temptable in a spark.sql interpreter, the table shows the values without the leading zeros. If I export the data to a csv file, the zeros are also removed. I don'