SparkSQL Added file get Exception: is a directory and recursive is not turned on

Hi, all: As recorded in https://issues.apache.org/jira/browse/SPARK-16408, when using Spark-sql to execute sql like: add file hdfs://xxx/user/test; If the HDFS path( hdfs://xxx/user/test) is a directory, then we will get an exception like: org.apache.spark.SparkException: Added file hdfs:

why did spark2.0 Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

Hi All, I have tried the spark sql of Spark branch-2.0 and countered an unexpected problem: Operation not allowed: ROW FORMAT DELIMITED is only compatible with 'textfile', not 'orc'(line 1, pos 0) the sql is like: CREATE TABLE IF NOT EXISTS test.test_orc ( ... ) PARTITIONED BY (xxx) ROW FOR

run spark sql with script transformation faild

Hi, all: Recently, we are trying to compare with spark sql and hive on MR, and I have tried to run spark (spark1.6 rc2) sql with script transformation, the spark job faild and get an error message like: 16/06/26 11:01:28 INFO codegen.GenerateUnsafeProjection: Code generated in 19.054534 ms 16