Lately we upgraded our Spark to 1.3.
Not surprisingly, over the way I find few incomputability between the
versions and quite expected.
I found change that I'm interesting to understand it origin.
env: Amazon EMR, Spark 1.3, Hive 0.13, Hadoop 2.4
In Spark 1.2.1 I ran from the code query such:
SHOW TABLES LIKE '*tmp*'
The query gave me results from the code and from the Hive CLI.
After upgrading to Spark 1.3, from Hive CLI it still works but I get the
below exception from Spark.
Changing to other formats such as:
SHOW TABLES *.tmp
or
SHOW TABLES in default *.tmp
Yield with the same exception...
Any ideas?
*hc.sql("SHOW TABLES LIKE '*tmp*'")java.lang.RuntimeException: [1.13]
failure: ``in'' expected but identifier LIKE foundSHOW TABLES LIKE
'*tmp*' ^ at scala.sys.package$.error(package.scala:27) at
org.apache.spark.sql.catalyst.AbstractSparkSQLParser.apply(AbstractSparkSQLParser.scala:40)
at org.apache.spark.sql.hive.HiveQl$.parseSql(HiveQl.scala*
