Re: From Hive to Spark, what is the default database/table

2016-12-31 Thread Mich Talebzadeh
flight201601 is the name of database or schema it is not a TABLE! In Hive you can do show databases to see the list of databases. By Default Hive has a default database called "default" out of box For example to see list of tables in database flight201601 do the following: use flight201601; sh

From Hive to Spark, what is the default database/table

2016-12-31 Thread Raymond Xie
Hello, It is indicated in https://spark.apache.org/docs/1.6.1/sql-programming-guide.html#dataframes when Running SQL Queries Programmatically you can do: from pyspark.sql import SQLContextsqlContext = SQLContext(sc)df = sqlContext.sql("SELECT * FROM table") However, it did not indicate what sh