I dont think so, i was able to insert overwrite other created tables in
hive using spark sql. The only problem I am facing is, spark is not able
to recognize hive view name. Very strange but not sure where I am doing
wrong in this.
On Mon, Feb 6, 2017 at 11:03 AM, Jon Gregg <coble...@gmail.com> wrote:
> Confirming that Spark can read newly created views - I just created a test
> view in HDFS and I was able to query it in Spark 1.5 immediately after
> without a refresh. Possibly an issue with your Spark-Hive connection?
>
> Jon
>
> On Sun, Feb 5, 2017 at 9:31 PM, KhajaAsmath Mohammed <
> mdkhajaasm...@gmail.com> wrote:
>
>> Hi Khan,
>>
>> It didn't work in my case. used below code. View is already present in
>> Hive but I cant read that in spark sql. Throwing exception that table not
>> found
>>
>> sqlCtx.refreshTable("schema.hive_view")
>>
>>
>> Thanks,
>>
>> Asmath
>>
>>
>> On Sun, Feb 5, 2017 at 7:56 PM, vaquar khan <vaquar.k...@gmail.com>
>> wrote:
>>
>>> Hi Ashmath,
>>>
>>> Try refresh table
>>>
>>> // spark is an existing SparkSession
>>> spark.catalog.refreshTable("my_table")
>>>
>>>
>>> http://spark.apache.org/docs/latest/sql-programming-guide.ht
>>> ml#metadata-refreshing
>>>
>>>
>>>
>>> Regards,
>>> Vaquar khan
>>>
>>>
>>>
>>> On Sun, Feb 5, 2017 at 7:19 PM, KhajaAsmath Mohammed <
>>> mdkhajaasm...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I have a hive view which is basically set of select statements on some
>>>> tables. I want to read the hive view and use hive builtin functions
>>>> available in spark sql.
>>>>
>>>> I am not able to read that hive view in spark sql but can retreive data
>>>> in hive shell.
>>>>
>>>> can't spark access hive views?
>>>>
>>>> Thanks,
>>>> Asmath
>>>>
>>>
>>>
>>>
>>> --
>>> Regards,
>>> Vaquar Khan
>>> +1 -224-436-0783 <(224)%20436-0783>
>>>
>>> IT Architect / Lead Consultant
>>> Greater Chicago
>>>
>>
>>
>
