Yes it's very simple. So using the %spark context:
val user_meta = sqlContext.load("/vagrant/parquet_tables/user_meta.parquet")
user_meta.registerTempTable("user_meta")
val user = sqlContext.load("/vagrant/parquet_tables/user.parquet")
user.registerTempTable("user")
z.show(sqlContext.sql("select id, first_name, last_name, email from
user_meta left join user on user.id=user_meta.user_id where group_id=2"))
*Jose Rivera*
p.s. We're Hiring <https://www.internavenue.com/about/jobs/>!
*Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>*
Watch Intern Avenue on: BBC Dragons’ Den
<http://www.internavenue.com/dragons-den>
e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> |
www.internavenue.com | Great Interns Online
On 16 August 2016 at 13:54, Jeff Zhang <zjf...@gmail.com> wrote:
> Could you share your code ?
>
> On Tue, Aug 16, 2016 at 8:41 PM, Jose Rivera-Rubio <
> jose.riv...@internavenue.com> wrote:
>
>> No errors in the interpreter log stored in ./logs but still no HTML table
>> output after doing z.show() Any other locations where I should check for
>> logs?
>>
>> Thanks!
>>
>> PS: I'm using commit 37696ea8bd6a5c3b910f7d24141530f91f80391c of the
>> master branch
>>
>> *Jose Rivera*
>> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>!
>>
>> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>*
>> Watch Intern Avenue on: BBC Dragons’ Den
>> <http://www.internavenue.com/dragons-den>
>> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> |
>> www.internavenue.com | Great Interns Online
>>
>> On 12 August 2016 at 02:49, Jeff Zhang <zjf...@gmail.com> wrote:
>>
>>> I tried 0.6.1, it works for me. Could you check the interpreter log and
>>> yarn app log ?
>>>
>>> On Fri, Aug 12, 2016 at 7:20 AM, Jose Rivera-Rubio <
>>> jose.riv...@internavenue.com> wrote:
>>>
>>>> I built from source after pulling the latest master. I also checked out
>>>> the RC1 tag of v0.6.1, compiled and I could see the same behaviour: no
>>>> output from z.show().
>>>>
>>>> Thanks
>>>>
>>>> *Jose Rivera*
>>>> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>!
>>>>
>>>> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>*
>>>> Watch Intern Avenue on: BBC Dragons’ Den
>>>> <http://www.internavenue.com/dragons-den>
>>>> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> |
>>>> www.internavenue.com | Great Interns Online
>>>>
>>>> On 11 August 2016 at 14:05, Jeff Zhang <zjf...@gmail.com> wrote:
>>>>
>>>>> Which version of zeppelin are you using ?
>>>>>
>>>>> On Thu, Aug 11, 2016 at 8:36 PM, Jose Rivera-Rubio <
>>>>> jose.riv...@internavenue.com> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I saw this <https://issues.apache.org/jira/browse/ZEPPELIN-1228> JIRA
>>>>>> issue but I'm facing the problem with Spark 1.6.0 and 1.6.1
>>>>>>
>>>>>> When doing z.show(dataframe) I just get the REPL output of the
>>>>>> columns [id: bigint, first_name: string, last_name: string, email:
>>>>>> string]
>>>>>>
>>>>>> But not the HTML displayed data. If I do dataframe.show() I can see
>>>>>> the data so it's not an issue of the data or the Scala code.
>>>>>>
>>>>>> Any hints? Thanks!
>>>>>>
>>>>>> *Jose Rivera*
>>>>>> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>!
>>>>>>
>>>>>> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>*
>>>>>> Watch Intern Avenue on: BBC Dragons’ Den
>>>>>> <http://www.internavenue.com/dragons-den>
>>>>>> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> |
>>>>>> www.internavenue.com | Great Interns Online
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best Regards
>>>>>
>>>>> Jeff Zhang
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Best Regards
>>>
>>> Jeff Zhang
>>>
>>
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
