[
https://issues.apache.org/jira/browse/SPARK-18882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15758513#comment-15758513
]
David Hodeffi commented on SPARK-18882:
---------------------------------------
generate 4 random tables using range() function on DataFrame. Cartesian join
all of them and write them to Hive Table on HiveContext (Spark 1.6.2).
> Spark UI , storage tab is always empty.
> ---------------------------------------
>
> Key: SPARK-18882
> URL: https://issues.apache.org/jira/browse/SPARK-18882
> Project: Spark
> Issue Type: Question
> Components: Spark Core
> Environment: Spark 1.6.2
> Reporter: David Hodeffi
> Priority: Minor
>
> I have HDP 2.5 installed with Spark 1.6.2 on yarn, deploy mode cluster.
> On my code I create a DataFrame and cache it and then doing action on it. I
> have tried to look for details about my dataframe on Storage tab at Spark UI
> but I cannot see anything on this tab.
> My Question is : what could be the reasons why my storage tab is still empty?
> Is my code is wrong? Is the configuration of HDP 2.5 with Spark on yarn are
> wrong ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
