[
https://issues.apache.org/jira/browse/SPARK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827980#comment-15827980
]
Kaushal Prajapati commented on SPARK-8480:
------------------------------------------
Yes [~emlyn], Its correct that the name is not identical, but if it possible to
have some kind of uniqueness for names or an abstraction like the same that we
have for tables.
{code}
df.createTempView("myTable")
sqlContext.cacheTable("myTable")
sqlContext.uncacheTable("myTable")
{code}
Same like for Datasets, It would be very useful
{code}
scala> val df = sc.range(1,1000).toDF
df: org.apache.spark.sql.DataFrame = [value: bigint]
scala> df.setName("MyDataset")
res0: df.type = MyDataset
scala> df.cache
res1: df.type = MyDataset
sqlContext.getDataSet("MyDataset")
sqlContext.uncacheDataSet("MyDataset")
{code}
> Add setName for Dataframe
> -------------------------
>
> Key: SPARK-8480
> URL: https://issues.apache.org/jira/browse/SPARK-8480
> Project: Spark
> Issue Type: Wish
> Components: SQL
> Affects Versions: 1.4.0
> Reporter: Peter Rudenko
> Priority: Minor
>
> Rdd has a method setName, so in spark UI, it's more easily to understand
> what's this cache for. E.g. ("data for LogisticRegression model", etc.).
> Would be nice to have the same method for Dataframe, since it displays a
> logical schema, in cache page, which could be quite big.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
