[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15807248#comment-15807248
]
Liang-Chi Hsieh commented on SPARK-7768:
----------------------------------------
Hi Randall,
With the {{UDTRegistration}} added since 2.0, we already can make UDT work with
a class of an unmodified third-party library.
You can define the user defined type ({{UserDefinedType}}) for the class from
third-party library. Then you can register the defined type with the
third-party class to {{UDTRegistration}}:
{code}
class ThirdPartyClassUDT extends UserDefinedType[ThirdPartyClass] {
...
}
UDTRegistration.register(classOf[ThirdPartyClass].getName,
classOf[ThirdPartyClassUDT].getName)
{code}
Unfortunately, {{UDTRegistration}} is still in private. I hope we can make it
public soon in this change.
> Make user-defined type (UDT) API public
> ---------------------------------------
>
> Key: SPARK-7768
> URL: https://issues.apache.org/jira/browse/SPARK-7768
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Reporter: Xiangrui Meng
> Priority: Critical
>
> As the demand for UDTs increases beyond sparse/dense vectors in MLlib, it
> would be nice to make the UDT API public in 1.5.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
