[jira] [Assigned] (SPARK-11846) Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11846: Assignee: Apache Spark (was: Xusen Yin) > Model export/import for spark.ml: AFTSurvivalRe

[jira] [Resolved] (SPARK-11747) Can not specify input path in python logistic_regression example under ml

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11747. --- Resolution: Won't Fix > Can not specify input path in python logistic_regression example under ml > -

[jira] [Issue Comment Deleted] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-4036: Comment: was deleted (was: ok) > Add Conditional Random Fields (CRF) algorithm to Spark MLlib > ---

[jira] [Issue Comment Deleted] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-4036: Comment: was deleted (was: ok) > Add Conditional Random Fields (CRF) algorithm to Spark MLlib > ---

[jira] [Issue Comment Deleted] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-4036: Comment: was deleted (was: ok) > Add Conditional Random Fields (CRF) algorithm to Spark MLlib > ---

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013095#comment-15013095 ] hujiayin commented on SPARK-4036: - ok > Add Conditional Random Fields (CRF) algorithm to

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013097#comment-15013097 ] hujiayin commented on SPARK-4036: - ok > Add Conditional Random Fields (CRF) algorithm to

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013098#comment-15013098 ] hujiayin commented on SPARK-4036: - ok > Add Conditional Random Fields (CRF) algorithm to

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013096#comment-15013096 ] hujiayin commented on SPARK-4036: - ok > Add Conditional Random Fields (CRF) algorithm to

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-11-18 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013088#comment-15013088 ] Virgil Palanciuc commented on SPARK-10109: -- Haven't tried it lately - just ran

[jira] [Updated] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11339: -- Assignee: Felix Cheung > Fix and document the list of functions in R base packa

[jira] [Resolved] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11339. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Comment Edited] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013068#comment-15013068 ] Kai Sasaki edited comment on SPARK-4036 at 11/19/15 7:32 AM: -

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013068#comment-15013068 ] Kai Sasaki commented on SPARK-4036: --- [~hujiayin] I'm sorry for being late for response.

[jira] [Commented] (SPARK-11657) Bad Dataframe data read from parquet

2015-11-18 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013064#comment-15013064 ] Virgil Palanciuc commented on SPARK-11657: -- Yes, I think I was using Kryo. Thank

[jira] [Comment Edited] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-18 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010353#comment-15010353 ] hujiayin edited comment on SPARK-4036 at 11/19/15 7:09 AM: --- Hi S

[jira] [Assigned] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7499: --- Assignee: Apache Spark > Investigate how to specify columns in SparkR without $ or strings >

[jira] [Assigned] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7499: --- Assignee: (was: Apache Spark) > Investigate how to specify columns in SparkR without $ or

[jira] [Commented] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013045#comment-15013045 ] Apache Spark commented on SPARK-7499: - User 'sun-rui' has created a pull request for t

[jira] [Commented] (SPARK-11021) SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version

2015-11-18 Thread bit1129 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013046#comment-15013046 ] bit1129 commented on SPARK-11021: - I encounter exactly the same issue with Spark 1.5.0 +

[jira] [Commented] (SPARK-11748) Result is null after alter column name of table stored as Parquet

2015-11-18 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013030#comment-15013030 ] pin_zhang commented on SPARK-11748: --- Apache hive 0.14 has added Support for Parquet Col

[jira] [Commented] (SPARK-11659) Codegen sporadically fails with same input character

2015-11-18 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012995#comment-15012995 ] Catalin Alexandru Zamfir commented on SPARK-11659: -- It is not explicit.

[jira] [Assigned] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11817: Assignee: Apache Spark > insert of timestamp with factional seconds inserts a NULL > -

[jira] [Assigned] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11817: Assignee: (was: Apache Spark) > insert of timestamp with factional seconds inserts a N

[jira] [Commented] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012981#comment-15012981 ] Apache Spark commented on SPARK-11817: -- User 'viirya' has created a pull request for

[jira] [Comment Edited] (SPARK-6725) Model export/import for Pipeline API

2015-11-18 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012815#comment-15012815 ] Earthson Lu edited comment on SPARK-6725 at 11/19/15 6:34 AM: --

[jira] [Commented] (SPARK-11849) Analyzer should replace current_date and current_timestamp with literals

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012972#comment-15012972 ] Apache Spark commented on SPARK-11849: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11849) Analyzer should replace current_date and current_timestamp with literals

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11849: Assignee: Reynold Xin (was: Apache Spark) > Analyzer should replace current_date and curr

[jira] [Assigned] (SPARK-11849) Analyzer should replace current_date and current_timestamp with literals

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11849: Assignee: Apache Spark (was: Reynold Xin) > Analyzer should replace current_date and curr

[jira] [Created] (SPARK-11849) Analyzer should replace current_date and current_timestamp with literals

2015-11-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11849: --- Summary: Analyzer should replace current_date and current_timestamp with literals Key: SPARK-11849 URL: https://issues.apache.org/jira/browse/SPARK-11849 Project: Spark

[jira] [Commented] (SPARK-11520) RegressionMetrics should support instance weights

2015-11-18 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012964#comment-15012964 ] Kai Sasaki commented on SPARK-11520: [~josephkb] The metrics of {{RegressionMetrics}}

[jira] [Updated] (SPARK-11622) Make LibSVMRelation extends HadoopFsRelation and Add LibSVMOutputWriter

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11622: -- Target Version/s: 1.7.0 > Make LibSVMRelation extends HadoopFsRelation and Add LibSVMOutputWrit

[jira] [Updated] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11275: - Priority: Critical (was: Major) > [SQL] Incorrect results when using rollup/cube >

[jira] [Resolved] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11842. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9829 [https://gi

[jira] [Commented] (SPARK-7457) Perf test for ALS.recommendAll

2015-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012843#comment-15012843 ] Jeff Zhang commented on SPARK-7457: --- [~mengxr] I don't find the api of ALS.recommandAll,

[jira] [Comment Edited] (SPARK-6725) Model export/import for Pipeline API

2015-11-18 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012815#comment-15012815 ] Earthson Lu edited comment on SPARK-6725 at 11/19/15 5:14 AM: --

[jira] [Commented] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012817#comment-15012817 ] Apache Spark commented on SPARK-11848: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11848: Assignee: Apache Spark > [SQL] Support EXPLAIN in DataSet APIs > -

[jira] [Assigned] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11848: Assignee: (was: Apache Spark) > [SQL] Support EXPLAIN in DataSet APIs > --

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

2015-11-18 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012815#comment-15012815 ] Earthson Lu commented on SPARK-6725: I'm glad to give help:) > Model export/import fo

[jira] [Created] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

2015-11-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11848: --- Summary: [SQL] Support EXPLAIN in DataSet APIs Key: SPARK-11848 URL: https://issues.apache.org/jira/browse/SPARK-11848 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11829) Model export/import for spark.ml: estimators under ml.feature (II)

2015-11-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012785#comment-15012785 ] Yanbo Liang commented on SPARK-11829: - Sure, I can take this. > Model export/import

[jira] [Commented] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-18 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012776#comment-15012776 ] yuhao yang commented on SPARK-11847: Sure, I can take it. > Model export/import for

[jira] [Updated] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11847: -- Description: Add read/write support to LDA, similar to ALS. > Model export/import for spark.ml:

[jira] [Commented] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012775#comment-15012775 ] Xiangrui Meng commented on SPARK-11847: --- [~yuhaoyan] We need some help on pipeline

[jira] [Created] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-18 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11847: - Summary: Model export/import for spark.ml: LDA Key: SPARK-11847 URL: https://issues.apache.org/jira/browse/SPARK-11847 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012770#comment-15012770 ] Xiangrui Meng commented on SPARK-6725: -- [~EarthsonLu] We are adding more import/expor

[jira] [Updated] (SPARK-11846) CLONE - Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11846: -- Description: Add read/write support to AFTSurvivalRegression and IsotonicRegression using Line

[jira] [Updated] (SPARK-11846) Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11846: -- Summary: Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression (was:

[jira] [Updated] (SPARK-11846) CLONE - Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11846: -- Assignee: Xusen Yin (was: Wenjian Huang) > CLONE - Model export/import for spark.ml: AFTSurviv

[jira] [Created] (SPARK-11846) CLONE - Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11846: - Summary: CLONE - Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression Key: SPARK-11846 URL: https://issues.apache.org/jira/browse/SPARK-11846

[jira] [Updated] (SPARK-11846) CLONE - Model export/import for spark.ml: AFTSurvivalRegression and IsotonicRegression

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11846: -- Fix Version/s: (was: 1.6.0) > CLONE - Model export/import for spark.ml: AFTSurvivalRegressi

[jira] [Assigned] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11845: Assignee: Tathagata Das (was: Apache Spark) > Add unit tests to verify correct checkpoint

[jira] [Commented] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012738#comment-15012738 ] Apache Spark commented on SPARK-11845: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11845: Assignee: Apache Spark (was: Tathagata Das) > Add unit tests to verify correct checkpoint

[jira] [Updated] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11845: -- Target Version/s: 1.6.0 > Add unit tests to verify correct checkpointing of TrackStateRDD > ---

[jira] [Created] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-11845: - Summary: Add unit tests to verify correct checkpointing of TrackStateRDD Key: SPARK-11845 URL: https://issues.apache.org/jira/browse/SPARK-11845 Project: Spark

[jira] [Updated] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

2015-11-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11845: -- Issue Type: Test (was: Bug) > Add unit tests to verify correct checkpointing of TrackStateRDD

[jira] [Commented] (SPARK-11838) Spark SQL query fragment RDD reuse

2015-11-18 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012724#comment-15012724 ] Mark Hamstra commented on SPARK-11838: -- One significant difference between this and

[jira] [Created] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2015-11-18 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11844: Summary: can not read class org.apache.parquet.format.PageHeader: don't know what type: 13 Key: SPARK-11844 URL: https://issues.apache.org/jira/browse/SPARK-11844 Project: Sp

[jira] [Updated] (SPARK-11614) serde parameters should be set only when all params are ready

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11614: - Assignee: Navis > serde parameters should be set only when all params are ready > ---

[jira] [Resolved] (SPARK-11614) serde parameters should be set only when all params are ready

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11614. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9580 [https://github.com/a

[jira] [Commented] (SPARK-11544) sqlContext doesn't use PathFilter

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012718#comment-15012718 ] Apache Spark commented on SPARK-11544: -- User 'dilipbiswal' has created a pull reques

[jira] [Reopened] (SPARK-11669) Python interface to SparkR GLM module

2015-11-18 Thread Shubhanshu Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubhanshu Mishra reopened SPARK-11669: --- What I mean't when I said a Python API to GLM was that the GLM module is something which

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012710#comment-15012710 ] Apache Spark commented on SPARK-5682: - User 'winningsix' has created a pull request fo

[jira] [Commented] (SPARK-11838) Spark SQL query fragment RDD reuse

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012701#comment-15012701 ] Michael Armbrust commented on SPARK-11838: -- As I said to [~markhamstra] offline,

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

2015-11-18 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012691#comment-15012691 ] Nishkam Ravi commented on SPARK-11278: -- [~andrewor14] This was last tested on Nov 11

[jira] [Updated] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11842: -- Description: Small cleanups to existing Readers and Writers * Add {{repartition(1)}} to

[jira] [Updated] (SPARK-6791) Model export/import for spark.ml: CrossValidator

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6791: - Description: Updated to be for CrossValidator only (was: Algorithms: Pipeline, CrossValid

[jira] [Commented] (SPARK-11829) Model export/import for spark.ml: estimators under ml.feature (II)

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012676#comment-15012676 ] Xiangrui Meng commented on SPARK-11829: --- [~yanboliang] Could you help on this JIRA?

[jira] [Assigned] (SPARK-6791) Model export/import for spark.ml: CrossValidator

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-6791: Assignee: Joseph K. Bradley > Model export/import for spark.ml: CrossValidator > --

[jira] [Updated] (SPARK-11829) Model export/import for spark.ml: estimators under ml.feature (II)

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11829: -- Description: Add read/write support to the following estimators and models under spark.ml: * C

[jira] [Updated] (SPARK-6791) Model export/import for spark.ml: CrossValidator

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6791: - Summary: Model export/import for spark.ml: CrossValidator (was: Model export/import for s

[jira] [Resolved] (SPARK-11816) fix some style issue in ML/MLlib examples

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11816. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9808 [https://gi

[jira] [Updated] (SPARK-11816) fix some style issue in ML/MLlib examples

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11816: -- Target Version/s: 1.6.0 Component/s: Documentation > fix some style issue in ML/MLlib

[jira] [Updated] (SPARK-11816) fix some style issue in ML/MLlib examples

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11816: -- Assignee: yuhao yang > fix some style issue in ML/MLlib examples >

[jira] [Updated] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11842: -- Target Version/s: 1.6.0 > Cleanups to existing Readers and Writers > --

[jira] [Commented] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012667#comment-15012667 ] Apache Spark commented on SPARK-11842: -- User 'jkbradley' has created a pull request

[jira] [Updated] (SPARK-11835) Add a menu to the documentation of MLlib

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11835: -- Component/s: Documentation > Add a menu to the documentation of MLlib > ---

[jira] [Updated] (SPARK-11835) Add a menu to the documentation of MLlib

2015-11-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11835: -- Assignee: Tim Hunter > Add a menu to the documentation of MLlib > -

[jira] [Resolved] (SPARK-11787) Speed up parquet reader for flat schemas

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11787. - Resolution: Fixed Assignee: Nong Li Fix Version/s: 1.6.0 > Speed up parquet reade

[jira] [Updated] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11842: -- Description: Small cleanups to existing Readers and Writers * Add {{repartition(1)}} to

[jira] [Resolved] (SPARK-11839) Renames traits to avoid collision with java.util.* and add use default traits to simplify the impl

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11839. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9827 [ht

[jira] [Resolved] (SPARK-11833) Add Java tests for Kryo/Java encoders

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11833. - Resolution: Fixed Fix Version/s: 1.6.0 > Add Java tests for Kryo/Java encoders > -

[jira] [Commented] (SPARK-9761) Inconsistent metadata handling with ALTER TABLE

2015-11-18 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012655#comment-15012655 ] Xin Wu commented on SPARK-9761: --- One thing I notice is that if I create the table explicitly

[jira] [Comment Edited] (SPARK-9761) Inconsistent metadata handling with ALTER TABLE

2015-11-18 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012655#comment-15012655 ] Xin Wu edited comment on SPARK-9761 at 11/19/15 2:31 AM: - One thin

[jira] [Commented] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012653#comment-15012653 ] Marcelo Vanzin commented on SPARK-11843: Client.scala appends the application ID

[jira] [Created] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

2015-11-18 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11843: - Summary: Isolate staging directory across applications on same YARN cluster Key: SPARK-11843 URL: https://issues.apache.org/jira/browse/SPARK-11843 Project: Spark

[jira] [Commented] (SPARK-7286) Precedence of operator not behaving properly

2015-11-18 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012643#comment-15012643 ] Jakob Odersky commented on SPARK-7286: -- Going through the code, I saw that catalyst a

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

2015-11-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012638#comment-15012638 ] Andrew Or commented on SPARK-11278: --- also, when you said 6 nodes what kind of nodes are

[jira] [Assigned] (SPARK-11278) PageRank fails with unified memory manager

2015-11-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-11278: - Assignee: Andrew Or > PageRank fails with unified memory manager > -

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

2015-11-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012632#comment-15012632 ] Andrew Or commented on SPARK-11278: --- [~nravi] can you try again with the latest 1.6 bra

[jira] [Created] (SPARK-11842) Cleanups to existing Readers and Writers

2015-11-18 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11842: - Summary: Cleanups to existing Readers and Writers Key: SPARK-11842 URL: https://issues.apache.org/jira/browse/SPARK-11842 Project: Spark Issue Type

[jira] [Commented] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

2015-11-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012618#comment-15012618 ] Josh Rosen commented on SPARK-11649: [~vanzin], we actually _did_ see this fail in th

[jira] [Created] (SPARK-11841) None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document

2015-11-18 Thread Xiangyu Li (JIRA)
Xiangyu Li created SPARK-11841: -- Summary: None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document Key: SPARK-11841 URL: https://issues.apache.org/jira/bro

[jira] [Assigned] (SPARK-11840) Restore the 1.5's behavior of planning a single distinct aggregation.

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11840: Assignee: Apache Spark (was: Yin Huai) > Restore the 1.5's behavior of planning a single

[jira] [Assigned] (SPARK-11840) Restore the 1.5's behavior of planning a single distinct aggregation.

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11840: Assignee: Yin Huai (was: Apache Spark) > Restore the 1.5's behavior of planning a single

[jira] [Commented] (SPARK-11840) Restore the 1.5's behavior of planning a single distinct aggregation.

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012607#comment-15012607 ] Apache Spark commented on SPARK-11840: -- User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-11840) Restore the 1.5's behavior of planning a single distinct aggregation.

2015-11-18 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11840: Summary: Restore the 1.5's behavior of planning a single distinct aggregation. Key: SPARK-11840 URL: https://issues.apache.org/jira/browse/SPARK-11840 Project: Spark

[jira] [Commented] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

2015-11-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012601#comment-15012601 ] Andrew Or commented on SPARK-11649: --- I back ported it into 1.5. > "SparkListenerSuite.

  1   2   3   4   5   >