[jira] [Assigned] (SPARK-8698) partitionBy in Python DataFrame reader/writer interface should not default to empty tuple

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8698: --- Assignee: Apache Spark (was: Reynold Xin) > partitionBy in Python DataFrame reader/writer in

[jira] [Assigned] (SPARK-8698) partitionBy in Python DataFrame reader/writer interface should not default to empty tuple

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8698: --- Assignee: Reynold Xin (was: Apache Spark) > partitionBy in Python DataFrame reader/writer in

[jira] [Commented] (SPARK-8698) partitionBy in Python DataFrame reader/writer interface should not default to empty tuple

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605203#comment-14605203 ] Apache Spark commented on SPARK-8698: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8698) partitionBy in Python DataFrame reader/writer interface should not default to empty tuple

2015-06-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8698: -- Summary: partitionBy in Python DataFrame reader/writer interface should not default to empty tuple Key: SPARK-8698 URL: https://issues.apache.org/jira/browse/SPARK-8698 P

[jira] [Commented] (SPARK-5571) LDA should handle text as well

2015-06-28 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605200#comment-14605200 ] Alok Singh commented on SPARK-5571: --- Just wanted to get more clarification on this. Does

[jira] [Assigned] (SPARK-8355) Python DataFrameReader/Writer should mirror scala

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8355: --- Assignee: (was: Apache Spark) > Python DataFrameReader/Writer should mirror scala > -

[jira] [Commented] (SPARK-8355) Python DataFrameReader/Writer should mirror scala

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605185#comment-14605185 ] Apache Spark commented on SPARK-8355: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-8355) Python DataFrameReader/Writer should mirror scala

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8355: --- Assignee: Apache Spark > Python DataFrameReader/Writer should mirror scala >

[jira] [Updated] (SPARK-5562) LDA should handle empty documents

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5562: - Shepherd: Joseph K. Bradley > LDA should handle empty documents >

[jira] [Commented] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver => NPE

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605177#comment-14605177 ] Apache Spark commented on SPARK-8592: - User 'xuchenCN' has created a pull request for

[jira] [Assigned] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver => NPE

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8592: --- Assignee: (was: Apache Spark) > CoarseGrainedExecutorBackend: Cannot register with driver

[jira] [Assigned] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver => NPE

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8592: --- Assignee: Apache Spark > CoarseGrainedExecutorBackend: Cannot register with driver => NPE > -

[jira] [Created] (SPARK-8697) MatchIterator not serializable exception in RegexTokeinzer

2015-06-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8697: Summary: MatchIterator not serializable exception in RegexTokeinzer Key: SPARK-8697 URL: https://issues.apache.org/jira/browse/SPARK-8697 Project: Spark Issu

[jira] [Updated] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7739: - Target Version/s: 1.5.0 > Improve ChiSqSelector example code in the user guide > -

[jira] [Created] (SPARK-8696) StreamingLDA

2015-06-28 Thread yuhao yang (JIRA)
yuhao yang created SPARK-8696: - Summary: StreamingLDA Key: SPARK-8696 URL: https://issues.apache.org/jira/browse/SPARK-8696 Project: Spark Issue Type: New Feature Components: MLlib

[jira] [Updated] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7739: - Assignee: Seth Hendrickson > Improve ChiSqSelector example code in the user guide > --

[jira] [Resolved] (SPARK-8575) Deprecate callUDF in favor of udf

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8575. -- Resolution: Fixed Issue resolved by pull request 6993 [https://github.com/apache/spark/pull/6993

[jira] [Resolved] (SPARK-5962) [MLLIB] Python support for Power Iteration Clustering

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5962. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6992 [https://githu

[jira] [Resolved] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7212. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6997 [https://githu

[jira] [Updated] (SPARK-8695) TreeAggregation shouldn't be triggered for 5 partitions

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8695: - Priority: Minor (was: Major) > TreeAggregation shouldn't be triggered for 5 partitions >

[jira] [Created] (SPARK-8695) TreeAggregation shouldn't be triggered for 5 partitions

2015-06-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8695: Summary: TreeAggregation shouldn't be triggered for 5 partitions Key: SPARK-8695 URL: https://issues.apache.org/jira/browse/SPARK-8695 Project: Spark Issue T

[jira] [Commented] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-06-28 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605126#comment-14605126 ] Carson Wang commented on SPARK-8405: Thank you very much, [~hshreedharan] After I conf

[jira] [Assigned] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8694: --- Assignee: (was: Apache Spark) > Defer executing drawTaskAssignmentTimeline until page loa

[jira] [Commented] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605123#comment-14605123 ] Apache Spark commented on SPARK-8694: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8694: --- Assignee: Apache Spark > Defer executing drawTaskAssignmentTimeline until page loaded to avoi

[jira] [Commented] (SPARK-8374) Job frequently hangs after YARN preemption

2015-06-28 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605117#comment-14605117 ] Shay Rojansky commented on SPARK-8374: -- Any chance someone can look at this bug, at l

[jira] [Created] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-8694: - Summary: Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page Key: SPARK-8694 URL: https://issues.apache.org/jira/browse/SPARK-8694

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-28 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605112#comment-14605112 ] Animesh Baranawal commented on SPARK-8636: -- No a row with null will not be equal

[jira] [Comment Edited] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-06-28 Thread Gergely Svigruha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605078#comment-14605078 ] Gergely Svigruha edited comment on SPARK-8616 at 6/29/15 3:43 AM: --

[jira] [Commented] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-06-28 Thread Gergely Svigruha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605078#comment-14605078 ] Gergely Svigruha commented on SPARK-8616: - FYI, MYSQL may allow double quotes if t

[jira] [Commented] (SPARK-8651) Lasso with SGD not Converging properly

2015-06-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605056#comment-14605056 ] yuhao yang commented on SPARK-8651: --- [~aazout] I know someone met the similar issue. Usu

[jira] [Updated] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7845: Fix Version/s: 1.5.0 > Bump "Hadoop 1" tests to version 1.2.1 > -- > >

[jira] [Resolved] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7845. - Resolution: Fixed Assignee: Cheng Lian (was: Yin Huai) Target Version/s: 1.4.0, 1.5.

[jira] [Commented] (SPARK-8693) profiles and goals are not printed in a nice way

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605044#comment-14605044 ] Yin Huai commented on SPARK-8693: - [~boyork] Can you take a look at it when you get time?

[jira] [Created] (SPARK-8693) profiles and goals are not printed in a nice way

2015-06-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8693: --- Summary: profiles and goals are not printed in a nice way Key: SPARK-8693 URL: https://issues.apache.org/jira/browse/SPARK-8693 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8443: --- Assignee: Apache Spark > GenerateMutableProjection Exceeds JVM Code Size Limits > ---

[jira] [Assigned] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8443: --- Assignee: (was: Apache Spark) > GenerateMutableProjection Exceeds JVM Code Size Limits >

[jira] [Commented] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605028#comment-14605028 ] Apache Spark commented on SPARK-8443: - User 'saurfang' has created a pull request for

[jira] [Updated] (SPARK-8692) re-order the case statements that handling catalyst data types

2015-06-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8692: -- Shepherd: Cheng Lian > re-order the case statements that handling catalyst data types > ---

[jira] [Closed] (SPARK-8424) Add blacklist mechanism for task scheduler and Yarn container allocation

2015-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-8424. -- Resolution: Duplicate > Add blacklist mechanism for task scheduler and Yarn container allocation > -

[jira] [Commented] (SPARK-8424) Add blacklist mechanism for task scheduler and Yarn container allocation

2015-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605001#comment-14605001 ] Saisai Shao commented on SPARK-8424: OK, I will close this JIRA. > Add blacklist mech

[jira] [Updated] (SPARK-8692) re-order the case statements that handling catalyst data types

2015-06-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8692: --- Summary: re-order the case statements that handling catalyst data types (was: refactor the handling

[jira] [Updated] (SPARK-8692) refactor the handling of date and timestamp

2015-06-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8692: --- Summary: refactor the handling of date and timestamp (was: improve date and timestamp handling) > re

[jira] [Commented] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

2015-06-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604935#comment-14604935 ] koert kuipers commented on SPARK-8577: -- i do not have a way to reproduce this in non-

[jira] [Updated] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8677: -- Assignee: Liang-Chi Hsieh > Decimal divide operation throws ArithmeticException > --

[jira] [Resolved] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8677. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7056 [https://github.com/

[jira] [Assigned] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8674: --- Assignee: Apache Spark > 2-sample, 2-sided Kolmogorov Smirnov Test Implementation > -

[jira] [Assigned] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8674: --- Assignee: (was: Apache Spark) > 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

[jira] [Commented] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604898#comment-14604898 ] Apache Spark commented on SPARK-8674: - User 'josepablocam' has created a pull request

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604897#comment-14604897 ] Shivaram Venkataraman commented on SPARK-8596: -- Merged https://github.com/apa

[jira] [Assigned] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7894: --- Assignee: Apache Spark > Graph Union Operator > > > Key:

[jira] [Assigned] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7894: --- Assignee: (was: Apache Spark) > Graph Union Operator > > >

[jira] [Commented] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604830#comment-14604830 ] Apache Spark commented on SPARK-7894: - User 'arnabguin' has created a pull request for

[jira] [Comment Edited] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá edited comment on SPARK-8337 at 6/28/15 6:16 PM:

[jira] [Assigned] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8692: --- Assignee: (was: Apache Spark) > improve date and timestamp handling > ---

[jira] [Commented] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604773#comment-14604773 ] Apache Spark commented on SPARK-8692: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8692: --- Assignee: Apache Spark > improve date and timestamp handling > --

[jira] [Created] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8692: -- Summary: improve date and timestamp handling Key: SPARK-8692 URL: https://issues.apache.org/jira/browse/SPARK-8692 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-8645) Incorrect expression analysis with Hive

2015-06-28 Thread Eugene Zhulenev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Zhulenev closed SPARK-8645. -- Resolution: Won't Fix > Incorrect expression analysis with Hive > --

[jira] [Assigned] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8691: --- Assignee: Apache Spark > Enable GZip for Web UI > -- > >

[jira] [Commented] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604733#comment-14604733 ] Apache Spark commented on SPARK-8691: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8691: --- Assignee: (was: Apache Spark) > Enable GZip for Web UI > -- > >

[jira] [Resolved] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8686. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7063 [https://github.com/

[jira] [Created] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8691: --- Summary: Enable GZip for Web UI Key: SPARK-8691 URL: https://issues.apache.org/jira/browse/SPARK-8691 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604724#comment-14604724 ] Davies Liu commented on SPARK-8636: --- [~animeshbaranawal] What happen if there is null in

[jira] [Assigned] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2017: --- Assignee: (was: Apache Spark) > web ui stage page becomes unresponsive when the number of

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604723#comment-14604723 ] Apache Spark commented on SPARK-2017: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2017: --- Assignee: Apache Spark > web ui stage page becomes unresponsive when the number of tasks is l

[jira] [Resolved] (SPARK-8610) Separate Row and InternalRow (part 2)

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8610. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7003 [https://github.com/

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604642#comment-14604642 ] Vincent Warmerdam commented on SPARK-8684: -- I have an initial commit that I would

[jira] [Comment Edited] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam edited comment on SPARK-8684 at 6/28/15 11:26 AM:

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I have worked a bit o

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-06-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604632#comment-14604632 ] Littlestar commented on SPARK-5281: --- Does this patch merge to spark 1.3 branch, thanks.

[jira] [Commented] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604631#comment-14604631 ] Apache Spark commented on SPARK-8690: - User 'thegiive' has created a pull request for

[jira] [Assigned] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8690: --- Assignee: (was: Apache Spark) > Add a setting to disable SparkSQL parquet schema merge by

[jira] [Assigned] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8690: --- Assignee: Apache Spark > Add a setting to disable SparkSQL parquet schema merge by using data

[jira] [Created] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread thegiive (JIRA)
thegiive created SPARK-8690: --- Summary: Add a setting to disable SparkSQL parquet schema merge by using datasource API Key: SPARK-8690 URL: https://issues.apache.org/jira/browse/SPARK-8690 Project: Spark

[jira] [Updated] (SPARK-8679) remove dummy java class BaseRow and BaseMutableRow

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8679: - Priority: Minor (was: Major) Component/s: SQL Issue Type: Improvement (was: Bug) [~cloud_fan

[jira] [Updated] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8680: - Component/s: SQL > PropagateTypes is very slow when there are lots of columns > --

[jira] [Updated] (SPARK-8645) Incorrect expression analysis with Hive

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8645: - Component/s: SQL Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark Set

[jira] [Updated] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8635: - Assignee: Wenchen Fan > improve performance of CatalystTypeConverters > --

[jira] [Updated] (SPARK-8237) misc function: sha2

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8237: - Assignee: Liang-Chi Hsieh > misc function: sha2 > --- > > Key: SPARK-8237

[jira] [Updated] (SPARK-7088) [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7088: - Assignee: Santiago M. Mola > [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans > -

[jira] [Updated] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6777: - Assignee: Cheng Lian > Implement backwards-compatibility rules in Parquet schema converters >

[jira] [Commented] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604619#comment-14604619 ] Sean Owen commented on SPARK-6777: -- [~lian cheng] can you please assign JIRAs when you re

[jira] [Updated] (SPARK-5482) Allow individual test suites in python/run-tests

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5482: - Assignee: Josh Rosen > Allow individual test suites in python/run-tests >

[jira] [Updated] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8603: - Target Version/s: (was: 1.4.0) Fix Version/s: (was: 1.4.0) [~Prakashpc] Before opening a JIRA

[jira] [Assigned] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8688: --- Assignee: (was: Apache Spark) > Hadoop Configuration has to disable client cache when wri

[jira] [Commented] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604613#comment-14604613 ] Apache Spark commented on SPARK-8688: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8688: --- Assignee: Apache Spark > Hadoop Configuration has to disable client cache when writing or rea

[jira] [Comment Edited] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam edited comment on SPARK-8684 at 6/28/15 9:52 AM: -

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam commented on SPARK-8684: -- I'll double check. I've done this bef

[jira] [Assigned] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8596: --- Assignee: (was: Apache Spark) > Install and configure RStudio server on Spark EC2 > -

[jira] [Assigned] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8596: --- Assignee: Apache Spark > Install and configure RStudio server on Spark EC2 >

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604588#comment-14604588 ] Apache Spark commented on SPARK-8596: - User 'koaning' has created a pull request for t

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604587#comment-14604587 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/28/15 8:49 AM: -

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604587#comment-14604587 ] Vincent Warmerdam commented on SPARK-8596: -- 1. on it. > Install and configure

[jira] [Assigned] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8689: --- Assignee: (was: Apache Spark) > Add get* methods with fieldName to Row >

[jira] [Commented] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604586#comment-14604586 ] Apache Spark commented on SPARK-8689: - User 'sarutak' has created a pull request for t

[jira] [Assigned] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8689: --- Assignee: Apache Spark > Add get* methods with fieldName to Row > ---

  1   2   >