[jira] [Commented] (SPARK-16588) Missed API fix for a function name mismatched between FunctionRegistry and functions.scala

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381152#comment-15381152 ] Reynold Xin commented on SPARK-16588: - Yes we should deprecate the monotonicallyIncre

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381149#comment-15381149 ] Reynold Xin commented on SPARK-16452: - Go ahead. Thanks. > basic INFORMATION_SCHEMA

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381148#comment-15381148 ] Dongjoon Hyun commented on SPARK-16452: --- Oh, may I close SPARK-16492 as INVALID or

[jira] [Resolved] (SPARK-16584) Move regexp unit tests to RegexpExpressionsSuite

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16584. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Move regexp unit tests t

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381144#comment-15381144 ] Reynold Xin commented on SPARK-16452: - It is OK for temporary views that are defined

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381089#comment-15381089 ] Joseph K. Bradley commented on SPARK-15124: --- OK thanks! > R 2.0 QA: New R APIs

[jira] [Updated] (SPARK-15232) Add subquery SQL building tests to LogicalPlanToSQLSuite

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15232: Assignee: (was: Herman van Hovell) > Add subquery SQL building tests to LogicalPlanToSQLSuite >

[jira] [Updated] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16590: Assignee: Dongjoon Hyun > Improve LogicalPlanToSQLSuite to check generated SQL directly > -

[jira] [Updated] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16590: Issue Type: Sub-task (was: Improvement) Parent: SPARK-16576 > Improve LogicalPlanToSQLSuit

[jira] [Commented] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381036#comment-15381036 ] Dongjoon Hyun commented on SPARK-16590: --- [~rxin] I think we had better have stronge

[jira] [Assigned] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16590: Assignee: Apache Spark > Improve LogicalPlanToSQLSuite to check generated SQL directly > -

[jira] [Updated] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16590: -- Component/s: Tests > Improve LogicalPlanToSQLSuite to check generated SQL directly > --

[jira] [Assigned] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16590: Assignee: (was: Apache Spark) > Improve LogicalPlanToSQLSuite to check generated SQL d

[jira] [Commented] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381034#comment-15381034 ] Apache Spark commented on SPARK-16590: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16590: -- Description: This issue improves `LogicalPlanToSQLSuite` to check the generated SQL directly b

[jira] [Created] (SPARK-16590) Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-16 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16590: - Summary: Improve LogicalPlanToSQLSuite to check generated SQL directly Key: SPARK-16590 URL: https://issues.apache.org/jira/browse/SPARK-16590 Project: Spark

[jira] [Assigned] (SPARK-16507) Add CRAN checks to SparkR

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-16507: - Assignee: Shivaram Venkataraman (was: Apache Spark) > Add CRAN checks t

[jira] [Resolved] (SPARK-16507) Add CRAN checks to SparkR

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16507. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Resolved] (SPARK-16112) R programming guide update for gapply and gapplyCollect

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16112. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16112) R programming guide update for gapply and gapplyCollect

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16112: -- Assignee: Narine Kokhlikyan > R programming guide update for gapply and gapplyC

[jira] [Created] (SPARK-16589) Chained cartesian produces incorrect number of records

2016-07-16 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-16589: -- Summary: Chained cartesian produces incorrect number of records Key: SPARK-16589 URL: https://issues.apache.org/jira/browse/SPARK-16589 Project: Spark

[jira] [Resolved] (SPARK-16582) Explicitly define isNull = false for non-nullable expressions

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16582. - Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.0.1 > Explicitly defi

[jira] [Updated] (SPARK-16582) Explicitly define isNull = false for non-nullable expressions

2016-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16582: Fix Version/s: 2.1.0 > Explicitly define isNull = false for non-nullable expressions >

[jira] [Updated] (SPARK-16332) the history server of spark2.0-preview (may-24 build) consumes more than 1000% cpu

2016-07-16 Thread Peter Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Liu updated SPARK-16332: -- Attachment: graycol.gif Hi Sean, I have a general question: Is there a limit for reporting issues?

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-16 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380846#comment-15380846 ] Shea Parkes commented on SPARK-12261: - I believe I'm hitting the same bug. I'm also

[jira] [Commented] (SPARK-16490) Python mllib example for chi-squared feature selector

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380818#comment-15380818 ] Apache Spark commented on SPARK-16490: -- User 'rubenjanssen' has created a pull reque

[jira] [Assigned] (SPARK-16490) Python mllib example for chi-squared feature selector

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16490: Assignee: Apache Spark > Python mllib example for chi-squared feature selector > -

[jira] [Assigned] (SPARK-16490) Python mllib example for chi-squared feature selector

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16490: Assignee: (was: Apache Spark) > Python mllib example for chi-squared feature selector

[jira] [Commented] (SPARK-16588) Missed API fix for a function name mismatched between FunctionRegistry and functions.scala

2016-07-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380685#comment-15380685 ] Hyukjin Kwon commented on SPARK-16588: -- [~rxin] Should we deprecate or remove this f

[jira] [Created] (SPARK-16588) Missed API fix for a function name mismatched between FunctionRegistry and functions.scala

2016-07-16 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-16588: Summary: Missed API fix for a function name mismatched between FunctionRegistry and functions.scala Key: SPARK-16588 URL: https://issues.apache.org/jira/browse/SPARK-16588

[jira] [Comment Edited] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2016-07-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380653#comment-15380653 ] Michał Wesołowski edited comment on SPARK-5484 at 7/16/16 9:34 AM: -

[jira] [Comment Edited] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2016-07-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380653#comment-15380653 ] Michał Wesołowski edited comment on SPARK-5484 at 7/16/16 9:33 AM: -

[jira] [Commented] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2016-07-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380653#comment-15380653 ] Michał Wesołowski commented on SPARK-5484: -- [~ankurd] do you plan to prepare anot

[jira] [Assigned] (SPARK-16587) The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages.

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16587: Assignee: Apache Spark > The annotation for the abstract Class 'BlockTransferMessage' miss

[jira] [Assigned] (SPARK-16587) The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages.

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16587: Assignee: (was: Apache Spark) > The annotation for the abstract Class 'BlockTransferMe

[jira] [Commented] (SPARK-16587) The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages.

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380650#comment-15380650 ] Apache Spark commented on SPARK-16587: -- User 'f7753' has created a pull request for

[jira] [Updated] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16586: -- Description: When trying to run spark on a machine that cannot provide enough memory for java to use,

[jira] [Updated] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16586: -- Description: When trying to run spark on a machine that cannot provide enough memory for java to use,

[jira] [Assigned] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16586: Assignee: (was: Apache Spark) > spark-class crash with "[: too many arguments" instead

[jira] [Assigned] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16586: Assignee: Apache Spark > spark-class crash with "[: too many arguments" instead of display

[jira] [Commented] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380643#comment-15380643 ] Apache Spark commented on SPARK-16586: -- User 'zasdfgbnm' has created a pull request

[jira] [Updated] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16586: -- Priority: Minor (was: Major) Can you give an example? > spark-class crash with "[: too many argument

[jira] [Updated] (SPARK-16587) The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages.

2016-07-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16587: -- Priority: Trivial (was: Major) OK, open a pull request > The annotation for the abstract Class 'Block

[jira] [Created] (SPARK-16587) The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages.

2016-07-16 Thread Biao Ma (JIRA)
Biao Ma created SPARK-16587: --- Summary: The annotation for the abstract Class 'BlockTransferMessage' missing several kind of messages. Key: SPARK-16587 URL: https://issues.apache.org/jira/browse/SPARK-16587

[jira] [Created] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-16586: - Summary: spark-class crash with "[: too many arguments" instead of displaying the correct error message Key: SPARK-16586 URL: https://issues.apache.org/jira/browse/SPARK-16586

[jira] [Created] (SPARK-16585) Update inner fields of complex types in dataframes

2016-07-16 Thread Naveen Kumar (JIRA)
Naveen Kumar created SPARK-16585: Summary: Update inner fields of complex types in dataframes Key: SPARK-16585 URL: https://issues.apache.org/jira/browse/SPARK-16585 Project: Spark Issue Type

[jira] [Commented] (SPARK-16574) Distribute computing to each node based on certain hints

2016-07-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380607#comment-15380607 ] Sean Owen commented on SPARK-16574: --- You can guarantee it with a partitioner. Beyond th