[jira] [Commented] (SPARK-10924) Failed to update accumulators for ShuffleMapTask: Broken pipe

2017-01-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837778#comment-15837778 ] Pau Tallada Crespí commented on SPARK-10924: That would be difficult

[jira] [Commented] (SPARK-18891) Support for specific collection types

2017-02-06 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855011#comment-15855011 ] Michal Šenkýř commented on SPARK-18891: --- Thanks. Yes, I know about the Maps i

[jira] [Created] (SPARK-19510) org.codehaus.commons.compiler.CompileException: File 'generated.java', Line 44, Column 42: A method named "evaluate" is not declared in any enclosing class nor any super

2017-02-08 Thread JIRA
ough a static import Key: SPARK-19510 URL: https://issues.apache.org/jira/browse/SPARK-19510 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.1.0 Environment: spark 2.1 on yarn client hadoop 2.6.0 jdk 1.7 R

[jira] [Commented] (SPARK-19510) org.codehaus.commons.compiler.CompileException: File 'generated.java', Line 44, Column 42: A method named "evaluate" is not declared in any enclosing class nor any sup

2017-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857780#comment-15857780 ] 吴志龙 commented on SPARK-19510: - this is a example.because we have more SPARK

[jira] [Commented] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859795#comment-15859795 ] Christophe Préaud commented on SPARK-19477: --- As a workaround, mapping

[jira] [Comment Edited] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859795#comment-15859795 ] Christophe Préaud edited comment on SPARK-19477 at 2/9/17 4:5

[jira] [Comment Edited] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859795#comment-15859795 ] Christophe Préaud edited comment on SPARK-19477 at 2/9/17 5:0

[jira] [Issue Comment Deleted] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe Préaud updated SPARK-19477: -- Comment: was deleted (was: As a workaround, mapping the dataset with *identity* fix

[jira] [Comment Edited] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859795#comment-15859795 ] Christophe Préaud edited comment on SPARK-19477 at 2/9/17 5:0

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

2017-02-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867374#comment-15867374 ] Abel Rincón commented on SPARK-16742: - Hi all we are working on a solution

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

2017-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867916#comment-15867916 ] Abel Rincón commented on SPARK-16742: - Hi all, we recent push our new implementa

[jira] [Created] (SPARK-19625) Authorization Support(on all operations not only DDL) in Spark Sql version 2.1.0

2017-02-16 Thread JIRA
翟玉勇 created SPARK-19625: --- Summary: Authorization Support(on all operations not only DDL) in Spark Sql version 2.1.0 Key: SPARK-19625 URL: https://issues.apache.org/jira/browse/SPARK-19625 Project: Spark

[jira] [Commented] (SPARK-18891) Support for specific collection types

2017-02-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870570#comment-15870570 ] Michal Šenkýř commented on SPARK-18891: --- Started my work on Map support as t

[jira] [Commented] (SPARK-19625) Authorization Support(on all operations not only DDL) in Spark Sql version 2.1.0

2017-02-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871035#comment-15871035 ] 翟玉勇 commented on SPARK-19625: - for spark 1.5.2 has https://github.com/apache/spark/

[jira] [Created] (SPARK-19681) save and load pipeline and then use it yield java.lang.RuntimeException

2017-02-21 Thread JIRA
Boris Clémençon created SPARK-19681: Summary: save and load pipeline and then use it yield java.lang.RuntimeException Key: SPARK-19681 URL: https://issues.apache.org/jira/browse/SPARK-19681

[jira] [Closed] (SPARK-19681) save and load pipeline and then use it yield java.lang.RuntimeException

2017-02-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Clémençon closed SPARK-19681. Resolution: Fixed > save and load pipeline and then use it yi

[jira] [Commented] (SPARK-19681) save and load pipeline and then use it yield java.lang.RuntimeException

2017-02-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877033#comment-15877033 ] Boris Clémençon commented on SPARK-19681: -- EDIT: the problem i

[jira] [Created] (SPARK-19727) Spark SQL round function modifies original column

2017-02-24 Thread JIRA
Sławomir Bogutyn created SPARK-19727: Summary: Spark SQL round function modifies original column Key: SPARK-19727 URL: https://issues.apache.org/jira/browse/SPARK-19727 Project: Spark

[jira] [Created] (SPARK-19743) Exception when creating more than one implicit Encoder in REPL

2017-02-26 Thread JIRA
Maciej Bryński created SPARK-19743: -- Summary: Exception when creating more than one implicit Encoder in REPL Key: SPARK-19743 URL: https://issues.apache.org/jira/browse/SPARK-19743 Project: Spark

[jira] [Commented] (SPARK-19743) Exception when creating more than one implicit Encoder in REPL

2017-02-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884826#comment-15884826 ] Maciej Bryński commented on SPARK-19743: Possible solution could be to ch

[jira] [Updated] (SPARK-19743) Exception when creating more than one implicit Encoder in REPL

2017-02-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-19743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-19743: --- Component/s: (was: SQL) Spark Shell > Exception when creating more t

[jira] [Commented] (SPARK-25153) Improve error messages for columns with dots/periods

2018-09-10 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609061#comment-16609061 ] Fernando Díaz commented on SPARK-25153: --- I will take a look at it. Quick ques

[jira] [Created] (SPARK-25433) Add support for PEX in PySpark

2018-09-14 Thread JIRA
Fabian Höring created SPARK-25433: - Summary: Add support for PEX in PySpark Key: SPARK-25433 URL: https://issues.apache.org/jira/browse/SPARK-25433 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: This has been partly discussed in SPARK-13587 I would like to provision the

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: This has been partly discussed in SPARK-13587 I would like to provision the

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: This has been partly discussed in SPARK-13587 I would like to provision the

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: This has been partly discussed in SPARK-13587 I would like to provision the

[jira] [Issue Comment Deleted] (SPARK-25153) Improve error messages for columns with dots/periods

2018-09-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fernando Díaz updated SPARK-25153: -- Comment: was deleted (was: I will take a look at it. Quick question: Given a dataframe with

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617399#comment-16617399 ] Fabian Höring commented on SPARK-25433: --- [~hyukjin.kwon] I changed

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Comment Edited] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617399#comment-16617399 ] Fabian Höring edited comment on SPARK-25433 at 9/17/18 11:4

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Updated] (SPARK-25433) Add support for PEX in PySpark

2018-09-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated SPARK-25433: -- Description: The goal of this ticket is to ship and use custom code inside the spark

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

2018-09-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622327#comment-16622327 ] Fabian Höring commented on SPARK-25433: --- Actually it turns out this ca

[jira] [Commented] (SPARK-25511) Map with "null" key not working in spark 2.3

2018-09-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624642#comment-16624642 ] Michal Šenkýř commented on SPARK-25511: --- Null keys in MapType should have

[jira] [Commented] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

2018-09-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629321#comment-16629321 ] Michal Šenkýř commented on SPARK-17952: --- Implemented nested bean support in

[jira] [Created] (SPARK-25597) SQL query with limit iterates the whole iterator when WholeStage code generation is enabled

2018-10-02 Thread JIRA
Hannu Kröger created SPARK-25597: Summary: SQL query with limit iterates the whole iterator when WholeStage code generation is enabled Key: SPARK-25597 URL: https://issues.apache.org/jira/browse/SPARK-25597

[jira] [Updated] (SPARK-25597) SQL query with limit iterates the whole iterator when WholeStage code generation is enabled

2018-10-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannu Kröger updated SPARK-25597: - Description: When _SELECT * FROM table LIMIT 1_ is executed, the WholeStageCodegenExec

[jira] [Resolved] (SPARK-25597) SQL query with limit iterates the whole iterator when WholeStage code generation is enabled

2018-10-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannu Kröger resolved SPARK-25597. -- Resolution: Duplicate > SQL query with limit iterates the whole iterator when WholeStage c

[jira] [Commented] (SPARK-25497) limit operation within whole stage codegen should not consume all the inputs

2018-10-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635443#comment-16635443 ] Hannu Kröger commented on SPARK-25497: -- Note: This also affects 2.3.0. >

[jira] [Created] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
Maciej Bryński created SPARK-25652: -- Summary: Wrong datetime conversion between Java and Python Key: SPARK-25652 URL: https://issues.apache.org/jira/browse/SPARK-25652 Project: Spark Issue

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of

[jira] [Created] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

2018-10-05 Thread JIRA
Michal Šenkýř created SPARK-25654: - Summary: createDataFrame does not support nested JavaBeans inside arrays and collections Key: SPARK-25654 URL: https://issues.apache.org/jira/browse/SPARK-25654

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640239#comment-16640239 ] Michal Šenkýř commented on SPARK-25654: --- Nested JavaBean sup

[jira] [Issue Comment Deleted] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Šenkýř updated SPARK-25654: -- Comment: was deleted (was: Nested JavaBean support) > createDataFrame does not supp

[jira] [Commented] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640283#comment-16640283 ] Michal Šenkýř commented on SPARK-17952: --- Created a new issue and PR for ar

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński commented on SPARK-25652: [~hyukjin.kwon] Sorry for late an

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:1

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:1

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647364#comment-16647364 ] Maciej Bryński commented on SPARK-25652: The fold is added by Spark

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647364#comment-16647364 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:1

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647368#comment-16647368 ] Maciej Bryński commented on SPARK-25652: Exaclly. > Wrong datetime con

[jira] [Created] (SPARK-25787) [K8S] Spark can't use data locality information

2018-10-20 Thread JIRA
Maciej Bryński created SPARK-25787: -- Summary: [K8S] Spark can't use data locality information Key: SPARK-25787 URL: https://issues.apache.org/jira/browse/SPARK-25787 Project: Spark

[jira] [Commented] (SPARK-25787) [K8S] Spark can't use data locality information

2018-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657865#comment-16657865 ] Maciej Bryński commented on SPARK-25787: [~kimoonkim] Could you help ? &g

[jira] [Updated] (SPARK-25787) [K8S] Spark can't use data locality information

2018-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25787: --- Description: I started experimenting with Spark based on this presentation: https

[jira] [Commented] (SPARK-25787) [K8S] Spark can't use data locality information

2018-10-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658608#comment-16658608 ] Maciej Bryński commented on SPARK-25787: [~hyukjin.kwon] I think i

[jira] [Created] (SPARK-25799) DataSourceApiV2 scan reuse does not respect options

2018-10-22 Thread JIRA
Max Kießling created SPARK-25799: Summary: DataSourceApiV2 scan reuse does not respect options Key: SPARK-25799 URL: https://issues.apache.org/jira/browse/SPARK-25799 Project: Spark Issue

[jira] [Commented] (SPARK-17469) mapWithState causes block lock warning

2016-09-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486668#comment-15486668 ] Christopher Mårtensson commented on SPARK-17469: nc -lk 1234 &

[jira] [Updated] (SPARK-17469) mapWithState causes block lock warning

2016-09-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Mårtensson updated SPARK-17469: --- Description: run-example with StatefulNetworkWordCount ( for example {{nc

[jira] [Updated] (SPARK-17469) mapWithState causes block lock warning

2016-09-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Mårtensson updated SPARK-17469: --- Description: run-example with StatefulNetworkWordCount ( for example {{nc

[jira] [Commented] (SPARK-10816) API design: window and session specification

2016-09-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488035#comment-15488035 ] Maciej Bryński commented on SPARK-10816: Hi, Any updates on Session Wi

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

2016-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490657#comment-15490657 ] Abel Rincón commented on SPARK-16742: - We at Stratio are working on this i

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491107#comment-15491107 ] Maciej Bryński commented on SPARK-16534: [~rxin] Could you explain your deci

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-09-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495496#comment-15495496 ] Maciej Bryński commented on SPARK-16534: [~rxin] I understand your point of

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548438#comment-15548438 ] Maciej Bryński commented on SPARK-17707: I have similar problem with S

[jira] [Updated] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-17707: --- Affects Version/s: 2.0.1 > Web UI prevents spark-submit application to be finis

[jira] [Comment Edited] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548438#comment-15548438 ] Maciej Bryński edited comment on SPARK-17707 at 10/5/16 11:3

[jira] [Created] (SPARK-17786) [SPARK 2.0] Sorting algorithm gives higher skewness of output

2016-10-05 Thread JIRA
Maciej Bryński created SPARK-17786: -- Summary: [SPARK 2.0] Sorting algorithm gives higher skewness of output Key: SPARK-17786 URL: https://issues.apache.org/jira/browse/SPARK-17786 Project: Spark

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548785#comment-15548785 ] Maciej Bryński commented on SPARK-17707: I did some tests. {code} mbry

[jira] [Comment Edited] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548785#comment-15548785 ] Maciej Bryński edited comment on SPARK-17707 at 10/5/16 1:5

[jira] [Comment Edited] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548785#comment-15548785 ] Maciej Bryński edited comment on SPARK-17707 at 10/5/16 1:5

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548808#comment-15548808 ] Maciej Bryński commented on SPARK-17707: Ad 3) Output from kill -QUIT after

[jira] [Comment Edited] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548785#comment-15548785 ] Maciej Bryński edited comment on SPARK-17707 at 10/5/16 2:0

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548938#comment-15548938 ] Maciej Bryński commented on SPARK-17707: I understand. But Spark 1.6 w

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549016#comment-15549016 ] Maciej Bryński commented on SPARK-17707: Maybe It's connected with t

[jira] [Comment Edited] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549016#comment-15549016 ] Maciej Bryński edited comment on SPARK-17707 at 10/5/16 3:0

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549146#comment-15549146 ] Maciej Bryński commented on SPARK-17707: At the end of submitted python sc

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549200#comment-15549200 ] Maciej Bryński commented on SPARK-17707: Maybe this could help.

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549227#comment-15549227 ] Maciej Bryński commented on SPARK-17707: I think so. There is DestroyJa

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549310#comment-15549310 ] Maciej Bryński commented on SPARK-17707: Tested. setStopAtShutdown(true) doe

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-06 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15551190#comment-15551190 ] Maciej Bryński commented on SPARK-17707: I reverted this PR. https://github

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-06 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15551261#comment-15551261 ] Maciej Bryński commented on SPARK-17707: And wasn't needed before Spa

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-06 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15551278#comment-15551278 ] Maciej Bryński commented on SPARK-17707: For python code I have workaround

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-10-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554651#comment-15554651 ] Maciej Bryński commented on SPARK-17707: [~srowen] I tested your branch an

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2016-10-10 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561958#comment-15561958 ] Michael Schmeißer commented on SPARK-650: - To mee, the two seem related, but

[jira] [Comment Edited] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2016-10-10 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561958#comment-15561958 ] Michael Schmeißer edited comment on SPARK-650 at 10/10/16 10:5

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2016-10-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578289#comment-15578289 ] Michael Schmeißer commented on SPARK-650: - I disagree that those issues

[jira] [Commented] (SPARK-636) Add mechanism to run system management/configuration tasks on all workers

2016-10-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578294#comment-15578294 ] Michael Schmeißer commented on SPARK-636: - I agree, that's why I also

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2016-10-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578361#comment-15578361 ] Michael Schmeißer commented on SPARK-650: - Then somebody should please explai

<    2   3   4   5   6   7   8   9   10   11   >