[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15580055#comment-15580055 ] Michael Schmeißer commented on SPARK-650: - Ok, let me explain the spec

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15580069#comment-15580069 ] Michael Schmeißer commented on SPARK-650: - But I'll need to have an RDD t

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15580502#comment-15580502 ] Michael Schmeißer commented on SPARK-650: - What if I have a Hadoop InputFo

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581971#comment-15581971 ] Michael Schmeißer commented on SPARK-650: - I agree that static initializa

[jira] [Created] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

Maciej Bryński created SPARK-18022: -- Summary: java.lang.NullPointerException instead of real exception when saving DF to MySQL Key: SPARK-18022 URL: https://issues.apache.org/jira/browse/SPARK-18022

[jira] [Commented] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354248#comment-16354248 ] Márcio Furlani Carmona commented on SPARK-23308: Yeah, I set it bac

[jira] [Commented] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354250#comment-16354250 ] Márcio Furlani Carmona commented on SPARK-23308: Yeah, I set it bac

[jira] [Issue Comment Deleted] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márcio Furlani Carmona updated SPARK-23308: --- Comment: was deleted (was: Yeah, I set it back to `ignoreCorruptFiles=false

[jira] [Created] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

吴志龙 created SPARK-23346: --- Summary: Failed tasks reported as success if the failure reason is not ExceptionFailure Key: SPARK-23346 URL: https://issues.apache.org/jira/browse/SPARK-23346 Project: Spark

[jira] [Updated] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-23346: Attachment: 企业微信截图_15179714603307.png > Failed tasks reported as success if the failure reason is

[jira] [Updated] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-23346: Attachment: 企业微信截图_15179715023606.png > Failed tasks reported as success if the failure reason is

[jira] [Updated] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-23346: Description: !企业微信截图_15179715023606.png! !企业微信截图_15179714603307.png! We have many other failure reasons, such

[jira] [Commented] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356271#comment-16356271 ] Márcio Furlani Carmona commented on SPARK-23308: That's true

[jira] [Closed] (SPARK-10924) Failed to update accumulators for ShuffleMapTask: Broken pipe

[ https://issues.apache.org/jira/browse/SPARK-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pau Tallada Crespí closed SPARK-10924. -- > Failed to update accumulators for ShuffleMapTask: Broken p

[jira] [Commented] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363217#comment-16363217 ] Márcio Furlani Carmona commented on SPARK-23308: {quote}if your i

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365991#comment-16365991 ] Piotr Kołaczkowski commented on SPARK-14540: Any progress on this? Are

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370434#comment-16370434 ] Sönke Liebau commented on SPARK-18057: -- The upcoming release of Kafka 1.1

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370642#comment-16370642 ] Sönke Liebau commented on SPARK-18057: -- I think in addition to the na

[jira] [Created] (SPARK-23474) mapWithState + async operations = no checkpointing

Daniel Lanza García created SPARK-23474: --- Summary: mapWithState + async operations = no checkpointing Key: SPARK-23474 URL: https://issues.apache.org/jira/browse/SPARK-23474 Project: Spark

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371174#comment-16371174 ] Sönke Liebau commented on SPARK-18057: -- I agree that we should not rename

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371174#comment-16371174 ] Sönke Liebau edited comment on SPARK-18057 at 2/21/18 10:1

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372627#comment-16372627 ] Sönke Liebau commented on SPARK-18057: -- Fine with me :) Any thoughts on w

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374872#comment-16374872 ] Sönke Liebau commented on SPARK-18057: -- Alright. I've got a 12h flight to

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375758#comment-16375758 ] Frédéric ESCANDELL commented on SPARK-16996: On Hdp 2.6, i confirm that

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375758#comment-16375758 ] Frédéric ESCANDELL edited comment on SPARK-16996 at 2/24/18 8:1

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375758#comment-16375758 ] Frédéric ESCANDELL edited comment on SPARK-16996 at 2/24/18 8:1

[jira] [Commented] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16378303#comment-16378303 ] 吴志龙 commented on SPARK-23346: - This bug is found and solved? This bug will resul

[jira] [Commented] (SPARK-23474) mapWithState + async operations = no checkpointing

[ https://issues.apache.org/jira/browse/SPARK-23474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383566#comment-16383566 ] Daniel Lanza García commented on SPARK-23474: - Thanks [~gsomogyi] Does

[jira] [Created] (SPARK-23610) Cast of ArrayType of NullType to ArrayType of nullable material type does not work

Max Kießling created SPARK-23610: Summary: Cast of ArrayType of NullType to ArrayType of nullable material type does not work Key: SPARK-23610 URL: https://issues.apache.org/jira/browse/SPARK-23610

[jira] [Updated] (SPARK-23610) Cast of ArrayType of NullType to ArrayType of nullable material type does not work

[ https://issues.apache.org/jira/browse/SPARK-23610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Kießling updated SPARK-23610: - Description: Given a DataFrame that contains a column with _ArrayType of NullType_ casting this

[jira] [Created] (SPARK-23679) uiWebUrl show inproper URL when running on YARN

Maciej Bryński created SPARK-23679: -- Summary: uiWebUrl show inproper URL when running on YARN Key: SPARK-23679 URL: https://issues.apache.org/jira/browse/SPARK-23679 Project: Spark Issue

[jira] [Commented] (SPARK-14652) pyspark streaming driver unable to cleanup metadata for cached RDDs leading to driver OOM

[ https://issues.apache.org/jira/browse/SPARK-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16402230#comment-16402230 ] Zoltán Zvara commented on SPARK-14652: -- Reproduced the problem in Spark 2

[jira] [Created] (SPARK-23796) There's no API to change state RDD's name

István Gansperger created SPARK-23796: - Summary: There's no API to change state RDD's name Key: SPARK-23796 URL: https://issues.apache.org/jira/browse/SPARK-23796 Project: Spark

[jira] [Updated] (SPARK-23796) There's no API to change state RDD's name

[ https://issues.apache.org/jira/browse/SPARK-23796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] István Gansperger updated SPARK-23796: -- Description: I use a few {{mapWithState}} stream oparations in my application and at

[jira] [Commented] (SPARK-19076) Upgrade Hive dependence to Hive 2.x

[ https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417291#comment-16417291 ] Maciej Bryński commented on SPARK-19076: So it's not resolved but in

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431100#comment-16431100 ] Maciej Bryński commented on SPARK-16996: [~ste...@apache.org] Are you prep

[jira] [Created] (SPARK-23950) Coalescing an empty dataframe to 1 partition

João Neves created SPARK-23950: -- Summary: Coalescing an empty dataframe to 1 partition Key: SPARK-23950 URL: https://issues.apache.org/jira/browse/SPARK-23950 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

[ https://issues.apache.org/jira/browse/SPARK-12105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434015#comment-16434015 ] Tomasz Gawęda commented on SPARK-12105: --- +1, It's a quite common qu

[jira] [Commented] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

[ https://issues.apache.org/jira/browse/SPARK-12105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16435308#comment-16435308 ] Tomasz Gawęda commented on SPARK-12105: --- It can be used, but it should be so s

[jira] [Created] (SPARK-22740) [SQL][JDBC] Reserved SQL words are not escaped for table names

Nicolas Lalevée created SPARK-22740: --- Summary: [SQL][JDBC] Reserved SQL words are not escaped for table names Key: SPARK-22740 URL: https://issues.apache.org/jira/browse/SPARK-22740 Project: Spark

[jira] [Commented] (SPARK-22740) [SQL][JDBC] Reserved SQL words are not escaped for table names

[ https://issues.apache.org/jira/browse/SPARK-22740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284716#comment-16284716 ] Nicolas Lalevée commented on SPARK-22740: - Yes, that is a work around that

[jira] [Commented] (SPARK-22740) [SQL][JDBC] Reserved SQL words are not escaped for table names

[ https://issues.apache.org/jira/browse/SPARK-22740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284845#comment-16284845 ] Nicolas Lalevée commented on SPARK-22740: - A db with different reserved w

[jira] [Comment Edited] (SPARK-22740) [SQL][JDBC] Reserved SQL words are not escaped for table names

[ https://issues.apache.org/jira/browse/SPARK-22740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284845#comment-16284845 ] Nicolas Lalevée edited comment on SPARK-22740 at 12/9/17 5:2

[jira] [Comment Edited] (SPARK-22740) [SQL][JDBC] Reserved SQL words are not escaped for table names

[ https://issues.apache.org/jira/browse/SPARK-22740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284845#comment-16284845 ] Nicolas Lalevée edited comment on SPARK-22740 at 12/9/17 5:2

[jira] [Created] (SPARK-22768) Spark SQL alter table and beeline alter table Metadata is different

吴志龙 created SPARK-22768: --- Summary: Spark SQL alter table and beeline alter table Metadata is different Key: SPARK-22768 URL: https://issues.apache.org/jira/browse/SPARK-22768 Project: Spark Issue

[jira] [Commented] (SPARK-8542) PMML export for Decision Trees

[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295145#comment-16295145 ] Björn-Elmar Macek commented on SPARK-8542: -- Are there any updates for this i

[jira] [Comment Edited] (SPARK-8542) PMML export for Decision Trees

[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295145#comment-16295145 ] Björn-Elmar Macek edited comment on SPARK-8542 at 12/18/17 3:5

[jira] [Comment Edited] (SPARK-8542) PMML export for Decision Trees

[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295145#comment-16295145 ] Björn-Elmar Macek edited comment on SPARK-8542 at 12/18/17 4:2

[jira] [Created] (SPARK-22835) Spark toJSON gives wrong results when there is quote sign in value

Maciej Bryński created SPARK-22835: -- Summary: Spark toJSON gives wrong results when there is quote sign in value Key: SPARK-22835 URL: https://issues.apache.org/jira/browse/SPARK-22835 Project

[jira] [Resolved] (SPARK-22835) Spark toJSON gives wrong results when there is quote sign in value

[ https://issues.apache.org/jira/browse/SPARK-22835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński resolved SPARK-22835. Resolution: Invalid > Spark toJSON gives wrong results when there is quote sign in va

[jira] [Commented] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306197#comment-16306197 ] Łukasz Żukowski commented on SPARK-22500: - Hmm Below still make 64k excep

[jira] [Comment Edited] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306197#comment-16306197 ] Łukasz Żukowski edited comment on SPARK-22500 at 12/29/17 10:5

[jira] [Comment Edited] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306197#comment-16306197 ] Łukasz Żukowski edited comment on SPARK-22500 at 12/29/17 10:5

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327553#comment-16327553 ] Maciej Bryński commented on SPARK-16534: [~rxin] I tested this patch with 2

[jira] [Commented] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

[ https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334388#comment-16334388 ] Michał Świtakowski commented on SPARK-23173: I think starting with opti

[jira] [Created] (SPARK-23190) Error when infering date columns

Nacho García Fernández created SPARK-23190: -- Summary: Error when infering date columns Key: SPARK-23190 URL: https://issues.apache.org/jira/browse/SPARK-23190 Project: Spark Issue

[jira] [Updated] (SPARK-23190) Error when infering date columns

[ https://issues.apache.org/jira/browse/SPARK-23190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23190: --- Description: Hi. I'm trying to read the following file using the spar

[jira] [Updated] (SPARK-23190) Error when infering date columns

[ https://issues.apache.org/jira/browse/SPARK-23190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23190: --- Description: Hi. I'm trying to read the following file using the spar

[jira] [Created] (SPARK-23211) SparkR MLlib randomFroest parameter problem

黄龙龙 created SPARK-23211: --- Summary: SparkR MLlib randomFroest parameter problem Key: SPARK-23211 URL: https://issues.apache.org/jira/browse/SPARK-23211 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23211) SparkR MLlib randomFroest parameter problem

[ https://issues.apache.org/jira/browse/SPARK-23211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16338894#comment-16338894 ] 黄龙龙 commented on SPARK-23211: - I want to konw the usage of parameter newDat

[jira] [Created] (SPARK-23212) Casts the column to a different data type.

黄龙龙 created SPARK-23212: --- Summary: Casts the column to a different data type. Key: SPARK-23212 URL: https://issues.apache.org/jira/browse/SPARK-23212 Project: Spark Issue Type: Question

[jira] [Commented] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

[ https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16339144#comment-16339144 ] Michał Świtakowski commented on SPARK-23173: I'm going to wor

[jira] [Created] (SPARK-23225) Spark is infering decimal values with wrong precision

Nacho García Fernández created SPARK-23225: -- Summary: Spark is infering decimal values with wrong precision Key: SPARK-23225 URL: https://issues.apache.org/jira/browse/SPARK-23225 Project

[jira] [Updated] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23225: --- Description: Hi there. I'm reading a CSV file with data exported b

[jira] [Updated] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23225: --- Description: Hi there. I'm reading a CSV file with data exported b

[jira] [Updated] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23225: --- Description: Hi there. I'm reading a CSV file with data exported b

[jira] [Updated] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23225: --- Affects Version/s: (was: 2.1.1) 2.1.0 > Spark

***UNCHECKED*** [jira] [Commented] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340886#comment-16340886 ] Nacho García Fernández commented on SPARK-23225: Sorry, it was my

[jira] [Updated] (SPARK-23225) Spark is infering decimal values with wrong precision

[ https://issues.apache.org/jira/browse/SPARK-23225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nacho García Fernández updated SPARK-23225: --- Fix Version/s: 2.1.1 > Spark is infering decimal values with wrong precis

[jira] [Commented] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344831#comment-16344831 ] Martin Brišiak commented on SPARK-20927: If i understand it correctly cac

[jira] [Comment Edited] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344831#comment-16344831 ] Martin Brišiak edited comment on SPARK-20927 at 1/30/18 10:3

[jira] [Commented] (SPARK-12394) Support writing out pre-hash-partitioned data and exploit that in join optimizations to avoid shuffle (i.e. bucketing in Hive)

[ https://issues.apache.org/jira/browse/SPARK-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345598#comment-16345598 ] Thomas Bünger commented on SPARK-12394: --- Any news on this issue? Is it re

[jira] [Commented] (SPARK-23251) ClassNotFoundException: scala.Any when there's a missing implicit Map encoder

[ https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347808#comment-16347808 ] Michal Šenkýř commented on SPARK-23251: --- Yes, this does seem like the Map enc

[jira] [Created] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

Márcio Furlani Carmona created SPARK-23308: -- Summary: ignoreCorruptFiles should not ignore retryable IOException Key: SPARK-23308 URL: https://issues.apache.org/jira/browse/SPARK-23308

[jira] [Commented] (SPARK-23251) ClassNotFoundException: scala.Any when there's a missing implicit Map encoder

[ https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351921#comment-16351921 ] Michal Šenkýř commented on SPARK-23251: --- I tried multiple solutions but this

[jira] [Comment Edited] (SPARK-23251) ClassNotFoundException: scala.Any when there's a missing implicit Map encoder

[ https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351921#comment-16351921 ] Michal Šenkýř edited comment on SPARK-23251 at 2/4/18 11:2

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352415#comment-16352415 ] Maciej Bryński commented on SPARK-21918: Ping [~huLiu] > HiveClient sh

[jira] [Commented] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException

[ https://issues.apache.org/jira/browse/SPARK-23308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353082#comment-16353082 ] Márcio Furlani Carmona commented on SPARK-23308: Yeah! The tricky t

[jira] [Created] (SPARK-25996) Agregaciones no retornan los valores correctos con rows con timestamps iguales

Ignacio Gómez created SPARK-25996: - Summary: Agregaciones no retornan los valores correctos con rows con timestamps iguales Key: SPARK-25996 URL: https://issues.apache.org/jira/browse/SPARK-25996

[jira] [Updated] (SPARK-25996) Agregaciones no retornan los valores correctos con rows con timestamps iguales

[ https://issues.apache.org/jira/browse/SPARK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Gómez updated SPARK-25996: -- Description: Qué, tal? Al utilizar pyspark realizo una operación de conteo de registros

[jira] [Updated] (SPARK-25996) Agregaciones no retornan los valores correctos con rows con timestamps iguales

[ https://issues.apache.org/jira/browse/SPARK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Gómez updated SPARK-25996: -- Description: Qué, tal? Al utilizar pyspark realizo una operación de conteo de registros

[jira] [Updated] (SPARK-25996) Agregaciones no retornan los valores correctos con rows con timestamps iguales

[ https://issues.apache.org/jira/browse/SPARK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Gómez updated SPARK-25996: -- Description: Hi all, When using pyspark I perform a count operation prior to the previous

[jira] [Created] (SPARK-26045) Error in the spark 2.4 release package with the spark-avro_2.11 depdency

Oscar garcía created SPARK-26045: - Summary: Error in the spark 2.4 release package with the spark-avro_2.11 depdency Key: SPARK-26045 URL: https://issues.apache.org/jira/browse/SPARK-26045 Project

[jira] [Updated] (SPARK-26045) Error in the spark 2.4 release package with the spark-avro_2.11 depdency

[ https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar garcía updated SPARK-26045: -- Description: Hello I have been problems with the last spark 2.4 release, the read avro file

[jira] [Updated] (SPARK-26045) Error in the spark 2.4 release package with the spark-avro_2.11 depdency

[ https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar garcía updated SPARK-26045: -- Description: Hello I have been problems with the last spark 2.4 release, the read avro file

[jira] [Commented] (SPARK-25799) DataSourceApiV2 scan reuse does not respect options

[ https://issues.apache.org/jira/browse/SPARK-25799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689409#comment-16689409 ] Max Kießling commented on SPARK-25799: -- Apparently this issues is already reso

[jira] [Resolved] (SPARK-25799) DataSourceApiV2 scan reuse does not respect options

[ https://issues.apache.org/jira/browse/SPARK-25799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Kießling resolved SPARK-25799. -- Resolution: Fixed Fix Version/s: 2.4.0 > DataSourceApiV2 scan reuse does not resp

[jira] [Commented] (SPARK-26045) Error in the spark 2.4 release package with the spark-avro_2.11 depdency

[ https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691101#comment-16691101 ] Oscar garcía commented on SPARK-26045: --- Following the 2.4 spark documenta

[jira] [Created] (SPARK-26157) Asynchronous execution of stored procedure

Jaime de Roque Martínez created SPARK-26157: --- Summary: Asynchronous execution of stored procedure Key: SPARK-26157 URL: https://issues.apache.org/jira/browse/SPARK-26157 Project: Spark

[jira] [Updated] (SPARK-26157) Asynchronous execution of stored procedure

[ https://issues.apache.org/jira/browse/SPARK-26157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaime de Roque Martínez updated SPARK-26157: Description: I am executing a jar file with spark-submit. This jar file

[jira] [Comment Edited] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700590#comment-16700590 ] Fabian Höring edited comment on SPARK-25433 at 11/27/18 3:3

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700590#comment-16700590 ] Fabian Höring commented on SPARK-25433: --- {code} $ pex numpy -o myarchive

[jira] [Resolved] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring resolved SPARK-25433. --- Resolution: Not A Problem > Add support for PEX in PySp

[jira] [Comment Edited] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700590#comment-16700590 ] Fabian Höring edited comment on SPARK-25433 at 11/27/18 3:3

[jira] [Created] (SPARK-26199) Long expressions cause mutate to fail

João Rafael created SPARK-26199: --- Summary: Long expressions cause mutate to fail Key: SPARK-26199 URL: https://issues.apache.org/jira/browse/SPARK-26199 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørnar Jensen reopened SPARK-25145: New information that I believe will make it reproducible: The "zerocopy" opti

[jira] [Commented] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16706862#comment-16706862 ] Bjørnar Jensen commented on SPARK-25145: Hi, I'm sorry it's not r

[jira] [Created] (SPARK-13391) Use Apache Arrow as In-memory columnar store implementation

Maciej Bryński created SPARK-13391: -- Summary: Use Apache Arrow as In-memory columnar store implementation Key: SPARK-13391 URL: https://issues.apache.org/jira/browse/SPARK-13391 Project: Spark

[jira] [Created] (SPARK-13515) FormatNumber uses wrong decimal separator under some locales.

Łukasz Gieroń created SPARK-13515: - Summary: FormatNumber uses wrong decimal separator under some locales. Key: SPARK-13515 URL: https://issues.apache.org/jira/browse/SPARK-13515 Project: Spark

[jira] [Commented] (SPARK-13247) REST API ignores spark.jars property

[ https://issues.apache.org/jira/browse/SPARK-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170166#comment-15170166 ] Łukasz Gieroń commented on SPARK-13247: --- Hi [~AdamWesterman] In the sp

<    3   4   5   6   7   8   9   10   11   12   >