[jira] [Updated] (SPARK-22118) Should prevent change epoch in success stage while there is some running stage

[ https://issues.apache.org/jira/browse/SPARK-22118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22118: --- Affects Version/s: 2.2.0 > Should prevent change epoch in success stage while there is s

[jira] [Updated] (SPARK-22118) Should prevent change epoch in success stage while there is some running stage

[ https://issues.apache.org/jira/browse/SPARK-22118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22118: --- Priority: Critical (was: Major) > Should prevent change epoch in success stage while th

[jira] [Created] (SPARK-22341) [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off

Maciej Bryński created SPARK-22341: -- Summary: [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off Key: SPARK-22341 URL: https://issues.apache.org/jira/browse/SPARK-22341 Project

[jira] [Commented] (SPARK-22341) [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off

[ https://issues.apache.org/jira/browse/SPARK-22341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216877#comment-16216877 ] Maciej Bryński commented on SPARK-22341: Because Spark 2.2.0 is wor

[jira] [Comment Edited] (SPARK-22341) [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off

[ https://issues.apache.org/jira/browse/SPARK-22341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216877#comment-16216877 ] Maciej Bryński edited comment on SPARK-22341 at 10/24/17 1:2

[jira] [Comment Edited] (SPARK-22341) [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off

[ https://issues.apache.org/jira/browse/SPARK-22341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216877#comment-16216877 ] Maciej Bryński edited comment on SPARK-22341 at 10/24/17 1:2

[jira] [Commented] (SPARK-22118) Should prevent change epoch in success stage while there is some running stage

[ https://issues.apache.org/jira/browse/SPARK-22118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216908#comment-16216908 ] Maciej Bryński commented on SPARK-22118: I think this problem is resolve

[jira] [Updated] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated SPARK-22148: --- Attachment: SPARK-22148_WIP.diff

[jira] [Commented] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217299#comment-16217299 ] Juan Rodríguez Hortalá commented on SPARK-22148: Hi, I've bee

[jira] [Commented] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225375#comment-16225375 ] Juan Rodríguez Hortalá commented on SPARK-22148: Hi [~irashid].

[jira] [Created] (SPARK-22410) Excessive spill for Pyspark UDF when a row has shrunk

Clément Stenac created SPARK-22410: -- Summary: Excessive spill for Pyspark UDF when a row has shrunk Key: SPARK-22410 URL: https://issues.apache.org/jira/browse/SPARK-22410 Project: Spark

[jira] [Commented] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241577#comment-16241577 ] Serkan Taş commented on SPARK-19680: I have the same issue also on a yarn clu

[jira] [Comment Edited] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241577#comment-16241577 ] Serkan Taş edited comment on SPARK-19680 at 11/7/17 6:3

[jira] [Comment Edited] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241577#comment-16241577 ] Serkan Taş edited comment on SPARK-19680 at 11/7/17 6:3

[jira] [Commented] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

[ https://issues.apache.org/jira/browse/SPARK-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16243469#comment-16243469 ] 翟玉勇 commented on SPARK-11248: - I have similar issue in Spark 2.1.0 > Spark hivethrif

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253531#comment-16253531 ] Maciej Bryński commented on SPARK-16996: In Spark 2.2 even major compac

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253531#comment-16253531 ] Maciej Bryński edited comment on SPARK-16996 at 11/15/17 2:3

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253531#comment-16253531 ] Maciej Bryński edited comment on SPARK-16996 at 11/15/17 9:0

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253531#comment-16253531 ] Maciej Bryński edited comment on SPARK-16996 at 11/15/17 9:1

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253531#comment-16253531 ] Maciej Bryński edited comment on SPARK-16996 at 11/15/17 9:0

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254821#comment-16254821 ] Maciej Bryński commented on SPARK-16996: After research I think Spark 2.2 in

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254997#comment-16254997 ] Maciej Bryński commented on SPARK-16996: I changed hive libraries to ver

[jira] [Commented] (SPARK-19076) Upgrade Hive dependence to Hive 2.x

[ https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255002#comment-16255002 ] Maciej Bryński commented on SPARK-19076: Why we mark this as Reso

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255070#comment-16255070 ] Maciej Bryński commented on SPARK-16996: Update: At the end I was able to

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255070#comment-16255070 ] Maciej Bryński edited comment on SPARK-16996 at 11/16/17 10:3

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255070#comment-16255070 ] Maciej Bryński edited comment on SPARK-16996 at 11/16/17 11:0

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258894#comment-16258894 ] Maciej Bryński commented on SPARK-16996: [~ste...@apache.org] I didn'

[jira] [Created] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

Éderson Cássio created SPARK-22568: -- Summary: Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey Key: SPARK-22568 URL: https://issues.apache.org/jira/browse/SPARK-22568 Project

[jira] [Updated] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Éderson Cássio updated SPARK-22568: --- Description: Sorry for any mistakes on filling this big form... it's my first issue

[jira] [Updated] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Éderson Cássio updated SPARK-22568: --- Description: Sorry for any mistakes on filling this big form... it's my first issue

[jira] [Commented] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260616#comment-16260616 ] Éderson Cássio commented on SPARK-22568: Thanks for your response. How c

[jira] [Commented] (SPARK-17694) convert DataFrame to DataSet should check columns match

[ https://issues.apache.org/jira/browse/SPARK-17694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537320#comment-16537320 ] Paweł Batko commented on SPARK-17694: - Another minimal: {code:scala} case class

[jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554109#comment-16554109 ] Tomasz Gawęda commented on SPARK-24288: --- [~smilegator] Yes, you are right. I

[jira] [Created] (SPARK-24905) Spark 2.3 Internal URL env variable

Björn Wenzel created SPARK-24905: Summary: Spark 2.3 Internal URL env variable Key: SPARK-24905 URL: https://issues.apache.org/jira/browse/SPARK-24905 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24905) Spark 2.3 Internal URL env variable

[ https://issues.apache.org/jira/browse/SPARK-24905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Björn Wenzel updated SPARK-24905: - Priority: Critical (was: Major) > Spark 2.3 Internal URL env varia

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570575#comment-16570575 ] Carlos Peña commented on SPARK-23932: - Hi [~ueshin] ! Sorry for the delay. Th

[jira] [Created] (SPARK-25075) Build and test Spark against Scala 2.13

Guillaume Massé created SPARK-25075: --- Summary: Build and test Spark against Scala 2.13 Key: SPARK-25075 URL: https://issues.apache.org/jira/browse/SPARK-25075 Project: Spark Issue Type

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574839#comment-16574839 ] Guillaume Massé commented on SPARK-25075: - Scala 2.13 is currently in

[jira] [Created] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

Bjørnar Jensen created SPARK-25145: -- Summary: Buffer size too small on spark.sql query with filterPushdown predicate=True Key: SPARK-25145 URL: https://issues.apache.org/jira/browse/SPARK-25145

[jira] [Updated] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørnar Jensen updated SPARK-25145: --- Attachment: create_bug.py > Buffer size too small on spark.sql query with filterPushd

[jira] [Updated] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørnar Jensen updated SPARK-25145: --- Attachment: report.txt > Buffer size too small on spark.sql query with filterPushd

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584279#comment-16584279 ] Tomasz Gawęda commented on SPARK-25150: --- [~nchammas] Maybe it's r

[jira] [Created] (SPARK-25334) Default SessionCatalog doesn't support UDFs

Tomasz Gawęda created SPARK-25334: - Summary: Default SessionCatalog doesn't support UDFs Key: SPARK-25334 URL: https://issues.apache.org/jira/browse/SPARK-25334 Project: Spark Issue

[jira] [Updated] (SPARK-25334) Default SessionCatalog should support UDFs

[ https://issues.apache.org/jira/browse/SPARK-25334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Gawęda updated SPARK-25334: -- Summary: Default SessionCatalog should support UDFs (was: Default SessionCatalog doesn&#

[jira] [Commented] (SPARK-25334) Default SessionCatalog should support UDFs

[ https://issues.apache.org/jira/browse/SPARK-25334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603341#comment-16603341 ] Tomasz Gawęda commented on SPARK-25334: --- If commiters say it's not very

[jira] [Commented] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade

[ https://issues.apache.org/jira/browse/SPARK-24070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452096#comment-16452096 ] Michał Świtakowski commented on SPARK-24070: [~maropu] I think you can

[jira] [Comment Edited] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade

[ https://issues.apache.org/jira/browse/SPARK-24070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452096#comment-16452096 ] Michał Świtakowski edited comment on SPARK-24070 at 4/25/18 11:4

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475688#comment-16475688 ] Carlos Peña commented on SPARK-23932: - I would like to take this one > Hig

[jira] [Created] (SPARK-24281) Option to disable Spark UI's web filter in YARN-client mode

Zoltán Zvara created SPARK-24281: Summary: Option to disable Spark UI's web filter in YARN-client mode Key: SPARK-24281 URL: https://issues.apache.org/jira/browse/SPARK-24281 Project:

[jira] [Created] (SPARK-24288) Enable preventing predicate pushdown

Tomasz Gawęda created SPARK-24288: - Summary: Enable preventing predicate pushdown Key: SPARK-24288 URL: https://issues.apache.org/jira/browse/SPARK-24288 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477160#comment-16477160 ] Tomasz Gawęda commented on SPARK-24288: --- Hi, my idea was to have some special

[jira] [Commented] (SPARK-24299) UI for Structured Streaming Monitoring

[ https://issues.apache.org/jira/browse/SPARK-24299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478075#comment-16478075 ] Tomasz Gawęda commented on SPARK-24299: --- CC [~vanzin] and [~tdas] >

[jira] [Created] (SPARK-24299) UI for Structured Streaming Monitoring

Tomasz Gawęda created SPARK-24299: - Summary: UI for Structured Streaming Monitoring Key: SPARK-24299 URL: https://issues.apache.org/jira/browse/SPARK-24299 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-24373) "df.cache() df.count()" no longer eagerly caches data

[ https://issues.apache.org/jira/browse/SPARK-24373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491153#comment-16491153 ] Tomasz Gawęda commented on SPARK-24373: --- [~LI,Xiao] That is a good idea :) E

[jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16492624#comment-16492624 ] Tomasz Gawęda commented on SPARK-22947: --- [~icexelloss] Hi, just wondering -

[jira] [Commented] (SPARK-24471) MlLib distributed plans

[ https://issues.apache.org/jira/browse/SPARK-24471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502429#comment-16502429 ] Tomasz Gawęda commented on SPARK-24471: --- Questions should be posted on Mai

[jira] [Created] (SPARK-24487) Add support for RabbitMQ.

Michał Jurkiewicz created SPARK-24487: - Summary: Add support for RabbitMQ. Key: SPARK-24487 URL: https://issues.apache.org/jira/browse/SPARK-24487 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505759#comment-16505759 ] Michał Jurkiewicz commented on SPARK-24487: --- I meant to add support

[jira] [Commented] (SPARK-24548) JavaPairRDD to Dataset in SPARK generates ambiguous results

[ https://issues.apache.org/jira/browse/SPARK-24548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511056#comment-16511056 ] Tomasz Gawęda commented on SPARK-24548: --- IMHO names should be distinct, in o

[jira] [Issue Comment Deleted] (SPARK-24548) JavaPairRDD to Dataset in SPARK generates ambiguous results

[ https://issues.apache.org/jira/browse/SPARK-24548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Gawęda updated SPARK-24548: -- Comment: was deleted (was: IMHO names should be distinct, in other cases it's hard to

[jira] [Created] (SPARK-26494) 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到

秦坤 created SPARK-26494: -- Summary: 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到 Key: SPARK-26494 URL: https://issues.apache.org/jira/browse/SPARK-26494 Project: Spark Issue Type

[jira] [Updated] (SPARK-26494) 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到

[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 秦坤 updated SPARK-26494: --- Priority: Minor (was: Major) > 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型

[jira] [Updated] (SPARK-26494) 【spark sql】Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type can't be found,

[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 秦坤 updated SPARK-26494: --- Description: Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type can't be found, When the data ty

[jira] [Reopened] (SPARK-26494) 【spark sql】Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type can't be found,

[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 秦坤 reopened SPARK-26494: > 【spark sql】Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type > can'

[jira] [Created] (SPARK-26531) How to setup Apache Spark to use local hard disk when data does not fit in RAM in local mode?

Lê Văn Thanh created SPARK-26531: Summary: How to setup Apache Spark to use local hard disk when data does not fit in RAM in local mode? Key: SPARK-26531 URL: https://issues.apache.org/jira/browse/SPARK-26531

[jira] [Created] (SPARK-26572) Join on distinct column with monotonically_increasing_id produced wrong output

Sören Reichardt created SPARK-26572: --- Summary: Join on distinct column with monotonically_increasing_id produced wrong output Key: SPARK-26572 URL: https://issues.apache.org/jira/browse/SPARK-26572

[jira] [Updated] (SPARK-26572) Join on distinct column with monotonically_increasing_id produced wrong output

[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sören Reichardt updated SPARK-26572: Description: When joining a table with projected monotonically_increasing_id column after

[jira] [Updated] (SPARK-26572) Join on distinct column with monotonically_increasing_id produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sören Reichardt updated SPARK-26572: Summary: Join on distinct column with monotonically_increasing_id produces wrong output

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737263#comment-16737263 ] Fabian Höring commented on SPARK-25433: --- For more details I actually have wri

[jira] [Closed] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring closed SPARK-25433. - > Add support for PEX in PySpark > -- > >

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738190#comment-16738190 ] Fabian Höring commented on SPARK-25433: --- [~dongjoon] [~hyukjin.kwon] If you t

[jira] [Updated] (SPARK-26572) Join on distinct column with monotonically_increasing_id produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sören Reichardt updated SPARK-26572: Description: When joining a table with projected monotonically_increasing_id column after

[jira] [Updated] (SPARK-26663) Cannot query a Hive table with subdirectories

[ https://issues.apache.org/jira/browse/SPARK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aäron updated SPARK-26663: -- Summary: Cannot query a Hive table with subdirectories (was: Cannot query a Hive table with orc files in

[jira] [Created] (SPARK-26663) Cannot query a Hive table with orc files in subdirectories

Aäron created SPARK-26663: - Summary: Cannot query a Hive table with orc files in subdirectories Key: SPARK-26663 URL: https://issues.apache.org/jira/browse/SPARK-26663 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26663) Cannot query a Hive table with subdirectories

[ https://issues.apache.org/jira/browse/SPARK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aäron updated SPARK-26663: -- Description: Hello,   I want to report the following issue (my first one :) ) When I create a table in

[jira] [Created] (SPARK-26670) worker.py uses resource python library, which is not available for windows

René Buffat created SPARK-26670: --- Summary: worker.py uses resource python library, which is not available for windows Key: SPARK-26670 URL: https://issues.apache.org/jira/browse/SPARK-26670 Project

[jira] [Created] (SPARK-26715) If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown

://issues.apache.org/jira/browse/SPARK-26715 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 3.0.0 Reporter: Antal Bálint Steinbach If GPU plugin is set for the NodeManger it is possible to run jobs with GPU. But if Linux container

[jira] [Resolved] (SPARK-26715) If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown

[ https://issues.apache.org/jira/browse/SPARK-26715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach resolved SPARK-26715. Resolution: Invalid YARN issue. > If linux container executor is not

[jira] [Commented] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764454#comment-16764454 ] Clément Michaud commented on SPARK-17454: - Hello, I've added

[jira] [Comment Edited] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764454#comment-16764454 ] Clément Michaud edited comment on SPARK-17454 at 2/10/19 3:4

[jira] [Created] (SPARK-26869) UDF with struct requires to have _1 and _2 as struct field names

Andrés Doncel Ramírez created SPARK-26869: - Summary: UDF with struct requires to have _1 and _2 as struct field names Key: SPARK-26869 URL: https://issues.apache.org/jira/browse/SPARK-26869

[jira] [Updated] (SPARK-26869) UDF with struct requires to have _1 and _2 as struct field names

[ https://issues.apache.org/jira/browse/SPARK-26869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrés Doncel Ramírez updated SPARK-26869: -- Description: When using a UDF which has a Seq of tuples as input, the struct

[jira] [Commented] (SPARK-26869) UDF with struct requires to have _1 and _2 as struct field names

[ https://issues.apache.org/jira/browse/SPARK-26869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773946#comment-16773946 ] Andrés Doncel Ramírez commented on SPARK-26869: --- Thanks for your an

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781353#comment-16781353 ] Maciej Bryński commented on SPARK-24432: I've just returned from Big

[jira] [Created] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

Piotr Kołaczkowski created SPARK-27018: -- Summary: Checkpointed RDD deleted prematurely when using GBTClassifier Key: SPARK-27018 URL: https://issues.apache.org/jira/browse/SPARK-27018 Project

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781481#comment-16781481 ] Piotr Kołaczkowski commented on SPARK-27018: The checkpoint is deleted

[jira] [Comment Edited] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781481#comment-16781481 ] Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:0

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781492#comment-16781492 ] Piotr Kołaczkowski commented on SPARK-27018: PeriodicCheckpoi

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Attachment

[jira] [Comment Edited] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781501#comment-16781501 ] Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:3

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781501#comment-16781501 ] Piotr Kołaczkowski commented on SPARK-27018: Atached patch for Spark 2

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Affects Version/s: 2.3.3 > Checkpointed RDD deleted prematurely when us

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Affects Version/s: 2.2.3 > Checkpointed RDD deleted prematurely when us

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781640#comment-16781640 ] Piotr Kołaczkowski commented on SPARK-27018: For master only? Why not

[jira] [Commented] (SPARK-18162) SparkEnv.get.metricsSystem in spark-shell results in error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'

[ https://issues.apache.org/jira/browse/SPARK-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15818123#comment-15818123 ] Bartosz Woźniak commented on SPARK-18162: - I came across same error w

[jira] [Commented] (SPARK-19125) Streaming Duration by Count

[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820782#comment-15820782 ] Paulo Cândido commented on SPARK-19125: --- Hi Mr. Owen, Thank you for

[jira] [Commented] (SPARK-19125) Streaming Duration by Count

[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820780#comment-15820780 ] Paulo Cândido commented on SPARK-19125: --- Hi Mr. Owen, Thank you for

[jira] [Issue Comment Deleted] (SPARK-19125) Streaming Duration by Count

[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Cândido updated SPARK-19125: -- Comment: was deleted (was: Hi Mr. Owen, Thank you for your attention. Your alternative

[jira] [Resolved] (SPARK-19125) Streaming Duration by Count

[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Cândido resolved SPARK-19125. --- Resolution: Workaround > Streaming Duration by Co

[jira] [Closed] (SPARK-19125) Streaming Duration by Count

[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Cândido closed SPARK-19125. - > Streaming Duration by Count > --- > > Key:

<    1   2   3   4   5   6   7   8   9   10   >