[jira] [Commented] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182951#comment-17182951 ] L. C. Hsieh commented on SPARK-32646: - All failed tests in hive-1.2 profile are fixe

[jira] [Updated] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hive1.2 profile in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32689: Summary: HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hive1.2

[jira] [Comment Edited] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182797#comment-17182797 ] L. C. Hsieh edited comment on SPARK-32689 at 8/24/20, 5:12 AM: ---

[jira] [Resolved] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-32689. - Resolution: Resolved > HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently faile

[jira] [Updated] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32689: Fix Version/s: 3.1.0 3.0.1 > HiveSerDeReadWriteSuite and ScriptTransformationSu

[jira] [Commented] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182945#comment-17182945 ] Daniel Moore commented on SPARK-32617: -- Is there a minikube support matrix? > Upgr

[jira] [Commented] (SPARK-32664) Getting local shuffle block clutters the executor logs

[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182943#comment-17182943 ] Apache Spark commented on SPARK-32664: -- User 'dmoore62' has created a pull request

[jira] [Assigned] (SPARK-32664) Getting local shuffle block clutters the executor logs

[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32664: Assignee: (was: Apache Spark) > Getting local shuffle block clutters the executor log

[jira] [Assigned] (SPARK-32664) Getting local shuffle block clutters the executor logs

[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32664: Assignee: (was: Apache Spark) > Getting local shuffle block clutters the executor log

[jira] [Assigned] (SPARK-32664) Getting local shuffle block clutters the executor logs

[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32664: Assignee: Apache Spark > Getting local shuffle block clutters the executor logs > ---

[jira] [Commented] (SPARK-32664) Getting local shuffle block clutters the executor logs

[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182942#comment-17182942 ] Daniel Moore commented on SPARK-32664: -- PR open - [https://github.com/apache/spark/

[jira] [Comment Edited] (SPARK-32683) Datetime Pattern F not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182932#comment-17182932 ] Kent Yao edited comment on SPARK-32683 at 8/24/20, 3:49 AM:

[jira] [Commented] (SPARK-32683) Datetime Pattern F not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182932#comment-17182932 ] Kent Yao commented on SPARK-32683: -- This is a bug of the doc that we inherited from JDK

[jira] [Commented] (SPARK-32517) Add StorageLevel.DISK_ONLY_3

[ https://issues.apache.org/jira/browse/SPARK-32517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182923#comment-17182923 ] huangtianhua commented on SPARK-32517: -- Thanks for looking deeply for this. I will

[jira] [Assigned] (SPARK-32648) Remove unused DELETE_ACTION in FileStreamSinkLog

[ https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32648: - Assignee: Michał Wieleba > Remove unused DELETE_ACTION in FileStreamSinkLog > -

[jira] [Assigned] (SPARK-32648) Remove unused DELETE_ACTION in FileStreamSinkLog

[ https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32648: - Assignee: (was: Jungtaek Lim) > Remove unused DELETE_ACTION in FileStreamSinkLog >

[jira] [Assigned] (SPARK-32648) Remove unused DELETE_ACTION in FileStreamSinkLog

[ https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32648: - Assignee: Jungtaek Lim > Remove unused DELETE_ACTION in FileStreamSinkLog > ---

[jira] [Resolved] (SPARK-32648) Remove unused DELETE_ACTION in FileStreamSinkLog

[ https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32648. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29505 [https://

[jira] [Assigned] (SPARK-32675) --py-files option is appended without passing value for it

[ https://issues.apache.org/jira/browse/SPARK-32675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32675: - Assignee: Farhan Khan > --py-files option is appended without passing value for it > --

[jira] [Resolved] (SPARK-32675) --py-files option is appended without passing value for it

[ https://issues.apache.org/jira/browse/SPARK-32675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32675. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29499 [https://

[jira] [Assigned] (SPARK-32676) Fix double caching in KMeans/BiKMeans

[ https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32676: Assignee: zhengruifeng > Fix double caching in KMeans/BiKMeans >

[jira] [Resolved] (SPARK-32676) Fix double caching in KMeans/BiKMeans

[ https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32676. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29501 [https://gi

[jira] [Comment Edited] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182750#comment-17182750 ] L. C. Hsieh edited comment on SPARK-32689 at 8/23/20, 7:49 PM: ---

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182796#comment-17182796 ] Apache Spark commented on SPARK-32352: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182798#comment-17182798 ] Apache Spark commented on SPARK-32352: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182797#comment-17182797 ] L. C. Hsieh commented on SPARK-32689: - "org.apache.spark.sql.hive.orc.HiveOrcHadoopF

[jira] [Updated] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32689: Description: There are three tests which are currently failed under hive1.2 profiles in branch-3.

[jira] [Updated] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32689: Description: There are three tests which are currently failed under hive1.2 profiles in branch-3.

[jira] [Commented] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182793#comment-17182793 ] Apache Spark commented on SPARK-25957: -- User 'jkleckner' has created a pull request

[jira] [Commented] (SPARK-32092) CrossvalidatorModel does not save all submodels (it saves only 3)

[ https://issues.apache.org/jira/browse/SPARK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182791#comment-17182791 ] Apache Spark commented on SPARK-32092: -- User 'Louiszr' has created a pull request f

[jira] [Commented] (SPARK-32092) CrossvalidatorModel does not save all submodels (it saves only 3)

[ https://issues.apache.org/jira/browse/SPARK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182792#comment-17182792 ] Apache Spark commented on SPARK-32092: -- User 'Louiszr' has created a pull request f

[jira] [Assigned] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32646: Assignee: L. C. Hsieh (was: Apache Spark) > ORC predicate pushdown should work with case

[jira] [Assigned] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32646: Assignee: Apache Spark (was: L. C. Hsieh) > ORC predicate pushdown should work with case

[jira] [Commented] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182750#comment-17182750 ] L. C. Hsieh commented on SPARK-32689: - "org.apache.spark.sql.hive.execution.ScriptTr

[jira] [Commented] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182747#comment-17182747 ] Apache Spark commented on SPARK-32594: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182745#comment-17182745 ] Apache Spark commented on SPARK-32594: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-32641) withField + getField on null structs returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182731#comment-17182731 ] Apache Spark commented on SPARK-32641: -- User 'fqaiser94' has created a pull request

[jira] [Assigned] (SPARK-32641) withField + getField on null structs returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32641: Assignee: Apache Spark > withField + getField on null structs returns incorrect results >

[jira] [Assigned] (SPARK-32641) withField + getField on null structs returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32641: Assignee: (was: Apache Spark) > withField + getField on null structs returns incorrec

[jira] [Commented] (SPARK-32641) withField + getField on null structs returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182729#comment-17182729 ] Apache Spark commented on SPARK-32641: -- User 'fqaiser94' has created a pull request

[jira] [Updated] (SPARK-32689) HiveSerDeReadWriteSuite and ScriptTransformationSuite are currently failed under hadoop2.7 and hive1.2 profiles in branch-3.0 and master

[ https://issues.apache.org/jira/browse/SPARK-32689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32689: Description: There are three tests which are currently failed under hive1.2 profiles in branch-3.

[jira] [Updated] (SPARK-32683) Datetime Pattern F not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32683: - Component/s: (was: Spark Core) SQL > Datetime Pattern F not working

[jira] [Commented] (SPARK-32683) Datetime Pattern F not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182677#comment-17182677 ] Takeshi Yamamuro commented on SPARK-32683: -- cc: [~maxgekk] [~Qin Yao] > Dateti

[jira] [Commented] (SPARK-32683) Datetime Pattern F not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182643#comment-17182643 ] Varun Wachasapti J commented on SPARK-32683: Stumbled upon the same issue, u

[jira] [Reopened] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reopened SPARK-32646: - Due to issue of hive-1.2 profile, reverted merged diff and so reopened this. > ORC predicate pushdo