[jira] [Updated] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarred Li updated SPARK-32582: -- Description: When infer schema is enabled, it tries to list all the files in the table, however only

[jira] [Assigned] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32586: Assignee: Apache Spark > Fix NumberFormatException error message when ansi is enabled > -

[jira] [Assigned] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32586: Assignee: (was: Apache Spark) > Fix NumberFormatException error message when ansi is

[jira] [Commented] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175287#comment-17175287 ] Apache Spark commented on SPARK-32586: -- User 'wangyum' has created a pull request f

[jira] [Resolved] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-25715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tank Sui resolved SPARK-25715. -- Resolution: Fixed > support configuration on rpc port and port range on yarn client mode > ---

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175285#comment-17175285 ] Apache Spark commented on SPARK-32018: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175284#comment-17175284 ] Apache Spark commented on SPARK-32018: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32586: Description: How to reproduce: {noformat} spark-sql> set spark.sql.ansi.enabled=true; spark.sql.an

[jira] [Commented] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175280#comment-17175280 ] ulysses you commented on SPARK-32585: - [~rohitmishr1484] thanks for the remind, the

[jira] [Created] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

Yuming Wang created SPARK-32586: --- Summary: Fix NumberFormatException error message when ansi is enabled Key: SPARK-32586 URL: https://issues.apache.org/jira/browse/SPARK-32586 Project: Spark I

[jira] [Updated] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-32585: Description: Add code in {{ScalaReflection}} to support scala enumeration and make enumeration typ

[jira] [Assigned] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32470: --- Assignee: Wei Xue > Remove task result size check for shuffle map stage > -

[jira] [Resolved] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32470. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29276 [https://gith

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175275#comment-17175275 ] Hyukjin Kwon commented on SPARK-32580: -- [~airatsa] can you try to turn off {{spark

[jira] [Resolved] (SPARK-32573) Anti Join Improvement with EmptyHashedRelation and EmptyHashedRelationWithAllNullKeys

[ https://issues.apache.org/jira/browse/SPARK-32573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32573. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29389 [https://gith

[jira] [Assigned] (SPARK-32573) Anti Join Improvement with EmptyHashedRelation and EmptyHashedRelationWithAllNullKeys

[ https://issues.apache.org/jira/browse/SPARK-32573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32573: --- Assignee: Leanken.Lin > Anti Join Improvement with EmptyHashedRelation and > EmptyHashedRe

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175273#comment-17175273 ] Hyukjin Kwon commented on SPARK-32582: -- [~leejianwei] do you mean we shouldn't list

[jira] [Commented] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175272#comment-17175272 ] Rohit Mishra commented on SPARK-32585: -- [~ulysses], Can you please add a descriptio

[jira] [Commented] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175270#comment-17175270 ] Apache Spark commented on SPARK-32585: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32585: Assignee: Apache Spark > Support scala enumeration in ScalaReflection > -

[jira] [Assigned] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32585: Assignee: (was: Apache Spark) > Support scala enumeration in ScalaReflection > --

[jira] [Commented] (SPARK-32585) Support scala enumeration in ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175269#comment-17175269 ] Apache Spark commented on SPARK-32585: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32584: Assignee: Hyukjin Kwon > Exclude _images and _sources that are generated by Sphinx in Jek

[jira] [Resolved] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32584. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29402 [https://gi

[jira] [Created] (SPARK-32585) Support scala enumeration in ScalaReflection

ulysses you created SPARK-32585: --- Summary: Support scala enumeration in ScalaReflection Key: SPARK-32585 URL: https://issues.apache.org/jira/browse/SPARK-32585 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175237#comment-17175237 ] Apache Spark commented on SPARK-32584: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32584: Assignee: (was: Apache Spark) > Exclude _images and _sources that are generated by Sp

[jira] [Assigned] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32584: Assignee: Apache Spark > Exclude _images and _sources that are generated by Sphinx in Jek

[jira] [Updated] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32584: - Description: For _images directory, after SPARK-31851, now we added some images to use within t

[jira] [Updated] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

[ https://issues.apache.org/jira/browse/SPARK-32584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32584: - Attachment: Screen Shot 2020-08-11 at 1.52.46 PM.png > Exclude _images and _sources that are gen

[jira] [Created] (SPARK-32584) Exclude _images and _sources that are generated by Sphinx in Jekyll build

Hyukjin Kwon created SPARK-32584: Summary: Exclude _images and _sources that are generated by Sphinx in Jekyll build Key: SPARK-32584 URL: https://issues.apache.org/jira/browse/SPARK-32584 Project: Sp

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175219#comment-17175219 ] Ayrat Sadreev commented on SPARK-32580: --- If you select values from one of the arra

[jira] [Resolved] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32583. -- Resolution: Invalid > PySpark Structured Streaming Testing Support > -

[jira] [Reopened] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-32583: -- > PySpark Structured Streaming Testing Support > > >

[jira] [Commented] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175212#comment-17175212 ] Hyukjin Kwon commented on SPARK-32583: -- [~FelixKJose], let's interact in the mailin

[jira] [Commented] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175205#comment-17175205 ] Rohit Mishra commented on SPARK-32583: -- cc [~hyukjin.kwon].  > PySpark Structured

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175203#comment-17175203 ] Lantao Jin commented on SPARK-32582: Maybe we could offer a new interface to break o

[jira] [Commented] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175202#comment-17175202 ] Felix Kizhakkel Jose commented on SPARK-32583: -- [~rohitmishr1484] It would

[jira] [Resolved] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Mishra resolved SPARK-32583. -- Resolution: Not A Problem > PySpark Structured Streaming Testing Support > ---

[jira] [Commented] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175200#comment-17175200 ] Rohit Mishra commented on SPARK-32583: -- [~FelixKJose], Questions are usually answer

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175197#comment-17175197 ] Lantao Jin commented on SPARK-32582: I see. The implementation of {{inferSchema}} me

[jira] [Assigned] (SPARK-32216) Remove redundant ProjectExec

[ https://issues.apache.org/jira/browse/SPARK-32216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32216: --- Assignee: Allison Wang > Remove redundant ProjectExec > > >

[jira] [Resolved] (SPARK-32216) Remove redundant ProjectExec

[ https://issues.apache.org/jira/browse/SPARK-32216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32216. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29031 [https://gith

[jira] [Assigned] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32400: Assignee: (was: Apache Spark) > Test coverage of HiveScripTransformationExec > --

[jira] [Assigned] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32400: Assignee: Apache Spark > Test coverage of HiveScripTransformationExec > -

[jira] [Commented] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175167#comment-17175167 ] Apache Spark commented on SPARK-32400: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175165#comment-17175165 ] Jarred Li commented on SPARK-32582: --- The performance I mentioned here is not the read

[jira] [Updated] (SPARK-32543) Remove arrow::as_tibble usage in SparkR

[ https://issues.apache.org/jira/browse/SPARK-32543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32543: - Fix Version/s: 3.0.1 > Remove arrow::as_tibble usage in SparkR > ---

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175143#comment-17175143 ] Lantao Jin commented on SPARK-32582: {code} files.toIterator.map(file => readSchema(

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175117#comment-17175117 ] Tianchen Zhang commented on SPARK-25299: Hi [~mcheah], by following the history

[jira] [Created] (SPARK-32583) PySpark Structured Streaming Testing Support

Felix Kizhakkel Jose created SPARK-32583: Summary: PySpark Structured Streaming Testing Support Key: SPARK-32583 URL: https://issues.apache.org/jira/browse/SPARK-32583 Project: Spark

[jira] [Updated] (SPARK-32528) The analyze method should make sure the plan is analyzed

[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32528: -- Fix Version/s: 3.0.1 > The analyze method should make sure the plan is analyzed >

[jira] [Commented] (SPARK-32571) yarnClient.killApplication(appId) is never called

[ https://issues.apache.org/jira/browse/SPARK-32571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175096#comment-17175096 ] A Tester commented on SPARK-32571: -- [~viirya] , if the application is a spark-streaming

[jira] [Updated] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32577: - Parent: SPARK-32461 Issue Type: Sub-task (was: Improvement) > Fix the config value for shuffled

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175052#comment-17175052 ] Sean R. Owen commented on SPARK-32530: -- I speak for myself, but, I think the cost i

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175010#comment-17175010 ] Pasha Finkeshteyn commented on SPARK-32530: --- Hi [~srowen], we agree with you t

[jira] [Commented] (SPARK-32528) The analyze method should make sure the plan is analyzed

[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174989#comment-17174989 ] Apache Spark commented on SPARK-32528: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-32528) The analyze method should make sure the plan is analyzed

[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174988#comment-17174988 ] Apache Spark commented on SPARK-32528: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32469. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29273 [https://gith

[jira] [Resolved] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32403. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29199 [https://gith

[jira] [Assigned] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32403: --- Assignee: angerszhu > SCRIP TRANSFORM Extract common method from process row to avoid repea

[jira] [Updated] (SPARK-32409) Document the dependency between spark.metrics.staticSources.enabled and JVMSource registration

[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32409: -- Issue Type: Documentation (was: Bug) > Document the dependency between spark.metrics.staticSo

[jira] [Assigned] (SPARK-32409) Document the dependency between spark.metrics.staticSources.enabled and JVMSource registration

[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32409: - Assignee: Luca Canali > Document the dependency between spark.metrics.staticSources.ena

[jira] [Resolved] (SPARK-32409) Document the dependency between spark.metrics.staticSources.enabled and JVMSource registration

[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32409. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Resolved] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pedro Rossi resolved SPARK-32235. - Fix Version/s: 3.1.0 Resolution: Fixed Issue was solved by SPARK-30122, but the same was

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174361#comment-17174361 ] Takeshi Yamamuro commented on SPARK-32580: -- I made the given query simpler; {co

[jira] [Comment Edited] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174361#comment-17174361 ] Takeshi Yamamuro edited comment on SPARK-32580 at 8/10/20, 2:38 PM: --

[jira] [Assigned] (SPARK-32517) Add StorageLevel.DISK_ONLY_3

[ https://issues.apache.org/jira/browse/SPARK-32517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32517: - Assignee: Dongjoon Hyun > Add StorageLevel.DISK_ONLY_3 > >

[jira] [Resolved] (SPARK-32517) Add StorageLevel.DISK_ONLY_3

[ https://issues.apache.org/jira/browse/SPARK-32517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32517. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29331 [https://

[jira] [Created] (SPARK-32582) Spark SQL Infer Schema Performance

Jarred Li created SPARK-32582: - Summary: Spark SQL Infer Schema Performance Key: SPARK-32582 URL: https://issues.apache.org/jira/browse/SPARK-32582 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-32554) Remove the words "experimental" in the k8s document

[ https://issues.apache.org/jira/browse/SPARK-32554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32554: -- Description: To make users understood more correctly about the current development status of

[jira] [Updated] (SPARK-32554) Remove the words "experimental" in the k8s document

[ https://issues.apache.org/jira/browse/SPARK-32554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32554: -- Summary: Remove the words "experimental" in the k8s document (was: Update the k8s document ac

[jira] [Assigned] (SPARK-32554) Update the k8s document according to the current development status

[ https://issues.apache.org/jira/browse/SPARK-32554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32554: - Assignee: Takeshi Yamamuro > Update the k8s document according to the current developme

[jira] [Resolved] (SPARK-32554) Update the k8s document according to the current development status

[ https://issues.apache.org/jira/browse/SPARK-32554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32554. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29368 [https://

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayrat Sadreev updated SPARK-32580: -- Attachment: ExplodeTest.java > Issue accessing a column values after 'explode' function >

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayrat Sadreev updated SPARK-32580: -- Attachment: data.json > Issue accessing a column values after 'explode' function > ---

[jira] [Comment Edited] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174303#comment-17174303 ] Takeshi Yamamuro edited comment on SPARK-32580 at 8/10/20, 1:26 PM: --

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174303#comment-17174303 ] Takeshi Yamamuro commented on SPARK-32580: -- Please do not use "Blocker" in the

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32580: - Component/s: (was: Spark Core) > Issue accessing a column values after 'explode' fun

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32580: - Priority: Major (was: Blocker) > Issue accessing a column values after 'explode' functi

[jira] [Assigned] (SPARK-32581) update duration property for live ui application list and application apis

[ https://issues.apache.org/jira/browse/SPARK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32581: Assignee: Apache Spark > update duration property for live ui application list and applic

[jira] [Commented] (SPARK-32581) update duration property for live ui application list and application apis

[ https://issues.apache.org/jira/browse/SPARK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174283#comment-17174283 ] Apache Spark commented on SPARK-32581: -- User 'zhli1142015' has created a pull reque

[jira] [Assigned] (SPARK-32581) update duration property for live ui application list and application apis

[ https://issues.apache.org/jira/browse/SPARK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32581: Assignee: (was: Apache Spark) > update duration property for live ui application list

[jira] [Commented] (SPARK-32581) update duration property for live ui application list and application apis

[ https://issues.apache.org/jira/browse/SPARK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174286#comment-17174286 ] Apache Spark commented on SPARK-32581: -- User 'zhli1142015' has created a pull reque

[jira] [Updated] (SPARK-32581) update duration property for live ui application list and application apis

[ https://issues.apache.org/jira/browse/SPARK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-32581: Attachment: updatedapiJPG.JPG oldapi.JPG > update duration property for live ui applicatio

[jira] [Created] (SPARK-32581) update duration property for live ui application list and application apis

Zhen Li created SPARK-32581: --- Summary: update duration property for live ui application list and application apis Key: SPARK-32581 URL: https://issues.apache.org/jira/browse/SPARK-32581 Project: Spark

[jira] [Comment Edited] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174263#comment-17174263 ] Takeshi Yamamuro edited comment on SPARK-29767 at 8/10/20, 11:48 AM: -

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174263#comment-17174263 ] Takeshi Yamamuro commented on SPARK-29767: -- I checked the given query and I thi

[jira] [Created] (SPARK-32580) Issue accessing a column values after 'explode' function

Ayrat Sadreev created SPARK-32580: - Summary: Issue accessing a column values after 'explode' function Key: SPARK-32580 URL: https://issues.apache.org/jira/browse/SPARK-32580 Project: Spark Is

[jira] [Updated] (SPARK-32290) NotInSubquery SingleColumn Optimize

[ https://issues.apache.org/jira/browse/SPARK-32290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32290: Priority: Major (was: Minor) > NotInSubquery SingleColumn Optimize >

[jira] [Updated] (SPARK-32409) Document the dependency between spark.metrics.staticSources.enabled and JVMSource registration

[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-32409: Summary: Document the dependency between spark.metrics.staticSources.enabled and JVMSource registr

[jira] [Updated] (SPARK-32573) Anti Join Improvement with EmptyHashedRelation and EmptyHashedRelationWithAllNullKeys

[ https://issues.apache.org/jira/browse/SPARK-32573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32573: Description: In SPARK-32290, we introduced several new types of HashedRelation * EmptyHashedRelat

[jira] [Commented] (SPARK-32576) Support PostgreSQL `bpchar` type and array of char type

[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174152#comment-17174152 ] Apache Spark commented on SPARK-32576: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-32576) Support PostgreSQL `bpchar` type and array of char type

[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174151#comment-17174151 ] Apache Spark commented on SPARK-32576: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-32579) Implement JDBCScan/ScanBuilder/WriteBuilder

[ https://issues.apache.org/jira/browse/SPARK-32579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174129#comment-17174129 ] Apache Spark commented on SPARK-32579: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-32579) Implement JDBCScan/ScanBuilder/WriteBuilder

[ https://issues.apache.org/jira/browse/SPARK-32579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174128#comment-17174128 ] Apache Spark commented on SPARK-32579: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-32579) Implement JDBCScan/ScanBuilder/WriteBuilder

[ https://issues.apache.org/jira/browse/SPARK-32579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32579: Assignee: Apache Spark > Implement JDBCScan/ScanBuilder/WriteBuilder > --

[jira] [Assigned] (SPARK-32579) Implement JDBCScan/ScanBuilder/WriteBuilder

[ https://issues.apache.org/jira/browse/SPARK-32579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32579: Assignee: (was: Apache Spark) > Implement JDBCScan/ScanBuilder/WriteBuilder > ---

[jira] [Created] (SPARK-32579) Implement JDBCScan/ScanBuilder/WriteBuilder

Huaxin Gao created SPARK-32579: -- Summary: Implement JDBCScan/ScanBuilder/WriteBuilder Key: SPARK-32579 URL: https://issues.apache.org/jira/browse/SPARK-32579 Project: Spark Issue Type: Sub-task