[
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingbo jiao updated SPARK-44381:
Description:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit -{-}master yarn --deploy-m
[
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742293#comment-17742293
]
qingbo jiao commented on SPARK-44381:
-
[~jshao] please cc ,thanks
> How to specify
[
https://issues.apache.org/jira/browse/SPARK-44353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44353.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Remove toAttributes from StructType
[
https://issues.apache.org/jira/browse/SPARK-44373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44373.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41938
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-44373:
Assignee: Kent Yao
> Wrap withActive for Dataset API w/ parse logic
> ---
[
https://issues.apache.org/jira/browse/SPARK-44334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44334.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41891
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-44334:
Assignee: Kent Yao
> Status of execution w/ error and w/o jobs shall be FAILED not COMPLETED
> --
[
https://issues.apache.org/jira/browse/SPARK-44370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44370.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41933
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-43755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742252#comment-17742252
]
Snoot.io commented on SPARK-43755:
--
User 'juliuszsompolski' has created a pull request
qingbo jiao created SPARK-44381:
---
Summary: How to specify parameters in spark-sumbit to make
HiveDelegationTokenProvider refresh token regularly
Key: SPARK-44381
URL: https://issues.apache.org/jira/browse/SPARK-4438
[
https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44340.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41899
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-44340:
---
Assignee: jiaan.geng
> Define the computing logic through PartitionEvaluator API and use it
[
https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742246#comment-17742246
]
Snoot.io commented on SPARK-44340:
--
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742247#comment-17742247
]
Snoot.io commented on SPARK-44340:
--
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43665.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41931
[https://
[
https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43665:
-
Assignee: Haejoon Lee
> Enable PandasSQLStringFormatter.vformat to work with Spark Conn
[
https://issues.apache.org/jira/browse/SPARK-44325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44325.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41884
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-44325:
Assignee: Vinod KC
> Define the computing logic through PartitionEvaluator API and use it in
> S
[
https://issues.apache.org/jira/browse/SPARK-44377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44377.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41944
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742234#comment-17742234
]
Yang Jie commented on SPARK-44377:
--
Fixed
> exclude junit5 deps from jersey-test-frame
[
https://issues.apache.org/jira/browse/SPARK-44377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44377:
Assignee: Yang Jie
> exclude junit5 deps from jersey-test-framework-provider-simple
> ---
[
https://issues.apache.org/jira/browse/SPARK-44374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-44374:
---
Fix Version/s: 3.5.0
> Add example code
>
>
> Key: SPARK-44374
>
[
https://issues.apache.org/jira/browse/SPARK-44374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu resolved SPARK-44374.
Resolution: Done
> Add example code
>
>
> Key: SPARK-44374
>
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1774#comment-1774
]
jiaan.geng commented on SPARK-44362:
Thank you.
> Use PartitionEvaluator API in
>
Takuya Ueshin created SPARK-44380:
-
Summary: Support for UDTF to analyze in Python
Key: SPARK-44380
URL: https://issues.apache.org/jira/browse/SPARK-44380
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44217:
---
Summary: Allow custom precision for fp approx equality (was: Add
assert_approx_df_equality util fun
[
https://issues.apache.org/jira/browse/SPARK-44264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44264.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41770
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-43513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742175#comment-17742175
]
Frederik Paradis commented on SPARK-43513:
--
Hi [~wenxin]. Thank you for your co
[
https://issues.apache.org/jira/browse/SPARK-43513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742175#comment-17742175
]
Frederik Paradis edited comment on SPARK-43513 at 7/11/23 9:02 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742146#comment-17742146
]
Bjørn Jørgensen commented on SPARK-44279:
-
have a look at https://github.com/apa
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742139#comment-17742139
]
Sean R. Owen commented on SPARK-44279:
--
This is a dumb question, but what is that f
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742137#comment-17742137
]
Bjørn Jørgensen commented on SPARK-44279:
-
[~srowen]
https://github.com/apache/
[
https://issues.apache.org/jira/browse/SPARK-44262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-44262:
-
Issue Type: Improvement (was: Bug)
Priority: Minor (was: Major)
> JdbcUtils hardcodes so
[
https://issues.apache.org/jira/browse/SPARK-43439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-43439:
-
Priority: Minor (was: Major)
> Drop does not work when passed a string with an alias
>
[
https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-44058.
--
Resolution: Not A Problem
> Remove deprecated API usage in HiveShim.scala
> --
[
https://issues.apache.org/jira/browse/SPARK-44379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shardul Mahadik updated SPARK-44379:
Description:
Context: After migrating to Spark 3 with AQE, we saw a significant increase i
[
https://issues.apache.org/jira/browse/SPARK-44379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742126#comment-17742126
]
Shardul Mahadik commented on SPARK-44379:
-
cc: [~cloud_fan] [~joshrosen] [~mridu
[
https://issues.apache.org/jira/browse/SPARK-44379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shardul Mahadik updated SPARK-44379:
Description:
Context: After migrating to Spark 3 with AQE, we saw a significant increase i
[
https://issues.apache.org/jira/browse/SPARK-44379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shardul Mahadik updated SPARK-44379:
Attachment: screenshot-1.png
> Broadcast Joins taking up too much memory
> ---
[
https://issues.apache.org/jira/browse/SPARK-44379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shardul Mahadik updated SPARK-44379:
Attachment: screenshot-2.png
> Broadcast Joins taking up too much memory
> ---
Shardul Mahadik created SPARK-44379:
---
Summary: Broadcast Joins taking up too much memory
Key: SPARK-44379
URL: https://issues.apache.org/jira/browse/SPARK-44379
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742120#comment-17742120
]
Sean R. Owen commented on SPARK-44279:
--
Is this a library that's used in spark? I c
[
https://issues.apache.org/jira/browse/SPARK-44304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-44304.
--
Resolution: Duplicate
> Broadcast operation is not required when no parameters are specified
>
[
https://issues.apache.org/jira/browse/SPARK-44377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742105#comment-17742105
]
Sean R. Owen commented on SPARK-44377:
--
Sure can you open a PR?
> exclude junit5 d
[
https://issues.apache.org/jira/browse/SPARK-44376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742104#comment-17742104
]
Sean R. Owen commented on SPARK-44376:
--
Did you run dev/change-scala-version.sh 2.1
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Attachment: image2.png
> Jobs that have join & have .rdd calls get executed 2x when AQE is ena
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Description:
We have a few spark scala jobs that are currently running in production. Most
jo
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44362:
-
Summary: Use PartitionEvaluator API in
AggregateInPandasExec,EvalPythonExec,AttachDistributedSequenceEx
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44362:
-
Description:
Use PartitionEvaluator API in
AggregateInPandasExec
EvalPythonExec
AttachDistributedSeq
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742099#comment-17742099
]
Vinod KC commented on SPARK-44362:
--
yes, please go ahead
> Use PartitionEvaluator API
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Description:
We have a few spark scala jobs that are currently running in production. Most
jo
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Attachment: Screenshot 2023-07-11 at 9.36.19 AM.png
> Jobs that have join & have .rdd calls ge
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Attachment: Screenshot 2023-07-11 at 9.36.14 AM.png
> Jobs that have join & have .rdd calls ge
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Description:
We have a few spark scala jobs that are currently running in production. Most
jo
Priyanka Raju created SPARK-44378:
-
Summary: Jobs that have join & have .rdd calls get executed 2x
when AQE is enabled.
Key: SPARK-44378
URL: https://issues.apache.org/jira/browse/SPARK-44378
Project:
[
https://issues.apache.org/jira/browse/SPARK-44360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44360.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41930
[https://
[
https://issues.apache.org/jira/browse/SPARK-44360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44360:
-
Assignee: Anton Okolnychyi
> Support schema pruning in delta-based MERGE operations
> -
[
https://issues.apache.org/jira/browse/SPARK-44377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-44377:
-
Description:
SPARK-44316 upgrade Jersey from 2.36 to 2.40. Jersey 2.38 start to use [Junit5
instead of
Yang Jie created SPARK-44377:
Summary: exclude junit5 deps from
jersey-test-framework-provider-simple
Key: SPARK-44377
URL: https://issues.apache.org/jira/browse/SPARK-44377
Project: Spark
Issue
Emil Ejbyfeldt created SPARK-44376:
--
Summary: Build using maven is broken using 2.13 and Java 11 and
Java 17
Key: SPARK-44376
URL: https://issues.apache.org/jira/browse/SPARK-44376
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742006#comment-17742006
]
Pratik Malani edited comment on SPARK-33782 at 7/11/23 1:33 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742006#comment-17742006
]
Pratik Malani commented on SPARK-33782:
---
Hi [~pralabhkumar]
The latest update in
Jia Fan created SPARK-44375:
---
Summary: Use PartitionEvaluator API in DebugExec
Key: SPARK-44375
URL: https://issues.apache.org/jira/browse/SPARK-44375
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742004#comment-17742004
]
Jia Fan commented on SPARK-44375:
-
I'm working on it.
> Use PartitionEvaluator API in D
Weichen Xu created SPARK-44374:
--
Summary: Add example code
Key: SPARK-44374
URL: https://issues.apache.org/jira/browse/SPARK-44374
Project: Spark
Issue Type: Sub-task
Components: Conne
[
https://issues.apache.org/jira/browse/SPARK-44374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-44374:
--
Assignee: Weichen Xu
> Add example code
>
>
> Key: SPARK-443
[
https://issues.apache.org/jira/browse/SPARK-42471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-42471:
--
Assignee: Weichen Xu
> Distributed ML <> spark connect
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-44341:
---
Summary: Define the computing logic through PartitionEvaluator API and use
it in WindowExec and Wind
Kent Yao created SPARK-44373:
Summary: Wrap withActive for Dataset API w/ parse logic
Key: SPARK-44373
URL: https://issues.apache.org/jira/browse/SPARK-44373
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-38476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-38476:
Assignee: Bo Zhang
> Use error classes in org.apache.spark.storage
>
[
https://issues.apache.org/jira/browse/SPARK-38476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-38476.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41923
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai-Michael Roesner updated SPARK-44354:
Description:
When trying to create a dataframe with a CharType or VarcharType colu
[
https://issues.apache.org/jira/browse/SPARK-44354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741925#comment-17741925
]
Kai-Michael Roesner commented on SPARK-44354:
-
PS: I tried to work around th
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741921#comment-17741921
]
jiaan.geng commented on SPARK-44362:
[~vinodkc] Because WindowInPandasExec related t
[
https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741916#comment-17741916
]
ASF GitHub Bot commented on SPARK-43665:
User 'itholic' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741915#comment-17741915
]
ASF GitHub Bot commented on SPARK-43665:
User 'itholic' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-44263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44263:
Assignee: Alice Sayutina
> Allow ChannelBuilder extensions -- Scala
> ---
[
https://issues.apache.org/jira/browse/SPARK-44263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44263.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41880
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-44320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44320.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41909
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-44320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44320:
Assignee: BingKun Pan
> Assign names to the error class _LEGACY_ERROR_TEMP_[1067,1150,1220,1265,1
Haejoon Lee created SPARK-44372:
---
Summary: Enable KernelDensity within Spark Connect
Key: SPARK-44372
URL: https://issues.apache.org/jira/browse/SPARK-44372
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-43629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43629:
Summary: Enable RDD dependent tests with Spark Connect (was: Enable RDD
with Spark Connect)
> En
[
https://issues.apache.org/jira/browse/SPARK-44371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741882#comment-17741882
]
jiaan.geng commented on SPARK-44371:
I'm working on.
> Define the computing logic t
jiaan.geng created SPARK-44371:
--
Summary: Define the computing logic through PartitionEvaluator API
and use it in CollectLimitExec, CollectTailExec, LocalLimitExec and
GlobalLimitExec
Key: SPARK-44371
URL: https://i
84 matches
Mail list logo
