[jira] [Created] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
William Montaz created SPARK-24150: -- Summary: Race condition in FsHistoryProvider Key: SPARK-24150 URL: https://issues.apache.org/jira/browse/SPARK-24150 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition between the method checkLogs and cleanLogs. cleanL

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition in checkLogs method between threads of replayExecu

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition in checkLogs method between threads of replayExecu

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition in checkLogs method between threads of replayExecu

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Priority: Major (was: Minor) > Race condition in FsHistoryProvider > ---

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition in checkLogs method between threads of replayExecu

[jira] [Updated] (SPARK-24150) Race condition in FsHistoryProvider

2018-05-02 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-24150: --- Description: There exist a race condition in checkLogs method between threads of replayExecu

[jira] [Updated] (SPARK-25973) Spark History Main page performance improvement

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-25973: --- Description: HistoryPage.scala counts applications (with a predicate depending on if it is

[jira] [Updated] (SPARK-25973) Spark History Main page performance improvement

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-25973: --- Summary: Spark History Main page performance improvement (was: Spark History Main page perf

[jira] [Created] (SPARK-25973) Spark History Main page performance improvment

2018-11-08 Thread William Montaz (JIRA)
William Montaz created SPARK-25973: -- Summary: Spark History Main page performance improvment Key: SPARK-25973 URL: https://issues.apache.org/jira/browse/SPARK-25973 Project: Spark Issue Type

[jira] [Updated] (SPARK-25973) Spark History Main page performance improvment

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-25973: --- Attachment: fix.patch > Spark History Main page performance improvment > ---

[jira] [Created] (SPARK-25975) Spark History does not display necessarily the incomplete applications when requested

2018-11-08 Thread William Montaz (JIRA)
William Montaz created SPARK-25975: -- Summary: Spark History does not display necessarily the incomplete applications when requested Key: SPARK-25975 URL: https://issues.apache.org/jira/browse/SPARK-25975

[jira] [Updated] (SPARK-25973) Spark History Main page performance improvement

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-25973: --- Priority: Minor (was: Major) > Spark History Main page performance improvement > --

[jira] [Commented] (SPARK-25973) Spark History Main page performance improvement

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679853#comment-16679853 ] William Montaz commented on SPARK-25973: New pull request on master branch https

[jira] [Commented] (SPARK-25973) Spark History Main page performance improvement

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679772#comment-16679772 ] William Montaz commented on SPARK-25973: Ok created https://github.com/apache/sp

[jira] [Updated] (SPARK-25975) Spark History does not display necessarily the incomplete applications when requested

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-25975: --- Attachment: fix.patch > Spark History does not display necessarily the incomplete applicatio

[jira] [Commented] (SPARK-25975) Spark History does not display necessarily the incomplete applications when requested

2018-11-08 Thread William Montaz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679788#comment-16679788 ] William Montaz commented on SPARK-25975: Associated pull request https://github.

[jira] [Created] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
William Montaz created SPARK-47520: -- Summary: Rounding issues with sum of floats/doubles leads to incorrect data after repartition Key: SPARK-47520 URL: https://issues.apache.org/jira/browse/SPARK-47520

[jira] [Updated] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024 Ev

[jira] [Updated] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024 Ev

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Summary: Precision issues with sum of floats/doubles leads to incorrect data after repartiti

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024 Ev

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

2024-03-22 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024 Ev

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition stage retry

2024-03-23 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Summary: Precision issues with sum of floats/doubles leads to incorrect data after repartiti

[jira] [Commented] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition stage retry

2025-01-20 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17914587#comment-17914587 ] William Montaz commented on SPARK-47520: Hello, I see no activity regarding thi