[jira] [Commented] (ARROW-8056) [R] Support read and write orc file format

2021-08-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406137#comment-17406137 ] Arghya Saha commented on ARROW-8056: Hi [~yingzhou474] , any update on ORC support fo

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-07-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388797#comment-17388797 ] Arghya Saha commented on SPARK-18105: - [~dongjoon] Can we please address this before

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-07-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388794#comment-17388794 ] Arghya Saha edited comment on SPARK-18105 at 7/28/21, 1:55 PM: ---

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-07-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388794#comment-17388794 ] Arghya Saha commented on SPARK-18105: - I am also facing the same error, I have raise

[jira] [Updated] (SPARK-36196) Spark FetchFailedException Stream is corrupted Error

2021-07-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-36196: Affects Version/s: (was: 3.1.2) > Spark FetchFailedException Stream is corrupted Error > -

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-28 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388790#comment-17388790 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] Thanks again for your

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-21 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383743#comment-17383743 ] Arghya Saha edited comment on HADOOP-17789 at 7/21/21, 12:49 PM:

[jira] [Updated] (SPARK-36196) Spark FetchFailedException Stream is corrupted Error

2021-07-19 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-36196: Component/s: PySpark Kubernetes > Spark FetchFailedException Stream is corrupted

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-19 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383743#comment-17383743 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] Thanks for your all g

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382824#comment-17382824 ] Arghya Saha edited comment on HADOOP-17789 at 7/19/21, 6:27 AM: -

[jira] [Issue Comment Deleted] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated HADOOP-17789: - Comment: was deleted (was: [~ste...@apache.org] not sure what I am missing but I am getting ex

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383009#comment-17383009 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] Please find below the

[jira] [Updated] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated HADOOP-17789: - Attachment: storediag.log > S3 read performance with Spark with Hadoop 3.3.1 is slower than old

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382824#comment-17382824 ] Arghya Saha edited comment on HADOOP-17789 at 7/18/21, 1:47 PM: -

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382824#comment-17382824 ] Arghya Saha edited comment on HADOOP-17789 at 7/18/21, 1:47 PM: -

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382824#comment-17382824 ] Arghya Saha edited comment on HADOOP-17789 at 7/18/21, 1:46 PM: -

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382816#comment-17382816 ] Arghya Saha edited comment on HADOOP-17789 at 7/18/21, 1:33 PM: -

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382816#comment-17382816 ] Arghya Saha edited comment on HADOOP-17789 at 7/18/21, 1:33 PM: -

[jira] [Created] (SPARK-36196) Spark FetchFailedException Stream is corrupted Error

2021-07-18 Thread Arghya Saha (Jira)
Arghya Saha created SPARK-36196: --- Summary: Spark FetchFailedException Stream is corrupted Error Key: SPARK-36196 URL: https://issues.apache.org/jira/browse/SPARK-36196 Project: Spark Issue Type

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382824#comment-17382824 ] Arghya Saha commented on HADOOP-17789: -- Also, I am have tried with config (*spark

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-18 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382816#comment-17382816 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] not sure what I am mi

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-13 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380265#comment-17380265 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] Let me share the deta

[jira] [Created] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-02 Thread Arghya Saha (Jira)
Arghya Saha created HADOOP-17789: Summary: S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop Key: HADOOP-17789 URL: https://issues.apache.org/jira/browse/HADOOP-17789 Projec

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-02 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373622#comment-17373622 ] Arghya Saha commented on HADOOP-17755: -- https://issues.apache.org/jira/browse/HADO

[jira] [Created] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-02 Thread Arghya Saha (Jira)
Arghya Saha created HADOOP-17789: Summary: S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop Key: HADOOP-17789 URL: https://issues.apache.org/jira/browse/HADOOP-17789 Projec

[jira] [Comment Edited] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-02 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373310#comment-17373310 ] Arghya Saha edited comment on HADOOP-17755 at 7/2/21, 8:05 AM: --

[jira] [Comment Edited] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-02 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373310#comment-17373310 ] Arghya Saha edited comment on HADOOP-17755 at 7/2/21, 8:04 AM: --

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-02 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373310#comment-17373310 ] Arghya Saha commented on HADOOP-17755: -- [~dongjoon] Hi.. I have also used the defa

[jira] [Comment Edited] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-01 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373213#comment-17373213 ] Arghya Saha edited comment on HADOOP-17755 at 7/2/21, 4:17 AM: --

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-07-01 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373213#comment-17373213 ] Arghya Saha commented on HADOOP-17755: -- [~ste...@apache.org] Apologies for the del

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-06-24 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369235#comment-17369235 ] Arghya Saha commented on HADOOP-17755: -- [~ste...@apache.org] Sorry, Let me share t

[jira] [Commented] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-16 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364371#comment-17364371 ] Arghya Saha commented on SPARK-35700: - Any update on this please? This is very commo

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-13 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Created] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar(12) data type

2021-06-09 Thread Arghya Saha (Jira)
Arghya Saha created SPARK-35700: --- Summary: spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar(12) data type Key: SPARK-35700 URL: https://issues.apache.org/jira/browse/SPARK-35700

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Environment: Spark 3.1.1 on K8S (was: **Spark 3.1.1 on K8S**) > spark.sql.orc.filterPushdown not

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Summary: spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data ty

[jira] [Updated] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated HADOOP-17755: - Description: Hi I am trying to do some transformation using Spark 3.1.1-Hadoop 3.2 on K8s and

[jira] [Created] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-06-09 Thread Arghya Saha (Jira)
Arghya Saha created HADOOP-17755: Summary: EOF reached error reading ORC file on S3A Key: HADOOP-17755 URL: https://issues.apache.org/jira/browse/HADOOP-17755 Project: Hadoop Common Issue Typ

[jira] [Created] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-06-09 Thread Arghya Saha (Jira)
Arghya Saha created HADOOP-17755: Summary: EOF reached error reading ORC file on S3A Key: HADOOP-17755 URL: https://issues.apache.org/jira/browse/HADOOP-17755 Project: Hadoop Common Issue Typ

[jira] [Comment Edited] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

2021-05-16 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345731#comment-17345731 ] Arghya Saha edited comment on SPARK-34645 at 5/16/21, 3:08 PM: ---

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

2021-05-16 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345731#comment-17345731 ] Arghya Saha commented on SPARK-34645: - I am facing the same issue Spark 3.1.1 + JDK

[jira] [Created] (IMPALA-5782) Issue with WITH clause with Cloudera JDBC Driver for Impala - Returning column name instead of actual Data

2017-08-09 Thread Arghya Saha (JIRA)
Arghya Saha created IMPALA-5782: --- Summary: Issue with WITH clause with Cloudera JDBC Driver for Impala - Returning column name instead of actual Data Key: IMPALA-5782 URL: https://issues.apache.org/jira/browse/IMPAL