Re: S3 Metrics when reading/writing using Spark

Spark leverages the hadoop S3A connector, https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/connecting.html Specifics of S3 metrics are documented with AWS, https://docs.aws.amazon.com/AmazonS3/latest/userguide/metrics-dimensions.html Hope this helps. Best Regards Soumasish Goswam

CVE-2024-23945: Apache Hive and Spark: CookieSigner exposes the correct signature when message verification fails

Severity: important Affected versions: - Apache Hive 1.2.0 before 4.0.0 - Apache Spark 2.0.0 before 3.0.0 - Apache Spark 3.0.0 before 3.3.4 - Apache Spark 3.4.0 before 3.4.2 - Apache Spark 3.5.0 Description: Signing cookies is an application security feature that adds a digital signature to coo

S3 Metrics when reading/writing using Spark

Hi, I was looking for metrics specifying how many objects ("files") were read / written when using Spark over S3. The metrics specified at [ https://spark.apache.org/docs/3.5.1/monitoring.html#component-instance--executor] do not have objects written / read from s3 metric. I do see the Hadoop de