Kontinuation commented on issue #1795: URL: https://github.com/apache/sedona/issues/1795#issuecomment-2649695054
Just to clarify that this problem happens not only on ADLS Gen2, but also on every file system supported by Hadoop, including local file system. The new shapefile reader does not have this problem, since the file discovery is not impacted by the [Hadoop hidden file filter](https://github.com/apache/hadoop/blob/rel/release-3.3.4/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/FileInputFormat.java#L93-L98). ```python # Define the path to the shapefile directory path = "abfss://[email protected]/_GEODATA/" # Read shapefiles df = spark.read.format("shapefile").load(path) # Print DataFrame count print(df.count()) df.show() ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
