unsubscribe

unsubscribe

Re:Question about how parquet files are read and processed

Hi， The advantage of Parquet is that it only scans the required columns, it is a file in a column storage format. The fewer columns you select, the less memory is required. Developers do not need to care about the details of loading data, they are well-designed and imperceptible to users.

Re:[Structured Streaming] Checkpoint file compact file grows big

SEE:http://spark.apache.org/docs/2.3.1/streaming-programming-guide.html#checkpointing "Note that checkpointing of RDDs incurs the cost of saving to reliable storage. This may cause an increase in the processing time of those batches where RDDs get checkpointed." As far as I know, the officia

Re:RE: Going it alone.

No wonder I said why I can't understand what the mail expresses, it feels like a joke…… 在 2020-04-16 02:28:49，seemanto.ba...@nomura.com.INVALID 写道： Have we been tricked by a bot ? From: Matt Smith Sent: Wednesday, April 15, 2020 2:23 PM To: jane thorpe Cc: dh.lo...@gmail.com;