Re: 回复: For the same data source in two SQLs, how to read it once？

I will pay attention in the future, thank you very much for your suggestions. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: For the same data source in two SQLs, how to read it once？

If use a temporary table, the execution process is shown in the following figure Is there any way to achieve the following figure? than

Re: For the same data source in two SQLs, how to read it once？

Writing to the temporary table does allow the data source to read once, but writing to the temporary table will have disk I/O operations, and there is no effective use of Spark RDD's memory-based operations -- Sent

For the same data source in two SQLs, how to read it once？

QL statements will generate two Physical Plan, and the data source "spark_input_test" will be read twice. If spark_input_test is read only once, it will save memory. Cheers, Gang Li -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --