Re: For the same data source in two SQLs, how to read it once?

2020-09-09 Thread Gang Li
If use a temporary table, the execution process is shown in the following figure Is there any way to achieve the following figure? than

Re: For the same data source in two SQLs, how to read it once?

2020-09-09 Thread Gang Li
Writing to the temporary table does allow the data source to read once, but writing to the temporary table will have disk I/O operations, and there is no effective use of Spark RDD's memory-based operations -- Sent

Re: For the same data source in two SQLs, how to read it once?

2020-09-09 Thread Yang shun
> > You can do this by creating a temporary table. > 1.Ensure that all fields are included and cached as a dataset when the data is first pulled(age、sex、other...) 2.When outputting to different tables, select different fields of the cached dataset.