Wahno commented on issue #7990: URL: https://github.com/apache/incubator-doris/issues/7990#issuecomment-1033506485
> > > > Maybe we should add a mapping of STRING type and DataTypes.StringType. > > > > > > > > > I saw that this place needs to be added. What is your usage method? It may not be completely modified last time. You are welcome to submit a PR > > > > > > The usage is that the user only needs to specify the table identifiers of spark and doris, and the structure of the spark table and the doris table may be changed. My idea is to read the schema of the doris table and construct the matching data in spark and import it into doris. > > The RDD that was only considered before, this part of SQL may be ignored > > Thank you very much for your PR I have observed that there may be problems with the delimiter used in data splicing, such as '\t' or '\n' in normal data. I have replaced data transmission with json in my usage. Of course there may be performance degradation, but this method is still usable in the case of poor data quality. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
