gnehil commented on PR #30368: URL: https://github.com/apache/doris/pull/30368#issuecomment-2003047727
> Colude you provide more details on the version requirements? Are there any specific requirements for the Spark version on the user service end? For the previous code, when writing the parquet file, the Row object is converted to an Internal Row object by calling the toRow method of RowEncoder. For this behavior in the RowEncoder class, spark 2 and spark 3 have different implementation methods, so spark load can only run in the spark 2 environment. For the current modification, use the apply method of InternalRow to initialize a new InternalRow object through the value array in the Row object. This method is implemented in the same way in spark 2 and spark 3, so spark load can run normally in both two versions of spark environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
