Eric Marnadi created SPARK-51373: ------------------------------------ Summary: Removing extra copy for column family prefix from 'ReplyChangelog' Key: SPARK-51373 URL: https://issues.apache.org/jira/browse/SPARK-51373 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 4.0.0, 4.1 Reporter: Eric Marnadi
There is currently an extra copy when column families are enabled to first remove the column family prefix, and then one to add this column family prefix back when replaying the changelog. Because we don't do anything with this prefix or the raw bytes, we don't need to add and remove and can instead just passthrough. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org