Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-11 Thread via GitHub
Hisoka-X commented on PR #8916: URL: https://github.com/apache/seatunnel/pull/8916#issuecomment-2703248003 > > Maybe fixing ClickHouse connector's sharding logic is a better option. > > Could you please provide more details? > > Currently the source using SQL to query data, if w

Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-11 Thread via GitHub
hailin0 merged PR #8916: URL: https://github.com/apache/seatunnel/pull/8916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-06 Thread via GitHub
Hisoka-X commented on code in PR #8916: URL: https://github.com/apache/seatunnel/pull/8916#discussion_r1982975782 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceReader.java: ## @@ -80,31 +

Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-06 Thread via GitHub
FrommyMind commented on PR #8916: URL: https://github.com/apache/seatunnel/pull/8916#issuecomment-2703238420 > Maybe fixing ClickHouse connector's sharding logic is a better option. Could you please provide more details? Currently the source using SQL to query data, if we tr

Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-05 Thread via GitHub
Hisoka-X commented on PR #8916: URL: https://github.com/apache/seatunnel/pull/8916#issuecomment-2703039586 Maybe fixing ClickHouse connector's sharding logic is a better option. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-05 Thread via GitHub
FrommyMind opened a new pull request, #8916: URL: https://github.com/apache/seatunnel/pull/8916 ### Purpose of this pull request close #8803 ### Does this PR introduce _any_ user-facing change? When use Clickhouse, use must set parallelism to 1.