[I] [Bug] [seatunnel-starter] 启动seatunnel任务-i 传递key=value value不支持空格、逗号等分隔,会导致value被截断丢失 [seatunnel]

2023-12-18 Thread via GitHub
1026409426 opened a new issue, #6023: URL: https://github.com/apache/seatunnel/issues/6023 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] spark engine can not read hive source [seatunnel]

2023-12-18 Thread via GitHub
Light-Towers commented on issue #5174: URL: https://github.com/apache/seatunnel/issues/5174#issuecomment-1859866895 @successok the problem has been solved now? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [I] [Bug] [Zeta] HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [seatunnel]

2023-12-18 Thread via GitHub
Light-Towers commented on issue #5861: URL: https://github.com/apache/seatunnel/issues/5861#issuecomment-1859870059 #5174 The same question -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[PR] [Improve] Remove useless code in doris sink and enable e2e [seatunnel]

2023-12-18 Thread via GitHub
Hisoka-X opened a new pull request, #6024: URL: https://github.com/apache/seatunnel/pull/6024 ### Purpose of this pull request This PR remove uesless code in Doris sink, and enable e2e test. ### Does this PR introduce _any_ user-facing change? no ##

Re: [PR] [Improve][CDC] Disable snapshot split memory buffer when `exactly_once` is turned off [seatunnel]

2023-12-18 Thread via GitHub
hailin0 commented on PR #6017: URL: https://github.com/apache/seatunnel/pull/6017#issuecomment-1859957145 test passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [improve][connector-tdengine] support read bool column from tdengine [seatunnel]

2023-12-18 Thread via GitHub
alextinng opened a new pull request, #6025: URL: https://github.com/apache/seatunnel/pull/6025 ### Purpose of this pull request supporting read bool column from tdengine. ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested?

Re: [PR] [improve][connector-tdengine] support read bool column from tdengine [seatunnel]

2023-12-18 Thread via GitHub
hailin0 commented on PR #6025: URL: https://github.com/apache/seatunnel/pull/6025#issuecomment-185995 please update https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-tdengine-e2e -- This is an automated message from the Apache Git Service.

Re: [PR] [Improve][CDC] Disable snapshot split memory buffer when `exactly_once` is turned off [seatunnel]

2023-12-18 Thread via GitHub
Hisoka-X merged PR #6017: URL: https://github.com/apache/seatunnel/pull/6017 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Feature][CDC] Improve snapshot read performance [seatunnel]

2023-12-18 Thread via GitHub
Hisoka-X closed issue #5349: [Feature][CDC] Improve snapshot read performance URL: https://github.com/apache/seatunnel/issues/5349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

(seatunnel) branch dev updated: [Improve][CDC] Disable memory buffering when `exactly_once` is turned off (#6017)

2023-12-18 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 300a624c5b [Improve][CDC] Disable memory buffering

[PR] [Bugfix][JDBC、CDC] Fix Spliter Error in Case of Extensive Duplicate Data [seatunnel]

2023-12-18 Thread via GitHub
ic4y opened a new pull request, #6026: URL: https://github.com/apache/seatunnel/pull/6026 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [ ] I

[PR] [Feature][JDBC、CDC] Support Short and Byte Type in spliter [seatunnel]

2023-12-18 Thread via GitHub
ic4y opened a new pull request, #6027: URL: https://github.com/apache/seatunnel/pull/6027 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [ ] I

[I] seatunnels&postgresql [seatunnel]

2023-12-18 Thread via GitHub
MZSY opened a new issue, #6028: URL: https://github.com/apache/seatunnel/issues/6028 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Improve] Add `SavePointFailedException` for savepoint failed [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN merged PR #5994: URL: https://github.com/apache/seatunnel/pull/5994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

(seatunnel) branch dev updated: [Improve] Add `SavePointFailedException` for savepoint failed (#5994)

2023-12-18 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 56d99562a1 [Improve] Add `SavePointFailedExcep

Re: [PR] [Hotfix][Jdbc] Fix jdbc setFetchSize error [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN merged PR #6005: URL: https://github.com/apache/seatunnel/pull/6005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

(seatunnel) branch dev updated: [Hotfix][Jdbc] Fix jdbc setFetchSize error (#6005)

2023-12-18 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new d41af8a6ed [Hotfix][Jdbc] Fix jdbc setFetchSiz

Re: [I] SQL validate failed:NOT FOUND TABEL [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] closed issue #5752: SQL validate failed:NOT FOUND TABEL URL: https://github.com/apache/seatunnel/issues/5752 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Bug] [connector-v2] [http-base] How do I pass a POST request when the body parameter is a form? [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] commented on issue #5761: URL: https://github.com/apache/seatunnel/issues/5761#issuecomment-1861904677 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [connector-v2] [http-base] How do I pass a POST request when the body parameter is a form? [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] closed issue #5761: [Bug] [connector-v2] [http-base] How do I pass a POST request when the body parameter is a form? URL: https://github.com/apache/seatunnel/issues/5761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [I] [connector-v2] [jdbc] sqlserver don't support UNIQUEIDENTIFIER type [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] commented on issue #5759: URL: https://github.com/apache/seatunnel/issues/5759#issuecomment-1861904696 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] SQL validate failed:NOT FOUND TABEL [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] commented on issue #5752: URL: https://github.com/apache/seatunnel/issues/5752#issuecomment-1861904728 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [connector-v2] [jdbc] sqlserver don't support UNIQUEIDENTIFIER type [seatunnel]

2023-12-18 Thread via GitHub
github-actions[bot] closed issue #5759: [connector-v2] [jdbc] sqlserver don't support UNIQUEIDENTIFIER type URL: https://github.com/apache/seatunnel/issues/5759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Bug] [Zeta] HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [seatunnel]

2023-12-18 Thread via GitHub
Light-Towers closed issue #5861: [Bug] [Zeta] HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V URL: https://github.com/apache/seatunnel/issues/5861 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [I] [Bug] [Zeta] HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [seatunnel]

2023-12-18 Thread via GitHub
Light-Towers commented on issue #5861: URL: https://github.com/apache/seatunnel/issues/5861#issuecomment-1861942455 use ${SEATUNNEL_HOME}/lib/hive-exec-2.3.9.jar instead of `hive-exec-3.1.3.jar` is success -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1430809381 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/sink/PulsarSinkWriter.java: ## @@ -0,0 +1,285 @@ +/* +

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1430809381 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/sink/PulsarSinkWriter.java: ## @@ -0,0 +1,285 @@ +/* +

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1430809811 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/sink/PulsarSinkWriter.java: ## @@ -0,0 +1,285 @@ +/* +

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1430810074 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/sink/PulsarSinkWriter.java: ## @@ -0,0 +1,285 @@ +/* +

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1430810518 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/state/PulsarSinkState.java: ## @@ -0,0 +1,33 @@ +/* +

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-18 Thread via GitHub
Carl-Zhou-CN commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r143088 ## seatunnel-connectors-v2/connector-pulsar/src/main/java/org/apache/seatunnel/connectors/seatunnel/pulsar/sink/PulsarSink.java: ## @@ -0,0 +1,151 @@ +/* + * Lic

Re: [I] [Bug] can not execute myssql-to-clickhouse job [seatunnel]

2023-12-18 Thread via GitHub
spihiker commented on issue #6021: URL: https://github.com/apache/seatunnel/issues/6021#issuecomment-1861968458 用flink cdc吧。这个bug太多了。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] seatunnels&postgresql [seatunnel]

2023-12-18 Thread via GitHub
MZSY commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1861985686 这里报错说找不到这个class文件java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry,我去看了postgis-jdbc.jar的包结构,只能找到net/postgis/jdbc这一级目录,往后的找不到了。我不确定是代码找的目录写错了,或者是我用的包版本不对,又或者是我其他地方配置有问题

[PR] [feature] add_starrocks_save_mode [seatunnel]

2023-12-18 Thread via GitHub
chl-wxp opened a new pull request, #6029: URL: https://github.com/apache/seatunnel/pull/6029 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [I] [Bug] [Starter] Checkpoint Config Use HDFS Namespace [seatunnel]

2023-12-18 Thread via GitHub
svea-vip closed issue #5906: [Bug] [Starter] Checkpoint Config Use HDFS Namespace URL: https://github.com/apache/seatunnel/issues/5906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [improve][connector-tdengine] support read bool column from tdengine [seatunnel]

2023-12-18 Thread via GitHub
alextinng commented on PR #6025: URL: https://github.com/apache/seatunnel/pull/6025#issuecomment-1862044735 > please update https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-tdengine-e2e done -- This is an automated message from the Apa

[I] [Feature][TIDB] TiDB Connector supports CDC or not. [seatunnel]

2023-12-18 Thread via GitHub
CodeExplorer10 opened a new issue, #6031: URL: https://github.com/apache/seatunnel/issues/6031 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature] support avro format [seatunnel]

2023-12-18 Thread via GitHub
zhilinli123 commented on PR #5084: URL: https://github.com/apache/seatunnel/pull/5084#issuecomment-1862282370 hi I found some issues in kafka avro e2e testing. My configuration is as follows ``` source { Kafka { bootstrap.servers = "kafkaCluster:9092" topic = "test_