[PR] [Feature][Transform-V2] Support SqlTransform Not Like Expression [seatunnel]

2024-01-03 Thread via GitHub
zhilinli123 opened a new pull request, #6123: URL: https://github.com/apache/seatunnel/pull/6123 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [I] seatunnels&postgresql [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875119876 @Carl-Zhou-CN In fact, I later tried to remove the postgis jar package and keep only the postgresql jar package, and there was no such problem. If I just want to copy spatial dat

Re: [I] seatunnels&postgresql [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875120730 Shall I raise this issue again or consult it here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] seatunnels&postgresql [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875128268 > Shall I raise this issue again or consult it here? You can create a new issue and associate it -- This is an automated message from the Apache Git Service. To respon

Re: [I] seatunnels&postgresql [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875129217 > @Carl-Zhou-CN In fact, I later tried to remove the postgis jar package and keep only the postgresql jar package, and there was no such problem. If I just want to copy spatia

Re: [I] [Bug] [clickhouse] clickhouse sink can not support mysql bigint [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #5968: URL: https://github.com/apache/seatunnel/issues/5968#issuecomment-1875135329 @0212 This doesn't seem to be a bug in my opinion, the restriction is to prevent loss of precision when importing Long type into Int, you can improve the type in clickhous

Re: [I] [Bug] [clickhouse] clickhouse sink can not support mysql bigint [seatunnel]

2024-01-03 Thread via GitHub
0212 closed issue #5968: [Bug] [clickhouse] clickhouse sink can not support mysql bigint URL: https://github.com/apache/seatunnel/issues/5968 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875147143 > > @Carl-Zhou-CN In fact, I later tried to remove the postgis jar package and keep only the postgresql jar package, and there was no such problem. If I just want to copy spatial

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875153571 I think you found a way to add jar packages differently due to PostgreSQL versions. I was hoping you could help me add a reminder to the documentation, re you interested?

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875179594 I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar package version. The PG ver

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1875195980 > I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar packag

Re: [PR] [Improve][Zeta] Add restore when commit failed [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer commented on PR #6101: URL: https://github.com/apache/seatunnel/pull/6101#issuecomment-1875245657 What test case can verify it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [Improve][Zeta] Add restore when commit failed [seatunnel]

2024-01-03 Thread via GitHub
Hisoka-X commented on PR #6101: URL: https://github.com/apache/seatunnel/pull/6101#issuecomment-1875246570 > What test case can verify it? adding -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer commented on code in PR #6115: URL: https://github.com/apache/seatunnel/pull/6115#discussion_r1440362793 ## seatunnel-formats/seatunnel-format-text/src/main/java/org/apache/seatunnel/format/text/TextSerializationSchema.java: ## @@ -134,11 +136,18 @@ private String

Re: [PR] [Improve][Zeta] Add restore when commit failed [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer commented on PR #6101: URL: https://github.com/apache/seatunnel/pull/6101#issuecomment-1875250932 > > What test case can verify it? > > adding Could you please offer the details? -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] [Feature][CDC] Support custom table primary key [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer merged PR #6106: URL: https://github.com/apache/seatunnel/pull/6106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@se

(seatunnel) branch dev updated: [Feature][CDC] Support custom table primary key (#6106)

2024-01-03 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 1312a1dd27 [Feature][CDC] Support custom tab

Re: [PR] [Improve] Shade hikari in jdbc connector [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer merged PR #6116: URL: https://github.com/apache/seatunnel/pull/6116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@se

(seatunnel) branch dev updated (1312a1dd27 -> dd698c95bf)

2024-01-03 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 1312a1dd27 [Feature][CDC] Support custom table primary key (#6106) add dd698c95bf [Improve][Connector-V2][

Re: [PR] [Feature][Connectors-v2-Jdbc] Supports Sqlserver Niche Data Types [seatunnel]

2024-01-03 Thread via GitHub
TyrantLucifer merged PR #6122: URL: https://github.com/apache/seatunnel/pull/6122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@se

(seatunnel) branch dev updated: [Feature][Connectors-V2][Jdbc] Supports Sqlserver Niche Data Types (#6122)

2024-01-03 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6673f6f771 [Feature][Connectors-V2][Jdbc] Su

Re: [PR] [Improve][Zeta] Add restore when commit failed [seatunnel]

2024-01-03 Thread via GitHub
Hisoka-X commented on PR #6101: URL: https://github.com/apache/seatunnel/pull/6101#issuecomment-1875258691 > Could you please offer the details? I'm adding test case, after it ready, I will push to this PR branch. -- This is an automated message from the Apache Git Service. To respo

[I] [Feature][API] Support declare nest row type with hocon style [seatunnel]

2024-01-03 Thread via GitHub
CheneyYin opened a new issue, #6124: URL: https://github.com/apache/seatunnel/issues/6124 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature] Support SaveMode on Doris [seatunnel]

2024-01-03 Thread via GitHub
hailin0 commented on code in PR #6085: URL: https://github.com/apache/seatunnel/pull/6085#discussion_r1440444042 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-doris-e2e/src/test/resources/write-cdc-changelog-to-doris.conf: ## @@ -36,7 +36,8 @@ sink { fenodes = "10.1

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun commented on code in PR #6115: URL: https://github.com/apache/seatunnel/pull/6115#discussion_r1440542111 ## seatunnel-formats/seatunnel-format-text/src/main/java/org/apache/seatunnel/format/text/TextSerializationSchema.java: ## @@ -134,11 +136,18 @@ private String con

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun commented on code in PR #6115: URL: https://github.com/apache/seatunnel/pull/6115#discussion_r1440542111 ## seatunnel-formats/seatunnel-format-text/src/main/java/org/apache/seatunnel/format/text/TextSerializationSchema.java: ## @@ -134,11 +136,18 @@ private String con

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun commented on code in PR #6115: URL: https://github.com/apache/seatunnel/pull/6115#discussion_r1440609355 ## seatunnel-formats/seatunnel-format-text/src/main/java/org/apache/seatunnel/format/text/TextSerializationSchema.java: ## @@ -134,11 +136,18 @@ private String con

Re: [I] 现在支持敏感字段数据屏蔽吗? [seatunnel]

2024-01-03 Thread via GitHub
github-actions[bot] commented on issue #5959: URL: https://github.com/apache/seatunnel/issues/5959#issuecomment-1876146865 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876162717 > > I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar package version. The PG

Re: [I] [Bug] [seatunnel web ] source name is empty [seatunnel]

2024-01-03 Thread via GitHub
BobFang2023 commented on issue #6073: URL: https://github.com/apache/seatunnel/issues/6073#issuecomment-1876177659 me too! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876200734 @frozer798 hi,I tried to use postgis/postgis:11-3.3 docker image to build the environment. Do as you say only need to add the https://repo1.maven.org/maven2/org/postgresql/pos

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun closed pull request #6115: [BugFix] Fix tiny int convert error in TextSerializationSchema URL: https://github.com/apache/seatunnel/pull/6115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] [BugFix] Fix tiny int convert error in TextSerializationSchema [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun commented on code in PR #6115: URL: https://github.com/apache/seatunnel/pull/6115#discussion_r1441186212 ## seatunnel-formats/seatunnel-format-text/src/main/java/org/apache/seatunnel/format/text/TextSerializationSchema.java: ## @@ -134,11 +136,18 @@ private String con

Re: [I] 启动报错 [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #5958: URL: https://github.com/apache/seatunnel/issues/5958#issuecomment-1876206855 ` org.apache.seatunnel seatunnel-hadoop3-3.1.4-uber ${project.version}

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2024-01-03 Thread via GitHub
dzygoon commented on PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#issuecomment-1876210091 why this commit not be merged? when doris source can be integration? thks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876212401 Sorry, there seems to be other problems, I will update after checking > @frozer798 hi,I tried to use postgis/postgis:11-3.3 docker image to build the environment. Do as

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2024-01-03 Thread via GitHub
Hisoka-X commented on PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#issuecomment-1876216023 > why this commit not be merged? when doris source can be integration? thks. Hi @dzygoon , this pr is working in process. After it ready, we can start review it. Then merge it.

[I] Support Doris Source [seatunnel]

2024-01-03 Thread via GitHub
dzygoon opened a new issue, #6126: URL: https://github.com/apache/seatunnel/issues/6126 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876233863 @frozer798 Sorry,current version seatunnel cannot transfer PostgreSQL to PostgreSQL geometry at this time because geometry is currently recognized as a String,It will be added

[I] Fatal Error [seatunnel]

2024-01-03 Thread via GitHub
yewujie1025 opened a new issue, #6127: URL: https://github.com/apache/seatunnel/issues/6127 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happen

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876238076 link #5872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [Improve] Add "download_datasource.sh" for downloading datasource. [seatunnel-web]

2024-01-03 Thread via GitHub
andyliumathematics commented on PR #136: URL: https://github.com/apache/seatunnel-web/pull/136#issuecomment-1876263661 i downloaded them and put them in apache-seatunnel-web-1.0.0-bin/libs,but when i select source name/database ... they are blank.why? ![1](https://github.com/apache/seatu

Re: [I] [Bug] [Module Name] Database didn't list Postgres after successful add datasource and green test connection [seatunnel]

2024-01-03 Thread via GitHub
BobFang2023 commented on issue #6004: URL: https://github.com/apache/seatunnel/issues/6004#issuecomment-1876269527 I tried adding SEATUNNEL_HOME to the environment variable and exported SEATUNNEL_HOME=/opt/apache-seatunnel-2.3, but there was still no data in the sub-database and sub-table m

Re: [I] [Bug] [seatunnel web ] source name is empty [seatunnel]

2024-01-03 Thread via GitHub
BobFang2023 commented on issue #6073: URL: https://github.com/apache/seatunnel/issues/6073#issuecomment-1876269727 > me too! I tried adding SEATUNNEL_HOME to the environment variable and exported SEATUNNEL_HOME=/opt/apache-seatunnel-2.3, but there was still no data in the sub-databas

Re: [I] [Bug] [Module Name] Database didn't list Postgres after successful add datasource and green test connection [seatunnel]

2024-01-03 Thread via GitHub
BobFang2023 commented on issue #6004: URL: https://github.com/apache/seatunnel/issues/6004#issuecomment-1876270142 > I tried adding SEATUNNEL_HOME to the environment variable and exported SEATUNNEL_HOME=/opt/apache-seatunnel-2.3, but there was still no data in the sub-database and sub-table

[PR] [Fix][TEST] Fix sql server catalog test case failed [seatunnel]

2024-01-03 Thread via GitHub
Hisoka-X opened a new pull request, #6128: URL: https://github.com/apache/seatunnel/pull/6128 ### Purpose of this pull request This PR fix sql server catalog test case failed. Check https://github.com/Hisoka-X/seatunnel-fork/actions/runs/7404790339/job/20146864389 for detail.

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2024-01-03 Thread via GitHub
dzygoon commented on PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#issuecomment-1876326785 > > why this commit not be merged? when doris source can be integration? thks. > > Hi @dzygoon , this pr is working in process. After it ready, we can start review it. Then merge

Re: [I] Support Doris Source [seatunnel]

2024-01-03 Thread via GitHub
dzygoon closed issue #6126: Support Doris Source URL: https://github.com/apache/seatunnel/issues/6126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: co

Re: [PR] [Fix][TEST] Fix sql server catalog test case failed [seatunnel]

2024-01-03 Thread via GitHub
ruanwenjun merged PR #6128: URL: https://github.com/apache/seatunnel/pull/6128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatu

(seatunnel) branch dev updated: [Fix][TEST] Fix sql server catalog test case failed (#6128)

2024-01-03 Thread wenjun
This is an automated email from the ASF dual-hosted git repository. wenjun pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6c35b0f2bb [Fix][TEST] Fix sql server catalog test

Re: [PR] [feature][doc] update doc for jdbc-connector [seatunnel]

2024-01-03 Thread via GitHub
ic4y merged PR #5765: URL: https://github.com/apache/seatunnel/pull/5765 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.a

(seatunnel) branch dev updated: [feature][doc] update doc for jdbc-connector (#5765)

2024-01-03 Thread ic4y
This is an automated email from the ASF dual-hosted git repository. ic4y pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4d31253993 [feature][doc] update doc for jdbc-connect

Re: [I] [Bug] [Module Name] Database didn't list Postgres after successful add datasource and green test connection [seatunnel]

2024-01-03 Thread via GitHub
Hu-WF commented on issue #6004: URL: https://github.com/apache/seatunnel/issues/6004#issuecomment-1876436177 I have solved this problem: Firstly, if you deploy SeaTunnel and SeaTunnel-Web on different nodes, when copying apache-seatunnel-2.3.3-bin.tar.gz as a client to the node where the

Re: [I] [Bug] [seatunnel web ] source name is empty [seatunnel]

2024-01-03 Thread via GitHub
Hu-WF commented on issue #6073: URL: https://github.com/apache/seatunnel/issues/6073#issuecomment-1876439524 I have solved this problem: Firstly, if you deploy SeaTunnel and SeaTunnel-Web on different nodes, when copying apache-seatunnel-2.3.3-bin.tar.gz as a client to the node where the

Re: [I] [Bug] [Zeta] HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [seatunnel]

2024-01-03 Thread via GitHub
jeanleen commented on issue #5861: URL: https://github.com/apache/seatunnel/issues/5861#issuecomment-1876464103 > use ${SEATUNNEL_HOME}/lib/hive-exec-2.3.9.jar instead of `hive-exec-3.1.3.jar` is success but it till bring another bug, it may be imcompatible version about hive3 and hi

Re: [I] [BUG] jdbc Connector PostgreSQL java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry [seatunnel]

2024-01-03 Thread via GitHub
frozer798 commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1876489222 > @frozer798 Sorry,current version seatunnel cannot transfer PostgreSQL to PostgreSQL geometry at this time because geometry is currently recognized as a String,It will be added

Re: [PR] [Feature] Support SaveMode on Doris [seatunnel]

2024-01-03 Thread via GitHub
EricJoy2048 merged PR #6085: URL: https://github.com/apache/seatunnel/pull/6085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

(seatunnel) branch dev updated: [Feature] Support SaveMode on Doris (#6085)

2024-01-03 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b2375fffe8 [Feature] Support SaveMode on Doris

Re: [PR] Modify the names of the JDBC E2E modules [seatunnel]

2024-01-03 Thread via GitHub
hnbian closed pull request #5997: Modify the names of the JDBC E2E modules URL: https://github.com/apache/seatunnel/pull/5997 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To