[GitHub] [inlong] dockerzhang commented on issue #7875: [Bug]使用python对pulsar中的数据进行自主消费时无法对消息体解码

2023-04-20 Thread via GitHub
dockerzhang commented on issue #7875: URL: https://github.com/apache/inlong/issues/7875#issuecomment-1515874808 Hi, I'm sorry that there is no Python SDK parsing InLongMsg now. We could add this feature in the future. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [inlong] wang273257881 commented on issue #7875: [Bug]使用python对pulsar中的数据进行自主消费时无法对消息体解码

2023-04-20 Thread via GitHub
wang273257881 commented on issue #7875: URL: https://github.com/apache/inlong/issues/7875#issuecomment-1515880151 Nothing much, thank you for your reply. I tried using Python to call the official website’s Java code for parsing InLongMsg and it was successful. The issue has been resolved an

[GitHub] [inlong] dockerzhang commented on issue #7821: [Bug] 源数据使用pg数据库,目标数据使用pg数据库时,写入数据格式错误。

2023-04-20 Thread via GitHub
dockerzhang commented on issue #7821: URL: https://github.com/apache/inlong/issues/7821#issuecomment-1515889418 The sort module can not parse the `debezium json` correctly, and it's a verified issue. -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [inlong] fuweng11 opened a new pull request, #7884: [INLONG-7883][Manager] Invalidate user session when deleting user

2023-04-20 Thread via GitHub
fuweng11 opened a new pull request, #7884: URL: https://github.com/apache/inlong/pull/7884 ### Prepare a Pull Request - Fixes #7883 ### Motivation Invalidate user session when deleting user. ### Modifications Invalidate user session when deleting user. --

[GitHub] [inlong] dockerzhang commented on pull request #7744: [INLONG-7720][Manager] Creating schema of StreamSource by Excel

2023-04-20 Thread via GitHub
dockerzhang commented on PR #7744: URL: https://github.com/apache/inlong/pull/7744#issuecomment-1517168878 Implemented by #7720 sub-tasks, so close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [inlong] featzhang closed pull request #7744: [INLONG-7720][Manager] Creating schema of StreamSource by Excel

2023-04-20 Thread via GitHub
featzhang closed pull request #7744: [INLONG-7720][Manager] Creating schema of StreamSource by Excel URL: https://github.com/apache/inlong/pull/7744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [inlong] gong commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
gong commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173258301 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/split/MySqlSplitSerializer.java: ## @@ -226,6 +258,7 @@ public byte[] seriali

[GitHub] [inlong] EMsnap commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
EMsnap commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173266509 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/reader/MySqlRecordEmitter.java: ## @@ -219,12 +239,73 @@ private boolean sh

[GitHub] [inlong] e-mhui commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
e-mhui commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173268238 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/split/MySqlSplitSerializer.java: ## @@ -226,6 +258,7 @@ public byte[] seria

[GitHub] [inlong] EMsnap commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
EMsnap commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173269181 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/reader/MySqlRecordEmitter.java: ## @@ -219,12 +239,73 @@ private boolean sh

[GitHub] [inlong] EMsnap commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
EMsnap commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173272895 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/split/MySqlSplitSerializer.java: ## @@ -296,10 +329,12 @@ public MySqlSplit

[GitHub] [inlong] healchow commented on a diff in pull request #7884: [INLONG-7883][Manager] Invalidate user session when deleting user

2023-04-20 Thread via GitHub
healchow commented on code in PR #7884: URL: https://github.com/apache/inlong/pull/7884#discussion_r1173279504 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/user/UserServiceImpl.java: ## @@ -460,4 +466,28 @@ public void removeInChargeForConsum

[GitHub] [inlong] e-mhui commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
e-mhui commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173280928 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/reader/MySqlRecordEmitter.java: ## @@ -219,12 +239,73 @@ private boolean sh

[GitHub] [inlong] healchow commented on pull request #7884: [INLONG-7883][Manager] Invalidate user session when deleting user

2023-04-20 Thread via GitHub
healchow commented on PR #7884: URL: https://github.com/apache/inlong/pull/7884#issuecomment-1517227213 We need to consider a way to manage user information in a distributed manner. After deleting a user, all sessions in the Manager service will be invalidated. My idea is, without th

[GitHub] [inlong] e-mhui commented on a diff in pull request #7750: [INLONG-7554][Sort] MySQL CDC supports parsing gh-ost records

2023-04-20 Thread via GitHub
e-mhui commented on code in PR #7750: URL: https://github.com/apache/inlong/pull/7750#discussion_r1173288400 ## inlong-sort/sort-connectors/mysql-cdc/src/main/java/org/apache/inlong/sort/cdc/mysql/source/reader/MySqlRecordEmitter.java: ## @@ -219,12 +239,73 @@ private boolean sh

[GitHub] [inlong] dockerzhang merged pull request #7884: [INLONG-7883][Manager] Invalidate user session when deleting user

2023-04-20 Thread via GitHub
dockerzhang merged PR #7884: URL: https://github.com/apache/inlong/pull/7884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-7883][Manager] Invalidate user session when deleting user (#7884)

2023-04-20 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new f75f06bd8 [INLONG-7883][Manager] Invalidate

[GitHub] [inlong] dockerzhang commented on pull request #7878: [INLONG-7831][Sort] Using Spilling disk map to reduce memory loss for buffer per parititon data in iceberg ingesting

2023-04-20 Thread via GitHub
dockerzhang commented on PR #7878: URL: https://github.com/apache/inlong/pull/7878#issuecomment-1517318237 please add more detail about this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th