[GitHub] [doris] Im-Manshushu commented on issue #11258: [Feature] JSON data is dynamically written to the Doris table

[GitBox]

Im-Manshushu commented on issue #11258:
URL: https://github.com/apache/doris/issues/11258#issuecomment-1198096957

   Yes, that's it. A flink task can synchronize the data of the entire database
   
   
   
   
   
   
   
   ------------------ 原始邮件 ------------------
   发件人:                                                                         
                                               "apache/doris"                   
                                                                 
***@***.***>;
   发送时间: 2022年7月28日(星期四) 晚上8:31
   ***@***.***>;
   抄送: "I'm ~ ***@***.******@***.***>;
   主题: Re: [apache/doris] [Feature] JSON data is dynamically written to 
the Doris table (Issue #11258)
   
   
   
   
   
     
   生成
     
   canal json ---> serialize to RowData --> 
TableBufferMap<String,Buffer&gt; map
    key is {db}_{table}, buffer value is a buffer contained 
{"column_a":"value_a","column_b":"value_b"...}
    we can submit to http://xxx:xx/api/{db}/{table}/_streamLoad when buffer 
over size like doris-datax-writer.
    
   —
   Reply to this email directly, view it on GitHub, or unsubscribe.
   You are receiving this because you authored the thread.Message ID: 
***@***.***&gt;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org