[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4164: [Feature][ConnectorV2]add file excel sink and source

[via GitHub]

MonsterChenzhuo commented on PR #4164:
URL: 
https://github.com/apache/incubator-seatunnel/pull/4164#issuecomment-1495847548

   ftp、Sftp test
   <img width="1021" alt="图片" 
src="https://user-images.githubusercontent.com/60029759/229781929-0ba5818f-2349-4abe-b8be-692ccd06dcfa.png";>
   
   <img width="1154" alt="图片" 
src="https://user-images.githubusercontent.com/60029759/229784458-1dd1ab66-8a92-44c9-bd7c-78702d417095.png";>
   
   2023-04-04 19:56:34,442 INFO  
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SeaTunnel 
LocalFileSource -> Sink Writer: Console (1/1) 
(8b5f4516a0f742f909722f9b2391f00a) switched from DEPLOYING to INITIALIZING.
   2023-04-04 19:56:34,535 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
output rowType: c_map<Map<STRING, STRING>>, c_array<ARRAY<INT>>, 
c_string<STRING>, c_boolean<BOOLEAN>, c_tinyint<TINYINT>, c_smallint<SMALLINT>, 
c_int<INT>, c_bigint<BIGINT>, c_float<FLOAT>, c_double<DOUBLE>, c_bytes<BYTES>, 
c_date<DATE>, c_decimal<Decimal(38, 18)>, c_timestamp<TIMESTAMP>, 
c_row<ROW<c_map Map<STRING, STRING>,c_array ARRAY<INT>,c_string 
STRING,c_boolean BOOLEAN,c_tinyint TINYINT,c_smallint SMALLINT,c_int 
INT,c_bigint BIGINT,c_float FLOAT,c_double DOUBLE,c_bytes BYTES,c_date 
DATE,c_decimal Decimal(38, 18),c_timestamp TIMESTAMP>>
   2023-04-04 19:56:34,548 INFO  
org.apache.seatunnel.translation.flink.source.BaseSeaTunnelSourceFunction - 
Consumer subtask 0 has no restore state.
   2023-04-04 19:56:34,556 INFO  
org.apache.seatunnel.connectors.seatunnel.file.source.split.FileSourceSplitEnumerator
 - SubTask 0 is assigned to [file:/Users/zhuoyuchen/Desktop/e2e.xlsx]
   2023-04-04 19:56:34,558 INFO  org.apache.flink.runtime.taskmanager.Task - 
Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1)#0 
(8b5f4516a0f742f909722f9b2391f00a) switched from INITIALIZING to RUNNING.
   2023-04-04 19:56:34,559 INFO  
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SeaTunnel 
LocalFileSource -> Sink Writer: Console (1/1) 
(8b5f4516a0f742f909722f9b2391f00a) switched from INITIALIZING to RUNNING.
   2023-04-04 19:56:35,302 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
subtaskIndex=0  rowIndex=1:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 
{"OQBqH":"wTKAH","rkvlO":"KXStv","pCMEX":"CyJKx","DAgdj":"SMbQe","dsJag":"jyFsb"},
 [2095115245, 220036717, 1427565674, 454707262, 1254213323], rDAya, true, 25, 
22478, 1333226130, 2121369863495191552, 3.2607235E38, 9.981217840075622E307, 
[91, 55, 55, 44, 32, 49, 49, 54, 44, 32, 56, 57, 44, 32, 49, 49, 56, 44, 32, 
49, 49, 57, 93], 2023-06-13, 6.174646127906821E+19, 2023-05-17T00:36:12, 
[{"gfBji":"emeXF","BCStD":"cUZwy","XyMkz":"CWBGW","nTHbQ":"Oaaos","IwjTs":"zyGjf"},
 [1939637044, 1066960875, 2141621606, 1638720300, 1269572120], YjilG, false, 
11, 26418, 1110174340, 4728476106429842432, 2.0147008E38, 
8.338846635117556E307, [85, 120, 116, 114, 82], 2023-12-18, 
7.627320560637959E+19, 2023-03-04T07:08:58]
   2023-04-04 19:56:35,309 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
subtaskIndex=0  rowIndex=2:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 
{"CsNWf":"zPqJw","TpNjQ":"PRJVp","vrnjO":"DPLgU","CiqBl":"buNOk","zwxrj":"amWQB"},
 [1907780289, 603006068, 1499103511, 1664361282, 1954659141], tlGZx, false, 57, 
12377, 2018512972, 4289484500905522176, 1.6261603E37, 3.212515417004616E307, 
[91, 54, 57, 44, 32, 54, 56, 44, 32, 56, 52, 44, 32, 49, 49, 53, 44, 32, 56, 
53, 93], 2023-04-09, 9.910022191838642E+19, 2023-04-26T13:34:37, 
[{"nQKso":"SieuO","EWTvX":"tiNDg","BNQQk":"gTHin","WJRGR":"aEvAo","UaBqo":"uYQKS"},
 [1532331195, 1937694896, 1076700740, 1918982238, 1848188893], pMXdt, true, 29, 
26801, 1176668170, 6979831097367872512, 3.1210152E38, 1.2397703959747439E308, 
[105, 71, 115, 110, 66], 2023-12-06, 9.145198807616533E+19, 2023-06-25T14:48:32]
   2023-04-04 19:56:35,320 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
subtaskIndex=0  rowIndex=3:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 
{"BcQrZ":"NeqLL","UjbSy":"zOQTN","GXPZh":"fbhIe","weICe":"TgbNo","Ceexe":"SLocM"},
 [568165232, 148140995, 1424723363, 143852139, 1739017648], OJAhJ, false, 49, 
10355, 753397823, 8716948125956533248, 6.9086283E37, 1.4531838439908356E308, 
[91, 54, 54, 44, 32, 49, 49, 50, 44, 32, 49, 49, 51, 44, 32, 49, 48, 50, 44, 
32, 56, 53, 93], 2023-04-23, 3.5313325785835196E+19, 2023-07-25T00:49:42, 
[{"NHAod":"bEHsL","kFhyq":"jGVeW","NNbGi":"fiaxs","lUXii":"wsAXk","vpZUY":"RwBrv"},
 [1166108684, 33568523, 1631516316, 1056141081, 383999373], DKzXf, false, 55, 
11647, 491155597, 4631245454348803072, 2.3000027E38, 4.994745800575068E307, 
[116, 79, 97, 122, 106], 2023-10-24, 1.33589056880950554E+18, 
2023-04-13T12:07:20]
   2023-04-04 19:56:35,330 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
subtaskIndex=0  rowIndex=4:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 
{"gQcKG":"wuZrm","XqhQR":"EUSBe","znPMm":"cBsFV","IFUis":"TqoeT","UNNUM":"QflNg"},
 [884099422, 575096287, 1474286603, 460734375, 331544071], XbsPD, true, 83, 
23047, 197040251, 1214385768298543104, 2.7490064E38, 4.85325598318931E307, [91, 
55, 51, 44, 32, 49, 50, 48, 44, 32, 49, 49, 57, 44, 32, 56, 50, 44, 32, 55, 55, 
93], 2023-10-18, 4.371249109784438E+19, 2023-08-20T20:30:20, 
[{"ZwGBS":"qFbmG","yLoFX":"yaFBz","adCij":"iqota","YhIKB":"nljjK","vFtfq":"sztOi"},
 [1603101335, 306333008, 558717179, 1685313180, 1123190321], QTUED, false, 122, 
28275, 784631344, 2666059071953321984, 2.1216978E38, 2.16231799113261E307, 
[118, 69, 71, 66, 73], 2023-08-14, 3.2126522713088406E+19, 2023-09-05T05:09:43]
   2023-04-04 19:56:35,337 INFO  
org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - 
subtaskIndex=0  rowIndex=5:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 
{"GvYvC":"GwQeI","lcbKQ":"hxMBm","IAZcR":"oLGcX","nSKXZ":"mwReC","lhKXf":"fUSym"},
 [1032612363, 853726186, 1552190828, 1279372680, 1338787938], LnIBa, true, 40, 
20216, 169628980, 1300092495241966592, 1.5487907E38, 1.7080796439354392E306, 
[91, 57, 55, 44, 32, 49, 49, 57, 44, 32, 55, 51, 44, 32, 49, 49, 55, 44, 32, 
56, 56, 93], 2023-01-02, 3.906035407715534E+19, 2023-11-23T12:40:16, 
[{"TAViV":"vgCTK","iZXas":"RtBlu","OLnHX":"BSGYj","srkpH":"pGNkJ","PIhFt":"OqSDa"},
 [400240622, 159949170, 1012001551, 13013702, 1794182386], vzVkD, true, 70, 
12001, 1664931122, 9193584532670996480, 1.5386908E38, 9.915098876262986E305, 
[77, 71, 66, 87, 102], 2023-03-01, 8.006372520258236E+19, 2023-11-15T12:17:11]
   2023-04-04 19:56:35,342 INFO  
org.apache.seatunnel.connectors.seatunnel.file.source.BaseFileSourceReader - 
Closed the bounded File source
   2023-04-04 19:56:35,360 INFO  org.apache.flink.runtime.taskmanager.Task - 
Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1)#0 
(8b5f4516a0f742f909722f9b2391f00a) switched from RUNNING to FINISHED.
   
   
   
   
   
   <img width="1268" alt="图片" 
src="https://user-images.githubusercontent.com/60029759/229781890-941afaf6-aca5-4b5c-b024-dc09c8021d6b.png";>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org