YuriyGavrilov commented on issue #8604: URL: https://github.com/apache/seatunnel/issues/8604#issuecomment-2637842754
> > Thanks [@liunaijie](https://github.com/liunaijie) This is main reason of crash But I can't understood what wrong with this character it is just simply "?" ( I didn't try to add exceptions inside promt ) > > A lot of restrictions already added but it is not enough. Errors are not skipped. Also it is difficult to understand the real reason of crash all the job. > > First time crash was on ~3500 line ( 7500 total ) due to next line character like \r or some similar from excel cell where next line could be used. > > Maybe you can use this way to check. > > 1. remove LLM transform, update sink to `Console` - to check is this file can't be read/parse or the LLM can't input "?". > 2. if the `Console` print job can work well, you can add `Sql` transform first to filter out the record answer = ? , then use this output to LLM transform > 3. if the Console print job can't work well, we need to fix the csv file reader. csv output works fine, so need dig to llm and filtering i suppose ``` 2025-02-05 19:23:41,989 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - *********************************************** Job Statistic Information *********************************************** Start Time : 2025-02-05 19:11:01 End Time : 2025-02-05 19:23:41 Total Time(s) : 760 Total Read Count : 7590 Total Write Count : 7590 Total Failed Count : 0 *********************************************** �2025-02-05 19:23:41,990 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-606865] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN 2025-02-05 19:23:42,001 INFO [c.h.i.s.t.TcpServerConnection ] [hz.main.IO.thread-in-1] - [localhost]:5801 [seatunnel-606865] [5.1] Connection[id=1, /127.0.0.1:5801->/127.0.0.1:36645, qualifier=null, endpoint=[127.0.0.1]:36645, remoteUuid=b1fd9c44-49c7-4036-8d1b-f0afb3df0e0b, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side �2025-02-05 19:23:42,002 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-606865] [5.1] Removed connection to endpoint: [localhost]:5801:62e4d59c-0164-4e5c-a6ef-fe993b026bb7, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/127.0.0.1:36645->localhost/127.0.0.1:5801}, remoteAddress=[localhost]:5801, lastReadTime=2025-02-05 19:23:41.989, lastWriteTime=2025-02-05 19:23:41.987, closedTime=2025-02-05 19:23:41.991, connected server version=5.1} �2025-02-05 19:23:42,002 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-606865] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED �2025-02-05 19:23:42,003 INFO [c.h.c.i.ClientEndpointManager ] [hz.main.event-1] - [localhost]:5801 [seatunnel-606865] [5.1] Destroying ClientEndpoint{connection=Connection[id=1, /127.0.0.1:5801->/127.0.0.1:36645, qualifier=null, endpoint=[127.0.0.1]:36645, remoteUuid=b1fd9c44-49c7-4036-8d1b-f0afb3df0e0b, alive=false, connectionType=JVM, planeIndex=-1], clientUuid=b1fd9c44-49c7-4036-8d1b-f0afb3df0e0b, clientName=hz.client_1, authenticated=true, clientVersion=5.1, creationTime=1738782661612, latest clientAttributes=lastStatisticsCollectionTime=1738783421717,enterprise=false,clientType=JVM,clientVersion=5.1,clusterConnectionTimestamp=1738782661594,clientAddress=127.0.0.1,clientName=hz.client_1,credentials.principal=null,os.committedVirtualMemorySize=4301324288,os.freePhysicalMemorySize=3218112512,os.freeSwapSpaceSize=405217280,os.maxFileDescriptorCount=1048576,os.openFileDescriptorCount=85,os.processCpuTime=33770000000,os.systemLoadAverage=1.22,os.totalPhysicalMemorySize=16424837 120,os.totalSwapSpaceSize=1023406080,runtime.availableProcessors=4,runtime.freeMemory=306726320,runtime.maxMemory=477626368,runtime.totalMemory=430440448,runtime.uptime=766371,runtime.usedMemory=123714128, labels=[]} �2025-02-05 19:23:42,006 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-606865] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN 2025-02-05 19:23:42,007 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed SeaTunnel client...... �2025-02-05 19:23:42,007 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] [localhost]:5801 is SHUTTING_DOWN 2025-02-05 19:23:42,012 INFO [c.h.i.p.i.MigrationManager ] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-606865] [5.1] Shutdown request of Member [localhost]:5801 - 62e4d59c-0164-4e5c-a6ef-fe993b026bb7 [master node] [active master] this is handled �2025-02-05 19:23:42,017 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] Shutting down connection manager... �2025-02-05 19:23:42,019 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] Shutting down node engine... �2025-02-05 19:23:42,043 INFO [.s.s.o.e.j.s.AbstractConnector] [main] - Stopped ServerConnector@71f1cc02{HTTP/1.1, (http/1.1)}{0.0.0.0:8080} 2025-02-05 19:23:42,043 INFO [o.a.s.s.o.e.j.s.session ] [main] - node0 Stopped scavenging �2025-02-05 19:23:42,044 INFO [a.s.s.o.e.j.s.h.ContextHandler] [main] - Stopped o.a.s.s.o.e.j.s.ServletContextHandler@3b83459e{/,null,STOPPED} 2025-02-05 19:23:42,046 INFO [.c.c.DefaultClassLoaderService] [main] - close classloader service 2025-02-05 19:23:42,048 INFO [o.a.s.e.s.EventService ] [event-forwarder-0] - Event forward thread interrupted �2025-02-05 19:23:42,053 INFO [c.h.i.i.NodeExtension ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] Destroying node NodeExtension. �2025-02-05 19:23:42,054 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] Hazelcast Shutdown is completed in 43 ms. �2025-02-05 19:23:42,054 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-606865] [5.1] [localhost]:5801 is SHUTDOWN 2025-02-05 19:23:42,054 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed HazelcastInstance ...... 2025-02-05 19:23:42,054 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed metrics executor service ...... �2025-02-05 19:23:42,055 INFO [s.c.s.s.c.ClientExecuteCommand] [SeaTunnel-CompletableFuture-Thread-3] - run shutdown hook because get close signal ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
