liunaijie commented on issue #8604: URL: https://github.com/apache/seatunnel/issues/8604#issuecomment-2635809712
> > Thanks [@liunaijie](https://github.com/liunaijie) This is main reason of crash But I can't understood what wrong with this character it is just simply "?" ( I didn't try to add exceptions inside promt ) > > A lot of restrictions already added but it is not enough. Errors are not skipped. Also it is difficult to understand the real reason of crash all the job. > > First time crash was on ~3500 line ( 7500 total ) due to next line character like \r or some similar from excel cell where next line could be used. > > Maybe you can use this way to check. > > 1. remove LLM transform, update sink to `Console` - to check is this file can't be read/parse or the LLM can't input "?". > 2. if the `Console` print job can work well, you can add `Sql` transform first to filter out the record answer = ? , then use this output to LLM transform > 3. if the `Console` print job can't work well, we need fix the csv file reader. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
