Hi I am facing a weird issue with the file parsing. My log files have a thorn 'รพ' as separator. I tried writing a test case for deserializer and kind of confused by the fact it works fine as I pass the line to the deserializer, however when i run it on hive the line is not split into columns and table inside hive has thorn as it is.
Any help would be appreciated. Thanks Ankit