May I get some requirement details? Such as: 1. The row count and one row data size 2. The avg length of text to be parsed by RegEx 3. The sample format of text to be parsed 4. The sample of current RegEx
-- Cheers, -z On Mon, 11 May 2020 18:40:49 -0400 Rishi Shah <rishishah.s...@gmail.com> wrote: > Hi All, > > I have a tagging problem at hand where we currently use regular expressions > to tag records. Is there a recommended way to distribute & tag? Data is > about 10TB large. > > -- > Regards, > > Rishi Shah --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
