Hi,
I wrote to parquet file as following:

+--------------------+
|                word|
+--------------------+
|THIS IS MY CHARACTERS ...|
|// ANOTHER LINE OF CHAC...|
+--------------------+

These lines are not full text and it is being trimmed down.
Does anyone know how many chacters StringType could handle ?

In the Spark code:
org.apache.spark.sql.types.StringType
/**
   * The default size of a value of the StringType is 4096 bytes.
   */
  override def defaultSize: Int = 4096


Thanks,
Kevin.

Reply via email to