ThriftServer LDAP doesn't work

Hi Team, My env is as follows: Hive:3.1.2 Spark: 2.2.0 Apache Hadoop: 3.1.2 I have Hive enabled with LDAP and by connecting to hive server 1 port from Beeline, I can query hive tables with right LDAP credentials. I want to make use of Spark capabilities to query hive. So, I copied hive-site.

Spark Dataframe returning null columns when schema is specified

Hi All, I have this problem where in Spark Dataframe is having null columns for the attributes from JSON that are not present. A clear explanation is provided below: *Use case:* Convert the JSON object into dataframe for further usage. *Case - 1:* Without specifying the schema for JSON: records.