Error - Spark STREAMING

2022-09-20 Thread Akash Vellukai
Hello, py4j.protocol.Py4JJavaError: An error occurred while calling o80.load. : java.lang.NoClassDefFoundError: org/apache/spark/sql/internal/connector/SimpleTableProvider May anyone help Me to solve this issue. Thanks and regards Akash

Data ingestion

2022-08-17 Thread Akash Vellukai
Dear Sir, How we could do data ingestion from MySQL to Hive with the help of Spark streaming and not with Kafka Thanks and regards Akash

Re: [EXTERNAL] Re: Spark streaming - Data Ingestion

2022-08-17 Thread Akash Vellukai
l.html> >to read Write Ahead logs(WAL) and send to Kafka >- Kafka connect to write to cloud storage -> Hive > - OR > > >- Spark streaming to parse WAL -> Storage -> Hive > > Regards > -- > *From:* Gibson >

Spark streaming - Data Ingestion

2022-08-17 Thread Akash Vellukai
Dear sir I have tried a lot on this could you help me with this? Data ingestion from MySql to Hive with spark- streaming? Could you give me an overview. Thanks and regards Akash P