Hi all,
How are you testing your Spark applications?
We are writing features by using Cucumber. This is testing the behaviours. Is
this called functional test or integration test?
We are also planning to write unit tests.
For instance we have a class like below. It has one method. This methos i
Thank you Gourav,
Today I saw the article:
https://databricks.com/session/apache-spark-in-cloud-and-hybrid-why-security-and-governance-become-more-important
It seems also interesting.
I was in meeting, I will also watch it.
From: Gourav Sengupta
Date: 24 October 2018 Wednesday 13:39
To: "Ozsaka
Thank you very much 😊
From: Gourav Sengupta
Date: 24 October 2018 Wednesday 11:20
To: "Ozsakarya, Omer"
Cc: Spark Forum
Subject: Re: Triggering sql on Was S3 via Apache Spark
This is interesting you asked and then answered the questions (almost) as well
Regards,
Gourav
On Tue, 23 Oct 2018, 1
Hi guys,
We are using Apache Spark on a local machine.
I need to implement the scenario below.
In the initial load:
1. CRM application will send a file to a folder. This file contains customer
information of all customers. This file is in a folder in the local server.
File name is: custome
