-274
[cid:image002.png@01D166A7.36DE1270]
From: Subhash Sriram
Sent: Saturday, December 8, 2018 10:38 PM
To: David Markovitz
Cc: user@spark.apache.org
Subject: Re: Run SQL on files directly
Hi David,
I’m not sure if that is possible, but why not just read the CSV file using the
Scala API
Hi David,
I’m not sure if that is possible, but why not just read the CSV file using the
Scala API, specifying those options, and then query it using SQL by creating a
temp view?
Thanks,
Subhash
Sent from my iPhone
> On Dec 8, 2018, at 12:39 PM, David Markovitz
> wrote:
>
> Hi
> Spark SQL
Hi
Spark SQL supports direct querying on files
(here<https://spark.apache.org/docs/latest/sql-data-sources-load-save-functions.html#run-sql-on-files-directly>),
e.g. –
select * from csv.`/my/path/myfile.csv`
Does anybody know if it possible to pass options (sep, header, encoding etc.)
