and reading a local Parquet file from my hard drive.
-Chris
From: Cheng Lian [lian.cs@gmail.com]
Sent: Saturday, June 13, 2015 6:56 PM
To: Chris Freeman; user@spark.apache.org
Subject: Re: How to silence Parquet logging?
Hi Chris,
Which Spark version were you
log4j.logger.org.apache.spark.repl.SparkILoop$SparkILoopInterpreter=ERROR
This does, in fact, silence the logging for everything else, but the Parquet
config seems totally unchanged. Does anyone know how to do this?
Thanks!
-Chris Freeman
That did it! Thanks!
From: Yin Huai
Date: Friday, June 12, 2015 at 10:31 AM
To: Chris Freeman
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: Re: Issues with `when` in Column class
Hi Chris,
Have you imported "org.apache.spark.sql.functions._"?
Th
I’m trying to iterate through a list of Columns and create new Columns based on
a condition. However, the when method keeps giving me errors that don’t quite
make sense.
If I do `when(col === “abc”, 1).otherwise(0)` I get the following error at
compile time:
[error] not found: value when
Howe
