Shixiong have a PR working on this.
https://github.com/apache/spark/pull/5983
Sent from my iPhone
> On May 13, 2015, at 16:52, Reynold Xin wrote:
>
> Was looking at a PR test log just now. Can somebody take a look and remove
> the warnings (or just hide them)?
>
>
> 15/05/13 01:49:35 INFO UI
Hi, all
I got an ERROR when I build spark master branch with maven (commit:
|2d1e916730492f5d61b97da6c483d3223ca44315|)
|[INFO]
[INFO]
[INFO] Building Spark Project Catalyst 1.3.0-SNAPSHOT
[INFO] -
Is there any way to support multiple users executing SQL on one thrift
server?
I think there are some problems for spark 1.2.0, for example:
1. Start thrift server with user A
2. Connect to thrift server via beeline with user B
3. Execute “insert into table dest select … from table src”
then w
Hi, all
I have create a JIRA ticket about adding a monitor page for Thrift server.
https://issues.apache.org/jira/browse/SPARK-5100
Anyone could review the design doc, and give some advises?
-
To unsubscribe, e-mail: dev-unsub
Hi, all
We found some bugs in hive-0.12, but we could not wait for hive
community fixing them.
We want to fix these bugs in our lab and build a new release which could
be recognized by spark.
As we know, spark depends on a special release of hive, like:
|
org.spark-project.hive
hive-me
: make sure you got enough memory on each node, more than
SPARK_EXECUTOR_INSTANCES * SPARK_WORKER_MEMORY
Best Regards,
Yi Tian
tianyi.asiai...@gmail.com
On Sep 29, 2014, at 21:06, myasuka wrote:
> Our cluster is a standalone cluster with 16 computing nodes, each node has 16
> cores.
for yarn-client mode:
SPARK_EXECUTOR_CORES * SPARK_EXECUTOR_INSTANCES = 2(or 3) *
TotalCoresOnYourCluster
for standlone mode:
SPARK_WORKER_INSTANCES * SPARK_WORKER_CORES = 2(or 3) * TotalCoresOnYourCluster
Best Regards,
Yi Tian
tianyi.asiai...@gmail.com
On Sep 28, 2014, at 17:59
I think you should modify the module settings in IDEA instead of pom.xml
Best Regards,
Yi Tian
tianyi.asiai...@gmail.com
On Sep 26, 2014, at 18:09, Yanbo Liang wrote:
> Hi Hansu,
>
> I have encountered the same problem. Maven compiled avro file and generated
> corresponding
Hi Reynold!
Will sparkSQL strictly obey the HQL syntax ?
For example, the cube function.
In other words, the hiveContext of sparkSQL should only implement the subset of
HQL features?
Best Regards,
Yi Tian
tianyi.asiai...@gmail.com
On Sep 23, 2014, at 15:49, Reynold Xin wrote:
>
&
Hi, Will
We are planning to start implementing these functions.
We hope that we could make a general design in following week.
Best Regards,
Yi Tian
tianyi.asiai...@gmail.com
On Sep 23, 2014, at 23:39, Will Benton wrote:
> Hi Yi,
>
> I've had some interest in implemen
,
Yi Tian
tianyi.asiai...@gmail.com
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
e it is not worth it if YARN alpha will go away at some
> point and IntelliJ can easily be told where the extra src/ is.
>
> On Sun, Aug 31, 2014 at 3:38 AM, Yi Tian wrote:
>> Hi everyone!
>>
>> I found the YARN module has nonstandard path structure like:
>>
>>
Hi everyone!
I found the YARN module has nonstandard path structure like:
${SPARK_HOME}
|--yarn
|--alpha (contains yarn api support for 0.23 and 2.0.x)
|--stable (contains yarn api support for 2.2 and later)
| |--pom.xml (spark-yarn)
|--common (Common codes not depending
Hi, Devl!
I got the same problem.
You can try to upgrade your scala plugins to 0.41.2
It works on my mac.
On Aug 12, 2014, at 15:19, Devl Devel wrote:
> When compiling the master checkout of spark. The Intellij compile fails
> with:
>
>Error:(45, 8) not found: value $scope
>
>
14 matches
Mail list logo
