[
https://issues.apache.org/jira/browse/PIG-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167284#comment-16167284
]
liyunzhang_intel edited comment on PIG-5305 at 9/15/17 3:44 AM:
----------------------------------------------------------------
[~szita]: several suggestions
1. can we only add {{pigtest-jar}} to {{test-spark}} target in build.xml? I
guess for {{test-tez}}, there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of
{{test-tez}} as the dependency of {{compile-test}} includes {{jar-simple}}. If
my understanding is not right, tell me.
2.please add comment {{added feature to re-initialize SparkContext when
switching between cluster and local mode PigServers}} on related code.
Besides, is there any unit test failures if convert {{SPARK_MASTER}} from
"local" to "yarn-client"?
was (Author: kellyzly):
[~szita]: several suggestions
1. can we only modify {{test-spark}} target in build.xml? I guess for
{{test-tez}}, there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of
{{test-tez}} as the dependency of {{compile-test}} includes {{jar-simple}}. If
my understanding is not right, tell me.
2.please add comment {{added feature to re-initialize SparkContext when
switching between cluster and local mode PigServers}} on related code.
Besides, is there any unit test failures if convert {{SPARK_MASTER}} from
"local" to "yarn-client"?
> Enable yarn-client mode execution of tests in Spark (1) mode
> ------------------------------------------------------------
>
> Key: PIG-5305
> URL: https://issues.apache.org/jira/browse/PIG-5305
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Adam Szita
> Assignee: Adam Szita
> Attachments: PIG-5305.0.patch
>
>
> See parent jira (PIG-5305) for problem description
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
