Shenson Joseph created IGNITE-12397:
---------------------------------------
Summary: Apache spark -
org.apache.ignite.IgniteIllegalStateException
Key: IGNITE-12397
URL: https://issues.apache.org/jira/browse/IGNITE-12397
Project: Ignite
Issue Type: Bug
Components: spark
Affects Versions: 2.7
Reporter: Shenson Joseph
Running spark application with apache ignite-2.7.0 throws following exception
This causes spark applications to die.Do we have a work around for this problem
9/11/26 16:38:50 INFO CoarseGrainedExecutorBackend: Got assigned task
1568109/11/26 16:38:50 INFO CoarseGrainedExecutorBackend: Got assigned task
15681019/11/26 16:38:50 INFO Executor: Running task 0.2 in stage 1564.0 (TID
156810)19/11/26 16:38:50 ERROR Executor: Exception in task 0.2 in stage 1564.0
(TID 156810)class org.apache.ignite.IgniteIllegalStateException: Ignite
instance with provided name doesn't exist. Did you call Ignition.start(..) to
start an Ignite instance? [name=shared-grid] at
org.apache.ignite.internal.IgnitionEx.grid(IgnitionEx.java:1390) at
org.apache.ignite.Ignition.ignite(Ignition.java:531) at
org.apache.ignite.spark.impl.package$.ignite(package.scala:86) at
org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:226)
at
org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:223)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:224) at
org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:145) at
org.apache.ignite.spark.impl.IgniteSQLDataFrameRDD.compute(IgniteSQLDataFrameRDD.scala:65)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99) at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55) at
org.apache.spark.scheduler.Task.run(Task.scala:123) at
org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)19/11/26 16:38:50 INFO
CoarseGrainedExecutorBackend: Got assigned task 15681119/11/26 16:38:50 INFO
Executor: Running task 0.3 in stage 1562.0 (TID 156811)19/11/26 16:38:50 ERROR
Executor: Exception in task 0.3 in stage 1562.0 (TID 156811)class
org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided
name doesn't exist.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
