Hi, Vinodkc Yes, I found another solution, https://github.com/apache/spark/pull/4771/ I will test it later.
------------------ 原始邮件 ------------------ 发件人: "vinodkc";<vinod.kc...@gmail.com>; 发送时间: 2015年3月21日(星期六) 下午4:52 收件人: "dev"<dev@spark.apache.org>; 主题: Re: Filesystem closed Exception Hi Sea, I've raised a JIRA Issue on this : https://issues.apache.org/jira/browse/SPARK-6445 . Making a PR now On Sat, Mar 21, 2015 at 11:06 AM, Sea [via Apache Spark Developers List] < ml-node+s1001551n11145...@n3.nabble.com> wrote: > Hi, all: > > > > > When I exit the console of spark-sql， the following exception > throwed...... > > > My spark version is 1.3.0, hadoop version is 2.2.0 > > > Exception in thread "Thread-3" java.io.IOException: Filesystem closed > at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:629) > at > org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1677) > at > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106) > > at > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102) > > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102) > > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1397) > at > org.apache.spark.scheduler.EventLoggingListener.stop(EventLoggingListener.scala:196) > > at > org.apache.spark.SparkContext$$anonfun$stop$4.apply(SparkContext.scala:1388) > > at > org.apache.spark.SparkContext$$anonfun$stop$4.apply(SparkContext.scala:1388) > > at scala.Option.foreach(Option.scala:236) > at org.apache.spark.SparkContext.stop(SparkContext.scala:1388) > at > org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.stop(SparkSQLEnv.scala:66) > > at > org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$$anon$1.run(SparkSQLCLIDriver.scala:107) > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-developers-list.1001551.n3.nabble.com/Filesystem-closed-Exception-tp11145.html > To start a new topic under Apache Spark Developers List, email > ml-node+s1001551n...@n3.nabble.com > To unsubscribe from Apache Spark Developers List, click here > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=dmlub2Qua2MuaW5AZ21haWwuY29tfDF8MTk2Mjg4MTAzOA==> > . > NAML > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Filesystem-closed-Exception-tp11145p11148.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
