[
https://issues.apache.org/jira/browse/FLINK-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951386#comment-14951386
]
ASF GitHub Bot commented on FLINK-2842:
---------------------------------------
Github user rmetzger commented on the pull request:
https://github.com/apache/flink/pull/1245#issuecomment-147009826
Great that we finally get rid of this AWS dependency.
It seems that the dependency actually influenced somehow other dependencies
from Hadoop.
I have a test in the YARN tests which verifies that the web interface is
working. It seems that the change has broken that test now, so most likely the
PR breaks the web interface.
```
YARNSessionFIFOITCase.testTaskManagerFailure:229
expected:<[{"taskmanagers": 1, "slots": 1}]> but was:<[<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
<title>Error 500
org.apache.http.client.utils.URLEncodedUtils.parse(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/util/List;</title>
</head>
<body><h2>HTTP ERROR 500</h2>
<p>Problem accessing /proxy/application_1444429019714_0007/jobsInfo. Reason:
<pre>
org.apache.http.client.utils.URLEncodedUtils.parse(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/util/List;</pre></p><h3>Caused
by:</h3><pre>java.lang.NoSuchMethodError:
org.apache.http.client.utils.URLEncodedUtils.parse(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/util/List;
at
org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.getUserName(PseudoAuthenticationHandler.java:124)
at
org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:160)
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:361)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1223)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
</pre>
<hr /><i><small>Powered by Jetty://</small></i><br/>
```
> S3FileSystem is broken
> ----------------------
>
> Key: FLINK-2842
> URL: https://issues.apache.org/jira/browse/FLINK-2842
> Project: Flink
> Issue Type: Bug
> Affects Versions: 0.9, 0.10
> Reporter: Fabian Hueske
> Assignee: Fabian Hueske
> Priority: Critical
> Fix For: 0.10
>
>
> Flink has a file system implementation for S3 which is broken. Therefore,
> Flink cannot out-of-the-box read data from S3.
> Since Flink can use all Hadoop FileSystems, I propose to completely remove
> Flink's S3FileSystem and rely on Hadoop's implementation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
