[
https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929275#comment-15929275
]
Michael Armbrust commented on SPARK-19982:
------------------------------------------
I'm not sure if changing weak to strong references will change
[anything|http://stackoverflow.com/questions/299659/what-is-the-difference-between-a-soft-reference-and-a-weak-reference-in-java].
It seems like there must be another handle to {{this}} since the test harness
is actively executing it. So either way it shouldn't be available for garbage
collection, or am I missing something?
> JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate
> an encoder for inner class"
> ---------------------------------------------------------------------------------------------------------
>
> Key: SPARK-19982
> URL: https://issues.apache.org/jira/browse/SPARK-19982
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 2.1.0
> Reporter: Jose Soltren
> Labels: flaky-test
>
> JavaDatasetSuite.testJavaBeanEncoder fails sporadically with the error below:
> Unable to generate an encoder for inner class
> `test.org.apache.spark.sql.JavaDatasetSuite$SimpleJavaBean` without access to
> the scope that this class was defined in. Try moving this class out of its
> parent class.
> From https://spark-tests.appspot.com/test-logs/35475788
> [~vanzin] looked into this back in October and reported:
> I ran this test in a loop (both alone and with the rest of the spark-sql
> tests) and never got a failure. I even used the same JDK as Jenkins
> (1.7.0_51).
> Also looked at the code and nothing seems wrong. The errors is when an entry
> with the parent class name is missing from the map kept in OuterScopes.scala,
> but the test populates that map in its first line. So it doesn't look like a
> race nor some issue with weak references (the map uses weak values).
> public void testJavaBeanEncoder() {
> OuterScopes.addOuterScope(this);
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
