[
https://issues.apache.org/jira/browse/SOLR-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17680305#comment-17680305
]
Michael Gibney commented on SOLR-16634:
---------------------------------------
Improvement-wise, it'd be valuable to experiment with adjusting the following
relative to one another:
# org.gradle.workers.max
# org.gradle.jvmargs=-Xmx[heapsize]
# tests.jvms (maybe?)
Ishan, I'm not sure why I didn't check when I initially looked at your
{{gradle.properties}} that you posted, but I notice that (unsurprisingly, given
your hardware :)) you are running with 12x parallelization.
{code}
# Maximum number of parallel gradle workers.
org.gradle.workers.max=12
# Maximum number of test JVMs forked per test task.
tests.jvms=12
{code}
I strongly suspect that this has an impact on the required heap of the
top-level gradle process -- i.e., that reducing {{org.gradle.workers.max}} or
increasing {{org.gradle.jvmargs=-Xmx[heapsize]}} accordingly will address the
situation. Ishan, if you can find a setting of
{{org.gradle.jvmargs=-Xmx[heapsize]}} that works for 12x parallelization,
that'd probably give us enough information to determine how it's necessary to
scale top-level heap size, and a minor update to
{{gradle/generation/local-settings.gradle}} should address the fixable problem
here.
IIUC (recalling conversations with Dawid Weiss and others), the "run
localSettings before initial run on clean checkout" situation is awkward, but
the options for making it less awkward are not great. Certainly open to
suggestions regarding how that process/prerequisite could be made more
transparent.
> "gradlew check" fails with OOM on fresh clone
> ---------------------------------------------
>
> Key: SOLR-16634
> URL: https://issues.apache.org/jira/browse/SOLR-16634
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Ishan Chattopadhyaya
> Priority: Major
>
> I have a 64GB machine, where a fresh Solr clone was done. "gradlew check"
> failed with this following:
> https://issues.apache.org/jira/browse/SOLR-15616?focusedCommentId=17679832&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17679832
> {code}
> [ishan@7980xe solr] $ ./gradlew check -x test -Pvalidation.errorprone=true
> Downloading gradle-wrapper.jar from
> https://raw.githubusercontent.com/gradle/gradle/v7.6.0/gradle/wrapper/gradle-wrapper.jar
> To honour the JVM settings for this build a single-use Daemon process will be
> forked. See
> https://docs.gradle.org/7.6/userguide/gradle_daemon.html#sec:disabling_the_daemon.
> Daemon will be stopped at the end of the build
> > Task :localSettings
> IMPORTANT. This is the first time you ran the build. I wrote some sane
> defaults (for this machine) to 'gradle.properties', they will be picked up on
> consecutive gradle invocations (not this one).
> Run gradlew :helpLocalSettings for more information.
> > Task :rat
> Trying to override old definition of task javadoc
> > Task :solr:solrj:compileJava
> Note: Some input files use or override a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> > Task :solr:solrj-streaming:compileJava
> Note: Some input files use or override a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> > Task :solr:solrj-zookeeper:compileJava
> Note: Some input files use or override a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> FAILURE: Build failed with an exception.
> * What went wrong:
> Gradle build daemon has been stopped: JVM garbage collector thrashing and
> after running out of JVM memory
> * Try:
> > Run with --stacktrace option to get the stack trace.
> > Run with --info or --debug option to get more log output.
> > Run with --scan to get full insights.
> * Get more help at https://help.gradle.org
> {code}
> For context, [~krisden] has attributed this to user error:
> https://issues.apache.org/jira/browse/SOLR-15616?focusedCommentId=17679837&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17679837
> Please also note that "gradlew localSettings" also resulted in a subsequent
> OOM failure (details here:
> https://issues.apache.org/jira/browse/SOLR-15616?focusedCommentId=17679841&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17679841)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org
