[
https://issues.apache.org/jira/browse/FLINK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481586#comment-17481586
]
Yun Gao edited comment on FLINK-18356 at 1/25/22, 7:03 AM:
-----------------------------------------------------------
!1234.jpg|width=651,height=313!
I compared the current master and the master on Dec 20th, 2021 and also the
current master + jemalloc, it seems
# The master on Dec 20th seems do not have too much difference with the
current master? But the running time of the current master is longer, perhaps
due to we have new cases.
# By changing to jemalloc, it seems the memory assumption is decreased a bit.
Since the memory used has been much beyond the heap limit, perhaps it is
related to memory fragment with libc?
# Another possible issue is whether we have class leaks: like some static
objects references classloader in some way, which might cause all the loaded
class could not be released, thus cause a high meta-space usage.
One possible hotfix is to not reuse the process first.
was (Author: gaoyunhaii):
!1234.jpg|width=651,height=313!
I compared the current master and the master on Dec 20th, 2021 and also the
current master + jemalloc, it seems
# The master on Dec 20th seems do not have too much difference with the
current master? But the running time of the current master is longer, perhaps
due to we have new cases.
# By changing to jemalloc, it seems the memory assumption is decreased a bit.
Since the memory used has been much beyond the heap limit, perhaps it is
related to memory fragment with libc?
One possible hotfix is to not reuse the process first.
> Exit code 137 returned from process
> -----------------------------------
>
> Key: FLINK-18356
> URL: https://issues.apache.org/jira/browse/FLINK-18356
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines, Tests
> Affects Versions: 1.12.0, 1.13.0, 1.14.0, 1.15.0
> Reporter: Piotr Nowojski
> Assignee: Dawid Wysakowicz
> Priority: Blocker
> Labels: pull-request-available, test-stability
> Fix For: 1.15.0
>
> Attachments: 1234.jpg
>
>
> {noformat}
> ============================= test session starts
> ==============================
> platform linux -- Python 3.7.3, pytest-5.4.3, py-1.8.2, pluggy-0.13.1
> cachedir: .tox/py37-cython/.pytest_cache
> rootdir: /__w/3/s/flink-python
> collected 568 items
> pyflink/common/tests/test_configuration.py .......... [
> 1%]
> pyflink/common/tests/test_execution_config.py ....................... [
> 5%]
> pyflink/dataset/tests/test_execution_environment.py .
> ##[error]Exit code 137 returned from process: file name '/bin/docker',
> arguments 'exec -i -u 1002
> 97fc4e22522d2ced1f4d23096b8929045d083dd0a99a4233a8b20d0489e9bddb
> /__a/externals/node/bin/node /__w/_temp/containerHandlerInvoker.js'.
> Finishing: Test - python
> {noformat}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=3729&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=8d78fe4f-d658-5c70-12f8-4921589024c3
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
