[jira] [Created] (HDFS-15944) Prevent truncation with snprintf
Gautham Banasandra created HDFS-15944:
-
Summary: Prevent truncation with snprintf
Key: HDFS-15944
URL: https://issues.apache.org/jira/browse/HDFS-15944
Project: Hadoop HDFS
Issue Type: Bug
Components: fuse-dfs, libhdfs
Affects Versions: 3.4.0
Reporter: Gautham Banasandra
Assignee: Gautham Banasandra
There are some areas of code in libhdfs and fuse-dfs components where the
destination buffer is smaller than the source that's trying to write. This
would cause truncation. Thus we need to ensure that the source that's being
written doesn't exceed the destination buffer size.
The following warnings are reported for this issue -
{code}
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:
In function ‘doTestHdfsOperations.isra.0’:
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:226:39:
warning: ‘/many_files_’ directive output may be truncated writing 12 bytes
into a region of size between 1 and 4096 [-Wformat-truncation=]
226 | snprintf(filename, PATH_MAX, "%s/many_files_%d", listDirTest,
nFile);
| ^~~~
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:226:36:
note: directive argument in the range [0, ]
226 | snprintf(filename, PATH_MAX, "%s/many_files_%d", listDirTest,
nFile);
|^~
In file included from /usr/include/stdio.h:867,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:19:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note:
‘__builtin___snprintf_chk’ output between 14 and 4112 bytes into a destination
of size 4096
67 | return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
| ^~~~
68 |__bos (__s), __fmt, __va_arg_pack ());
|~
{code}
{code}
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:255:33:
warning: ‘/a’ directive output may be truncated writing 2 bytes into a region
of size between 1 and 4096 [-Wformat-truncation=]
255 | snprintf(tmp, sizeof(tmp), "%s/a", base);
| ^~
In file included from /usr/include/stdio.h:867,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:22:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note:
‘__builtin___snprintf_chk’ output between 3 and 4098 bytes into a destination
of size 4096
67 | return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
| ^~~~
68 |__bos (__s), __fmt, __va_arg_pack ());
|~
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:263:33:
warning: ‘/b’ directive output may be truncated writing 2 bytes into a region
of size between 1 and 4096 [-Wformat-truncation=]
263 | snprintf(tmp, sizeof(tmp), "%s/b", base);
| ^~
In file included from /usr/include/stdio.h:867,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
from
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:22:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note:
‘__builtin___snprintf_chk’ output between 3 and 4098 bytes into a destination
of size 4096
67 | return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
| ^~~~
68 |__bos (__s), __fmt, __va_arg_pack ());
|~
/mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-nativ
[jira] [Created] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately
Takanobu Asanuma created HDFS-15945: --- Summary: DataNodes with zero capacity and zero blocks should be decommissioned immediately Key: HDFS-15945 URL: https://issues.apache.org/jira/browse/HDFS-15945 Project: Hadoop HDFS Issue Type: Bug Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma Such as when there is a storage problem, DataNode capacity and block count becomes zero. When I tried to decommission those DataNodes, I ran into an issue that the decommission did not complete because the NameNode had not received their first block report. I think those DataNodes should be decommissioned immediately even if they haven't reported the first block report. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15946) Fix java doc in FSPermissionChecker
tomscut created HDFS-15946: -- Summary: Fix java doc in FSPermissionChecker Key: HDFS-15946 URL: https://issues.apache.org/jira/browse/HDFS-15946 Project: Hadoop HDFS Issue Type: Wish Reporter: tomscut Assignee: tomscut Fix java doc for org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker#hasAclPermission. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen spotbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.fs.TestFileUtil hadoop.crypto.key.kms.server.TestKMS hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.datanode.TestBlockRecovery hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.yarn.server.nodemanager.TestNodeStatusUpdater hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.task.reduce.TestFetcher hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator hadoop.tools.TestDistCpSystem hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.service.TestResourceEstimatorService hadoop.resourceestimator.solver.impl.TestLpSolver cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-compile-javac-root.txt [496K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-checkstyle-root.txt [16M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/patch-mvnsite-root.txt [812K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-patch-pylint.txt [48K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-patch-shellcheck.txt [56K] shelldocs: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-patch-shelldocs.txt [8.0K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/diff-javadoc-javadoc-root.txt [20K] spotbugs: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-build-tools.txt [60K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-project.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-annotations.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-project-dist.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-assemblies.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-maven-plugins.txt [28K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-minikdc.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-auth.txt [28K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/256/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-auth-exampl
[jira] [Resolved] (HDFS-15944) Prevent truncation by snprintf
[
https://issues.apache.org/jira/browse/HDFS-15944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Íñigo Goiri resolved HDFS-15944.
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Prevent truncation by snprintf
> --
>
> Key: HDFS-15944
> URL: https://issues.apache.org/jira/browse/HDFS-15944
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: fuse-dfs, libhdfs
>Affects Versions: 3.4.0
>Reporter: Gautham Banasandra
>Assignee: Gautham Banasandra
>Priority: Critical
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> There are some areas of code in libhdfs and fuse-dfs components where the
> destination buffer is smaller than the source that's trying to write. This
> would cause truncation. Thus we need to ensure that the source that's being
> written doesn't exceed the destination buffer size.
> The following warnings are reported for this issue -
> {code}
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:
> In function ‘doTestHdfsOperations.isra.0’:
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:226:39:
> warning: ‘/many_files_’ directive output may be truncated writing 12 bytes
> into a region of size between 1 and 4096 [-Wformat-truncation=]
> 226 | snprintf(filename, PATH_MAX, "%s/many_files_%d", listDirTest,
> nFile);
> | ^~~~
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:226:36:
> note: directive argument in the range [0, ]
> 226 | snprintf(filename, PATH_MAX, "%s/many_files_%d", listDirTest,
> nFile);
> |^~
> In file included from /usr/include/stdio.h:867,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:19:
> /usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note:
> ‘__builtin___snprintf_chk’ output between 14 and 4112 bytes into a
> destination of size 4096
>67 | return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
> | ^~~~
>68 |__bos (__s), __fmt, __va_arg_pack ());
> |~
> {code}
> {code}
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:255:33:
> warning: ‘/a’ directive output may be truncated writing 2 bytes into a
> region of size between 1 and 4096 [-Wformat-truncation=]
> 255 | snprintf(tmp, sizeof(tmp), "%s/a", base);
> | ^~
> In file included from /usr/include/stdio.h:867,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:22:
> /usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note:
> ‘__builtin___snprintf_chk’ output between 3 and 4098 bytes into a destination
> of size 4096
>67 | return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
> | ^~~~
>68 |__bos (__s), __fmt, __va_arg_pack ());
> |~
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:263:33:
> warning: ‘/b’ directive output may be truncated writing 2 bytes into a
> region of size between 1 and 4096 [-Wformat-truncation=]
> 263 | snprintf(tmp, sizeof(tmp), "%s/b", base);
> | ^~
> In file included from /usr/include/stdio.h:867,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/expect.h:23,
> from
> /mnt/c/Users/Gautham/projects/apache/wsl/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/fuse-dfs/test/fuse_workload.c:22:
> /us
[jira] [Created] (HDFS-15947) Replace deprecated protobuf APIs
Gautham Banasandra created HDFS-15947:
-
Summary: Replace deprecated protobuf APIs
Key: HDFS-15947
URL: https://issues.apache.org/jira/browse/HDFS-15947
Project: Hadoop HDFS
Issue Type: Bug
Components: libhdfs++
Affects Versions: 3.4.0
Reporter: Gautham Banasandra
Assignee: Gautham Banasandra
Some protobuf APIs are soon going to get deprecated and must be replaced with
newer ones. One of the warnings are reported due to the issue is as follows -
{code}
[ 48%] Building CXX object
main/native/libhdfspp/tests/CMakeFiles/rpc_engine_test.dir/rpc_engine_test.cc.o
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/rpc_engine_test.cc:
In function ‘std::pair > RpcResponse(const
hadoop::common::RpcResponseHeaderProto&, const string&, const
boost::system::error_code&)’:
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/rpc_engine_test.cc:92:56:
warning: ‘int google::protobuf::MessageLite::ByteSize() const’ is deprecated:
Please use ByteSizeLong() instead [-Wdeprecated-declarations]
92 | pbio::CodedOutputStream::VarintSize32(h.ByteSize()) +
|^
In file included from
/usr/local/include/google/protobuf/generated_enum_util.h:36,
from /usr/local/include/google/protobuf/map.h:49,
from
/usr/local/include/google/protobuf/generated_message_table_driven.h:34,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/out/build/WSL-GCC-Debug/main/native/libhdfspp/tests/test.pb.h:26,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/rpc_engine_test.cc:22:
/usr/local/include/google/protobuf/message_lite.h:408:7: note: declared here
408 | int ByteSize() const { return internal::ToIntSize(ByteSizeLong()); }
| ^~~~
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15948) Fix test4tests for libhdfspp
Gautham Banasandra created HDFS-15948: - Summary: Fix test4tests for libhdfspp Key: HDFS-15948 URL: https://issues.apache.org/jira/browse/HDFS-15948 Project: Hadoop HDFS Issue Type: Bug Components: build, libhdfs++ Affects Versions: 3.4.0 Reporter: Gautham Banasandra Assignee: Gautham Banasandra test4tests seems to be broken for libhdfs++. Even if I modify the tests accordingly, the Jenkins run will still report -1 against test4tests saying that the tests weren't added/modified. Seems like, some config is missing that actually conveys to yetus about the test discovery in libhdfs++. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/ [Apr 1, 2021 3:32:03 AM] (Xiaoqiao He) HDFS-15921. Improve the log for the Storage Policy Operations. Contributed by Bhavik Patel. [Apr 1, 2021 3:49:39 AM] (Brahma Reddy Battula) HDFS-15494. TestReplicaCachingGetSpaceUsed#testReplicaCachingGetSpaceUsedByRBWReplica Fails on Windows. Contributed by Ravuri Sushma sree. [Apr 1, 2021 7:21:15 AM] (Peter Bacsko) YARN-10720. YARN WebAppProxyServlet should support connection timeout to prevent proxy server from hanging. Contributed by Qi Zhu. [Apr 1, 2021 9:39:40 AM] (Peter Bacsko) YARN-9618. NodesListManager event improvement. Contributed by Qi Zhu. [Apr 1, 2021 2:09:52 PM] (Peter Bacsko) YARN-10726. Log the size of DelegationTokenRenewer event queue in case of too many pending events. Contributed by Qi Zhu. [Apr 1, 2021 11:34:31 PM] (noreply) HDFS-15931 : Fix non-static inner classes for better memory management (#2830). Contributed by Viraj Jasani [Apr 2, 2021 1:33:40 AM] (noreply) HDFS-15892. Add metric for editPendingQ in FSEditLogAsync (#2770) -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.ha.TestZKFailoverController hadoop.crypto.key.kms.server.TestKMS hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots hadoop.hdfs.TestLeaseRecoveryStriped hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestBlockRecovery hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks hadoop.hdfs.TestDecommissionWithStriped hadoop.mapred.TestJobEndNotifier hadoop.tools.fedbalance.procedure.TestBalanceProcedureScheduler hadoop.tools.fedbalance.TestDistCpProcedure hadoop.hdfs.server.federation.router.TestRouterMultiRack hadoop.hdfs.server.federation.router.TestRouterRpc hadoop.hdfs.server.federation.router.TestSafeMode hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor hadoop.yarn.applications.distributedshell.TestDSTimelineV10 hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher hadoop.mapred.nativetask.kvtest.KVTest hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.TestDynamometerInfra cc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-compile-cc-root.txt [104K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-compile-javac-root.txt [388K] blanks: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/blanks-eol.txt [13M] https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/blanks-tabs.txt [2.0M] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-checkstyle-root.txt [16M] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-pathlen.txt [16K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/results-shellcheck.txt [28K] xml: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/artifact/out/xml.txt [24K] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/465/arti
[jira] [Created] (HDFS-15949) Fix integer overflow
Gautham Banasandra created HDFS-15949:
-
Summary: Fix integer overflow
Key: HDFS-15949
URL: https://issues.apache.org/jira/browse/HDFS-15949
Project: Hadoop HDFS
Issue Type: Bug
Components: libhdfs++
Affects Versions: 3.4.0
Reporter: Gautham Banasandra
Assignee: Gautham Banasandra
There are some instances where integer overflow warnings are reported. Need to
fix them.
{code}
[ 63%] Building CXX object
main/native/libhdfspp/tests/CMakeFiles/hdfs_ext_hdfspp_test_shim_static.dir/hdfs_ext_test.cc.o
In file included from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/out/build/WSL-GCC-Debug/main/native/libhdfspp/googletest-src/googletest/include/gtest/gtest.h:375,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/out/build/WSL-GCC-Debug/main/native/libhdfspp/googletest-src/googlemock/include/gmock/internal/gmock-internal-utils.h:47,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/out/build/WSL-GCC-Debug/main/native/libhdfspp/googletest-src/googlemock/include/gmock/gmock-actions.h:51,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/out/build/WSL-GCC-Debug/main/native/libhdfspp/googletest-src/googlemock/include/gmock/gmock.h:59,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/hdfspp_mini_dfs.h:24,
from
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/hdfs_ext_test.cc:19:
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/hdfs_ext_test.cc:
In member function ‘virtual void hdfs::HdfsExtTest_TestHosts_Test::TestBody()’:
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/hdfs_ext_test.cc:456:95:
warning: integer overflow in expression of type ‘long int’ results in
‘-9223372036854775808’ [-Woverflow]
456 | EXPECT_EQ(nullptr, hdfsGetHosts(fs, filename.c_str(), 0,
std::numeric_limits::max()+1));
|
~~~^~
/mnt/d/projects/apache/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/hdfs_ext_test.cc:460:92:
warning: integer overflow in expression of type ‘long int’ results in
‘-9223372036854775808’ [-Woverflow]
460 | EXPECT_EQ(nullptr, hdfsGetHosts(fs, filename.c_str(),
std::numeric_limits::max()+1, std::numeric_limits::max()));
|
~~~^~
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
