actual on disk size without header is negative.

2021-06-27 Thread Minwoo Kang
Hello, I met a strange issue. However, I don't understand why it occurred. That is "On-disk size without header provided is 65347, but block header contains -620432417. Block offset: 117193180315, data starts with:". Call stack: at org.apache.hadoop.hbase.io.hfile.HFileBlock.validateOnDiskSizeW

Re: actual on disk size without header is negative.

2021-06-29 Thread Minwoo Kang
, Minwoo Kang 님이 작성: > Hello, > > I met a strange issue. However, I don't understand why it occurred. > That is "On-disk size without header provided is 65347, but block header > contains -620432417. Block offset: 117193180315, data starts with:

How to do wire encryption without using kerberos.

2022-01-25 Thread Minwoo Kang
Hello, HBase community, I have a question about HBase security. If I want to use wire encryption, I should set kerberos and hbase.rpc.protection=privacy. Is there any way not to use kerberos? (This seems like a silly question.) (I think... If I could safely provide a key to use for encryption, I

RegexStringComparator에 regex engine를 java에서 joni로 변경한 분이 있는지 궁금합니다.

2022-06-26 Thread Minwoo Kang
Hello, Recently, java.util.regex in the Regex filter (RegexStringComparator) had been running forever. It is said that java.util.regex can run forever or stack overflow in the worst case. Looking at RegexStringComparator, I saw that two regex implementations (java, joni) were provided. I was wond

If anyone has experience in changing the regex engine in RegexStringComparator to joni?

2022-06-26 Thread Minwoo Kang
I saw that two regex implementations (java, joni) were provided. I was wondering if anyone has experience in changing the regex engine in RegexStringComparator to joni and operating it. Best Regards, Minwoo On 2022/06/27 04:37:11 Minwoo Kang wrote: > Hello, > > Recently, java.util.rege

RE: If anyone has experience in changing the regex engine in RegexStringComparator to joni?

2022-07-13 Thread Minwoo Kang
] In HBase, like trino, it seems to be necessary to use NonStrictUTF8Encoding instead of UTF8Encoding for JoniRegexEngine's encoding. What do you think about changing JoniRegexEngine's encoding to NonStrictUTF8Encoding? Best Regards, Minwoo On 2022/06/27 04:41:41 Minwoo Kang wrote: >

RE: Re: If anyone has experience in changing the regex engine in RegexStringComparator to joni?

2022-07-18 Thread Minwoo Kang
ul 16, 2022, at 10:43 AM, Sean Busbey wrote: > > > > That sounds reasonable. Could you file an issue in our issue tracker? Are > > you up for working on a PR? > > > > > >> On Wed, Jul 13, 2022 at 2:27 AM Minwoo Kang > >> wrote: > >> > &

How to Prevent ReDoS in RegexStringComparator

2022-08-18 Thread Minwoo Kang
Hello, Java regular expression engine is based on backtracking. Thus, a malicious regular expression may result in a ReDoS (regular expression denial of service). When ReDoS occurs in the HBase, the region server's handler is occupied as a result it cannot process the user's request. To avoid th

How to handle Remote Exceptions when shading HBase client

2024-09-09 Thread Minwoo Kang
Hello, community I am creating an in-house library using the HBase client library and distributing it so that other users can use it. To prevent conflicts with the user library, we shaded the HBase package. (For example, org.apahce.hadoop.hbase... -> good.company.org.apahce.hadoop.hbase...) Howev