[
https://issues.apache.org/jira/browse/AMBARI-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096648#comment-17096648
]
Ivan Martynov commented on AMBARI-25505:
----------------------------------------
I managed to test the case with manual install (case #3 "Customer installs new
mpack with fix and selects hbase service in the installation wizard")
1. I created a HDFS cluster with command without HDP and MPack.:
conductor -b onefs-hdp3.1-4clients-ranger-kms-nohbase.json --onefs
onefs19.west.isilon.com --ducttape-owner=imartynov --skip-hdp --no-mpack
--ducttape-location=seattle
2. I installed mpack 1.0.3 with fix
3. I ran Ambari, started wizard, selected to create HBASE service. Opened
service settings (Custom hbase-site) and see the property
hbase.wal.provider is set.
4. I installed the HBASE service, run HDP cluster - OK.
5. Checked hbase.wal.provider property after running - it is there.
Now all cases have tested, I'm working on publishing the project to Open Source.
> New version of isilon-onefs-mpack (1.0.3)
> -----------------------------------------
>
> Key: AMBARI-25505
> URL: https://issues.apache.org/jira/browse/AMBARI-25505
> Project: Ambari
> Issue Type: Improvement
> Components: contrib
> Affects Versions: trunk, 2.7.0
> Environment: HDP versions started from "2.6"
> Ambari started from version "2.7"
> Reporter: Ivan Martynov
> Priority: Critical
> Labels: performance
> Fix For: trunk, 2.7.0
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> This issue is going under the direction of Dell Technologies.
> We are going to change the code of isilon-onefs-mpack
> (+[https://github.com/apache/ambari/tree/trunk/contrib/management-packs/isilon-onefs-mpack]+).
> The problem is that a new feature of HBase 2 (AsyncFSWAL) causes worse
> performance with OneFS. We need to disable this in the Ambari management pack
> by setting the property name: "hbase.wal.provider" with value: "filesystem"
> for HBASE. The way to change the property has been already introduced at:
> [https://jira.apache.org/jira/browse/HBASE-15536]
> In section about how to disable AsyncFSWAL:
> {quote}> ...add this in hbase-site.xml
> > \{code}
> > <property>
> > <name>hbase.wal.provider</name>
> > <value>filesystem</value>
> > </property>
> > \{code}
> {quote}
> We are going to issue a new version of isilon-onefs-mpack (1.0.3) where we
> will have some code lines which add this property to HBASE settings. Change
> of property is applied automatically after installation of HBASE service and
> installing a new version of mpack.
> Now our code change relates to one file of code: service_advisor.py, other
> changes are cosmetic (version numbering and comments).
> As well we are going to port the code to all necessary branches of Ambari of
> older versions which support isilon-onefs-mpack.
> Business Justification: The problem we are working on is that a new feature
> of HBase 2 (AsyncFSWAL) causes worse performance with OneFS.
> Some Isilon customers which use HBASE with Ambari with OneFS suffer from this
> problem. The fix should help these customers.
> Available Maintenance Resources: HDFS team of Dell Isilon supports Ambari
> mpack project.
> Impact: Improve interaction of Isilon with Hadoop
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
