Hi All , Recently we have upgraded our Cluster to Hadoop 2.7.1 version.
When i try to run Mover , it throws below exception :
2016-10-06 00:24:44,643 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: opCopyBlock
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_160995799
recei
Hi All , We are in the situation to balance the cluster data since median
reached 98% .. I started balancer as below
Hadoop Version: Hadoop 2.4.1
/apache/hadoop/sbin/start-balancer.sh -threshold 30
Once i start balancer it goes will for first 8-10 minutes of time..
Balancer was moving so q
roto=tcp,nolock,noacl,addr=10.115.22.46'
mount.nfs: prog 13, trying vers=3, prot=6
mount.nfs: trying 10.115.22.46 prog 13 vers 3 prot TCP port 2049
mount.nfs: prog 15, trying vers=3, prot=6
mount.nfs: trying 10.115.22.46 prog 15 vers 3 prot TCP port 4242
*mount.nfs: mount(2):
trying vers=3, prot=6
> mount.nfs: trying 10.115.22.109 prog 15 vers 3 prot TCP port 4242
> *mount.nfs: mount(2): Permission denied*
> *mount.nfs: access denied by server while mounting gatewaymachine:/*
>
>
> Not sure why mount throwing permission issue .. Anybody fa
ver while mounting gatewaymachine:/*
Not sure why mount throwing permission issue .. Anybody faced this issue ??
--Senthil
On Thu, Aug 25, 2016 at 10:53 AM, Senthil Kumar
wrote:
> Hi Team , As part of NFS Evaluation , i have installed NFS Gateway
> Service in Secure Cluster
Hi Team , As part of NFS Evaluation , i have installed NFS Gateway Service
in Secure Cluster ..
Config in Gateway Machine:
nfs.file.dump.dir
/tmp/.hdfs-nfs
nfs.keytab.file
/etc/hadoop/hadoop.keytab
nfs.kerberos.principal
hadoop/_h.
Hi Team , I'm trying out the NFS Gateway feature in Hadoop.
Would like to understand the performance of NFS..
Hadoop Version : *Hadoop 2.7.1.2.4.2.0-258*
Cluster Size : 10 DNS , 1 NN, 1 SN , 1 RM.
One of the Data Node is NFS Gateway Server..Now i could see Performance
issues when i start ( 5
Hi Team , Pls add your suggestion(s) here , So that i can tune parameters
to balance cluster which is in bad shape now :( ..
--Senthil
On Thu, Aug 11, 2016 at 3:51 PM, Senthil Kumar
wrote:
> Thanks Lars for your quick response!
>
> Here is my Cluster Utilization..
> DFS Used% :
10% and that's a fairly huge range still
> especially on clusters that are almost at capacity. So a threshold of 5 or
> even lower might work for you.
>
> What is your utilisation in the cluster (used space / available space)?
>
> Cheers,
> Lars
>
> On Wed, Aug 1
Hadoop Version :
*Hadoop 2.4.1*
--Senthil
On Wed, Aug 10, 2016 at 6:58 PM, Zhe Zhang
wrote:
> Which version of Hadoop is your cluster / Balancer running?
>
> On Wed, Aug 10, 2016 at 6:27 AM, Senthil Kumar
> wrote:
>
>> Hi Team , We are running big cluster ( 3000 nodes
Hi Team , We are running big cluster ( 3000 nodes cluster ) , many time we
are hitting Median Increasing to 99.99 % ( 80 % of the DN's ) . Balancer
is running all time in cluster ..But still median is not coming down i.e <
90 % ..
Here is how i start balancer ?
/apache/hadoop/sbin/start-balanc
Regards,
Senthil
Hi Team, Pls check this and let me your comment(s) ..
--Senthil
On Aug 4, 2016 7:22 PM, "Senthil Kumar" wrote:
> Hi Team ,
>
>
> Current HDFS NFS gateway Supports exporting only one Directory..
>
> Example :
>
> nfs.export.point
> /user
>
>
&g
Hi Team ,
Current HDFS NFS gateway Supports exporting only one Directory..
Example :
nfs.export.point
/user
This property helps us to export particular directory ..
Code Block :
public RpcProgramMountd(NfsConfiguration config,
DatagramSocket registrationSocket, boolean allowInsecurePorts)
t
14 matches
Mail list logo
