Re: bootstrap standby namenode failure

2024-05-28 Thread anup ahire
2] > https://apache.github.io/hadoop/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html#namenode > > On Sat, 25 May 2024 at 01:59, anup ahire wrote: > > > > Hello Team, > > > > I am trying to recover the failed node which has namenode and journal > node, the cluster

bootstrap standby namenode failure

2024-05-24 Thread anup ahire
Hello Team, I am trying to recover the failed node which has namenode and journal node, the cluster has one active NN and 2 journal nodes currently. When I am trying to setup node being recovered as standby, I am getting this error. *java.io.IOException: Gap in transactions. Expected to be able

[jira] [Created] (HADOOP-18914) use http simple auth only for Web UIs and not for webhdfs

2023-09-28 Thread Anup Ahire (Jira)
Anup Ahire created HADOOP-18914: --- Summary: use http simple auth only for Web UIs and not for webhdfs Key: HADOOP-18914 URL: https://issues.apache.org/jira/browse/HADOOP-18914 Project: Hadoop Common

[jira] [Created] (HADOOP-18914) use http simple auth only for Web UIs and not for webhdfs

2023-09-28 Thread Anup Ahire (Jira)
Anup Ahire created HADOOP-18914: --- Summary: use http simple auth only for Web UIs and not for webhdfs Key: HADOOP-18914 URL: https://issues.apache.org/jira/browse/HADOOP-18914 Project: Hadoop Common

use http simple auth only for Web UIs and not for webhdfs

2023-09-28 Thread anup ahire
Hello Team, I see that in hadoop 3.3.6, setting hadoop.http.authentication.type to simple sets simple auth to webhdfs unlike previous verison like 3.1 I have a use case where I only want to skip spnego for web ui access and not for webhdfs. In HttpServer2.java, I see this if (this.securityEnabl

rack awareness

2023-02-10 Thread anup ahire
Hello is the topology for rack awareness cached when ScriptBasedMapping mapping is used in HDFS ? Thanks, Anup

Re: OOZIE HA

2023-02-03 Thread anup ahire
balancer? Have you goz > 503 from both Oozie instance? > > If you got 503 you must have sumething suspicios in oozie logs or jetty > logs. > > Regards, > Denes > > On Fri, 3 Feb 2023, 01:08 anup ahire, wrote: > > > Hello, > > > > I followed ste

OOZIE HA

2023-02-02 Thread anup ahire
Hello, I followed steps from https://oozie.apache.org/docs/5.0.0/AG_Install.html#High_Availability_HA to configure HA in Kerberized cluster. After enabling HA, I am seeing that clients are not able to communicate to oozie server and get 503 service unavailable. . The embedded oozie server process

Re: HBase Backup and Restore

2022-07-16 Thread anup ahire
; If you’d like to see a particular timeline or want to see the feature > available in active releases it would be more effective to spend your time > helping Mallikarjun with outstanding issues. (Also something for the > dev@HBase list) > > On Thu, Jul 14, 2022 at 6:00 PM anup a

Re: HBase Backup and Restore

2022-07-14 Thread anup ahire
wrote: > Backport is possible. We have backported to 2.1.x and using it. > > Waiting for some PRs to merge so that I can put some effort in getting the > backport available for active 2.x releases. > > On Tue, Jul 12, 2022, 10:42 PM anup ahire wrote: > > > Thanks Mallikar

Re: HBase Backup and Restore

2022-07-13 Thread anup ahire
Tue, Jul 12, 2022, 10:42 PM anup ahire wrote: > > > Thanks Mallikarjun. Will it be possible to backport this to 2.x ? trying > to > > understand if there are any hard dependencies on 3.0.0. > > > > On Tue, Jul 12, 2022 at 10:01 AM Mallikarjun > > wrote: > &g

Re: HBase Backup and Restore

2022-07-12 Thread anup ahire
> On Tue, Jul 12, 2022, 10:26 PM anup ahire wrote: > > > Hello, > > > > I am trying to understand, why is > > https://github.com/apache/hbase/tree/master/hbase-backup part of master > > but > > getting left out from release tags ? > > > > Also,

HBase Backup and Restore

2022-07-12 Thread anup ahire
Hello, I am trying to understand, why is https://github.com/apache/hbase/tree/master/hbase-backup part of master but getting left out from release tags ? Also, What is the minimum required version of the HBase to use Backup and Restore ? I am on 2.2.6 Thanks, Anup

Loading data from one swift container into external table pointing to another container fails

2018-02-02 Thread anup ahire
Hello, Loading data from one swift container into external table pointing to another container is failing for me. hive> load data inpath 'swift://mycontainer.default/source_test' into table my_test; Loading data to table default.my_test Failed with exception copyFiles: error while moving files!

ambari python version change

2017-10-01 Thread anup ahire
Hello, I have amabri 2.4.2.0 running with python 2.6.6 on RHEL 6. I wan to switch to python 2.7.8 or higher. Has anyone done it and Is it possible to switch easily ? Thanks,

apply UDFs to N columns dynamically in dataframe

2017-03-14 Thread anup ahire
Hello, I have a schema and name of columns to apply UDF to. Name of columns are user input and they can differ in numbers for each input. Is there a way to apply UDFs to N columns in dataframe ? Thanks !

insert on condition

2016-12-27 Thread anup ahire
Hello All, Is it possible to achieve " Insert overwrite into a partition only if it does not exist " ? Partition is a string date. Thanks, Anup

find outliers within data

2016-11-22 Thread anup ahire
I have a large data set with millions of records which is something like Movie Likes Comments Shares Views A 100 10 20 30 A 102 11 22 35 A 104 12 25 45 A *103* 13 *24*50 B 200 10 20 30 B 205*9* 21

issue with hive jdbc

2016-09-23 Thread anup ahire
Hello, I am getting this exception when my query finishes which results in job failure. java.sql.SQLException: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296) Any help is appreciated !! THanks !!

Fwd: need help with hive session getting killed

2016-09-20 Thread anup ahire
Hello, I am using hive-jdbc-1.2.1 to run a query. Query runs around an hour and eventually completes. But my hive session terminats before I can get results from completed query and job fails. *java.sql.SQLException: org.apache.http.NoHttpResponseException: The target server failed to respond* *

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-25 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14043940#comment-14043940 ] Anup Ahire commented on PIG-4023: - Thanks Daniel ! > BigDec/Int sort is

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-25 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Attachment: PIG-4025-2.patch > TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper

[jira] [Commented] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-25 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14043939#comment-14043939 ] Anup Ahire commented on PIG-4025: - Thanks Daniel for review. Added patch with cha

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041534#comment-14041534 ] Anup Ahire commented on PIG-4023: - Attached patch ! > BigDec/Int sort is

[jira] [Commented] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041536#comment-14041536 ] Anup Ahire commented on PIG-4025: - Attached patch ! > TestLoadFunc

[jira] [Commented] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041535#comment-14041535 ] Anup Ahire commented on PIG-4024: - Attached patch ! > TestPigStreaming

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Status: Patch Available (was: Open) > TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrap

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Attachment: PIG-4025.patch > TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper

[jira] [Updated] (PIG-4023) BigDec/Int sort is broken

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4023: Status: Patch Available (was: Open) > BigDec/Int sort is bro

[jira] [Updated] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4024: Attachment: PIG-4024.patch > TestPigStreamingUDF and TestPigStreaming fail on IBM

[jira] [Updated] (PIG-4023) BigDec/Int sort is broken

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4023: Attachment: PIG-4023.patch > BigDec/Int sort is broken > - > >

[jira] [Updated] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4024: Status: Patch Available (was: Open) > TestPigStreamingUDF and TestPigStreaming fail on IBM

[jira] [Updated] (PIG-4023) BigDec/Int sort is broken

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4023: Status: Patch Available (was: Open) > BigDec/Int sort is bro

[jira] [Updated] (PIG-4023) BigDec/Int sort is broken

2014-06-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4023: Status: Open (was: Patch Available) > BigDec/Int sort is bro

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Description: Method positioning on stack strace in IBM jdk is different which makes these tests fail . we

[jira] [Created] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4024: --- Summary: TestPigStreamingUDF and TestPigStreaming fail on IBM JDK. Key: PIG-4024 URL: https://issues.apache.org/jira/browse/PIG-4024 Project: Pig Issue Type

[jira] [Created] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4025: --- Summary: TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK Key: PIG-4025 URL: https://issues.apache.org/jira/browse

[jira] [Created] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4023: --- Summary: BigDec/Int sort is broken Key: PIG-4023 URL: https://issues.apache.org/jira/browse/PIG-4023 Project: Pig Issue Type: Bug Affects Versions: 0.12.0

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036854#comment-14036854 ] Anup Ahire commented on PIG-4023: - I can provide a patch > BigDec/Int sort is

cast cast exception in local mode

2014-03-06 Thread anup ahire
Hello, I am getting following error sometimes in local mode java.lang.Exception: java.lang.ClassCastException: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit incompatible with org.apache.hadoop.mapreduce.lib.input.FileSplit at org.apache.hadoop.mapred.LocalJobRunne

AvroStorage issue

2013-10-15 Thread anup ahire
Hello , I am trying to store data into avro using AvroStorage() with following schema. I have pig 0.11. {"type":"record","name":"TUPLE_0","fields":[{"name":"Header","type":["null","string"],"doc":"autogenerated from Pig Field Schema"}]} I am getting following errors when I run the job. Caused b

pig output path permissions

2013-10-07 Thread anup ahire
Hello, Is it possible to set file permissions for pig output path at job level ? Thanks, Anup

[jira] [Commented] (PIG-3391) Issue with DateTime-> Long conversion in New AvroStorage()

2013-07-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13717776#comment-13717776 ] Anup Ahire commented on PIG-3391: - I am talking about [PIG-3015] which converts

[jira] [Updated] (PIG-3391) Issue with DateTime-> Long conversion in New AvroStorage()

2013-07-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-3391: Summary: Issue with DateTime-> Long conversion in New AvroStorage() (was: Issue with DataTime->

[jira] [Updated] (PIG-3391) Issue with DataTime-> Long conversion in New AvroStorage()

2013-07-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-3391: Summary: Issue with DataTime-> Long conversion in New AvroStorage() (was: Issue with DataType->

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-07-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13717641#comment-13717641 ] Anup Ahire commented on PIG-3015: - Done.[PIG-3391] Thanks!! > Rew

[jira] [Created] (PIG-3391) Issue with DataType-> Long conversion in New AvroStorage()

2013-07-23 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-3391: --- Summary: Issue with DataType-> Long conversion in New AvroStorage() Key: PIG-3391 URL: https://issues.apache.org/jira/browse/PIG-3391 Project: Pig Issue T

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-07-23 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13716634#comment-13716634 ] Anup Ahire commented on PIG-3015: - Shouldn't we loose the timezone informat

Re: timezone option for timestamp to datetime conversion

2013-07-17 Thread anup ahire
wrote: > I haven't try, but looks like you can use ToDate(String dtStr, String > format, String timezone) ? > > Johnny > > > On Wed, Jul 17, 2013 at 11:28 AM, anup ahire wrote: > > > Hello, > > > > ToDate function on long timestamp always uses defa

timezone option for timestamp to datetime conversion

2013-07-17 Thread anup ahire
Hello, ToDate function on long timestamp always uses default time zone. Why option of specifying timezone for timestamp to datetime conversion is not available like its available for customized string to date time conversion ? Thanks, Anup

need help for building avro

2013-07-09 Thread anup ahire
Hello, I downloaded trunk today but I am not able to build it. I am seeing following errors. [INFO] [ERROR] Failed to execute goal org.apache.avro:avro-maven-plugin:1.7.5-SNAPSHOT:schema (schemas) on project avro-ipc: Execut

ruuning application in multinode environment

2012-08-14 Thread anup ahire
Hello, I am trying to run twittertopic count example using zookeeper. I run one s4 node and zookeeper on the same machine while another S4- node and client adapter on two seperatemachines. Client-adapter and S4 nodes are able to grab the task in zookeeper but when I am running twitteerfeedlisterne

multiple feed-listeners

2012-08-12 Thread anup ahire
Hello, I want to get data into S4 from multiple sources. How can I create multiple feed-listeners like the one in the twittertopiccount example. Thanks, Anup

output to webservice

2012-08-06 Thread anup ahire
Hello, I trying to provide output of a processing element as a web-service for my class project. I am not sure how to proceed. Any help ? Thanks, Anup