[jira] [Created] (HADOOP-19343) Add native support for GCS connector

2024-11-20 Thread Abhishek Modi (Jira)
Abhishek Modi created HADOOP-19343: -- Summary: Add native support for GCS connector Key: HADOOP-19343 URL: https://issues.apache.org/jira/browse/HADOOP-19343 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-19275) dtutil cancel command fails with NullPointerException

2024-09-14 Thread Abhishek Pal (Jira)
Abhishek Pal created HADOOP-19275: - Summary: dtutil cancel command fails with NullPointerException Key: HADOOP-19275 URL: https://issues.apache.org/jira/browse/HADOOP-19275 Project: Hadoop Common

[jira] [Created] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-02-17 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-18129: - Summary: Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem Key: HADOOP-18129 URL: https://issues.apache.org/jira/browse/HADOOP-18129

[jira] [Created] (HADOOP-18100) Change scope of inner classes in InodeTree to make them accessible outside package

2022-01-31 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-18100: - Summary: Change scope of inner classes in InodeTree to make them accessible outside package Key: HADOOP-18100 URL: https://issues.apache.org/jira/browse/HADOOP-18100

[jira] [Created] (HADOOP-17039) Change scope of InternalDirOfViewFs and InodeTree to make ViewFileSystem extendable outside common package

2020-05-12 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-17039: - Summary: Change scope of InternalDirOfViewFs and InodeTree to make ViewFileSystem extendable outside common package Key: HADOOP-17039 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-17032) Handle path having multiple children mount points pointing to different filesystems

2020-05-05 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-17032: - Summary: Handle path having multiple children mount points pointing to different filesystems Key: HADOOP-17032 URL: https://issues.apache.org/jira/browse/HADOOP-17032

[jira] [Created] (HADOOP-17029) ViewFS does not return correct user/group and ACL

2020-05-05 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-17029: - Summary: ViewFS does not return correct user/group and ACL Key: HADOOP-17029 URL: https://issues.apache.org/jira/browse/HADOOP-17029 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-19 Thread Abhishek Modi
; https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 > pm > > PST. > > > > I have done testing with a pseudo cluster and distributed shell job. My > +1 > > to start. > > > > Thanks & Regards > > Rohith Sharma K S > > > -- Regards, Abhishek Modi

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-05 Thread Abhishek Modi
986ed800029@%3Cyarn-dev.hadoop.apache.org%3E > > [2] > > > > > https://lists.apache.org/thread.html/6e94469ca105d5a15dc63903a541bd21c7ef70b8bcff475a16b5ed73@%3Cyarn-dev.hadoop.apache.org%3E > > > -- With Regards, Abhishek Modi Member of Technical Staff, Qubole Private Ltd, Bengaluru Mobile: +91-9560486536

Re: [ANNOUNCE] Eric Badger is now a committer!

2019-03-06 Thread Abhishek Modi
> >> > > > >> On Tue, Mar 5, 2019 at 11:20 AM Eric Payne > > >> .invalid> > > > >> wrote: > > > >> > > > >>> It is my pleasure to announce that Eric Badger has accepted an > > > invitation > > > >>> to become a Hadoop Core committer. > > > >>> > > > >>> Congratulations, Eric! This is well-deserved! > > > >>> > > > >>> -Eric Payne > > > >>> > > > >> > > > > > > - > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > > -- With Regards, Abhishek Modi

[jira] [Created] (HADOOP-12423) ShutdownHookManager throws exception if JVM is already being shut down

2015-09-18 Thread Abhishek Agarwal (JIRA)
Abhishek Agarwal created HADOOP-12423: - Summary: ShutdownHookManager throws exception if JVM is already being shut down Key: HADOOP-12423 URL: https://issues.apache.org/jira/browse/HADOOP-12423

[jira] [Created] (HADOOP-9403) in case of zero map jobs map completion graph is broken

2013-03-13 Thread Abhishek Gayakwad (JIRA)
Abhishek Gayakwad created HADOOP-9403: - Summary: in case of zero map jobs map completion graph is broken Key: HADOOP-9403 URL: https://issues.apache.org/jira/browse/HADOOP-9403 Project: Hadoop

Number of reducers

2012-08-27 Thread Abhishek
choose to decide number of reducers to mention explicitly, what should I consider.Because choosing in appropriate number of reducer hampers the performance. Sorry for this question, am little confused on this number of reducers. Regards Abhishek Sent from my iPhone

Re: Hive partitioner

2012-07-24 Thread Abhishek
Data is skewed here so does it help? Thanks Abhi Sent from my iPhone On Jul 24, 2012, at 9:50 AM, Nitin Pawar wrote: > Tried rarely. > > It also depends on the data :) > > On Tue, Jul 24, 2012 at 6:26 PM, Abhishek wrote: >> Hi nitin, >> >> Thanks for

Re: Hive partitioner

2012-07-24 Thread Abhishek
ioner; > set total.order.partitioner.natural.order=[false|true]; > set total.order.partitioner.path=[path]; > > On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal > wrote: >> >> hi all, >> >> How to use total order partitioner hive? >> >> Regards >> Abhishek > > > > > -- > Nitin Pawar

Re: Reg:Sequence id generation

2012-06-07 Thread abhishek dodda
ueNumber myUniqueNumber=MyUniqueNumber.getInstance(); >        for(int n=0;n<=5;n++){ >            System.out.println("read number: > "+myUniqueNumber.getUniqueNumber()); >        } >    } > } > > > On Thu, Jun 7, 2012 at 6:14 PM, abhishek dodda

Re: Reg:Sequence id generation

2012-06-07 Thread abhishek dodda
Actually trying to look how we can write a mapreduce program. On Thu, Jun 7, 2012 at 7:12 AM, Harsh J wrote: > Ashish - Note though that Twitter's Snowflake is only roughly > sequential in generation. > > Abhishek - Do you really require proper sequence IDs? Why not just >

Re: Reg:Sequence id generation

2012-06-07 Thread abhishek dodda
Hi all, I have a scenario where all my tables are in DB2 and after dumping them into HDFS. A unique sequence id (or) unique identifier an extra column should be added at beginning or at the end of the table can anyone help me on this please. Thanks Regards Abhi.

Re: hadoop fair scheduler

2011-10-17 Thread abhishek sharma
Hi Shivam, The following paper by Zaharia et al. has design insights as well as lots of evaluation. http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf Abhishek On Mon, Oct 17, 2011 at 1:20 PM, Harsh J wrote: > Shivam, > > Here lies its inception with good read

Re: Namenode not starting

2011-09-01 Thread abhishek sharma
Actually, I found the reason. I am running HDFS as "root" and there is a bug that has recently been fixed. https://issues.apache.org/jira/browse/HDFS-1943 Thanks, Abhishek On Thu, Sep 1, 2011 at 6:25 PM, Ravi Prakash wrote: > Hi Abhishek, > > Try reading through the s

Re: Namenode not starting

2011-09-01 Thread abhishek sharma
t;1.6.0_27" but get same error with it. Abhishek On Thu, Sep 1, 2011 at 4:00 PM, hailong.yang1115 wrote: > Hi abhishek, > > Have you successfully installed java virtual machine like sun JDK before > running Hadoop? Or maybe you forget to configure the environment variable > J

Namenode not starting

2011-09-01 Thread abhishek sharma
Hi all, I am trying to install Hadoop (release 0.20.203) on a machine with CentOS. When I try to start HDFS, I get the following error. : Unrecognized option: -jvm : Could not create the Java virtual machine. Any idea what might be the problem? Thanks, Abhishek

Hadoop File system performance counters

2010-12-15 Thread abhishek sharma
Hi, What do the following two File Sytem counters associated with a job (and printed at the end of a job's execution) represent? FILE_BYTES_READ and FILE_BYTES_WRITTEN How are they different from the HDFS_BYTES_READ and HDFS_BYTES_WRITTEN? Thanks, Abhishek

Re: Hadoop's deafult FIFO scheduler

2010-10-14 Thread abhishek sharma
What is the inter-arrival time between these jobs? There is a "set up" phase for jobs before they are launched. It is possible that the order of jobs can change due to slightly different set up times. Apart from the number of blocks, it may matter "where" these blocks lie. A

cluster under-utilization with Hadoop Fair Scheduler

2010-04-11 Thread abhishek sharma
change the Fair Scheduler to assign more than 1 map task to a TT per heart beat (I did that and achieved 100% utilization even with small map tasks). But I am wondering, if doing so will violate some fairness properties. Thanks, Abhishek

measuring the split reading time in Hadoop

2010-04-03 Thread abhishek sharma
information (say, in the TaskTracker logs)? Thanks, Abhishek

posted again: how are the splits for map tasks computed?

2010-03-24 Thread abhishek sharma
I realized that I made a mistake in my earlier post. So here is the correct one. I have a job ("loadgen") with only 1 input (say) part-0 of size 1368654 bytes. So when I submit this job, I get the following output: INFO mapred.FileInputFormat: Total input paths to process : 1 However, in th

how are the splits for map tasks computed?

2010-03-24 Thread abhishek sharma
two splits greater than the size of my input? I also noticed that if I run the same job with 2 inputs (say) part-0 and part-1, then only 2 map tasks are created. To my knowledge, the number of map tasks should be the same as the number of inputs. Thanks, Abhishek

Re: Map Reduce in heterogeneous environ..

2010-03-11 Thread abhishek sharma
> No. of slots per task tracker cannot be varied so even if some nodes > have additional cores, extra slots cannot be added. True. This is what I have been wishing for;-) I routinely use clusters where some machines have 8 while others have 4 cores. Abhishek > > Regards

Re: Map Reduce in heterogeneous environ..

2010-03-10 Thread abhishek sharma
more cores compared to servers with fewer cores. Abhishek On Wed, Mar 10, 2010 at 11:39 PM, Sujitha wrote: > hi all >  map reduce is running on hadoop clusters(homogeneous).is it possible to > use it in a heterogeneous environment..is that we need any interface to > support this??

resolution to Hadoop error: mapred.JobClient: Error reading task output

2010-01-23 Thread abhishek sharma
irectory from the command-line for example: $ mkdir {hadoop-home}/logs//userlogs/testdir If you have too many directories in userlogs the OS should fail to create the directory and report there are too many. Thanks, Abhishek

mapred JobClient: Error reading task output

2010-01-22 Thread abhishek sharma
ota over time. How do I reduce the number of these queries in Hadoop? Thanks, Abhishek

Re: Source Code

2010-01-13 Thread abhishek sharma
Do you want the latest source code or the source code for a particular release? In case, it is a particular release, the source code comes with the distribution. Abhishek On Wed, Jan 13, 2010 at 12:21 AM, wrote: > Hi all, >        I want to know how to get the source code for hadoop an

Re: Global scheduling in the Fair Scheduler

2009-12-22 Thread abhishek sharma
Hi Matei, Many thanks for your prompt reply. Abhishek On Tue, Dec 22, 2009 at 8:42 PM, Matei Zaharia wrote: > Hi Abhishek, > > You can find the in-development version of Hadoop in SVN, using the > instructions at http://hadoop.apache.org/mapreduce/version_control.html. Note

Global scheduling in the Fair Scheduler

2009-12-22 Thread abhishek sharma
possible for me to download the code related to the modified Fair Scheduler in order to use the global scheduling feature? Thanks, Abhishek