Ivan Kelly created HDFS-4266:
Summary: BKJM: Separate write and ack quorum
Key: HDFS-4266
URL: https://issues.apache.org/jira/browse/HDFS-4266
Project: Hadoop HDFS
Issue Type: Sub-task
Ivan Kelly created HDFS-4265:
Summary: BKJM doesn't take advantage of speculative reads
Key: HDFS-4265
URL: https://issues.apache.org/jira/browse/HDFS-4265
Project: Hadoop HDFS
Issue Type
Ivan Kelly created HDFS-4154:
Summary: Two namenodes usng bkjm can race to create the version
znode
Key: HDFS-4154
URL: https://issues.apache.org/jira/browse/HDFS-4154
Project: Hadoop HDFS
On Wed, Oct 24, 2012 at 02:44:45PM +, Xiaohan wrote:
> And the logs in NameNode, we found the difference from each of the times:
>
> 2012-10-20 20:05:43,249 INFO
> org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of syncs: 1347
> SyncTimes(ms): 14138 3677
>
> 2012-10-22 18:34:4
Ivan Kelly created HDFS-3810:
Summary: Implement format() for BKJM
Key: HDFS-3810
URL: https://issues.apache.org/jira/browse/HDFS-3810
Project: Hadoop HDFS
Issue Type: Sub-task
Ivan Kelly created HDFS-3809:
Summary: Make BKJM use protobufs for all serialization with ZK
Key: HDFS-3809
URL: https://issues.apache.org/jira/browse/HDFS-3809
Project: Hadoop HDFS
Issue Type
Ivan Kelly created HDFS-3789:
Summary: JournalManager#format() should be able to throw
IOException
Key: HDFS-3789
URL: https://issues.apache.org/jira/browse/HDFS-3789
Project: Hadoop HDFS
Issue
Ivan Kelly created HDFS-3474:
Summary: Cleanup Exception handling in BookKeeper journal manager
Key: HDFS-3474
URL: https://issues.apache.org/jira/browse/HDFS-3474
Project: Hadoop HDFS
Issue
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4230/
---
(Updated 2012-05-18 15:43:52.712478)
Review request for hadoop-hdfs.
Summary
-
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4230/
---
(Updated 2012-05-10 14:44:08.706764)
Review request for hadoop-hdfs.
Summary
-
It would be great if it did go into 0.23.
-Ivan
On Wed, Mar 28, 2012 at 09:17:55AM +, Uma Maheswara Rao G wrote:
> Hi Devs,
>
>
>
> Seems HDFS-234 committed only in Trunk. As this is missed to commit in HA
> branch before, also missed in the merge from HA branch to 23 version.
>
>
>
>
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4230/
---
Review request for hadoop-hdfs.
Summary
---
There's a couple of TODO(HA) co
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: 0.24.0
There's a couple of TODO(HA) comments in the BookKeeperJournalManager code.
This JIRA is to address those.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please co
Streamline usage of bookkeeper journal manager
--
Key: HDFS-2743
URL: https://issues.apache.org/jira/browse/HDFS-2743
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Ivan Kelly
: Bug
Reporter: Ivan Kelly
Assignee: Ivan Kelly
As summary says, we're not checking the addComplete return code, so there's a
change of losing update.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA adminis
hdfs script does not work out of the box.
-
Key: HDFS-2674
URL: https://issues.apache.org/jira/browse/HDFS-2674
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Ivan Kelly
Ack! The mailing list seems to strip attachments. The throughput/latency
diagram is available on HDFS-234
https://issues.apache.org/jira/secure/attachment/12503763/hdfs_tpt_lat.pdf
-Ivan
On 15 Nov 2011, at 17:29, Ivan Kelly wrote:
> Hi guys,
>
> I've just uploaded a patch to
Hi guys,
I've just uploaded a patch to HDFS-234 which contains an implementation of
JournalManager for BookKeeper. The code is ready for review, though I plan to
add some more tests. The code relies on HDFS-1580 which isn't in trunk yet. The
code is on github if you want to avoid faffing about
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2835/
---
Review request for hadoop-hdfs.
Summary
---
BookKeeper is a system to relia
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2672/
---
(Updated 2011-11-03 11:25:09.526158)
Review request for hadoop-hdfs.
Summary
-
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2672/
---
(Updated 2011-11-02 20:54:27.126053)
Review request for hadoop-hdfs.
Summary
-
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2672/
---
Review request for hadoop-hdfs.
Summary
---
This is the final piece to allo
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2247/
---
(Updated 2011-10-24 09:18:46.680787)
Review request for hadoop-hdfs.
Changes
-
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2247/
---
(Updated 2011-10-20 09:00:57.815922)
Review request for hadoop-hdfs.
Summary (
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2247/
---
Review request for hadoop-hdfs.
Summary
---
A JournalManager may take hold
[
https://issues.apache.org/jira/browse/HDFS-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Kelly resolved HDFS-311.
-
Resolution: Duplicate
This JIRA has been superseded by HDFS-1580 and its subtasks.
> Modifications
Add Closeable to JournalManager
---
Key: HDFS-2334
URL: https://issues.apache.org/jira/browse/HDFS-2334
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Ivan Kelly
Assignee: Ivan Kelly
HDFS-2284 introduced 2 findbugs warnings on trunk
-
Key: HDFS-2333
URL: https://issues.apache.org/jira/browse/HDFS-2333
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Ivan Kelly
TestBackupNode fails since HADOOP-7524 went in.
---
Key: HDFS-2310
URL: https://issues.apache.org/jira/browse/HDFS-2310
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Ivan Kelly
/HDFS-2227
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Ivan Kelly
Assignee: Ivan Kelly
This is the second part of HDFS-2018. This patch moves the code that selects
the available RemoteEditLogManifest out of the transactional inspector and
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Ivan Kelly
Assignee: Ivan Kelly
This is the first part of HDFS-2018 changes, to refactor some of the file
management classes so they're in file specific places rather than in the
generic classes.
--
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: 0.23.0
Currently, FSEditLog retrieves the list of Journals to create from NNStorage.
Obviously this is file specific. This JIRA aims to remove this restriction
Issue Type: Improvement
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: 0.23.0
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: 0.23.0
On trunk serialisation of editlog ops is in FSEditLog#log* and deserialisation
is in FSEditLogOp.*Op . This improvement is to move the serialisation code into
one place, i.e under FSEditLogOp.*Op.
This
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: Edit log branch (HDFS-1073)
Zero pad the filenames so they appear in the correct order when you ls on the
filesystem.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http
Hi Andre,
Could you open a JIRA ticket for this. I think the fix should be quite
straightforward. We just need to add checksum calculation when writing
to the backup stream and either remove the reading of the version from
the input side or add writing of the version on the output side.
-Iva
This seems to have been introduced here:
https://github.com/apache/hadoop-hdfs/commit/27b956fa62ce9b467ab7dd287dd6dcd5ab6a0cb3#src/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java
The backup streams never write the version, so it should never try to
read it either. I would have expect
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Currently in the HDFS-1073 branch, the code for creating output streams is in
FileJournalManager and the code for input streams is in the inspectors. This
change does a number of things.
- Input and Output streams are now created by the
Issue Type: Improvement
Affects Versions: Edit log branch (HDFS-1073)
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Fix For: Edit log branch (HDFS-1073)
Currently FSEditLogLoader has code for reading from an InputStream interleaved
with code which updates the
-task
Reporter: Ivan Kelly
Assignee: Ivan Kelly
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
I had a quick look before. It's trying to download a file that doesn't exist. I
think I fixed that, but it was masking another problem, so I gave up at that
stage.
-Ivan
On 4 Apr 2011, at 19:14, Todd Lipcon wrote:
> Hi all,
>
> The hdfsproxy TestAuthorizationFilter test has been failing now f
Cleanup FSImage construction
Key: HDFS-1725
URL: https://issues.apache.org/jira/browse/HDFS-1725
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Ivan Kelly
Assignee: Ivan Kelly
[
https://issues.apache.org/jira/browse/HDFS-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Kelly resolved HDFS-1489.
--
Resolution: Incomplete
Assignee: Ivan Kelly
This is now being handled by HDFS-1580 in a less
Reporter: Ivan Kelly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Reporter: Ivan Kelly
Fix For: 0.22.0
FSImage currently derives from Storage and FSEditLog has to call methods
directly on FSImage to access the filesystem. This JIRA is to separate the
Storage class out into NNStorage so that FSEditLog is less dependent on
FSImage. From this
>> As many of you know, I've been working on HDFS-1073 for a few months, and
>>> we're hoping to get it in for 0.22 (OOM has given the OK to merge this into
>>> branch and Sanjay has helpfully gotten some commitment from Yahoo QA to help
>>> test it).
>&g
46 matches
Mail list logo
