Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-23 Thread Avery Ching
Hello, Thank you for taking a look at the proposal and for your questions. I've responded to your questions inline. Avery On Jul 23, 2011, at 5:38 AM, florent andré wrote: > Hi Avery, > > Be careful, newbie here ! :) > > I read your proposal with attention and also this presentation [1]. >

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-23 Thread florent andré
Hi Avery, Be careful, newbie here ! :) I read your proposal with attention and also this presentation [1]. So my questions are : - What are the differences / similiarities between Giraph and triples store like Jena ? - Does Giraph provide (or will provide) a convenient way to "request / query

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-22 Thread Henry Saputra
Sounds good to me. Thanks for your reply Avery. - Henry On Thu, Jul 21, 2011 at 4:39 PM, Avery Ching wrote: > Henry, > > While we haven't begun too much work on a generic library, the intent is to > provide generic vertex input/output formats, aggregators, combiners, and > graph computations t

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-21 Thread Avery Ching
Henry, While we haven't begun too much work on a generic library, the intent is to provide generic vertex input/output formats, aggregators, combiners, and graph computations that make it very easy for a user to get started right away. None of these need to be explicitly integrated with Hadoop

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-21 Thread Henry Saputra
Will the library generic graph algorithm be tightly coupled with the Hadoop integration piece? - Henry On Fri, Jul 15, 2011 at 11:14 AM, Avery Ching wrote: > Hi, > > I would like to propose Giraph as an Apache Incubator project.  Giraph is a > large-scale graph processing infrastructure (inspir

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-21 Thread Jakob Homan
We've quite interested in helping to develop Giraph and have been experimenting with it here. I'd like to add myself to the initial list of committers, if there are no objections. My background: Apache Hadoop committer and PMC member, committer on Apache Kafka in Incubator and contributor to othe

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-18 Thread Hyunsik Choi
I have experiences about graph processing as follows: * RDF pattern matching and storage system on HBase * some types of graph counting * subgraph isomorphism on large graph data with MapReduce (I'm writing a research paper on this) * all pairs of shortest paths with CUDA I have just added myself

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-18 Thread Phillip Rhodes
Cool. I've added myself to the list of "Initial Committers" on the wiki. (As I understand it, during the proposal phase of an incubator project, anyone can jump in and volunteer to be a committer. But if anyone wants to know more about me or my background, feel free to ask). Phil On Sun, Jul

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-17 Thread Owen O'Malley
On Fri, Jul 15, 2011 at 11:14 AM, Avery Ching wrote: > Hi, > > I would like to propose Giraph as an Apache Incubator project. Obviously, I'm +1 for this. *smile* -- Owen

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-17 Thread Hyunsik Choi
I read the proposal of Giraph. That's very interesting! I have some experiences in graph processing with MapReduce. I think that the approach of Giraph is very promising since MapReduce already is regarded as the de-facto standards in processing large data and is appropriate to many graph algorith

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-17 Thread Avery Ching
Mohammed, Thank you for looking at the proposal. I added the twiki: http://wiki.apache.org/incubator/GiraphProposal Avery On Jul 17, 2011, at 12:03 AM, Mohammad Nour El-Din wrote: +1 on the proposal And for the point raised by Edward, I agree with his concerns, but also it is up to the mento

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-17 Thread Avery Ching
Phillip, Thank you for your suggestion. I've added the proposal as you suggested to the Apache wiki. http://wiki.apache.org/incubator/GiraphProposal I'm glad to hear the project interests you and hope you get some time to take a look at it. Avery On Jul 15, 2011, at 6:42 PM, Phillip Rhodes

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-17 Thread Mohammad Nour El-Din
+1 on the proposal And for the point raised by Edward, I agree with his concerns, but also it is up to the mentors and development team to manage this kind of syncing between them and other Apache projects. For the putting the proposal on the Incubator wiki, Avery would you please do that ? :) O

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-15 Thread Phillip Rhodes
On Fri, Jul 15, 2011 at 2:14 PM, Avery Ching wrote: > Hi, > > Here is a link to the proposal in our GitHub wiki: > > https://github.com/aching/Giraph/wiki/Apache-Incubator-Proposal > > Should the contents of this proposal to be copied to the incubator section of the ASF wiki, at something like:

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-15 Thread Phillip Rhodes
On Fri, Jul 15, 2011 at 2:14 PM, Avery Ching wrote: > Hi, > > I would like to propose Giraph as an Apache Incubator project. Giraph is a > large-scale graph processing infrastructure (inspired by Pregel) that runs > entirely on Hadoop. Giraph applications and MapReduce jobs coexist on > shared

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-15 Thread Edward J. Yoon
Based on that statement, I expect that if Giraph is accepted in the Apache Incubator, our projects will hopefully be able to share ideas and grow together. +1 Sent from my iPhone On 2011. 7. 16., at 오후 12:55, Avery Ching wrote: > > Based on that statement, I expect that if Giraph is accepte

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-15 Thread Avery Ching
Ed, Offline, you and I have discussed potential future collaboration in our projects. However, there are significant differences in our approaches today. * Hama has been focused on BSP computing. It only recently (June 30 - about 16 days ago) opened a JIRA for graph processing (https://issue

Re: [PROPOSAL] Proposing Giraph for the Apache Incubator

2011-07-15 Thread Edward J. Yoon
Just FYI, My heavy concern is that the boundaries between 'Apache Hama' and 'Giraph' you said, can be collapsed in near future. * Someone already contributed Pregel-like vertex API set on top of Hama v0.2[1]. * The Hama job will be run on both Hama own cluster and Hadoop nextGen. Then, BSP-bas