Hi guys, As some people already might know, I'm recently working on real-time data processing project on top of Hama BSP model, called Meerkat[1] (currently only few developers (from two organizations, Kakaotalk and DataSayer) are involved in this project).
According to our internal study, Storm-like DAG-style and fault-tolerant streaming processing framework can be implemented on top of Hama BSP model. And, furthermore, we're thinking, it may be possible to connect to other BSP applications using some smart input and output formats in the future e.g., streaming graph or learning BSP applications. Thus, we believe that we may be able to have an next-generation architecture that processes and analyzes the data rapidly in real-time, beyond complex old-style data collecting, storing, ordering, processing, and analyzing architecture. Does it make sense to you? If so, I'd like to start to move from github to ASF soon, although this is very *early* stage. Because, it's highly related with Apache Hama and others. Hama sub-module or sub-project, (or Apache incubator?). Which is best you think? I'm also CC'ing general@i.a.o to see more feedbacks (from Apache big data OSS communities). 1. https://github.com/datasayer/meerkat -- Best Regards, Edward J. Yoon --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
