Here is thurber (https://github.com/atdixon/thurber) (at early alpha 
release) that enables Clojure on Apache Beam platforms like Google Dataflow.

thurber's goals include:

- Full support for Beam capabilities
- AOT-less (AOT not required; full dynamic support for serializing 
functions, including inlined functions, and proxies)
- Macro-less (very few, always optional, macros)
- Performance focus (core optimized for large volume data streaming)
- Idiomatic Clojure focus (Clojure functions are automatically 
distributable functional transforms, lazy sequences over iterative output, 
..)

When coming to Apache Beam and wanting to use Clojure there are a few 
hurdles to overcome, some discussed here in the past.  Clojure's Java 
interop commonly falls short in the domain of distributed big data Java 
platforms (proxies and functions not serializable, no support for 
generation of generic type signatures, minimal/insufficient support for 
method annotations, suboptimal dynamic binding performance, etc)

thurber bridges these issues internally, giving a full dynamic/Clojure 
experience on top of Apache Beam.

(For Onyx users, thurber + Beam meet the same ideals 
<http://www.onyxplatform.org/docs/user-guide/0.14.x/#what-does-onyx-offer> as 
Onyx on a well-backed platform.)

This is early alpha release and feedback on the API & facilities are 
welcome.

For the curious, the walkthrough covers most of thurber capability: 
https://github.com/atdixon/thurber/blob/master/demo/walkthrough.clj

-- 
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clojure@googlegroups.com
Note that posts from new members are moderated - please be patient with your 
first post.
To unsubscribe from this group, send email to
clojure+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to clojure+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/clojure/c18cc8e1-01c9-4688-bff3-6d50f128d0e4%40googlegroups.com.

Reply via email to