consumer app to dump data in binary form
> to GPFS or NFS, since the HDFS api is very special.
>
> Thanks,
>
> Jun
>
>
> On Fri, May 16, 2014 at 8:17 AM, Carlile, Ken
> wrote:
>
>> Hi all,
>>
>> Sorry for the possible repost--hadn't seen
Correction, the http post may or may not be faster than writing directly to
SMB, but hopefully we can improve that speed in a more scalable manner than
SMB.
--Ken
On May 16, 2014, at 11:17 AM, Carlile, Ken wrote:
> Hi all,
>
> Sorry for the possible repost--hadn't seen th
Hi all,
Sorry for the possible repost--hadn't seen this in the list after 18 hours and
figured I'd try again
We are experimenting as using Kafka as a midpoint between microscopes and a
Spark cluster for data analysis. Our microscopes almost universally use Windows
machines for acquisition
Hi all,
We are experimenting as using Kafka as a midpoint between microscopes and a
Spark cluster for data analysis. Our microscopes almost universally use Windows
machines for acquisition (as do most scientific instruments), and our compute
cluster (which runs Spark among many other things) r
r if anyone else is running
> their zk alongside their kafka brokers in production?
>
> Ray
>
>
> On Sat, Mar 15, 2014 at 10:28 AM, Carlile, Ken
> wrote:
>
>> I'd rather not purchase dedicated hardware for ZK if I don't absolutely
>> have to, unles
it's java under all of this?
--Ken
On Mar 15, 2014, at 12:07 AM, Jun Rao wrote:
> The spec looks reasonable. If you have other machines, it may be better to
> put ZK on its own machines.
>
> Thanks,
>
> Jun
>
>
> On Fri, Mar 14, 2014 at 10:52 AM, Carlile, Ken
&g
Hi all,
I'm looking at setting up a (small) Kafka cluster for streaming microscope data
to Spark-Streaming.
The producer would be a single Windows 7 machine with a 1Gb or 10Gb ethernet
connection running http posts from Matlab (this bit is a little fuzzy, and I'm
not the user, I'm an admin),
