Re: Re: Need help in setting up spark cluster

2015-07-23 Thread Jeetendra Gangele
Thanks for reply and your valuable suggestions I have 10 GB data generated every day so this data I need to write in my database also this data is schema base and schema changes frequently , so consider this as unstructured data sometimes I may have to serve 1 write/secs with 4 m1.xLarge machi

Re: Re: Need help in setting up spark cluster

2015-07-22 Thread fightf...@163.com
Hi, there Per for your analytical and real time recommendations request, I would recommend you use spark sql and hive thriftserver to store and process your spark streaming data. As thriftserver would be run as a long-term application and it would be quite feasible to cyclely comsume data an