Re: Data Processing speed SQL Vs SPARK

I would probably also look at what kind of analytical use case is to servefor example unification of Streaming, Batch and machine learning workloads can be easily achieved in Spark. This is one of the USP of Spark. But if SQL is the only use case, and data volume <1 milion or 100 GB, I think S

Re: Data Processing speed SQL Vs SPARK

MySQL and PgSQL scale to millions. Spark or any distributed/clustered computing environment would be inefficient for the kind of data size you mention. That's because of coordination of processes, moving data around etc. On Mon, Jul 13, 2015 at 5:34 PM, Sandeep Giri wrote: > Even for 2L records

Re: Data Processing speed SQL Vs SPARK

Even for 2L records the MySQL will be better. Regards, Sandeep Giri, +1-253-397-1945 (US) +91-953-899-8962 (IN) www.KnowBigData.com. [image: linkedin icon] [image: other site icon] [image: facebook icon

Re: Data Processing speed SQL Vs SPARK

For records below 50,000 SQL is better right? On Fri, Jul 10, 2015 at 12:18 AM, ayan guha wrote: > With your load, either should be fine. > > I would suggest you to run couple of quick prototype. > > Best > Ayan > > On Fri, Jul 10, 2015 at 2:06 PM, vinod kumar > wrote: > >> Ayan, >> >> I would

Re: Data Processing speed SQL Vs SPARK

With your load, either should be fine. I would suggest you to run couple of quick prototype. Best Ayan On Fri, Jul 10, 2015 at 2:06 PM, vinod kumar wrote: > Ayan, > > I would want to process a data which nearly around 5 records to 2L > records(in flat). > > Is there is any scaling is ther

Re: Data Processing speed SQL Vs SPARK

Ayan, I would want to process a data which nearly around 5 records to 2L records(in flat). Is there is any scaling is there to decide what technology is best?either SQL or SPARK? On Thu, Jul 9, 2015 at 9:40 AM, ayan guha wrote: > It depends on workload. How much data you would want to p

Re: Data Processing speed SQL Vs SPARK

It depends on workload. How much data you would want to process? On 9 Jul 2015 22:28, "vinod kumar" wrote: > Hi Everyone, > > I am new to spark. > > Am using SQL in my application to handle data in my application.I have a > thought to move to spark now. > > Is data processing speed of spark bette

Data Processing speed SQL Vs SPARK

Hi Everyone, I am new to spark. Am using SQL in my application to handle data in my application.I have a thought to move to spark now. Is data processing speed of spark better than SQL server? Thank, Vinod