I agree with Ted's assessment. Big Data space is getting crowded with an amazing array of tools and utilities some disappearing like meteors. Hadoop is definitely a keeper. So are Hive and Spark. Hive is the most stable Data Warehouse on Big Data and Spark is offering an array of impressive tools. You can use spark-sql for what is says, deploy powerful functional programming with spark-shell and create packages with SBT and Scala code. Within each of these frameworks, there are an array of tools and functionality and it is best to build upon Hadoop, Hive and Spark. I don't believe one can be an SME in every popular tool in Big Data space, so best to focus on what you already know.
The problem is that typical Big Data customers these days want someone who knows from A-Z of Big Data often with intend of deploying parallel products etc which kind of makes me laugh as these skill set together will take years to master. My two cents Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 9 March 2016 at 15:45, Ted Yu <yuzhih...@gmail.com> wrote: > bq. it is kind of columnar NoSQL database. > > The storage format in HBase is not columnar. > > I would suggest you build upon what you already know (Spark and Hive) and > expand on that. Also, if your work uses Big Data technologies, those would > be the first to consider getting to know better. > > On Wed, Mar 9, 2016 at 7:06 AM, Ashok Kumar <ashok34...@yahoo.com.invalid> > wrote: > >> Hi Gurus, >> >> I am relatively new to Big Data and know some about Spark and Hive. >> >> I was wondering do I need to pick up skills on Hbase as well. I am not >> sure how it works but know that it is kind of columnar NoSQL database. >> >> I know it is good to know something new in Big Data space. Just wondering >> if I am better off spending efforts on something else please. >> >> Appreciate any advice >> >> Regards >> >> >> >
