Re: package for data quality in Spark 1.5.2

ok thanks let me check it. So your primary storage layer is Hbase with Phoenix as a tool. Sounds interesting. I will get back to you on this Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: package for data quality in Spark 1.5.2

Hi, Spark is a query tool. It stores data in HDFS or Hive database or anything else but does not have its own generic database nulls values and foreign key constraint belong to the domain of databases. What is exactly the nature of your requirements? Do you want to use Spark tool to look at the D