spark over drill

2015-10-08 Thread Pranay Tonpay
hi ,, Is spark-drill integration already done ? if yes, which spark version supports it ... it was in the "upcming list for 2015" is what i had read somewhere

spark-sql / apache-drill / jboss-tiied

2015-10-25 Thread Pranay Tonpay
Hi, In terms of federated query, has anyone done any evaluation between spark-sql and drill and jboss-tiied. I have a very urgent requirement for creating a virtualized layer (sitting atop several databases) and am evaluating these 3 as an option.. Any help would be appreciated. I know Spark-SQL ha

sqlContext vs hivecontext

2015-11-24 Thread Pranay Tonpay
hi , when i am using hivecontext, i am able to query for individual columns from a table as against when using sqlContext where only a select * works Is is possible to use sqlContext and still query for specific columns from a hive table ?

DAG in Pipeline

2016-06-08 Thread Pranay Tonpay
Hi, Pipeline as of now seems to be having a series of transformers and estimators in a serial fashion. Is it possible to create a DAG sort of thing - Eg - Two transformers running in parallel to cleanse data (a custom built Transformer) in some way and then their outputs ( two outputs ) used for s