The world has moved in from indexes, materialized views, and other single processor non-distributed system algorithms. Nice that you are not asking questions regarding hierarchical file systems.
Regards, Gourav On Sun, Aug 14, 2016 at 4:03 AM, Taotao.Li <charles.up...@gmail.com> wrote: > > hi, guys, does Spark SQL support indexes? if so, how can I create an > index on my temp table? if not, how can I handle some specific queries on a > very large table? it would iterate all the table even though all I want is > just a small piece of that table. > > great thanks, > > > *___________________* > Quant | Engineer | Boy > *___________________* > *blog*: http://litaotao.github.io > <http://litaotao.github.io/?utm_source=spark_mail> > *github*: www.github.com/litaotao > > >