Adding OpenSearch as a secondary index provider to SparkSQL

2023-03-24 Thread Anirudha Jadhav
Hello community, wanted your opinion on this implementation demo. / support for Materialized views, skipping indices and covered indices with bloom filter optimizations with opensearch via SparkSQL https://github.com/opensearch-project/sql/discussions/1465 ( see video with voice over ) Ani -- A

Re: spark worker on mesos slave | possible networking config issue

2015-03-25 Thread Anirudha Jadhav
your network address like 192.168.1.10 > > Thanks > Best Regards > > On Tue, Mar 24, 2015 at 11:18 PM, Anirudha Jadhav > wrote: > >> is there some setting i am missing: >> this is my spark-env.sh>>> >> >> export MESOS_NATIVE_LIBRARY=/usr

spark worker on mesos slave | possible networking config issue

2015-03-24 Thread Anirudha Jadhav
is there some setting i am missing: this is my spark-env.sh>>> export MESOS_NATIVE_LIBRARY=/usr/local/lib/libmesos.so export SPARK_EXECUTOR_URI=http://100.125.5.93/sparkx.tgz export SPARK_LOCAL_IP=127.0.0.1 here is what i see on the slave node. less 20150226-160708-78932-50

Re: newbie quesiton - spark with mesos

2015-03-23 Thread Anirudha Jadhav
". HTH, Dean Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly) Typesafe <http://typesafe.com> @deanwampler <http://twitter.com/deanwampler> http://polyglotprogramming.com On Mon, Mar 23, 2015 at 11:46

newbie quesiton - spark with mesos

2015-03-23 Thread Anirudha Jadhav
i have a mesos cluster, which i deploy spark to by using instructions on http://spark.apache.org/docs/0.7.2/running-on-mesos.html after that the spark shell starts up fine. then i try the following on the shell: val data = 1 to 1 val distData = sc.parallelize(data) distData.filter(_< 10).co