Regards
Sanjiv Singh
Mob : +1 571-599-5236
Regards
Sanjiv Singh
Mob : +1 571-599-5236
driver="com.mysql.jdbc.Driver",
*partitionColumn*="id",
*lowerBound *= 1,
*upperBound *= maxId,
*numPartitions *= 100
).load()
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Aug 10, 2016 at 6:35 AM, Siva A wrote:
> Hi Team,
Hi All,
We are using for Spark SQL :
- Hive :1.2.1
- Spark : 1.3.1
- Hadoop :2.7.1
Let me know if needs other details to debug the issue.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Sun, Mar 13, 2016 at 1:07 AM, Mich Talebzadeh
wrote:
> Hi,
>
> Thanks for the inp
ive> insert into foo values(20);
scala> sqlContext.table("default.foo").count* // Gives 2 , no compaction
required.*
Regards
Sanjiv Singh
Mob : +091 9990-447-339
after compaction, Spark SQL
start recognizing delta files.
Let know me if needed other details to get root cause.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Feb 23, 2016 at 2:28 PM, Varadharajan Mukundan wrote:
> That's interesting. I'm not sure why first compaction is neede
e data is still in delta files
Now run major compaction:
hive> ALTER TABLE default.foo COMPACT 'MAJOR';
scala> sqlContext.table("default.foo").count // Gives 1
hive> insert into foo values(20);
scala> sqlContext.table("default.foo").count* // Gives 2
unt(*) from mytable ;
+--+
| _c0 |
+--+
| 44 |
+--+
1 row selected (1.196 seconds)
*HIVE JDBC :*
1: jdbc:hive2://myhost:1> select count(*) from mytable ;
+--+--+
| _c0 |
+--+--+
| 44 |
+--+--+
1 row selected (0.121 seconds)
Regards
Sanjiv Singh
Mob : +091 9
db.db/mytable/delta_086_086
drwxr-xr-x - root hdfs 0 2016-02-23 11:41
/apps/hive/warehouse/mydb.db/mytable/delta_087_087
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Feb 22, 2016 at 1:38 PM, Varadharajan Mukundan wrote:
> Actually the auto compaction if enabled is
Documentation is upset sometimes.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Feb 22, 2016 at 9:49 AM, Varadharajan Mukundan wrote:
> Yes, I was burned down by this issue couple of weeks back. This also means
> that after every insert job, compaction should be run to access ne
#x27;root',
'last_modified_time'='1455859079',
'numFiles'='37',
'numRows'='3',
'rawDataSize'='0',
'totalSize'='11383',
'transactional'='true',
'tran
is working on plain Apache setup.
Let me know if needs other details.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
ory and JDBC queries are
getting results.
*conf/spark-env.sh* (executor memory configurations not picked by
thrift-server)
export SPARK_JAVA_OPTS="-Dspark.executor.memory=512M"
export SPARK_EXECUTOR_MEMORY=512M
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Jan 28, 2016 at
.run(Thread.java:744)
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Jan 28, 2016 at 9:57 PM, @Sanjiv Singh
wrote:
> Any help on this.
>
> Regards
> Sanjiv Singh
> Mob : +091 9990-447-339
>
> On Wed, Jan 27, 2016 at 10:25 PM, @Sanjiv Singh
> wrote:
>
>> H
Any help on this.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jan 27, 2016 at 10:25 PM, @Sanjiv Singh
wrote:
> Hi Ted ,
> Its typo.
>
>
> Regards
> Sanjiv Singh
> Mob : +091 9990-447-339
>
> On Wed, Jan 27, 2016 at 9:13 PM, Ted Yu wrote:
>
>> In
Hi Ted ,
Its typo.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jan 27, 2016 at 9:13 PM, Ted Yu wrote:
> In the last snippet, temptable is shown by 'show tables' command.
> Yet you queried tampTable.
>
> I believe this just was typo :-)
>
> On Wed, Jan
tampTable;*
I can list the table through "show tables", but I run the query , it is
either hanged or returns nothing.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Hi Karthik,
Can you provide us more detail of dataset "data" that you wanted to
parallelize with
SparkContext.parallelize(data);
Regards,
Sanjiv Singh
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Sun, Oct 12, 2014 at 11:45 AM, rapelly kartheek
wrote:
> Hi,
>
> I a
18 matches
Mail list logo
