Phoenix client threads

2019-07-29 Thread Sumanta Gh
Hi, When we use Phoenix client, there are by default 10 new PHOENIX-SCANNER-RENEW-LEASE-threads created. There are also new threads spawned for hconnection-shared-thread-pool. This thread pool goes upto having max 256 threads. How can these thread pool sizes be configured using configuration?

phoenix classpath

2018-12-31 Thread Sumanta Gh
Hi, Is there a way to avail the core-site.xml, hdfs-site.xml and hbase-site.xml in an external location than where phoenix-client.jar is located inside the application.war? I am facing a typical CI/CD issue where my "application.war" is built much before I got the hadoop xml files. Is it po

Is read-only user of Phoeix table possible?

2018-08-22 Thread Sumanta Gh
Hi, I have a Kerberos enabled Hbase 1.2 cluster with Phoenix 4.9. In hbase shell, I have granted an hbase user with permission R. hbase shell > grant 'user1', 'R' Now while connecting through SqlLine, I am getting the below error - Insufficient permissions (user=us...@example.com, scop

Phoenix 5 connection URL issue

2018-07-22 Thread Sumanta Gh
Hi, I am trying to connect a Kerberos enabled Hbase 2.0 cluster from Phoenix 5.0 client (sqlline). This is my connection URL - jdbc:phoenix:Zk1,Zk2,Zk3:2181:/hbase:suma...@example.com:~/sumanta.keytab I am getting following error in SqlLine. Error: ERROR 102 (08001): Malformed connection ur

Re: Phoenix 4.13 on Hortonworks

2018-01-17 Thread Sumanta Gh
ew upgrades for such a long time. On 17 Jan 2018 10:50, "Sumanta Gh" wrote: Hortonworks latest HDP gives Phoenix 4.7 out of the box. I tried to upgrade to 4.13 but it is shutting down the region servers. Regards Sumanta -Pedro Boado wrote: - To: user@phoenix.apache.org

Re: Phoenix 4.13 on Hortonworks

2018-01-17 Thread Sumanta Gh
Hi, Afaik Hortonworks already includes Apache Phoenix as part of the platform, doesn't it? Cheers. On 17 Jan 2018 10:30, "Sumanta Gh" wrote: I am eager to learn if anyone has installed Phoenix 4.13 on Hortonworks HDP cluster. Please let me know the version number of HD

Phoenix 4.13 on Hortonworks

2018-01-17 Thread Sumanta Gh
I am eager to learn if anyone has installed Phoenix 4.13 on Hortonworks HDP cluster. Please let me know the version number of HDP that was used. Regards Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confidenti

Phoenix 4.12 error on HDP 2.6

2017-10-25 Thread Sumanta Gh
Hi, I am trying to install phoenix-4.12.0 (HBase-1.1) on HDP 2.6.2.0. As per installation guide, I have copied the phoenix-4.12.0-HBase-1.1-server.jar inside HBase lib directory. After restarting HBase using Ambari and connecting through SqlLine, I can see phoenix system tables are getting creat

Support of OFFSET in Phoenix 4.7

2017-09-06 Thread Sumanta Gh
Hi, >From which version of Phoenix pagination with OFFSET is supported. It seems >this is not supported in 4.7 https://phoenix.apache.org/paged.html regards, Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confident

reactive Phoenix

2017-07-13 Thread Sumanta Gh
Hi, Would it not be a great value addition to make reactive Phoenix client and available as Spring Initializr ? Mongo, Cassandra, Redis are already in that space. - Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain co

Re: pagination

2017-05-18 Thread Sumanta Gh
2017 at 2:04 PM, rafa wrote: Ups...sorry my mistake. The Jira is for limit - offset with orderby. sorry. On Thu, May 18, 2017 at 2:02 PM, rafa wrote: Hi Sumanta, I think it is not supported yet: https://issues.apache.org/jira/browse/PHOENIX-3353 Best regards, rafa On Thu, May 18, 2017 at 1

pagination

2017-05-18 Thread Sumanta Gh
Hi, >From which version of Phoenix LIMIT-OFFSET based pagination is supported? I am >using 4.7, but not able to use OFFSET. Regards Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged informat

Re: Query TimeOut on Azure HDInsight

2017-02-10 Thread Sumanta Gh
dd a > secondary index on COL1 and INCLUDE(COLX). Otherwise, you'll have to > increase hbase.rpc.timeout to something higher than 6 and maybe even > phoenix.query.timeoutMs. I'm sure there are other optimizations too, but > I'll let someone else answer that. > &g

Re: Query TimeOut on Azure HDInsight

2017-02-10 Thread Sumanta Gh
ut to something higher than 6 and maybe even phoenix.query.timeoutMs. I'm sure there are other optimizations too, but I'll let someone else answer that. On Fri, Feb 10, 2017 at 7:40 AM, Sumanta Gh wrote: > Hi, > We have a production system on Azure HDInsight. > There is a table

Query TimeOut on Azure HDInsight

2017-02-10 Thread Sumanta Gh
Hi, We have a production system on Azure HDInsight. There is a table called TABLE1 which has approx 100 million rows. Recently the following query is always timing out - SELECT DISTINCT COLX FROM TABLE1 WHERE COL1=1 LIMIT 10; java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOExc

phoenix load time

2016-12-06 Thread Sumanta Gh
Hi, I am using phoenix from my Java app and found that it takes approx 30 sec to load giving the following warning - WARN [main]  o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable I am using standalone Hbase

Re: [ANNOUNCE] Phoenix 4.7 now supported in Amazon EMR

2016-06-30 Thread Sumanta Gh
Hi, To develop locally and migrate to EMR, I need to configure  phoenix-4.7.0-HBase-1.1/ on HBase 1.2 at dev systems. Will it run? Regards Sumanta  -James Taylor wrote: - To: user From: James Taylor Date: 06/10/2016 01:18PM Subject: Re: [ANNOUNCE] Phoenix 4.7 now supported in Amazon E

Re: Storage benefits of ARRAY types

2016-05-25 Thread Sumanta Gh
in HBase. - Sumanta  -Sumanta Gh wrote: - To: user@phoenix.apache.org From: Sumanta Gh Date: 05/13/2016 04:57PM Subject: Storage benefits of ARRAY types Hi, Do we gain any disk utilization benefit while defining columns as an array? - Sumanta =-=-= Notice: The

Storage benefits of ARRAY types

2016-05-13 Thread Sumanta Gh
Hi, Do we gain any disk utilization benefit while defining columns as an array? - Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dis

Dynamic column using Pig STORE function

2016-02-17 Thread Sumanta Gh
Hi, I was going through the Phoenix Pig integration [1]. I need to store value in a dynamic column using org.apache.phoenix.pig.PhoenixHBaseStorage. Is dynamic column allowed in STORE function? Please send me some example. [1] - https://phoenix.apache.org/pig_integration.html Regards Sumanta Gho

Drop in throughput

2015-10-13 Thread Sumanta Gh
Hi, I was experimenting the reasons why there is significant drop in through-put when I give mixed workload of 70% Upsert + 30% Selects over 100% Upserts or 100% Selects. While doing that I find that the following line is getting printed every time in my log :- "Re-resolved stale table MY_TABL

Storage cost of ARRAY Type

2015-08-28 Thread Sumanta Gh
Hi, Is an ARRAY type kept in a single cell of hbase? If so, is it not good idea to use more ARRAY types in a table as it reduces the meta-data cost like rowkeys, column names etc. Pls let me know. Regards Sumanta  =-=-= Notice: The information contained in this e-mail message

Re: Table salting

2015-08-18 Thread Sumanta Gh
in HBase. I dont think it possible without re-writing entire table with new RowKey(salted). Are you ok with rewriting entire table with new Rowkey? On Tue, Aug 18, 2015 at 7:29 AM, Sumanta Gh wrote: Hi, Is there a way to add salt buckets to an existing table with data? Regar

Table salting

2015-08-18 Thread Sumanta Gh
Hi, Is there a way to add salt buckets to an existing table with data? Regards Sumanta =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissem

Re: Poor SELECT performance in wide table

2015-07-31 Thread Sumanta Gh
/2015 03:13AM Subject: Re: Poor SELECT performance in wide table Hi Sumanta, Would it be possible to get more detail? Phoenix/HBase version, schema, queries? Where are you finding the bottlenecks to be? Thanks, James On Tue, Jul 28, 2015 at 10:46 PM, Sumanta Gh wrote: Hi All, Have anyone noticed

Poor SELECT performance in wide table

2015-07-28 Thread Sumanta Gh
Hi All, Have anyone noticed that with the increasing number of columns (static/dynamic) the performance of SELECT query linearly degrades even if I mention all row key columns in the query. Any comments on this is appreciated. Thanks and regards, Sumanta  =-=-= Notice: The i

Getting errors in Phoenix queries with JOIN clause[Phoenix version 3.2.2]

2015-07-27 Thread Sumanta Gh
Hello, I'm getting an error (Error: Encountered exception in sub plan [0] execution. (state=,code=0)) with Apache Phoenix version 3.2.2 while I'm trying to execute a query with INNER JOIN or LEFT OUTER JOIN or with sub-query.I'm using sqlline.py client from hadoop1/bin directory found under Pho

Re: Select dynamic column content

2015-01-07 Thread Sumanta Gh
out the dynamic annotation column names (which are things like annotations.a0, .a1, .a2, etc) The downside is that you then need to do two queries to get all the columns, but until we implement the cf.* logic for dynamic columns, that's the best you can do. - jesse On Tue, Jan 6, 2015, 9:

Re: Select dynamic column content

2015-01-06 Thread Sumanta Gh
dynamic column names to find them in the after math. regards On Tue, Jan 6, 2015 at 8:01 AM, Sumanta Gh wrote: Hi, It has been a puzzle for me to get the content of dynamic columns in a single SELECT * FROM query. Challenge is that I do not know the dynamic column names in advance so I can not

Select dynamic column content

2015-01-05 Thread Sumanta Gh
Hi, It has been a puzzle for me to get the content of dynamic columns in a single SELECT * FROM query. Challenge is that I do not know the dynamic column names in advance so I can not mention a dynamic column in the SELECT query. Is there any way out? Please suggest. Regards Sumanta =-

Re: Phoenix vs Trafodion

2014-09-12 Thread Sumanta Gh
"The problem with Trafodion SQL tables is that they use a fixed format to represent column values, making it harder for native HBase applications to access them. Also, they have a fixed structure, so users lose the flexibility of dynamic columns that comes with HBase." - as per their API Ref G