Re: Exception with datanucleus while running hive tests in eclipse

I ran into the same problem on the same MAC OS version. This seems to be a JVM command line issue. it exceeds its limits and it's platform independent. I know IntelliJ Idea handles this case. On Wed, May 16, 2012 at 5:40 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > I inst

Transform.java Vs. PhysicalPlanResolver.java

Hello, 1) Does Hive consider a clear-cut distinction between compile-time optimization and run-time optimization? 2) Does anybody know the difference between the optimizations implementing the Transform and the ones implementing the PhysicalPlanResolver? Why such optimizations are they in separate

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13437583#comment-13437583 ] Mahsa Mofidpoor commented on HIVE-2845: --- Finally, I replaced the table in

Re: Problem with Hive Indexing

Hi, At lease the table size must be greater than 5GB to use the index for filter pushdown. Otherwise you have to comment the checkQuerySize method. Cheers, Mahsa On Mon, Jul 30, 2012 at 11:12 AM, Ablimit Aji wrote: > I have written a custom index handler and wanted to test it. However hive > i

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428956#comment-13428956 ] Mahsa Mofidpoor commented on HIVE-2845: --- I put my code in optimizer/physical, pr

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424378#comment-13424378 ] Mahsa Mofidpoor commented on HIVE-2845: --- Can you please clarify on the new cha

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420673#comment-13420673 ] Mahsa Mofidpoor commented on HIVE-2845: --- I've checked the query plan. It

[jira] [Commented] (HIVE-1644) use filter pushdown for automatically accessing indexes

[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419996#comment-13419996 ] Mahsa Mofidpoor commented on HIVE-1644: --- Can the same approach be applied to

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419995#comment-13419995 ] Mahsa Mofidpoor commented on HIVE-2845: --- Can anybody tell me how close this JIR

Re: [jira] [Created] (HIVE-2845) Add support for index joins in Hive

Hello all, On Tue, Mar 6, 2012 at 8:31 PM, Namit Jain (Created) (JIRA) wrote: > Add support for index joins in Hive > --- > > Key: HIVE-2845 > URL: https://issues.apache.org/jira/browse/HIVE-2845 > Project: Hive >

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409115#comment-13409115 ] Mahsa Mofidpoor commented on HIVE-2845: --- what will be the operator rule that mat

Hive common join Vs. JoinLineage

Hello, As far as I know, a join operation can be converted to a common join at the physical optimization stage, if the correspondent variable is set to true . If not, join will be performed by JoinLineage, am I right? What is exactly the difference between these two approaches? I appreciate your

[jira] [Commented] (HIVE-2845) Add support for index joins in Hive

[ https://issues.apache.org/jira/browse/HIVE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405956#comment-13405956 ] Mahsa Mofidpoor commented on HIVE-2845: --- When where clause makes use of indexes,

Using indexes for predicates does not increase performance.

Hi, I did a simple experiment to see the performance difference between normal execution of a query and the index-based execution. However, the response time in non-indexed approach is astonishingly smaller. Is it because of the small data size or the single setup node I use? I appreciate any help

applying patches fails

Hi, I am trying to see how the following query works with indexes. Reading the logs, I am sure that the index is not used to execute the query. Applying HIVE-1644 .19.patch also fails with the following errors. What should I do to make Hive use inde

how to force hive to use index for predicates

Hi, I have a table pokes(foo int, bar string) on which I created a compact index (on foo). I set hive.optimze.autoindex=true and then run the query select * from pokes where name = 'somename'. However, when I enable logging, I do not see the phase in which the optimizer makes use of the index. I a

should managed tables be visible outside hive?

Hi, I built Hive from the source code. When I try to create tables, I do not see anything in /user/hive/warehouse. However, the tables are created correctly. After loading data to a table, I get the following statement: Deleted hdfs://localhost:54310/user/hive/warehouse/test_2 Is that normal? T

running Hive from Eclipse fails

Hi, When I try to run Hive by HiveCli.Launch I get this error: The archive: /hive-trunk/build/hadoopcore/hadoop-0.20.2/conf which is referenced by the classpath, does not exist. What should I do? Moreover, do I have to start hadoop manually before starting Hive? Thank you for your reply. Mahsa

running Hive from within Eclipse

Hi, I checked out the latest successful built, but when I try to run Hive from Eclipse the following message appears: 'Launching HiveCli' has encountered a problem. The archive: /hive-trunk/build/hadoopcore/hadoop-0.20.2/conf which is referenced by the classpath, does not exist. I checked the hi

Re: ant test fails

Hi, Thanks for your response Carl. I checked out the latest successful build (Build #1396 (Apr 25, 2012 4:01:02 PM) ), but again I got this error: BUILD FAILED /home/mahsa/workspace/apr25/hive-trunk/build.xml:316: Keepgoing execution: 3 of 12 iterations failed. What should I do? Thanks for your

[jira] [Commented] (HIVE-2902) undefined property exists in eclipse-templates/.classpath

[ https://issues.apache.org/jira/browse/HIVE-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244880#comment-13244880 ] Mahsa Mofidpoor commented on HIVE-2902: --- then there should be no problem

[jira] [Updated] (HIVE-2915) up-to-date metastore ER diagram

[ https://issues.apache.org/jira/browse/HIVE-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahsa Mofidpoor updated HIVE-2915: -- Release Note: Updated ER Diagram of the Meta-store has been attached with this ticket

[jira] [Updated] (HIVE-2915) up-to-date metastore ER diagram

[ https://issues.apache.org/jira/browse/HIVE-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahsa Mofidpoor updated HIVE-2915: -- Attachment: HiveMetastoreCompleterelations.pdf > up-to-date metastore ER diag

[jira] [Created] (HIVE-2915) up-to-date metastore ER diagram

Environment: Ubuntu, MySQL workbech Reporter: Mahsa Mofidpoor Priority: Trivial Fix For: 0.8.1 The up-to-date ER diagram for metastore is not available in Hive wiki. Now there are 31 tables residing in metastore including the ones for indexes. -- This message

build failed

Hi, After checking out the source code, I go to my eclipse workspace and execute "ant clean package eclipse-files", but I receive the following message: Unable to locate tools.jar. Expected to find it in /usr/lib/jvm/java-6-openjdk/lib/tools.jar Buildfile: build.xml does not exist! Build failed