Re: [elephant-devel] Querying Advice

2006-11-12 Thread Daniel Salama
Were you storing persistent-metaclass objects or simply normal objects? Normal objects are huge relative to persistent objects as currently all the slot names are also serialized (potentially in 32-bit unicode if on SBCL). I have some improvements planned to reduce the storage and processin

Re: [elephant-devel] Complex queries

2006-11-12 Thread Daniel Salama
Thanks. I'll be great to contribute anything to the project and a pleasure working with you guys. On Nov 12, 2006, at 1:11 PM, Ian Eslick wrote: I'm interested in this problem myself, but haven't had the time to do the appropriate research. Many SQL query engines are built on top of a BTre

Re: [elephant-devel] Querying Advice [w/code example]

2006-11-12 Thread Daniel Salama
Wow! I wasn't expecting to hear back from you until Monday :)I haven't been able to run your code yet. I downloaded SBCL for PPC but have not been able to successfully compile Elephant with it. I will continue trying. I used to have it working before, but stopped using SBCL a while ago for OpenMCL.

Re: [elephant-devel] Querying Advice

2006-11-12 Thread Ian Eslick
>> >> First of all, ask yourself, what is the size of your dataset? Can >> you fit it all into memory? >> If so, you have the full power of lisp at your command in dealing >> with the querying. You >> will not have to write any macros to do this. You might find the DCM >> package, in the "contr

[elephant-devel] Complex queries

2006-11-12 Thread Ian Eslick
I'm interested in this problem myself, but haven't had the time to do the appropriate research. Many SQL query engines are built on top of a BTree infrastructure so building and performing optimized queries should be quite doable in Elephant. However, I do know that efficient operations are fairl

Re: [elephant-devel] Querying Advice

2006-11-12 Thread Daniel Salama
I'd love to hear/read about your take on the subject.It would be really great to be able to have some querying or even better a reporting tool that worked with Elephant. May be something a la Crystal Reports, but that may be shooting too high :). How about something like http://www.agata.org.br/?An

Re: [elephant-devel] Querying Advice

2006-11-12 Thread Daniel Salama
On Nov 12, 2006, at 3:48 PM, Robert L. Read wrote: This requires a philosophical response.  In general, I think it will be way easier than you image, once you have been pointed in the right direction.  Take my advice with a grain of salt.I certainly hope so. As I have been learning lisp, I have fu

Re: [elephant-devel] Querying Advice [w/code example]

2006-11-12 Thread Robert L. Read
Dear Daniel and Team,     I think the code below, which I have tested on SBCL, illustrated a typical problem that Daniel Salama introduces.  To paraphrase, you have a datatype (perhaps compound) which has a lot of slots; you have a GUI, perhaps web-based, that you use to both select or filter

Re: [elephant-devel] Querying Advice

2006-11-12 Thread Ian Eslick
I have another take on this for queries where you are looking for high throughput but want to stick with the elephant persistence model (slot values on disk) or your data won't fit in memory. I'll send this out when I get my computer back to an Inet connection... Robert and I have discussed a

Re: [elephant-devel] Querying Advice

2006-11-12 Thread Robert L. Read
This requires a philosophical response.  In general, I think it will be way easier than you image, once you have been pointed in the right direction.  Take my advice with a grain of salt. First of all, ask yourself, what is the size of your dataset?  Can you fit it all into memory? If so, you

[elephant-devel] Querying Advice

2006-11-12 Thread Daniel Salama
Hi all, Coming from a Rails/MySQL world, we are having some difficulty trying to comprehend/model/implement querying the database using dynamically generated criteria. For example, in the life we are trying to leave, we present the user with advanced search screen, where they can select a