Re: OSGi and classloaders

2012-07-09 Thread Jean-Baptiste Onofré
Thanks for the update guys. We are going to look for a way to handle configurations in an OSGi way without changing the API/dependency. Regards JB On 07/09/2012 08:30 PM, Owen O'Malley wrote: Changing the configurations is a big and very touchy job. It is touchy in that it is very exposed to

Re: OSGi and classloaders

2012-07-09 Thread Owen O'Malley
Changing the configurations is a big and very touchy job. It is touchy in that it is very exposed to the users and many many applications assume the configuration is dealt with in particular ways. It is a requirement to maintain compatibility and thus that needs to be factored in to the work. Furth

Re: OSGi and classloaders

2012-07-09 Thread Robert Evans
Guillaume, The problem with Configuration is that it is public, so changing it does not just impact Hadoop. It also impacts all of the projects that use it, either directly as part of the Map/Reduce APIs or for storing their own configuration. Within Hadoop proper there are several places where

Re: OSGi and classloaders

2012-07-09 Thread Guillaume Nodet
Right, that would surely be incompatible. The initial work I did was on 1.0.3 and those problems can be solved in a more simple (though less clean) way in that branch, mainly because of the fact that there is a single jar which contain everything, so that causes less problems in OSGi. For trunk,

Re: OSGi and classloaders

2012-07-09 Thread Jean-Baptiste Onofré
Hi Bobby, Guillaume and I are working on trunk. So it makes sense to focus on trunk for this kind of refactoring. We are working on a fork branch on github. We can choose when merge our changes to trunk (or a dedicated branch). Regards JB On 07/09/2012 04:37 PM, Robert Evans wrote: Guillau

Re: OSGi and classloaders

2012-07-09 Thread Robert Evans
Guillaume, I am not super familiar with OSGi. I have used it a little in the past, but that was 5+ years ago. I am in favor of something that will fix the CLASSPATH problems that we currently have and would allow for CLASSPATH isolation between Hadoop itself and the applications that use Hadoop.

OSGi and classloaders

2012-07-09 Thread Guillaume Nodet
I'm working with Jean-Baptiste to make hadoop work in OSGi. OSGi works with classloader in a very specific way which leads to several problems with hadoop. Let me quickly explain how OSGi works. In OSGi, you deploy bundles, which are jars with additional OSGi metadata. This metadata is used by t