Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread David Grizzanti
s the most sensitive code in CloudStack. > > From: Alex Ough > Date: Thursday, February 6, 2014 6:29 AM > To: "dev@cloudstack.apache.org" > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala > Subject: Re: [DISCU

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread Alex Ough
I am uncomfortable with changes to GenericDaoBase. Was this really > > necessary? This feature was supposed to be "outside" CloudStack as much > as > > possible and optional. Yet it touches the most sensitive code in > CloudStack. > > > > From: Alex Ough >

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread David Grizzanti
ot; > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala > Subject: Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions > > All, > > I just sent a review request, so please take a look a

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Alex Ough
ional. Yet it touches the most sensitive code in CloudStack. > > From: Alex Ough > Date: Thursday, February 6, 2014 6:29 AM > To: "dev@cloudstack.apache.org" > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Chiradeep Vittal
ilto:chiradeep.vit...@citrix.com>>, Kishan Kavala mailto:kishan.kav...@citrix.com>> Subject: Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions All, I just sent a review request, so please take a look at it and let me know if you have any comments/suggests. https://reviews.apache.org

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Alex Ough
All, I just sent a review request, so please take a look at it and let me know if you have any comments/suggests. https://reviews.apache.org/r/17790/ Thanks Alex Ough On Mon, Jan 13, 2014 at 11:17 AM, Alex Ough wrote: > All, > > I'd like to have some suggestion about 2 things related with th

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-01-13 Thread Alex Ough
All, I'd like to have some suggestion about 2 things related with this. 1. The 'Full Scan' management Now, I set it running every time a user logs in to the UI, but I think it will be necessary to make it run with some interval also. But I'm not familiar with the config file, so can anyone give s

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-01-08 Thread Alex Ough
All, A little bit of updates after a long vacation, I'm currently creating automated test scripts that randomly create/delete/update domain/account/user objects in random regions to trigger the sync-up and full scans regularly. Once they are completed, I'll post it in the github also and submit th

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-12-18 Thread Alex Ough
All, I updated the wiki after some logic changes, so please review them, especially "Full Scan", which is newly introduced. https://cwiki.apache.org/confluence/display/CLOUDSTACK/Domain-Account-User+Sync+Up+Among+Multiple+Regions And I implemented this functionality in Java and you can get the pu

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-12 Thread Alex Ough
Good point, Chiradeep, I'm not sure if you reviewed my design doc in the wiki, but my design is to just skip any actions for target resources that already took place by any means. But the issue is when conflict actions in the same resources (like create & delete the same users) are enqueued in rev

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-12 Thread Chiradeep Vittal
Missed this one. In a single region, the CloudStack DB is the master for most operations. If the infra is not in the state the DB says it should be, generally the approach is to whack it and make it conform. For some exceptions (live migration/related use cases are exceptions) the DB is the slave -

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-11 Thread Alex Ough
All, I'm new to the cloudstack project, so there can be something I missed for consideration, but the current region support seems to be inadequate (I hope this does not offend anyone...) because even if a customer can have multiple regions, the resources in each region are totally separated like

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-09 Thread Daan Hoogland
H Guys, Can you shoot at my claims below, please? syncing being optional does not conflict with the code being in the core server. It seems that making a plugin for this is misuse of the plugin mechanism. To me it is more of an option to switch on or of with a global setting, having some extra co

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-08 Thread Chip Childers
We are already (generally) AP for most infra changes really. I'd use that model. Eventual consistency is better in this scenario. > On Nov 8, 2013, at 6:49 PM, Chiradeep Vittal > wrote: > > I'd also like to highlight that it isn't a trivial problem. > Let's say there's 3 regions: this means t

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-08 Thread Chiradeep Vittal
I'd also like to highlight that it isn't a trivial problem. Let's say there's 3 regions: this means there are 3 copies of the user database that are geographically separated by network links that fail quite often (orders of magnitude more than intra-DC networks). Here we run into the consequences

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Chip Childers
On Thu, Nov 7, 2013 at 2:37 PM, Chiradeep Vittal wrote: > It may be an admin burden, but it has to be optional. There are other ways > to achieve global sync (e.g., LDAP/AD/Oauth). > A lot of service providers who run cloudstack have their own user database > / portal. In their implementations the

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Chiradeep Vittal
It may be an admin burden, but it has to be optional. There are other ways to achieve global sync (e.g., LDAP/AD/Oauth). A lot of service providers who run cloudstack have their own user database / portal. In their implementations the CloudStack database is not the master source of user records, bu

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Alex Ough
I don't mind implementing it in the core server unless there is anyone who thinks differently. Anyone with another thought? Thank Daan for your suggestion. Alex Ough On Thu, Nov 7, 2013 at 11:23 AM, Daan Hoogland wrote: > Alex, > > Why would you want to make this a plugin? It sounds like a func

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Daan Hoogland
Alex, Why would you want to make this a plugin? It sounds like a function of the core server. Don't you agree? regards, Daan On Wed, Nov 6, 2013 at 10:59 PM, Alex Ough wrote: > I'm having a difficulty finding documents about how to develop a plug-in. > Anyone to help me find one? > > Thanks in

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-06 Thread Alex Ough
I'm having a difficulty finding documents about how to develop a plug-in. Anyone to help me find one? Thanks in advance. Alex Ough On Tue, Nov 5, 2013 at 2:18 PM, Alex Ough wrote: > OK. > > 1) Do you mean the plug-in? If so, let me find out how to develop a > plug-in and work on this. > 2) Sur

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-05 Thread Alex Ough
OK. 1) Do you mean the plug-in? If so, let me find out how to develop a plug-in and work on this. 2) Sure, let me add more information in the document. Thanks for your suggestions. Alex Ough On Tue, Nov 5, 2013 at 11:41 AM, Chip Childers wrote: > Alex, > > I've moved your page to the "Designs

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-05 Thread Chip Childers
Alex, I've moved your page to the "Designs not committed to a release" parent (instead of the 4.3 designs page), to align with both the Jira record *and* the fact that feature freeze is about to happen for 4.3. As for the proposal itself, I have a couple of suggestions: 1) I'd like to see the im

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-04 Thread Alex Ough
All, Among the 2 approaches, I uploaded the implemented codes of the first approach, master-slave architecture, here. https://github.com/alexoughsg/albatross And here is the design doc in the wiki. https://cwiki.apache.org/confluence/display/CLOUDSTACK/Domain-Account-User+Sync+Up+Among+Multiple+R

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
Great! Thanks a lot, Daan. On Thu, Oct 31, 2013 at 4:58 PM, Daan Hoogland wrote: > you are added to jira, Alex > > On Thu, Oct 31, 2013 at 8:31 PM, Alex Ough wrote: > > Thanks Chip, and can you also give a permission in Jira so that I can > > assign myself in its jira? > > > > Alex Ough > > > >

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Daan Hoogland
you are added to jira, Alex On Thu, Oct 31, 2013 at 8:31 PM, Alex Ough wrote: > Thanks Chip, and can you also give a permission in Jira so that I can > assign myself in its jira? > > Alex Ough > > > On Thu, Oct 31, 2013 at 2:00 PM, Chip Childers wrote: > >> Permission added. >> >> On Wed, Oct 30,

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
Thanks Chip, and can you also give a permission in Jira so that I can assign myself in its jira? Alex Ough On Thu, Oct 31, 2013 at 2:00 PM, Chip Childers wrote: > Permission added. > > On Wed, Oct 30, 2013 at 12:19:23PM -0500, Alex Ough wrote: > > And I'd like to write the design document in th

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Chip Childers
(dropping users@ - try not to cross post please) On Thu, Oct 31, 2013 at 12:13:18PM -0500, Alex Ough wrote: > All, > > While I'm waiting for the permissions, I'd like to bring up a discussion on > the overall architecture to support this feature. > > There can be 2 different approaches as below.

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Chip Childers
Permission added. On Wed, Oct 30, 2013 at 12:19:23PM -0500, Alex Ough wrote: > And I'd like to write the design document in the wiki page, but I don't > seem to have a permission to create pages. > So can anyone give me the permission? > > My account in the wiki is alex.o...@sungard.com > > Than

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
All, While I'm waiting for the permissions, I'd like to bring up a discussion on the overall architecture to support this feature. There can be 2 different approaches as below. 1. master - slave architecture : the manual changes are allowed only in one master management server, and those in other

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-30 Thread Alex Ough
And I'd like to write the design document in the wiki page, but I don't seem to have a permission to create pages. So can anyone give me the permission? My account in the wiki is alex.o...@sungard.com Thanks in advance. Alex Ough On Tue, Oct 29, 2013 at 3:38 PM, Alex Ough wrote: > I created a

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-29 Thread Alex Ough
I created a jira for this feature. https://issues.apache.org/jira/browse/CLOUDSTACK-4992 But it doesn't allow for me to assign it to myself, so any permission do I need for this? If so, can anyone give me this permission? If there is anything missing, let me know. Thanks Alex Ough On Fri, Oct

RE: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-18 Thread Kishan Kavala
> -Original Message- > From: Alex Ough [mailto:alex.o...@sungard.com] > Sent: Thursday, 17 October 2013 11:25 PM > To: dev@cloudstack.apache.org; u...@cloudstack.apache.org > Subject: Fwd: [DISCUSS] Domain/Account/User Sync Up Among Multiple > Regions > > All, > > Currently, under the env