RE: Storing sensitive data in the Config

2015-03-09 Thread Thomas Becker
: Monday, March 09, 2015 7:27 PM To: dev@samza.apache.org Subject: Re: Storing sensitive data in the Config Hey Tommy, Yea, this has come up a few times. We don't currently have an answer for it. The simplest thing to do would be to have a prefix. Any config with the prefix could be stripped fro

Re: Storing sensitive data in the Config

2015-03-09 Thread Chris Riccomini
Hey Tommy, Yea, this has come up a few times. We don't currently have an answer for it. The simplest thing to do would be to have a prefix. Any config with the prefix could be stripped from the AM and logs. Another possibility is to store the configs in an encrypted way, and have the code decrypt

Storing sensitive data in the Config

2015-03-09 Thread Tommy Becker
We have some sensitive information that we are currently storing in the Samza config. Our ops guys have some concern regarding where the config is displayed (e.g. in logs, app master UI, etc). I'm curious if others have had similar concerns and if so what you did about it. Seems like we migh