Allowing return email

[postfix . org]

Greetings:
I'm running several spam-filtering tools including Postgrey, 
SpamAssassin, etc.  I would like to make replying to mail I have sent 
easier. 

How can I automatically white-list addresses to whom I have sent email? 

Thanks,
Chris