On Thu, 16 Aug 2007, Kay Diederichs wrote:
Date: Thu, 16 Aug 2007 17:16:54 +0200
From: Kay Diederichs <[EMAIL PROTECTED]>
To: CCP4BB@JISCMAIL.AC.UK
Subject: Re: [ccp4bb] The importance of USING our validation tools
I'm glad that the discussion has finally set in, and would only like to
comment on the practicability of storing images.
Disciplines such as astronomy have management and processing requirements for
image data that make our diffraction images look like pretty minor stuff. Data
rates of ~1Tb/day don't make these guys wonder whether it can be done or not.
Come 2013, the Large Synoptic Survey Telescope is expected to be producing
115Tb (yes: Tb) of data per day, and that is each and every day, not just now
and again.
I got these figures from:
http://www.ast.cam.ac.uk/~wfcam/docs/papers/JRL_ADASS_paper.pdf
http://www.aspbooks.org/a/volumes/article_details/?paper_id=771
http://www.gridtoday.com/grid/803617.html
http://www.lsst.org/Project/docs/lsst_data_man_prospects.pdf
A more general article on "The Data Deluge" covering a number of fields
including our own is at:
http://users.ecs.soton.ac.uk/ajgh/DataDeluge(final).pdf
If comprehensive archiving of diffraction seems daunting to some, it is only
in comparison with what we have been doing up to now in our own field of
macromolecular crystallography. In comparison to what other people are doing,
it doesn't seem that bad to me!
Regards,
Peter.
