Tuesday, March 6, 2012

1203.0591 (David Schlegel)

LSST is Not "Big Data"    [PDF]

David Schlegel
LSST promises to be the largest optical imaging survey of the sky. If we were fortunate enough to have the equivalent of LSST today, it would represent a "fire hose" of data that would be difficult to store, transfer, and analyze with available compute resources. LSST parallels the SDSS compute task which was ambitious yet tractable. By almost any measure relative to computers that will be available (thanks to the steady progression of Moore's Law), LSST will be a small data set. LSST will never fill more than 22 hard drives. Individual investigators will be able to maintain their own data copies to analyze as they choose.
View original: http://arxiv.org/abs/1203.0591

No comments:

Post a Comment