The data deluge refers to the situation where the sheer volume of new data being generated is overwhelming the capacity of institutions to manage it and researchers to make use of it.
|“||The ability to generate vast quantities of data is outpacing the development of infrastructures and tools adequate to support data-driven 21st century science and technology. The lag is understandable, given how rapidly the scale of digital data is growing. However, the work of rationalizing, organizing, and sustaining appropriate long-term infrastructures for significant data needs to be undertaken now. In the century ahead, print libraries for research and education must be matched by similar institutionalized infrastructures for scientific and other valuable digital data. Issues that need to be addressed include assignment of responsibility; costing and accountability for long-term management, maintenance, and preservation of data archives of national interest; challenges in federating archives; and policies for access to and use of data.||”|
- President’s Council of Advisors on Science and Technology, Leadership Under Challenge: Information Technology R&D in a Competitive World An Assessment of the Federal Networking and Information Technology R&D Program 35 (Aug. 2007) (full-text).