IST Lunch Bunch

Emerging challenges in Volume, Velocity, and Complexity across a number of scientific domains in Radio Astronomy, Climate and Atmospheric science, Earth science, and in defense are changing the way we build software, process and disseminate data, and ultimately do science. The Square Kilometre Array and its 700 TB data/sec. Comparing and contrasting decadal, century, and sub-daily from climate model output results made available by the Intergovernmental Panel on Climate Change (IPCC) with remote sensing data from 100s of TBs of data from NASA and other satellites. Reproducing and rapidly constructing a large archive and processing center to understand Snow covered area and melt in the Western US - these represent just some of the challenges! My team at NASA are engaging in a research vision for data science that prescribes improvements in (1) rapid and unobtrusive integration of scientific algorithms; (2) intelligent data movement; (3) automated extraction and analysis of text, metadata, language from 1200+ file formats; and (4) the participation in and use of the model and outputs from the open source software community to bring the people power necessary to get it done. In this talk I¹ll cover the vision; the projects, and the results, highlighting where we are; and where we¹re going in the area at NASA, touching on other projects from NSF, DARPA, NIH/NLM and a host of other government and industrial projects.