Data latency and the user community

The community using NASA Earth science observations in applications has grown significantly, with increasing sophistication to serve national interests. The National Research Council's Earth Science Decadal Survey report stated that the planning for applied and operational considerations in the missions should accompany the acquisition of new knowledge about Earth (NRC, 2007). This directive has made product applications at NASA an integral part of converting the data collected into actionable knowledge that can be used to inform policy. However, successfully bridging scientific research with operational decision making in different application areas requires looking into user data requirements and operational needs. This study was conducted to determine how users are incorporating NASA data into applications and operational processes. The approach included a review of published materials, direct interviews with mission representatives, and an online professional review, which was distributed to over 6000 individuals. We provide a complete description of the findings with definitions and explanations of what goes into measuring latency as well as how users and applications utilize NASA data products. We identified 3 classes of users: operational (need data in 3 hours or less), near real time (need data within a day of acquisition), and scientific users (need highest quality data, time independent). We also determined that most users with applications are interested in specific types of products that may come from multiple missions. These users will take the observations when they are available, however the observations may have additional applications value if they are available either by a certain time of day or within a period of time after acquisition. NASA has supported the need for access to low latency data on an ad-hoc basis and more substantively in stand-alone systems such as the MODIS Rapid Response system and more recently with LANCE. The increased level of support and advertising of that support has grown the community of individuals and organizations that use low-latency science data to supply decision making processes with updated information. These applications are increasingly high profile and have high societal value, which is of importance to NASA, the US Government and the broader society. The primary conclusions of this report revolve around clarifying NASA's intentions to support operations and near real time needs for quick access to data after acquisition. Specifically, clear statements from NASA Headquarters are needed to indicate the level of support that will be provided for low latency data products and whether that support should come directly from the missions or whether this support will come from separate stand-alone systems or direct broadcast. The results of the analysis clearly show the significant benefit to society for serving the needs of the agricultural, emergency response, environmental monitoring and weather communities who use low latency data today, and to grow the use of low latency NASA science data products into new communities in the future. These benefits can be achieved with a clear and consistent NASA policy on product latency.