A new study offers a comprehensive multi-model, large-scale accuracy assessment of an operational satellite-based data system to compute evapotranspiration.
Reno, Nev. (January 16, 2024) – Sustainable water management is an increasing concern in arid regions around the world, and scientists and regulators are turning to remote sensing tools like OpenET to help track and manage water resources. OpenET uses publicly available data produced by NASA and USGS Landsat and other satellite systems to calculate evapotranspiration (ET), or the amount of water lost to the atmosphere through soil evaporation and plant transpiration, at the level of individual fields. This tool has the potential to revolutionize water management, allowing for field-scale operational monitoring of water use, and a new study provides a thorough analysis of the accuracy of OpenET data for various crops and natural land cover types.
In the study, published Jan. 15 in Nature Water, DRI scientists led a large team of researchers in a comparison of OpenET data to evapotranspiration data produced by 152 ground-based micrometeorological stations known as eddy covariance flux towers. The researchers found that OpenET data has high accuracy for assessing evapotranspiration in agricultural settings, particularly for annual crops like wheat, corn, soy, and rice. OpenET results for these crops were particularly reliable in arid regions like California and the Southwest, supporting the use of this tool to address an ongoing regional water sustainability crisis.
“One of the biggest questions for users of OpenET data is how accurate it is, given the magnitude and implications of the use of the data for water resource management,” said John Volk, Ph.D., lead author of the study and assistant research scientist and software engineer at DRI. “A lot of groups want to know what the expected rates of error are in agricultural lands, so that’s the major question that we wanted to address for this paper.”
The eddy covariance stations consist of instruments and techniques for calculating the flux of trace gases, like water vapor, coming off the land surface. They offer one of the best methods for quantifying evapotranspiration on the ground, Volk says, which provided the researchers the opportunity to compare the ground-based observations with those provided by satellites. Each station’s data was compared to the OpenET model ensemble, which combines six different Landsat-based models to produce an average, as well as data from each individual model. Then, the stations were grouped by land cover type and climate zone to assess how the accuracy of OpenET data changes across these variables.
“I was impressed by the level of performance of the OpenET system,” Volk said. “It’s kind of surprising how well the models did, and how well they agreed with one another in agricultural sites—particularly in the peak growing season when water demands are the highest.”
For annual crops, OpenET data for monthly, growing season, and annual evapotranspiration had an average error rate of approximately 10-20%, which is within the targeted range set by OpenET partners such as farmers and water management agencies. For annual crops growing in Mediterranean climates, monthly error rates were consistently below 10% during peak growing season, emphasizing the usefulness of this data. Accuracy for orchards was more variable (17%), which could be related to the way that shadows impact satellite data for taller vegetation, the authors say.
OpenET data can also be used for monitoring evapotranspiration in natural ecosystems and error rates for most natural land cover types was less than 1 mm per day at monthly to annual timesteps. However, ET rates are generally lower for these ecosystems, resulting in relative error rates that are higher in these environments than in croplands, and range from 35% for forests to 50% for shrublands. While the relative errors are higher for natural ecosystems, the ET data are still useful as indicators of drought impacts, vegetation water stress and water availability.
“Evapotranspiration is one of the hardest hydrologic fluxes to measure, and to think we are quantifying this flux from space with comparable or better accuracy to ground-based weather stations and meter data for agricultural lands is really remarkable,” said study co-author Justin Huntington, Ph.D., research professor at DRI. “The combined use of the Landsat-satellite archive with new Google Earth Engine cloud computing resources has been key, as has our collaboration across different research groups and use of multiple models to better understand model strengths and weaknesses and identify areas for improvement.”
Future research will focus on natural ecosystems and how OpenET models compare under different agricultural demand management and conservation actions such as those being explored in the Colorado River Basin.
The study notes that although all OpenET models have room for improvement, the results show the remarkable progress achieved in developing fully automated remote sensing techniques for mapping evapotranspiration at large spatial scales and at the resolution of individual fields based on petabytes of Landsat satellite data and new cloud computing resources.
“Farmers and water managers increasingly need accurate, field-level data on water use,” said Maurice Hall, OpenET director and senior advisor, Climate Resilient Water Systems, Environmental Defense Fund. “This study helps confirm the vital role OpenET plays in providing a more granular, dynamic picture of water use that can meaningfully inform real-time water decision-making. We look forward to continuing to refine and expand the implementation of OpenET to ensure farmers, ranchers, and communities can thrive in a world of highly stressed and variable water supplies.”
More information: The full study, Assessing the accuracy of OpenET satellite-based evapotranspiration data to support water resource and land management applications, is available from Nature Water: 10.1038/s44221-023-00181-7. For more information on OpenET visit https://openetdata.org/. OpenET users and scientists can find the most updated accuracy information at https://openetdata.org/accuracy/.
Additional Quotes: “It’s truly rewarding to see decades of careful research and hard work by this science community come together, and this study sets a new benchmark for satellite mapping of field-scale evapotranspiration with Landsat,” says Forrest Melton, senior research scientist with NASA Ames Research Center. “By documenting the accuracy of the OpenET data, I anticipate that this study will further accelerate the already rapid uptake and use of these data to help solve pressing water management challenges and open up new applications and areas of future study.”
Study authors include: John M. Volk and Justin L. Huntington (DRI), Forrest S. Melton (NASA Ames, CSU Monterey Bay), Richard Allen, (U. of Idaho), Martha Anderson (USDA Agricultural Research Service), Joshua B. Fisher (UCLA), Ayse Kilic (University of Nebraska-Lincoln), Anderson Ruhoff (Universidade Federal do Rio Grande do Sul), Gabriel B. Senay (U.S. Geological Survey Earth Resources Observation and Science Center), Blake Minor (DRI), Charles Morton (DRI), Thomas Ott (DRI), Lee Johnson (NASA Ames, CSU Monterey Bay), Bruno Comini de Andrade (Universidade Federal do Rio Grande do Sul), Will Carrara (NASA Ames, CSU Monterey Bay), Conor Doherty (NASA Ames), Christian Dunkerly (DRI), MacKenzie Friedrichs (KBR, Inc), Alberto Guzman (NASA Ames, CSU Monterey Bay), Christopher Hain (NASA Marshall Space Flight Center), Gregory Halverson (NASA Jet Propulsion Lab), Yanghui Kang (UC Berkeley) , Kyle Knipper (USDA Agricultural Research Service), Leonardo Laipelt (Universidade Federal do Rio Grande do Sul), Samuel Ortega-Salazar (University of Nebraska-Lincoln), Christopher Pearson (DRI), Gabriel E.L. Parrish (Innovate!, Inc.), A.J. Purdy (NASA Ames, CSU Monterey Bay), Peter ReVelle (University of Nebraska-Lincoln), Tianxin Wang (UC Berkeley), Yun Yang (Mississippi State University)
OpenET is a public-private collaboration with input from more than 100 farmers, water managers, and other stakeholders, and led by OpenET, Inc., Desert Research Institute, NASA, Environmental Defense Fund, and the U.S. Geological Survey. Additional partners include Google, U.S. Department of Agriculture, California State University Monterey Bay, Mississippi State University, HabitatSeven, University of Idaho, University of Maryland, University of Nebraska-Lincoln, UCLA, and Universidade Federal do Rio Grande do Sul in Brazil.
The Desert Research Institute (DRI) is a recognized world leader in basic and applied environmental research. Committed to scientific excellence and integrity, DRI faculty, students who work alongside them, and staff have developed scientific knowledge and innovative technologies in research projects around the globe. Since 1959, DRI’s research has advanced scientific knowledge on topics ranging from humans’ impact on the environment to the environment’s impact on humans. DRI’s impactful science and inspiring solutions support Nevada’s diverse economy, provide science-based educational opportunities, and inform policymakers, business leaders, and community members. With campuses in Las Vegas and Reno, DRI serves as the non-profit research arm of the Nevada System of Higher Education. For more information, please visit www.dri.edu.
Science Writer, DRI