Abstract
Ecological restoration programs increasingly aim to provide socio-economic and environmental benefits. However, monitoring of socio-economic outcomes of these programs lags behind monitoring of ecological outcomes. Socio-economic methods are less established, managers have less experience, and metrics used vary, stymieing evaluation and adaptive management. Here we demonstrate that logic models and stakeholder engagement can be used to identify core socio-economic metrics across various types of restoration, focusing on coastal restoration in the Gulf of Mexico. Across four major restoration types (oyster restoration, habitat restoration, recreation enhancement, and water quality improvement), core metrics were identified as changes in jobs, restoration expenditures, recreational activity, cognitive function, and subjective well-being. These metrics can provide a starting point for increased and more consistent monitoring of socio-economic outcomes. The collaborative, science-based, and replicable process we developed to identify core metrics can be applied to other ecosystems and management actions to expand monitoring and evaluation of socio-economic impacts.
Similar content being viewed by others
Introduction
From global to local scales, natural resource programs and policies increasingly support ecological restoration to achieve socio-economic and environmental goals. Common socio-economic goals include community resilience, economic prosperity, supporting social and community values, public health, risk reduction, hazard mitigation, and other aspects of human well-being1,2,3. The combination of environmental and social goals is reflected in the United Nations Sustainable Development Goals which integrate environmental and human development goals, recognizing their tight interdependence4,5. The public health community is also rapidly expanding its understanding of environmental determinants of health6,7 and is calling for more integrated approaches to pandemic and disease prevention that encompass environmental drivers8,9,10. Yet, this shift toward integrated goals, missions, and policies to achieve human well-being outcomes is not yet reflected in restoration program development, implementation, and monitoring3.
Here, we focus on monitoring as a best practice for determining whether restoration efforts are effective, enabling adaptive management, and informing other restoration efforts11. In decades past, restoration has been motivated by ecological goals, so restoration design and monitoring has primarily focused on environmental outcomes. More recently, some restoration programs are shifting to a broader socio-economic framing, For example, the Gold Standard and the Global Environment Facility Forest and Landscape Restoration program have developed targets and metrics that incorporate environmental and socio-economic outcomes12,13. International principles and standards for the practice of ecological restoration explicitly state that effective implementation “contributes to protecting biodiversity; improving human health and well-being; increasing food and water security; delivering goods, services, and economic prosperity; and supporting climate change mitigation, resilience, and adaptation”14. However, this inclusion of socio-economic goals has not been met by sufficient development of methods and metrics for designing and monitoring restoration programs or projects for socio-economic outcomes15,16,17.
One of the largest restoration programs in the United States is coordinated between the federal government and state programs in the Gulf of Mexico and aims to achieve both ecological and socio-economic goals. Gulf Coast habitats are diverse, and include beaches and dunes, coastal marshes, oyster reefs, and seagrass beds18. Natural resources underpin major sectors of the economy in the region, with millions of people participating in wildlife-based tourism that generates billions of dollars in annual spending and tax revenues19,20. However, the socio-economic context of the Gulf is defined by historical inequities, relatively high poverty rates, and low economic mobility. This leaves many communities especially vulnerable to disasters21. The Resources and Ecosystems Sustainability, Tourist Opportunities, and Revived Economies of the Gulf Coast States (RESTORE) Act of 2012 directed around USD 5 billion to restore coastal habitats, communities, and economies after the damage incurred by the Deepwater Horizon Oil Spill22. Five goals have been set to guide this funding: (1) Restore and Conserve Habitat; (2) Restore Water Quality and Quantity; (3) Replenish and Protect Living Coastal and Marine Resources; (4) Enhance Community Resilience; and (5) Restore and Revitalize the Gulf Economy23. While several of these goals focus on socio-economic outcomes, monitoring of outcomes from RESTORE-funded projects initially concentrated on their ecological effects. The RESTORE program has identified over 50 metrics for monitoring, the majority of which measure ecological outcomes; socio-economic metrics focus on the number of people engaged with the project (e.g., as volunteers, through training, or as visitors to a site), the number of jobs created, and number of facilities benefitting from a community resilience project24. The RESTORE program aims to use monitoring and evaluation results to inform decision-making for current and future projects25. When this project was initiated, the RESTORE program was interested in expanding monitoring to encompass a broader suite of socio-economic benefits26.
To help expand monitoring of socio-economic benefits, we conducted the Gulf of Mexico Ecosystem Service Logic Models & Socio-Economic Indicators Project (GEMS) in collaboration with relevant funders (e.g., RESTORE, National Fish and Wildlife Foundation, states), experts, and practitioners across the Gulf. Our primary objectives were to (1) identify the main socio-economic outcomes of common restoration practices used in the Gulf of Mexico and (2) to develop a set of feasible and useful metrics for monitoring these socio-economic outcomes. The metrics account for current constraints in data and methods and were developed with restoration practitioners and experts from diverse disciplinary perspectives. These core metrics reinforce some existing RESTORE program metrics, and go beyond them, identifying metrics that could be adopted to more fully characterize the stated socio-economic restoration goals of the RESTORE program.
Results
Ecosystem service logic models and socio-economic outcomes
A total of 23 ecosystem service logic models (ESLMs) were developed, one for each restoration project type (Table 1).
ESLMs show how each restoration action cascades through both natural and human systems to result in a set of directly linked socio-economic outcomes27,28,29,30,31,32,33,34 (Fig. 1). We define outcomes as types of impact that restoration projects can have (e.g., economic impact, provision of cultural value, property protection), while metrics are specific measures that could be used to monitor particular aspects of each outcome (e.g., number of jobs provided, changes in cognitive function resulting from time spent at the project site, number of homes with reduced coastal erosion) to determine if the restoration project yielded a change in the outcome. The full set of ESLMs is available online35.
This example pathway from an ecosystem service logic model shows how a restoration action leads to a socio-economic outcome, and what metric could be used to measure that outcome. Ecosystem service logic models are made up of multiple pathways to show the variety of outcomes created by a restoration action.
The ESLMs indicate that two outcomes are likely to be affected by all types of coastal restoration assessed: economic activity associated with implementation of the project, and knowledge outcomes (when education programming is included). Other outcomes are expected from the majority of restoration types assessed, including recreational fishing opportunities, recreation-associated economic activity, subsistence harvest, climate stabilization (carbon sequestration), and property protection (via reduction of erosion). Recreational enhancement projects and water quality improvement projects are expected to affect fewer and different outcomes than other restoration types. For example, recreational enhancement projects are not expected to affect climate stabilization and are likely to influence property value (through real estate value) rather than property protection (through erosion reduction). Water quality improvement approaches are likely to affect socio-economic outcomes related to the targeted water body rather than the project site, leading to more regional effects including changes in water-associated health impacts and costs associated with drinking water and wastewater treatment.
The development of the ESLMs clarified a number of distinguishing features of specific project types that influence the socio-economic outcomes they create, and therefore which metrics are relevant to monitor. For example, Fig. 2 shows ESLMs for two different types of oyster reef restoration: a cultch plant intended to generate oysters for harvest and a living shoreline that uses oysters to build intertidal habitat. The differences in the structural complexity of these two types of oyster reef restoration and whether the reef is periodically set back by intensive harvest influence the outcomes created by these types of projects. As the ESLMs show, the cultch plant supports commercial oyster harvest, creating jobs and revenue36, and is likely to support local food security and cultural values including sense of place by preserving traditional livelihoods. In contrast, living shoreline type oyster reefs in intertidal settings are not intensively harvested due to the smaller size of oysters on those reefs37, so do not create outcomes related to commercial oyster harvest. However, the living shoreline reefs develop structural complexity that improves fish habitat38 and contributes to wave attenuation and shoreline protection39
a a cultch plant, where oyster shells are placed subtidally to create a two-dimensional structure on which oysters grow until they are harvested using intensive methods such as dredging, and (b) a living shoreline, where three-dimensional structures are placed in the intertidal zone to allow oyster colonization and long-term growth without harvest.
While we compare and elaborate on outcomes of two example restoration strategies in this section, the ESLMs, associated context documents, and project reports35,40,41 provide additional detail about how each of the 23 restoration project types is expected to affect the associated outcomes and indicate what design decisions and external factors influence those outcomes.
Metrics
For the 23 restoration approaches assessed, we identified 44 metrics that could show changes in outcomes resulting from restoration investments (see Supplementary Table 3 for full metrics list)35. Eight of these were classified as Tier 1 metrics, meaning that they are considered feasible for measurement by non-expert teams. Twenty-four metrics were classified as Tier 2, which would require additional expertise and resources to monitor, and the remaining 12 are research & development (R&D) metrics, with additional research and methods development required to enable their measurement. Across all metrics, the majority (35 metrics) quantify project-scale processes that could be observed or monitored at project sites. These will be the easiest to integrate into restoration project implementation because they do not require coordination across multiple projects and in many cases can be incorporated into routine project monitoring. Some outcomes, like economic activity, can be measured at both project and regional scales due to the availability of both local- and regional-scale datasets or methods. Quantifying regional-scale metrics would require investments beyond project-scale monitoring, either to aggregate data from multiple projects or to conduct larger-scale modeling and/or extrapolation. Thirty-eight of the 44 metrics identified are not currently required in the Gulf of Mexico restoration programs such as RESTORE Observational Data Plan guidelines24 or the National Resource Damage Assessment Monitoring and Adaptive Management Manual25, and thus could complement existing reporting to more fully represent socio-economic outcomes of restoration (see Supplementary Table 3 for overlap with RESTORE and National Resource Damage Assessment metrics).
We termed metrics relevant to at least half of the restoration approaches assessed in a given restoration category “core metrics.” We identified a set of 18 core metrics (13 at the project scale, five at the regional scale) that measure outcomes that are strongly linked to multiple project types (Tables 2 and 3) and that can be measured with current data and methods (i.e., are not R&D metrics). We consider project types and metrics strongly linked when a specific project type is highly likely to influence the metric, as determined by our literature review and expert consultations.
Given the state of data and methods in the region, two of the project scale core metrics (number of restoration jobs supported by the project and restoration expenditures by the project) were considered feasible for measurement by non-expert teams (i.e., Tier 1). These metrics provide a practical starting point for immediate wider adoption, as they relate to socio-economic outcomes expected for multiple restoration approaches and can be collected with relatively little expertise and resources. An additional 16 core metrics are relevant to common coastal restoration approaches and could be monitored with relevant expertise and sufficient resources (i.e., Tier 2).
A number of metrics are strongly linked to multiple different restoration approaches, presenting opportunities for comparison across restoration categories and aggregation of effects across multiple projects. At the project scale, five core metrics were identified as relevant to all restoration categories assessed: number of restoration jobs supported by project, restoration expenditures by the project, change in recreational activity expenditures associated with project site visitation, change in cognitive function, and change in subjective well-being (Table 2). Monitoring of these metrics would likely be relevant for any restoration approach assessed.
Six additional project scale core metrics were relevant to the majority of oyster restoration, habitat restoration and recreation investments, but not to water quality improvement projects. These metrics tend to be linked to habitat enhancement and people’s ability to visit project sites, which the water quality improvement projects do not usually provide as they focus on gray infrastructure improvements (e.g., to wastewater treatment plants or septic systems). The core metrics for habitat related projects quantify changes in the number of people with knowledge of the habitat or project outcomes, recreational fishing jobs and expenditures, food security, and property protection. Four of the core project scale metrics had counterparts identified at the regional scale, suggesting that investments in evaluating these outcomes at both scales could be informative (Table 3). One core metric can only be assessed at the regional scale, given current data. That metric is focused on economic expenditures related to commercial fishing and is most relevant to habitat and oyster restoration investments.
Discussion
We identified a set of core socio-economic metrics that are likely to be relevant to a wide range of coastal restoration approaches in the Gulf of Mexico. The stakeholder engagement and ESLM development processes conducted by this project reinforce that restoration investments in this region are likely to have socio-economic effects, and that a consistent set of metrics can be used for monitoring those effects. The metrics and ESLMs developed through this process can provide a starting point for research and management teams designing socio-economic monitoring. Not all metrics may be relevant in each specific context, but when consistent metrics can be adopted, they are likely to improve uniformity and efficiency in monitoring and evaluation of the major types of coastal restoration receiving investments across the Gulf region. Using a common set of metrics on social and economic outcomes allows comparison of effectiveness across projects, as well as better evaluation of regional impact of restoration on social, economic, and community recovery in regions impacted by the Deepwater Horizon Oil Spill and other shocks like hurricanes.
The measurement protocols developed for each of the core metrics are designed to guide consistent and high-quality measurement of many of the socio-economic metrics identified through the GEMS process35,42. Many of the socio-economic metrics identified through this process can be measured using established methods (e.g., intercept surveys43, erosion monitoring44, property valuation45, mental health surveys46, social cost of carbon47) which are included in available measurement protocols and are ready for use42. There are, however, still a number of needs to be addressed for consistent and widespread measurement of socio-economic outcomes of restoration projects.
One need relates to attributing change in an outcome to a project or set of projects. Both the literature review and expert consultation confirmed that the change in an outcome created by a specific restoration project, or even a set of projects, can be too small to detect relative to all of the other factors that influence that outcome. Causal methods such as use of a control site44 or hedonic regression45 can be used to better attribute a change in certain outcomes to a restoration activity, but they require additional expertise and resources. Measurement of restoration impacts could also be improved by making more relevant data publicly accessible in a useful format. Some datasets are aggregated to large geographic areas that obscure project impacts, while others are not publicly accessible and may be difficult or impossible to obtain or do not capture the entire relevant outcome. As the set of R&D metrics indicates, there remains a need to further develop some methodologies for measuring outcomes (see Supplementary Table 3). For example, in the case of water system cost outcomes, experts in our workshops suggested that relevant data are being collected by individual water utilities, but these data have not been evaluated for the effect of restoration projects on water system costs. For other outcomes, such as food security from subsistence harvest, there are examples of measurement at small scales through surveys48, but not for measuring impacts on a larger scale that can be attributed to a restoration project. As restoration monitoring and evaluation has historically focused on ecological outcomes, there is a need to enhance social science skills or better connect social scientists to restoration monitoring. Many of the core metrics identified are commonly monitored through methods that require engagement with communities and often depend on trusted relationships (e.g., for administering surveys, focus groups or interviews). Enhanced efforts to develop these relationships or connect people with these relationships to restoration monitoring efforts will be needed. See Supplementary Discussion for more details on these challenges.
All of the Tier 1 (easy-to-measure) metrics are project scale, which suggests that understanding regional effects of restoration actions is likely to require investments beyond commonly implemented monitoring. For example, additional primary data collection across multiple projects or modeling efforts to extract attributable effects from regularly reported regional statistics (e.g., for commercial fishery revenues) would help to fill gaps in regional understanding. Many of these analyses have been done in different regions across the Gulf (e.g., refs. 49,50,51,52,), but not at a scale or frequency for evaluating many of the restoration investments being made in the region. Support from and partnership with federal agencies, universities, or other parties are likely needed to enable regional or program-scale impact evaluation of restoration efforts.
Without additional investment in measuring socio-economic outcomes of restoration projects, both by individual projects and at larger scales, the effects of these projects on many outcomes, such as physical health, mental well-being, and food security, cannot be fully understood and incorporated into project planning and design. If these outcomes are more consistently measured, we will gain a broader understanding of the effects of restoration, and project planners can more easily consider these potential outcomes from the outset, resulting in projects that create a broader suite of benefits for people and ecosystems. Documenting these socio-economic outcomes could also build the evidence base for a diverse set of outcomes, giving a wider range of funders confidence that investments in restoration may contribute to the health, social, and economic well-being of communities.
Conclusions
Funders, policymakers, and affected communities are increasingly interested in the socio-economic outcomes of environmental interventions. We provide a consistent and community-vetted starting point for monitoring restoration effects on socio-economic outcomes in the Gulf of Mexico. To our knowledge, this is the first large-scale, evidence-based, and consensus-driven effort to identify socio-economic metrics for monitoring of coastal restoration in the Gulf of Mexico. The method used to identify these metrics is replicable, provides a means to draw on diverse disciplines and expertise to identify common, stakeholder-relevant socio-economic metrics, and has resulted in clear opportunities to advance monitoring of socio-economic outcomes, such as:
-
1.
Expanding project monitoring of socio-economic outcomes by broadening each project’s current set of metrics. While the Tier 1 metrics (Table 2) require few additional resources to measure and provide an accessible starting point, Tier 2 metrics are also within the reach of many projects and can be considered for measurement. The GEMS metrics protocols provide guidance on measurement methods, including methods for assessing equity effects through analysis of the distribution of the measured outcome among different groups of people. Uptake of these metrics could be accelerated if funders or regulators required or recommended their use.
-
2.
Testing measurement protocols to further advance methods. Testing measurement and distribution protocols will help to refine the measurement methodologies, clarify the costs and time required for measurement, and illustrate the utility of the data collected for tracking the impact of restoration projects on social outcomes, economic well-being, and equity.
-
3.
Developing data and methods for R&D metrics. More comprehensive monitoring of socio-economic outcomes will require expansion of data collection, creative use of existing data, and new analytical applications. These will need to be supported at both the project and the regional scales.
-
4.
Investing in measurement of regional scale metrics. Most restoration teams will not have the capacity or resources to conduct monitoring needed to assess regional-scale outcomes. Funding programs, universities, and non-profits could invest in and conduct studies to evaluate regional scale economic, water quality and health impacts of restoration investments, building on those already underway in a few regions.
The growth in restoration investments and the expansion of restoration goals to include socio-economic outcomes has created a need for efficient and effective monitoring of these outcomes. The development and use of the core metrics like those identified through the GEMS process can provide much needed consistency and efficiency across multiple types of restoration investments. Broad replication of the methods developed here and adoption of core metrics is highly relevant to existing large-scale restoration programs (e.g., RESTORE) and new efforts being developed through investments in ecosystem restoration53,54, nature-based solutions55,56, and systems of national natural capital accounting57,58.
Methods
General approach for developing generalized logic models and common metrics
We identified socio-economic outcomes and metrics for coastal restoration in the Gulf of Mexico through a collaborative process with an advisory council, which provided high-level guidance throughout the project, and a group of restoration practitioners, researchers, and community members who participated in workshops, calls, or focus groups (see Supplementary Notes 1 and Supplementary Tables 1–2 for details). This involved seven in-person workshops (at least one in each Gulf Coast state), four virtual workshops, and one-on-one calls and focus groups with over 80 scientists and practitioners. In total, 62 distinct organizations were engaged (Supplementary Note 1 and Supplementary Table 1). As described below, this was an iterative process in which the project team repeatedly sought input and feedback from experts and stakeholders on draft versions of the socio-economic outcomes and metrics lists.
The restoration approaches included in this project were chosen based on input from the advisory council and published strategy and planning documents for the RESTORE program59,60,61 (M. Love, pers. comm.). The logic model development and metric selection methods described below were piloted and fine-tuned on six types of oyster reef restoration (simple subtidal harvested, complex subtidal harvested, complex subtidal, complex intertidal, protection or enhancement of existing reef, and aquaculture). Oyster reef restoration was selected as the focus for the pilot with input from the GEMS advisory council due to its widespread use throughout the region, economic importance, and the large body of scientific research available to support development of ecosystem service logic models and socio-economic metrics. The method was then applied to the remaining restoration approaches which were grouped into three categories: habitat restoration and conservation (salt marsh, seagrass, mangrove, living shorelines, beaches and dunes, and hydrologic connectivity), recreational enhancement (boat ramps, fishing piers, and trails and boardwalks), and water quality improvement (sewage system improvements, wastewater treatment plant upgrades, treatment wetlands, and stormwater management improvements using gray or green infrastructure). More detailed descriptions of each of these project types can be found on our project website62. Through April 2023, 67% of environmental restoration projects funded by RESTORE included one of the GEMS project types63.
Working with participants, we first identified common socio-economic outcomes expected from the most common types of restoration using collaboratively developed ecosystem service logic models (ESLMs). The participants then identified possible metrics for the socio-economic outcomes and screened them for practicality based on data and measurement constraints.
Ecosystem service logic model development & metric identification
Draft ESLMs connecting restoration activities to socio-economic outcomes were created for six different types of oyster reef restoration, using a combination of literature (e.g., refs. 38,64,65) and expert input. We held a series of workshops with restoration practitioners, researchers, and stakeholders to refine the ESLMs in five focal estuaries (one in each Gulf Coast state to reflect various socio-ecological conditions found across the Gulf – Galveston Bay, TX; Chandeleur-Breton Sound, LA; Back Bay of Biloxi, MS; Mobile Bay, AL; and Charlotte Harbor, FL; see Supplementary Table 1 for participant details). Draft logic models were iterated with participants to ensure they reflected the full range of oyster reef restoration approaches and outcomes in each focal estuary. Participants also created an initial list of socio-economic metrics that could be used to measure outcomes that were specified through the logic models (workshop details available40). Not all relevant areas of expertise were represented by workshop participants, so additional, targeted outreach was conducted with individuals to fill gaps (see Supplementary Notes 2 for interview protocol).
Refinements to the oyster restoration ecosystem service logic models and metrics were verified through a review of both peer-reviewed literature and white papers. Some metrics suggested at the workshops were refined based on information from the literature66. To finalize the metrics list, we held a regional workshop including representatives from each local workshop, additional experts on oyster reef restoration and socio-economic indicators, and members of Gulf Coast restoration funding organizations (see Supplementary Table 1 for participant details)40. Regional workshop participants screened the metrics using the SMART criteria67 (specific, measurable, achievable, realistic, and time-bound), with a focus on the feasibility and relevance of each proposed metric, availability of existing data, and scale of application (whether metrics could be measured by individual projects or at a larger program scale).
Following the oyster reef restoration pilot, the GEMS advisory council requested that this project be expanded to include all ecosystem restoration approaches commonly used in the Gulf of Mexico. This was a broader scope than had been originally planned, which required us to streamline the process used for identification of metrics for oyster reef restoration to allow us to develop metrics for the other major restoration approaches within the time and resources allocated for this project. We did so using learnings from the pilot phase. Additionally, adjustments were made to move engagements online during the height of the COVID pandemic. One key insight from the oyster reef restoration pilot was that many ecosystem restoration approaches have similar effects on the biophysical and ecological systems, which translate into similar changes to human activity and socio-economic outcomes. For example, some of the key ecological outcomes of oyster reef restoration are improved water quality, reduced shoreline erosion, and enhanced populations of estuarine and marine wildlife. These changes support socio-economic outcomes such as recreational and commercial seafood harvest, other recreational activities, and protection of property and infrastructure. Many of the additional restoration approaches to be included in the GEMS project were other habitat types that have overlapping ecological and socio-economic outcomes with the oyster reef restoration approaches, enabling us to build on the ESLMs and metric results from the pilot phase.
Therefore, we used a condensed collaboration process to develop ESLMs and metrics lists for ecological restoration approaches that have similar ecological effects as oyster reef restoration (salt marsh restoration, seagrass restoration, mangrove restoration, living shorelines, beach and dune restoration, and hydrologic connectivity restoration) and for recreational enhancement projects with more similar effects on human activity (boat ramps, fishing piers, and trails and boardwalks). We drafted ESLMs and metrics lists for each of these restoration approaches, using the resources developed for the oyster reef restoration pilot as a starting point. Then, we used an iterative series of individual and small-group virtual meetings to gather input from experts on the ESLMs and metrics, consulting at least two experts for each ESLM created in this phase of work (e.g., salt marsh restoration) and at least two additional experts for each new metric (e.g., change in property value).
For water quality improvement projects, which cause substantially different environmental and socio-economic changes than the other restoration approaches included, we used a literature review to draft ESLMs and an initial list of potentially relevant metrics. Then, we held a regional workshop in which experts from across the Gulf region were invited to (1) share feedback on the restoration techniques included for water quality improvement projects, (2) give input on ESLMs, (3) clarify social and economic outcomes, and (4) brainstorm lists of possible metrics. Participants’ expertise included public health, water quality, restoration, environmental justice, social science, economics, and natural resource management (see Supplementary Table 1 for participant details).
The updated ESLMs and metrics from the regional workshop were used as the basis for two virtual workshops (one on health outcomes; the other on economic and cost outcomes) engaging experts at local, state, and Gulf wide levels to gather additional input, testing metrics against the SMART criteria with a particular focus on feasibility. Through the expert consultations we also identified which outcomes were most likely to be measurably affected by the water quality improvement projects. Following the workshops, we conducted additional literature review and virtual expert calls to iteratively refine the ESLMs and metrics. Similar to phase 1, workshop participants represented practitioners, affected communities, and experts that work with these communities.
Metric synthesis
Funders and restoration practitioners often seek a common set of metrics that can be meaningfully observed across multiple restoration approaches to allow comparison across projects and aggregation of results for larger regions, and to make efficient use of monitoring funds. To address this need, those metrics that were considered relevant for at least half of the project types in at least one of the categories (habitat restoration, oyster reef restoration, recreational enhancement, and water quality improvement) were labeled as core metrics.
Identified metrics vary in terms of expertise and resources required to monitor them. To reflect this variation, metrics were grouped into three tiers. Tier 1 metrics were defined as requiring relatively low effort and expertise to monitor. Tier 2 metrics were defined as those requiring more specialized expertise and higher levels of resources to monitor. R&D metrics were defined as those that do not yet have well-established methods widely accepted by relevant disciplinary fields.
The collaborative process and literature reviews also revealed that some outcomes can be observed at a project scale as the result of localized changes, while others can only be observed or modeled at a regional scale (e.g., economic impact and water quality) due to their reliance on ecosystem-scale processes, or the scale of available data (e.g., aggregated at the county scale). To indicate this, metrics were specified as either project or regional scale.
Many funders and practitioners are interested in how their projects contribute to community resilience, or communities’ capacity to adapt to short- and long-term natural and man-made hazards, particularly increased flood risks associated with sea-level rise and environmental stressors26. There is not widespread agreement across disciplines as to what constitutes community resilience, but there is recognition that many different social and economic outcomes contribute to it. We worked with resilience experts to identify a subset of outcomes that likely contribute to community resilience and described our rationale for each (see Supplementary Table 4 for details).
Our Gulf partners were also interested in metrics that could ascertain how restoration projects affect equity, with a particular interest in whether underserved communities might be affected differently and whether the installation of a restoration project worsened or alleviated existing inequities. As any outcome can cause equity effects if distributed unequally among populations, any of the metrics identified could be assessed for distributional effects. For example, in addition to measuring how many restoration jobs were created, one could also assess who is getting those jobs. Similarly, in addition to measuring the number of days evacuation routes are closed, one could assess who is most affected by those closures.
Measurement protocols
To facilitate use of these metrics in project monitoring, we developed measurement protocols for each of the core metrics. Measurement protocols are based on established, previously published methods and aim to provide a sufficient level of detail to guide consistent and high-quality measurement35,42. This is especially important as restoration practitioners tasked with monitoring are more likely be trained in natural science methods and have less familiarity regarding the use of social science methods to measure core metrics. Each protocol includes a how much section that describes how to quantify the metric and track if it is changing due to project installation. To address the potential use of any metric for assessing equity effects, we included a who section in each measurement protocol that describes how to evaluate who has access to the outcome the metric is measuring and whether that access is representative of the community around the project. The who protocols are intended to give projects tools to consider the equitable or inequitable distribution of their projects’ effects.
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
The ecosystem service logic models, metrics database, and measurement protocols developed for this study are available in the Duke Research Data Repository35, https://doi.org/10.7924/r45b0962f. The Deepwater Horizon Project Tracker63 used to assess how the GEMS project types aligned with funded projects is publicly available at https://dwhprojecttracker.org/.
References
McKinnon, M. C. et al. What are the effects of nature conservation on human well-being? a systematic map of empirical evidence from developing countries. Environ. Evid. 5, 8 (2016).
Díaz, S. et al. Summary for policymakers of the global assessment report on biodiversity and ecosystem services of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services (IPBES). http://rid.unrn.edu.ar/handle/20.500.12049/4223 (2019).
Koroneos, C. J. & Rokos, D. Sustainable and integrated development—a critical analysis. Sustainability 4, 141–153 (2012).
United Nations General Assembly. Transforming our world: the 2030 Agenda for Sustainable Development. UN Doc A/RES/70/1. https://sdgs.un.org/2030agenda (2015).
United Nations Department of Economic and Social Affairs. The 17 Goals. https://sdgs.un.org/goals (2015).
Whitmee, S. et al. Safeguarding human health in the Anthropocene epoch: report of The Rockefeller Foundation–Lancet Commission on planetary health. Lancet 386, 1973–2028 (2015).
Prüss-Ustün, A. et al. Diseases due to unhealthy environments: an updated estimate of the global burden of disease attributable to environmental determinants of health. J. Public Health 39, 464–475 (2017).
Hayman, D. T. Conservation as vaccination. EMBO Rep. 17, 286–291 (2016).
Organisation for Economic Co-operation and Development. Biodiversity and the Economic Response to COVID-19: Ensuring a Green and Resilient Recovery. https://www.oecd.org/en/publications/biodiversity-and-the-economic-response-to-covid-19-ensuring-a-green-and-resilient-recovery_d98b5a09-en.html (2020).
Barouki, R. et al. The COVID-19 pandemic and global environmental change: Emerging research needs. Environ. Int. 146, 106272 (2021).
Waylen, K. A. & Blackstock, K. L. Monitoring for adaptive management or modernity: lessons from recent initiatives for holistic environmental management. Environ. Policy Gov. 27, 311–324 (2017).
Global Environment Facility. Tracking Tool for SFM/REDD-Plus Projects, Guidance Note v0.2. https://www.thegef.org/sites/default/files/documents/GEF_SMF_TT_Guidelines.pdf (n.d.).
The Gold Standard. Certified SDG Impacts for Results Based Finance. Gold Standard. https://www.goldstandard.org/impact-quantification/certified-sdg-impacts (n.d.).
Gann, G. D. et al. International principles and standards for the practice of ecological restoration. Second edition. Restor. Ecol. 27, S1–S46 (2019).
Waylen, K. A. et al. Policy-driven monitoring and evaluation: does it support adaptive management of socio-ecological systems? Sci. Total Environ. 662, 373–384 (2019).
West, S., Beilin, R. & Wagenaar, H. Introducing a practice perspective on monitoring for adaptive management. People Nat. 1, 387–405 (2019).
Martin, D. M. & Lyons, J. E. Monitoring the social benefits of ecological restoration. Restor. Ecol. 26, 1045–1050 (2018).
U.S. National Park Service. Gulf Coast Network Ecosystems. https://www.nps.gov/im/guln/ecosystems.htm (2023).
Environmental Defense Fund. Gulf Tourism Depends on a Healthy Gulf. https://www.edf.org/media/gulf-tourism-depends-healthy-gulf (2013).
Stokes, S. & Lowe, M. Wildlife Tourism and the Gulf Coast Economy. Environmental Defense Fund. http://hdl.handle.net/1969.3/28557 (2013).
The Nature Conservancy. Building the Gulf: Recommendations for Ensuring Restoration Benefits for Communities and the Environment. https://s3.amazonaws.com/oxfam-us/www/static/media/files/building_the_gulf_oxfam.pdf (n.d.).
Restore The Gulf. About the RESTORE Act. https://www.restorethegulf.gov/history/about-restore-act (n.d.).
Gulf Coast Ecosystem Restoration Council. Comprehensive Plan Update 2016: Restoring the Gulf Coast’s Ecosystem and Economy. https://www.restorethegulf.gov/sites/default/files/CO-PL_20161208_CompPlanUpdate_English.pdf (2016).
RESTORE Council. Gulf Coast Ecosystem Restoration Council Observational Data Plan (ODP) Guidelines Version 2.0. https://restorethegulf.gov/sites/default/files/20210520_Council_Observational_Data_Plan_Guidelines_Version%202.0_508.pdf (2021).
Deepwater Horizon Natural Resource Damage Assessment Trustees. Monitoring and Adaptive Management Procedures and Guidelines Manual, Version 2.0. https://www.gulfspillrestoration.noaa.gov/media/document/2021-12-tc-monitoring-and-adaptive-management-procedures-and-guidelines-manual (2021).
Gulf Coast Ecosystem Restoration Council. 2022 Comprehensive Plan Update: Restoring the Gulf Coast’s Ecosystem and Economy. https://www.restorethegulf.gov/sites/default/files/2022_Comp-Plan_Update_Final1.pdf (2022).
National Academies of Sciences, E. Chapter 3: Restoration Project Monitoring. in Effective Monitoring to Evaluate Ecological Restoration in the Gulf of Mexico 29–50. https://doi.org/10.17226/23476 (2016).
Tallis, H., Kreis, K., Olander, L. & Ringler, C. Bridge Collaborative Practitioner’s Guide: Principles and Guidance for Cross-Sector Action Planning and Evidence Evaluation. Nicholas Institute for Energy, Environment & Sustainability. http://bridgecollaborativeglobal.org/wp-content/uploads/2017/10/Bridge-Collaborative-Principles-and-Guidance-2017.pdf (2017).
Stem, C. & Flores, M. Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. U.S. Agency for International Development. http://www.ccnetglobal.com/wp-content/uploads/sites/3/2017/01/USAID_Biodiversity_HowToGuide2_2016_pa00m8mw-1.pdf (2016).
Potschin-Young, M. et al. Understanding the role of conceptual frameworks: Reading the ecosystem service cascade. Ecosyst. Serv. 29, 428–440 (2018).
Wainger, L. & Ervin, D. The Valuation of Ecosystem Services from Farms and Forests Informing a Systematic Approach to Quantifying Benefits of Conservation Programs (Synthesis Chapter). https://ageconsearch.umn.edu/record/260677/ (2017).
Salafsky, N. Integrating development with conservation: a means to a conservation end, or a mean end to conservation? Biol. Conserv. 144, 973–978 (2011).
Margoluis, R. et al. Results chains: a tool for conservation action design, management, and evaluation. Ecol. Soc. 18, 3 (2013).
Kelble, C. R. et al. The EBM-DPSER conceptual model: integrating ecosystem services into the DPSIR framework. PLoS ONE 8, e70766 (2013).
Olander, L., Shepard, C., Tallis, H., Yoskowitz, D. Data from: Gulf of Mexico Ecosystem Service Logic Models & Socio-Economic Indicators (GEMS). Duke Research Data Repository. V2. https://doi.org/10.7924/r45b0962f (2021).
Miller, A., Ogunyinka, E. & Isaacs, J. An Economic Baseline and Characterization of U.S. Gulf of Mexico Dockside Seafood Dealers. Gulf States Marine Fisheries Commission Publication Number 226. https://www.gsmfc.org/publications/GSMFC%20Number%20226.pdf (2014).
VanderKooy, S. J. (ed.). The Oyster Fishery of the Gulf of Mexico, United States: A Regional Management Plan – 2012 Revision. Gulf States Marine Fisheries Commission Publication Number 202. https://www.gsmfc.org/publications/GSMFC%20Number%20202.pdf (2012).
Karp, M. A., Seitz, R. D. & Fabrizio, M. C. Faunal communities on restored oyster reefs: effects of habitat complexity and environmental conditions. Mar. Ecol. Prog. Ser. 590, 35–51 (2018).
McClenachan, G. M., Donnelly, M. J., Shaffer, M. N., Sacks, P. E. & Walters, L. J. Does size matter? quantifying the cumulative impact of small-scale living shoreline and oyster reef restoration projects on shoreline erosion. Restor. Ecol. 28, 1365–1371 (2020).
Olander, L. et al. GEMS Phase I Report: Oyster Reef Restoration. NI R 20-01. Durham, NC: Duke University. https://nicholasinstitute.duke.edu/sites/default/files/publications/GEMS-Phase-I-Report-Oyster-Reef-Restoration.pdf (2020).
Olander, L. et al. GEMS Phase II Report: Coastal Restoration. NI R 21-05. Durham, NC: Duke University. https://nicholasinstitute.duke.edu/sites/default/files/publications/Gems-Phase-II-Report-Coastal-Restoration_0.pdf (2021).
GEMS. About the Metric Measurement Protocols. Duke University. https://nicholasinstitute.duke.edu/project/gems/about-metric-measurement-protocols (2021).
Katherine J. Papacostas & John Foster. Survey Design and Statistical Methods for Estimation of Recreational Fisheries Catch and Effort. NOAA Fisheries: The Marine Recreational Information Program. https://media.fisheries.noaa.gov/2021-09/MRIP-Survey-Design-and-Statistical-Methods-2021-09-15.pdf (2021).
Polk, M. A. & Eulie, D. O. Effectiveness of living shorelines as an erosion control method in North Carolina. Estuaries Coasts 41, 2212–2222 (2018).
Holt, J. R. & Borsuk, M. E. Using Zillow data to value green space amenities at the neighborhood scale. Urban For. Urban Green. 56, 126794 (2020).
White, M. P. et al. Associations between green/blue spaces and mental health across 18 countries. Sci. Rep. 11, 8903 (2021).
Interagency Working Group on Social Cost of Greenhouse Gases, United States Government. Technical Support Document: Social Cost of Carbon, Methane. https://www.whitehouse.gov/wp-content/uploads/2021/02/TechnicalSupportDocument_SocialCostofCarbonMethaneNitrousOxide.pdf (2021).
Boucquey, N. & Fly, J. Contested Commoning: Urban Fishing Spaces and Community Wellbeing. Int. J. Commons 15, 305–319 (2021).
Bureau of Ocean Energy Management. Economic Inventory of Environmental and Social Resources Potentially Impacted by a Catastrophic Discharge Event within OCS Regions. https://www.boem.gov/sites/default/files/oil-and-gas-energy-program/Leasing/Five-Year-Program/2017-2022/Economic-Inventories-for-CDE.pdf (2014).
Constituency for a Sustainable Coast. Mississippi Gulf Coast Food System Stakeholder Analysis. https://grpc.com/wp-content/uploads/2018/04/Food_Stakeholders-Analysis.pdf (2011).
Ropicki, A. J., Adams, C. M., Caffey, R. H. & Haby, M. The Importance of Gulf of Mexico Marine Dependent Industries and Measuring Sea Grant Programming Benefits on Those Industries. Sea Grant, GOSG-T-16_001. https://repository.library.noaa.gov/pdfjs/web/viewer.html?file=https://repository.library.noaa.gov/view/noaa/37857/noaa_37857_DS1.pdf (2016).
Shepard, A. N., Valentine, J. F., D’Elia, C. F., Yoskowitz, D. & Dismukes, D. E. Economic impact of Gulf of Mexico ecosystem goods and services and integration into restoration decision-making. Gulf of Mexico Sci. 31, 10–27 (2013).
NOAA Fisheries. Transformational Habitat Restoration and Coastal Resilience Grants. National Oceanic and Atmospheric Administration. https://www.fisheries.noaa.gov/grant/transformational-habitat-restoration-and-coastal-resilience-grants (2023).
European Parliament. Press release: Nature restoration: Parliament adopts law to restore 20% of EU’s land and sea. https://www.europarl.europa.eu/news/en/press-room/20240223IPR18078/nature-restoration-parliament-adopts-law-to-restore-20-of-eu-s-land-and-sea (2024).
White House Council on Environmental Quality, White House Office of Science and Technology Policy & White House Domestic Climate Policy Office. Opportunities to Accelerate Nature-Based Solutions: A Roadmap for Climate Progress, Thriving Nature, Equity, & Prosperity. https://www.whitehouse.gov/wp-content/uploads/2022/11/Nature-Based-Solutions-Roadmap.pdf (2022).
Federal Ministry for the Environment, Nature Conservation, Nuclear Safety and Consumer Protection. Draft: Federal Action Plan on Nature-based Solutions for Climate and Biodiversity. https://www.bmuv.de/fileadmin/Daten_BMU/Download_PDF/Naturschutz/aktionsprogramm_natuerlicher_klimaschutz_entwurf_en_bf.pdf (n.d.).
The White House. National Strategy to Develop Statistics for Environmental-Economic Decisions. https://www.whitehouse.gov/wp-content/uploads/2023/01/Natural-Capital-Accounting-Strategy-final.pdf (2023).
United Nations et al. System of Environmental-Economic Accounting—Ecosystem Accounting. https://seea.un.org/sites/seea.un.org/files/documents/EA/seea_ea_white_cover_final.pdf (2021).
C. Shepard et al. Charting Restoration: Gulf Restoration Priorities and Funded Projects Five Years After Deepwater Horizon. The Nature Conservancy. https://www.nature.org/media/gulfofmexico/charting-gulf-restoration-report.pdf (2015).
Gulf Coast Ecosystem Restoration Council. Planning Framework. https://www.restorethegulf.gov/sites/default/files/508_PlanningFramework_Final_201908.pdf (2019).
Restore The Gulf. 2022 Comprehensive Plan Update. https://www.restorethegulf.gov/comprehensive-plan (2022).
GEMS. Project Types. Duke University. https://nicholasinstitute.duke.edu/project/gems/project-types (n.d.).
Deepwater Horizon Project Tracker. https://dwhprojecttracker.org/ (2024).
Grabowski, J. & H Peterson, C. Restoring oyster reefs to recover ecosystem services. Theoretical Ecology Series 4, 281-298 (2007).
La Peyre, M., Furlong, J., Brown, L. A., Piazza, B. P. & Brown, K. Oyster reef restoration in the northern Gulf of Mexico: extent, methods and outcomes. Ocean Coast. Manag. 89, 20–28 (2014).
Katie Warnell et al. Evidence Library for Oyster Reef Restoration in the Gulf of Mexico. Duke University, 1–28 https://nicholasinstitute.duke.edu/sites/default/files/gems/GEMS-Evidence-Library.pdf (2020).
Drucker, P. The Practice of Management. (Routledge, London, 1954). https://doi.org/10.4324/9780080942360.
Acknowledgements
This paper is a result of research funded by the National Academies of Sciences, Engineering, and Medicine’s Gulf Research Program under award 2000008884 to Duke University, The Nature Conservancy, and Texas A&M University-Corpus Christi. We would like to thank all experts, stakeholders, and restoration practitioners who attended workshops or provided input on ESLMs and metrics. The views expressed in this paper do not necessarily reflect that of the Texas Parks and Wildlife Department and its Commission.
Author information
Authors and Affiliations
Contributions
Lydia Olander, David Yoskowitz, Chris Shepard, and Heather Tallis designed the GEMS project. Lydia Olander, David Yoskowitz, Chris Shepard, Heather Tallis, Katie Warnell, Sara Mason, Rachel Karasik, Kara Coffey, Christine Hale, and Kateryna Wowk contributed to planning and hosting GEMS workshops and processing workshop outcomes. Lydia Olander led writing of the paper and Katie Warnell led editing of the paper with input from David Yoskowitz, Chris Shepard, Heather Tallis, Sara Mason, Rachel Karasik, Kara Coffey, Christine Hale, and Kateryna Wowk.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Communications Earth & Environment thanks Taryn Waite and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Primary Handling Editors: Edmond Totin, Martina Grecequet. A peer review file is available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Olander, L., Warnell, K., Mason, S. et al. Advancing consistent socio-economic monitoring of coastal ecosystem restoration through collaborative metric development. Commun Earth Environ 5, 537 (2024). https://doi.org/10.1038/s43247-024-01705-z
Received:
Accepted:
Published:
Version of record:
DOI: https://doi.org/10.1038/s43247-024-01705-z
This article is cited by
-
Co-developing Nature-based Solutions for Coastal Resilience: A Case Study from Refugio County, Texas
Estuaries and Coasts (2026)




