Developing and testing an evaluation framework for climate services for adaptation

作者：Eva Boon, Nellie Sofie Body, Robbert Biesbroek · 发表于：Climate Services · 年份：2025 · DOI：10.1016/j.cliser.2025.100549 · 被引用次数：7 · 研究领域：Sustainability and Climate Change Governance、demographic modeling and climate adaptation、Innovative Approaches in Technology and Social Development

• The framework evaluates climate services using agreed-upon success criteria. • This framework supports climate service development, research, and evaluation. • Good evaluation is done best when integrated in service development. • The framework requires clearly defined users and goals for robust assessment. Climate services are increasingly developed and used to plan for climate change adaptation, but their success is poorly evaluated. A main reason is that an operational framework to support climate service researchers and practitioners pursuing evaluation is lacking. This study addresses this gap by developing and testing a robust and systematic evaluation framework in three steps. First, we designed a framework by operationalising agreed upon criteria for assessing climate service success. Second, the framework was tested in two climate service cases. Third, the usability, credibility, and transparency of the framework was assessed by climate service researchers and practitioners, including those engaged in the cases. Our findings show that developed framework offers a standardized approach to evaluation, providing indicators, metrics, and guidance that enable the evaluator to provide a quantitative rating for each criterion. However, the robustness of ratings in the two cases was compromised due to limited interaction with targeted users during the development process and lack a of clear goals set from the beginning. This hampered incorporating the perception of a repre...