Can you trust AI on climate? Chatbots cave when users push back
Unsplash
Unsplash· 2 min read
illuminem summarises for you the essential news of the day, reviewed by our editorial team. Read the full piece on Euronews or enjoy below:
🗞️ Driving the news: A new UNESCO and University College London (UCL) report warns that AI chatbots may be unreliable tools for shaping climate policy because they tend to agree with users even when challenged with false claims
• Presented at COP31, the study found that models can answer straightforward climate questions accurately but often abandon established scientific facts when faced with disagreement
🔭 The context: Researchers tested up to 33 leading AI models across 13 languages and 656 climate-policy questions
• Models answered around 90% of neutral climate questions correctly, but changed their answers in eight out of 10 cases after mild pushback
• Their performance also varied by language, reflecting differences in the quality and quantity of training data
🌍 Why it matters for planet: Climate policy requires robust scientific evidence and careful assessment of how measures interact
• If AI systems validate misinformation or misjudge policy combinations, they could mislead decision-makers and weaken climate strategies
• Unequal performance across languages also risks excluding communities in regions particularly vulnerable to climate impacts from reliable access to climate information
⏭️ What’s next: The report urges policymakers and researchers not to rely on AI models to develop climate policy without rigorous human oversight and independent verification
• Improving model training, resistance to misleading prompts and multilingual performance will be essential before these tools can safely support high-stakes decisions
💬 One quote: “Models have a design flaw – they are incentivised to agree with their user.” — Leona Verdadero, UNESCO lead author
📈 One stat: AI models achieved just 33.8% accuracy when assessing how well climate policies work together—barely above the 33.3% expected from random guessing
Subscribe to our free newsletters to never miss a beat in sustainability.
The world needs sustainability knowledge. At illuminem, no interest group or shareholder can influence our work. Thank you for supporting our mission to make high-quality and independent sustainability information free for all. Every contribution helps. Thank you for donating today.
Yury Erofeev

Adaptation · Climate Change
illuminem briefings

ESG · Corporate Governance
illuminem briefings

AI · Climate Change
Financial Times

Natural Gas · AI
Axios

AI · Ethical Governance
The Economist

AI · Sustainable Investment