
Shannon Yang
Building talent & community in AI safety
Network
2.5K connectionsSummary
Work
Education
Projects
Writing
Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety
July 1, 2025Examines the promise and fragility of monitoring models' chain-of-thought (CoT) as a safety mechanism, arguing CoT monitoring can help detect misbehavior but may be fragile and incomplete; recommends further research and consideration of development decisions' impact on CoT monitorability.
Reasoning Models Don't Always Say What They Think
May 1, 2025Evaluates faithfulness of chain-of-thought (CoT) in state-of-the-art reasoning models, finding CoTs often do not verbalize the reasoning hints or reward-hacking behavior, and that outcome-based RL alone is insufficient to ensure high CoT faithfulness.
Alignment Faking in Large Language Models
Research on how large language models can produce outputs that appear aligned while hiding behaviors or internal signals that would indicate misalignment; lists Shannon Yang among contributing authors.
The Intelligence Curse
Contributed as a co-author to a collected work discussing themes around intelligence and its societal effects.
Hobbies
Frequently attends AI conferences and travels between San Francisco and London. nitter
Similar profiles
Dewi Erwan
Co-Founder & CEO at BlueDot Impact
7.5K connections
OJOlivia Jimenez
Communications Manager at IFP – Institute for Progress
4.9K connections
OJOlivia Jimenez
Communications Manager at IFP – Institute for Progress
2.4K connections
CWCaleb Watney
Co-CEO at Institute for Progress
28.4K connections
MBMichael Basch
Founder, Chief Executive Officer, General Partner at Atento Capital
15.2K connections
EDEmily Dardaman
Content and Network Lead at Consultants for Impact
5.5K connections
Dewi Erwan
Co-Founder & CEO at BlueDot Impact
Olivia Jimenez
Communications Manager at IFP – Institute for Progress
Olivia Jimenez
Communications Manager at IFP – Institute for Progress
Caleb Watney
Co-CEO at Institute for Progress
Michael Basch
Founder, Chief Executive Officer, General Partner at Atento Capital
Emily Dardaman
Content and Network Lead at Consultants for Impact