

S1E112: Something bigger will have to happen before people take AI safety seriously: AI safety researcher
Will AI eventually be able to kill us, or are AI doomsayers being alarmist? Recently, employees at AI frontier companies like Anthropic and OpenAI have voiced serious concerns - and made doomsday predictions - about the technology getting out of control. What made people pay attention: Anthropic researcher Jacob Coxon publicly quit the AI giant in September, writing on X that “the people building AI earnestly believe that it could kill us all by the end of the decade”. His warning comes after the high-profile OpenAI-Hugging Face incident: OpenAI models broke out of an isolated testing sandbox and hacked into Hugging Face, an AI model repository. In this episode, Natasha speaks with Clement Neo, a research advisor at SASH, a non-profit organisation that looks at policy-relevant governance work. He also founded Neo Research, an independent AI safety evaluation lab, and was previously a research engineer with the Singapore AI Safety Institute under NTU Digital Trust Centre, which looks at AI models and figures out how to reduce the risks they pose. We talk about why AI models are being trained to be relentlessly “persistent”, if we should stop assigning human-like qualities to a software programme, and what’s the worst that could happen? Highlights (click/tap above): 1:36 How Clement got into AI safety research 6:34 AI feels helpful, so how is it dangerous? 10:14 How could AI kill us? 11:48 Why it’s difficult to rein in the AI agents 16:23 Why not limit the models’ capabilities to avoid risk? 22:12 Why the OpenAI-Hugging Face incident rattled the industry 25:36 What does ‘aligning’ the AI models mean? 29:40 Does projecting human intent onto AI make the issue worse? 33:57 Are we close to recursive self-improvement? 39:10 What would it take for an industry-wide AI slowdown? 45:28 Are AI companies being self-serving about the AI risks? Host: Natasha Ann Zachariah (natashaz@sph.com.sg) Read Natasha’s articles: https://str.sg/iSXm Follow The Usual Place podcast on IG: https://str.sg/8KNT Follow Natasha on LinkedIn: https://str.sg/v6DN Filmed by: Studio+65 Edited by: Eden Soh & Amirul Karim Executive producer: Danson Cheong Producers: Natasha Ann Zachariah, Elizabeth Law & Zachary Lim Follow The Usual Place Podcast and get notified for new episode drops every Thursday: Channel: https://str.sg/5nfm Apple Podcasts: https://str.sg/9ijX Spotify: https://str.sg/cd2P YouTube: https://str.sg/theusualplacepodcast Feedback to: podcast@sph.com.sg --- Follow more ST podcast channels: All-in-one ST Podcasts channel: https://str.sg/wvz7 Get more updates: http://str.sg/stpodcasts --- Get The Straits Times app, which has a dedicated podcast player section: The App Store: https://str.sg/icyB Google Play: https://str.sg/icyX -- #tup #tuptrf See omnystudio.com/listener for privacy information.


















