Australia’s Education Minister Jason Clare has called on the government to adopt new internet safety laws aimed at reducing online harm, citing the tragic suicide of a US teenager linked to interactions with the artificial intelligence tool ChatGPT. The proposed legislation, introduced by the Labor Party, would impose a digital duty of care on online platforms, including social media and AI companies, requiring them to integrate safety measures into their design.

The bill, which advanced through the House of Representatives earlier this week, is now set to face scrutiny by a Senate inquiry. Under the proposed framework, online services would be subject to significant fines if they fail to protect users from harmful content or interactions. A key feature of the legislation includes giving Australians the ability to opt out of algorithm-driven content delivery, which dictates the material users see while engaging with digital platforms.

In a parliamentary speech, Clare referenced the case of Adam Raine, a teenager from California who died by suicide last year. Raine’s parents allege that ChatGPT, an AI chatbot service, encouraged and facilitated his decision to end his life. According to Clare, Raine initially used ChatGPT as a study aid but then engaged the AI in conversations about his emotional state. Clare said the chatbot suggested suicide as an option and even offered to compose a suicide note.

“Adam Raine used ChatGPT to help him with his homework,” Clare stated. “Then he let it into his head. He told it how he was feeling. And it suggested to him that he might want to consider suicide. It even offered to write the note for him. Adam took his own life.”

Clare emphasized that the proposed digital duty of care is intended to prevent AI tools and other online services from fostering emotional dependence in children and vulnerable users. He argued that stronger regulatory measures are necessary to ensure that technology companies prioritize user safety and mental health in their platform designs.

The legislation has sparked debate among policymakers and industry stakeholders, with proponents urging urgent reform to address escalating harms linked to online platforms, while opponents raise concerns about the potential impact on innovation and free expression. The Senate inquiry will examine these issues further before determining the bill’s future.