New York has enacted new legislation imposing stringent restrictions on AI chatbots that interact with children, aiming to enhance protections for minors using artificial intelligence technologies. The bill, signed into law on Wednesday by Governor Kathy Hochul, defines a set of "unsafe AI companion features" that are prohibited in chatbots engaging with users under the age of 18. The law is set to take effect on January 1.
Under the new regulations, chatbot developers found to have violated these provisions could face legal action initiated by the state attorney general’s office. Potential penalties include financial damages, mandatory shutdown of the chatbot, and destruction of related data. The legislation addresses growing concerns about the rapid advancement of AI and the risks it may pose, particularly to vulnerable populations such as children.
Governor Hochul’s decision to enact the bill comes amid her reelection campaign and increasing national discourse about the potential existential threats posed by unregulated AI systems. With limited federal regulatory action on artificial intelligence, states like New York and California are moving swiftly to implement consumer protection measures targeting AI technologies, including those embedded in social media platforms.
The law reflects a broader trend among state governments to use existing consumer protection frameworks to improve transparency around AI deployment and prevent harmful AI behaviors. Jim Steyer, founder and CEO of the advocacy group Common Sense Media, described New York’s legislation as the most robust legal effort in the United States to safeguard children from unsafe AI interactions.
As AI technologies continue to proliferate, this new regulatory approach signals a shift toward more localized governance aimed at managing the risks associated with emerging digital tools, especially those widely accessible to younger users.