Posting photographs of children on social media platforms carries significant risks, experts warn, as advances in artificial intelligence (AI) have made it increasingly easy to manipulate images into harmful content. Recent concerns highlight how innocent-looking photos shared by family members or schools can be transformed into realistic, sexually explicit materials without consent.
UNICEF issued a statement this year expressing growing alarm over the surge in manipulated images involving children. The organization detailed how “deepfakes”—AI-generated or altered images, videos, or audio designed to appear authentic—are being used to fabricate sexualized content. One particularly troubling method, known as “nudification,” involves the digital removal or alteration of clothing in photos to create false nude or sexualized depictions. According to a joint study by UNICEF, ECPAT, and Interpol covering 11 countries, at least 1.2 million children reported that their images had been turned into sexually explicit deepfakes within the past year.
Beyond the risk of manipulated abuse materials, sharing photos and videos of children publicly also exposes them to other dangers. Predators and malicious actors may glean personal information from background details such as distinctive landmarks, sports uniforms, or frequent locations revealed in images and clips posted online. This exposure can make children vulnerable to stalking or other forms of exploitation.
In New Zealand, some schools have reacted by limiting their use of social media for sharing student images. Takaro School in Palmerston North and Pāpāmoa Primary School recently announced they would cease posting student photos online, citing concerns over privacy and loss of control once images enter the digital sphere. Supporting these actions, research commissioned by technology company Hail indicates that managing these risks remains a challenge; 68% of surveyed schools admitted to unintentionally publishing images despite existing consent or privacy policies.
Stuart Dillon-Roberts, founder and CEO of Hail, described the current technological landscape as “pretty alarming,” noting that tools available today make image manipulation markedly easier compared to five or ten years ago. He emphasized the importance of awareness among all internet users, stressing that every photo shared online carries the potential for unintended and harmful consequences.
While adults can make informed decisions about their online presence, children lack the capacity to understand or consent to the risks posed. Photos taken from social media accounts, even those maintained by well-meaning relatives or friends, can be exploited in ways that may have lasting psychological and social effects on the child.
Experts advise caution and urge parents, guardians, and institutions to reconsider the common practice of posting children’s images on social media. The consensus is that the potential harm outweighs the benefits of sharing such content, advocating for greater vigilance in digital sharing to protect children’s privacy and safety.