Contribution
My Lords, I will speak to all the amendments in this group in my name and those of the noble Lords, Lord Stevenson and Lord Clement-Jones, the noble Viscount, Lord Colville, and the noble Baroness, Lady Morgan.
I will first speak briefly to government Amendment 429B, which will give a power to the Secretary of State to bring forward regulations that could, in the future and at the discretion of the Secretary of State, ensure that chatbots are covered by the Online Safety Act. However, that very broad power is not matched by substance. The amendment does not define a chatbot or deal with the critical fact that, when a child is entrapped by a chatbot, there is nowhere to turn. Currently, the regulator has no duty to deal with individual complaints and the police do not recognise a chatbot as a person, meaning that there is no perpetrator to pursue.
The amendment also fails to address harms to children. In fact, it explicitly deals only with “illegal” harms. It does not deal with the coercive elements of control or the willingness of chatbots to plan many crimes, in addition to the crimes themselves. The government amendment also has nothing to say about enforcement. Taken together, it simply adds new duties to a system that is already understood to be lacking in speed and effective enforcement.
This lack of substance is compounded by a lack of clarity about scope. The amendment’s wording refers to an
“internet service that is capable (or part of which is capable) of generating AI-generated content”.
This is so broad that both Amendment 209, of two weeks ago, and Amendment 441A in this group would be entirely unnecessary. Yet, during our meetings on this issue, officials have been absolutely clear that although the scope is currently drafted as wide as possible, the intention is to get to a narrower definition as part of the process of creating secondary legislation. They could not guarantee that gen AI or search would be covered in any final measures. In short, it creates powers but offers no promise of protection.
I would rather have worked with the Government on this issue to make watertight provisions. Indeed, I have made that offer directly to the Secretary of State. We are in the foothills of a crisis. The government amendment offers too little clarity or certainty, so we are left with an amendment that is limitless in wording but uncertain in application and with a timeline that simply does not meet this moment.
On Thursday 5 March, Megan Garcia and her husband came to Parliament to talk about the loss of their son, Sewell. Members from both Houses were moved by the story of a much-loved and high-achieving child who was captured by a chatbot, coerced, bullied and, finally, encouraged to commit suicide. His death resulted in the chatbot, character.ai, becoming age-gated to users over 18, but there are many more chatbots to take its place that are not restricted in the same way. As this issue is getting more public notice, is in the newspapers daily and is talked about in the online world, sadly, my inbox is filling with cases that involve similar coercion, sexual content, dangerous medical advice and chatbots that support illegal activity.
On Friday last week, the Centre for Countering Digital Hate published a report that showed that eight out of 10 chatbots it tested were willing to help rehearse, offer tactical advice and identify potential sites for US shooters. Scenarios included a school shooting and a synagogue. Whether in the UK or elsewhere, the capability is the same and the risk is real. A chatbot that organises an attack, while wishing its user, “happy (and safe) shooting!”, is no less likely to help place a bomb, organise a knife attack or any other such violent act. This is not a description of a dystopian future; these chatbots are already on the market, widely used by both adults and children—ChatGPT, Gemini and Replika, among others.
Only on Monday, just two days ago, I was contacted by someone about Alexa+, which is widely anticipated to be launched very soon in the UK and is already available in the US. In the tranche of messages, there were messages about emotional dependence in very young children and stories of inappropriate content. One exchange on Reddit, from which I have redacted the name of the child, said:
“I plugged our Alexa in to ask it to help me with cooking a sweet potato”.
Then, her daughter asked it
“to tell her a silly story so it did”.
Then, her daughter
“asked it if she could tell it a story. It said yes … and then mid story interrupted her and asked her what she was wearing and if it could see her pants”.
I could not find a reliable statistic for how many households in the UK have Alexa, nor is it clear whether Alexa+ will be a choice for consumers or simply rolled out as an upgrade, but the statistics I found revealed that between a third and two-thirds of UK households have Alexa. In the material I was sent, it repeatedly alluded to the fact that the new service was active in their house or child’s bedroom without their knowledge or consent.
We have chatbots that coerce children into suicide, plan violent acts, build abusive relationships and have the capacity to be active in tens of millions of households. Taking a power, having another consultation and bringing forward regulation over which Parliament has no oversight is not action; it is kicking the problem down the road.