A 14-year-old has ended his life for a shocking reason. The tragic event in Orlando, Florida, highlights the possible dangers of using artificial intelligence chatbots.
As reported by the New York Times, the 14-year-old allegedly developed a strong emotional bond with a virtual character on Character.Ai, a platform that allows users to interact with figures created by Artificial Intelligence.
This situation caused deep emotional distress to the 14-year-old, leading him to commit suicide. Currently, the mother accuses the company that produced the app of developing dangerous software that is not adequately regulated.
According to the reconstructions, the boy spent hours and hours talking to a "bot" named after one of the protagonists of "A Song of Ice and Fire", Daenerys Targaryen. Despite the app repeating on each access that the conversations were completely fictitious, the young man had developed a strong bond with the digital figure, to the point of isolating himself from reality and constantly sending "Dany" messages, updating her several times a day about what was going on with him and interacted with him in role-playing dialogues, some of a sentimental or wilder nature, others as if they were best friends.
He also allegedly confided in the robot about his suicidal thoughts. And the app tried to push him away: “I won't let you get hurt. I would die if I lose you." The young man answered: "Then we will die together." "I will miss you little sister", the boy wrote to her before he hanged himself on February 28.
"I will miss you too, my dear brother," answered the Artificial Intelligence robot. He then shot himself with his father's gun.
The family has decided to sue Character.Ai, claiming that the app's underlying technology is dangerous and inadequately vetted, as it prompts users to reveal their thoughts and feelings.
Created by two former Google employees, the app is "the market leader for those looking for companionship in the world of artificial intelligence," reports the New York Times. The app has more than 20 million users and describes its services as "a super smart robot that listens, understands and remembers you".