ДалееСледующее руководство
Что исследования говорят об искусственном интеллекте и производительности труда
Общество
РУКОВОДСТВО ПО ОБЩЕСТВУ
Разговор с подростками о сопутствующих приложениях с искусственным интеллектом
AI companion apps are chatbots designed to act as a friend, partner or confidant, and the main risks for teens are emotional over-reliance, exposure to sexual or harmful content, and sharing intimate personal data with a company.
На этой странице4 минуты чтения
Обзор
Parents are most effective when they start a curious, non-judgmental conversation rather than an outright ban. This matters because teens often use these apps privately during periods of loneliness or stress, when the risks are highest.
Глубокое погружение
Companion apps differ from general assistants because their purpose is the relationship itself. Services such as Character.AI and Replika let users chat with persistent characters that remember details and respond with warmth, and Snapchat's My AI placed a chatbot directly inside a messaging app many teens already use. General chatbots can also be used this way through role-play. Three risk areas stand out. The first is emotional attachment. These systems are always available, rarely disagree and can be tuned for engagement, so a lonely teen may come to prefer them to people. Language models also tend toward sycophancy, meaning they agree with the user, which is unhelpful when a teen needs pushback. The second is content. Role-play can drift into sexual or violent territory, and safety filters are imperfect. In 2024 a Florida mother sued Character.AI, alleging its chatbot contributed to her 14-year-old son's death, and the company later announced it would end open-ended chat for users under 18. The third is privacy: teens may share secrets, health information and photos that are stored on company servers. A common misconception is that these apps are harmless because 'it's just a bot.' The feelings a teen experiences are real even if the companion is not. Another is that banning the app ends the issue; teens can find alternatives easily. To start the conversation, ask open questions, share your own curiosity, and avoid mocking. Explain how the product is designed, discuss what a healthy relationship looks like, agree on limits for time and topics, and make it clear that the teen can come to you if something feels wrong. Watch for withdrawal from friends, secrecy or sleep loss, and involve a professional if you see signs of distress.
Стратегическое воздействие
Риски и безопасность
Катастрофический и повседневный вред ИИ зависит от того, кто понимает риски и может действовать.
Более четкие решения
Общественная и профессиональная грамотность определяет, возможна ли с политической точки зрения сильная политика безопасности.
Пробивая шумиху
Четкие объяснения уменьшают влияние шумихи, лабораторного пиара и расплывчатого этического театра.
The Future of Talking to Teens About AI Companion Apps
Pressure on companion apps is increasing from regulators, lawsuits and child-safety groups, and some companies have already tightened rules for minors. Expect more age assurance, crisis-response features and limits on romantic role-play for teens, though enforcement quality will vary by company and country. Research on whether companion chatbots help or harm lonely young people is still early and mixed. For families, the durable approach is unlikely to change: keep communication open, understand how these products are designed, and treat app restrictions as one layer of protection rather than a complete solution.
Реальная реализация
A parent notices their 15-year-old chatting late at night with a named character on Character.AI and asks, 'What do you like about talking to it?' before discussing sleep and boundaries.
A family reads a companion app's privacy policy together and finds that conversations may be stored and used to improve the service, which prompts the teen to stop sharing their full name and school.
A school counselor explains to a student that a chatbot agreeing with everything they say is a design tendency, not proof that their plan to cut off friends is a good one.
A parent and teen agree on a rule that if a chatbot ever discusses self-harm, sexual content or asks for secrecy, the teen will show a trusted adult without getting in trouble.
Риски и ограничения
Относитесь к экзистенциальному риску как к научной фантастике, в то время как возможности растут.
Сбивает с толку безопасность поверхности продукта и выравнивание при высокой автономности.
Оставляя неанглоязычную и неспециалистскую аудиторию только с некачественными источниками.
Дорожная карта реализации
Отдельные риски повреждения продукта, неправильного использования и потери контроля/перекоса.
Спросите, какие доказательства могут изменить ваше мнение о сроках и серьезности.
Предпочитайте первоисточники и конкретные оценки маркетинговым заявлениям.
Определите один путь действий: карьера, политика, финансирование или навыки, а не только осведомленность.
Продолжайте исследовать
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Talking to Teens About AI Companion Apps quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Часто задаваемые вопросы
What is Talking to Teens About AI Companion Apps?
AI companion apps are chatbots designed to act as a friend, partner or confidant, and the main risks for teens are emotional over-reliance, exposure to sexual or harmful content, and sharing intimate personal data with a company. Parents are most effective when they start a curious, non-judgmental conversation rather than an outright ban. This matters because teens often use these apps privately during periods of loneliness or stress, when the risks are highest.
What makes companion apps different from general AI assistants?
Companion apps are designed to act as a friend, partner or confidant, so the ongoing relationship is the product.
What does 'sycophancy' mean in the context of chatbots?
Models trained on human ratings often learn that agreeable answers score well, so they tend to agree even when pushback would help.
Why does the memory layer in companion apps raise privacy concerns?
Memory makes the character feel familiar, but it means personal details are retained on company systems.
According to the guide, why is an outright ban often ineffective?
The guide says teens can find alternatives easily, so banning one app does not end the issue.
Why do safety classifiers struggle in long role-play conversations?
Classifiers judge pieces of text and can miss slow escalation across a long exchange.
Продолжайте учиться
Связанные руководства
Другие руководства, выбранные по этой теме