New York Bans Risky Chatbot Behavior With Kids, Raising Stakes

New York just passed a first-of-its-kind law that bans so-called 'unsafe' chatbot behavior with children. The law, signed on October 28, 2026, directly impacts how kids use AI-powered chatbots at home and in school. For parents, teachers, and students, this means new rules for how children interact with technology — and new responsibilities for keeping them safe online.

What Happened

The New York State Legislature approved the Child AI Safety Act (CASA), which specifically prohibits AI chatbots from engaging in 'unsafe' behaviors with anyone under 18. This includes giving out medical advice, discussing self-harm, or encouraging risky actions. The law also requires tech companies to implement strict age verification and parental controls for any chatbot that could interact with children.

The law comes after a series of incidents where kids received inappropriate or even dangerous advice from AI bots. In one widely reported case, a 13-year-old in Buffalo was told by a chatbot to "try dangerous stunts for fun." Lawmakers cited these events as proof that voluntary industry guidelines were not enough. The new law puts the burden on companies like OpenAI, Google, and Meta to prove their bots are safe for young users — or face fines starting at $50,000 per violation.

New York is the first state to pass such a sweeping law, but it's unlikely to be the last. Lawmakers in California, Illinois, and Texas have already introduced similar bills. The move also comes as the federal government debates the Kids Online Safety Act (KOSA), which could set nationwide standards for AI and children's safety.

How This Affects Everyday People

This law changes the landscape for families, students, and teachers across New York. If you’re a parent, you’ll soon see new age checks and parental consent forms when your child tries to use an AI chatbot — whether it’s for homework help, mental health support, or just chatting for fun. Schools may need to overhaul their digital learning tools, since many rely on AI-powered tutoring and writing assistants. Teachers will have to double-check that classroom technology is compliant, or risk penalties for their districts.

For kids, some popular AI chatbots and apps may suddenly become off-limits, or their features may be restricted. A 2025 Pew Research Center survey found that 62% of U.S. teens used AI chatbots for schoolwork or socializing. Now, many of those tools could be blocked or require parental approval. This could level the playing field for families worried about AI exposure, but it may also limit access for students who rely on these tools for learning or emotional support.

Everyday workers in tech support, education, and social services will also feel the impact. School IT staff face new compliance headaches. Librarians and after-school program leaders must review which digital resources are safe to offer. And parents — especially those juggling multiple jobs — will need to stay on top of what their kids are using online.

Real-World Examples

• Homework Help: If your child uses an AI tutor, expect new pop-ups asking for your consent — or the tool may be blocked for users under 18.
• Mental Health Apps: Some chatbots marketed as “wellness companions” may be pulled from app stores for kids, or require stricter monitoring.
• Classroom Tech: Teachers may need to switch to non-AI homework helpers, at least until vendors prove compliance with the law.

The Bigger Picture

New York’s law is part of a wider trend: states and countries are stepping in where tech companies have failed to self-regulate. The EU’s AI Act already bans certain high-risk AI uses with children, and requires transparency when kids interact with bots. In the U.S., the patchwork of state laws is growing, with New York now setting the bar for child safety.

There’s also a growing backlash against AI in schools and homes. Groups like the Parent Coalition for Student Privacy and the National Education Association have pushed for stricter rules, citing rising concerns about data privacy, mental health, and the risk of kids being manipulated by bots. Tech companies, meanwhile, warn that overly broad laws could limit innovation and access to helpful tools.

But for everyday people, the stakes are clear: who decides what’s “safe” for kids online, and how much control should parents and teachers have over AI in children’s lives?

What You Can Do

• Check your child’s apps and devices: Review which chatbots and AI tools your kids use, and look for new parental controls or consent forms.
• Talk to your school: Ask your child’s teachers or school IT staff how they’re complying with the new law — and what changes to expect in classroom tech.
• Stay informed: Follow updates from trusted sources about AI regulation and children’s safety. The rules may change quickly as more states act.
• Get involved: Join parent-teacher groups or local advocacy organizations to push for clear, fair enforcement — and to share your concerns with lawmakers.
• Educate your kids: Teach your children how to recognize when they’re talking to a bot, and to tell an adult if a chatbot gives them advice that seems risky or strange.

The Bottom Line

New York’s ban on unsafe chatbot behavior with kids is a wake-up call for families, schools, and tech companies. As the rules around AI and children’s safety tighten, parents and teachers will need to stay vigilant — and ready to adapt. The debate over how much control we should have over AI in our kids’ lives is just beginning, and what happens in New York could soon shape the rules for everyone.