AI Regulation Debate: Why How We Measure Impact Matters Most

As governments scramble to write new rules for artificial intelligence, a crucial question is being overlooked: how do we actually measure AI’s impact on real people? While lawmakers argue about how fast to regulate, experts warn that without clear ways to track AI’s effects, everyday workers, parents, and students could be left unprotected—or caught in red tape that misses the point.

What Happened

The latest debate, covered by Knowledge at Wharton, centers on whether lawmakers should prioritize moving quickly to regulate AI, or slow down and focus on developing better ways to measure its real-world impact. In the U.S., Congress has held a flurry of hearings on AI safety and job loss, while the European Union recently passed the EU AI Act, the world’s first broad AI law. But critics say that both sides are missing something vital: without reliable ways to measure how AI affects jobs, privacy, and daily life, regulations could be toothless—or worse, harmful.

For example, the EU AI Act divides AI systems into risk categories, but many experts argue that its criteria are vague and hard to enforce. In the U.S., the Biden administration’s 2023 Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence called for agencies to assess AI’s risks, but offered little detail on how to actually do that. Meanwhile, tech giants like OpenAI, Google, and Microsoft are rolling out new AI tools in schools, hospitals, and workplaces, often with little oversight or public input.

How This Affects Everyday People

For most people, the debate over measurement isn’t just academic—it’s about whether the rules will actually protect them. If lawmakers can’t agree on what counts as harm, or how to track it, workers could see their jobs automated without warning, parents might struggle to understand how AI is shaping their kids’ education, and communities could miss out on the benefits of new technology while still facing the risks.

Consider job loss: If a company replaces 500 customer service workers with an AI chatbot, but there’s no requirement to report or measure the impact, those workers may have no recourse. Or take schools: If an AI grading tool is biased against certain students, but there’s no way to track errors or complaints, families are left in the dark. Even in healthcare, if an AI system misdiagnoses patients but there’s no clear reporting standard, lives could be at risk.

Without strong measurement, regulations can become little more than paperwork. Rules that look good on paper may not stop companies from quietly rolling out risky AI, or failing to fix problems when they arise. And when things go wrong, it’s often everyday people—not tech executives—who pay the price.

The Bigger Picture

This debate is part of a larger trend: as AI becomes more powerful and widespread, the gap between rapid innovation and slow-moving regulation is growing. In 2024, the EU passed the EU AI Act, but enforcement is still years away. In the U.S., Congress has yet to pass any comprehensive AI law, despite high-profile warnings about job loss and bias. Meanwhile, public backlash is rising, with workers, teachers, and parents organizing to demand more transparency and accountability from tech companies. (See our coverage of the growing AI backlash for more on this trend.)

Other countries are watching closely. Canada and Australia are drafting their own AI rules, but face similar challenges: how do you write laws for a technology that evolves faster than government can respond? And how do you make sure those laws actually protect people, rather than just creating more bureaucracy?

Some experts argue that the answer lies in better measurement. That means not just tracking technical errors, but also gathering real-world data on job loss, discrimination, and other harms. It also means giving regular people a say in how AI is used in their communities, schools, and workplaces. Without these steps, even the best-intentioned regulations may fall short.

What You Can Do

• Ask questions at work or school: If your employer or your child’s school introduces a new AI tool, ask how its impact will be measured. Who tracks errors? How are complaints handled? Demand transparency.
• Get involved in local discussions: Many cities and school boards are starting to hold public meetings on AI use. Attend these meetings or write to your representatives to share your concerns and push for clear measurement and reporting standards.
• Stay informed about AI regulation: Read up on how AI laws like the EU AI Act or U.S. proposals might affect you. Understanding what’s being measured—and what isn’t—can help you advocate for stronger protections.
• Report problems: If you experience bias, errors, or job impacts from AI at work, in school, or in healthcare, document it and report it to your union, parent association, or local officials. Real-world stories can drive better measurement and stronger rules.
• Join or support advocacy groups: Groups fighting for AI accountability need stories and support from regular people. Learn more about how people are fighting back against AI in their communities.

The Bottom Line

The fight over AI regulation isn’t just about how fast lawmakers can act—it’s about whether the rules will actually protect everyday people. Without clear ways to measure AI’s impact on jobs, families, and communities, even the toughest laws may fall short. As AI continues to reshape daily life, it’s up to all of us to demand not just more regulation, but smarter, more accountable measurement of what really matters.