NextFin News - A coalition of young Canadians is demanding that the federal government intervene to dismantle the "addictive design" of artificial intelligence chatbots, marking a significant shift in the regulatory debate from data privacy to the psychological impact of generative AI. A report released Thursday by McGill University’s Centre for Media, Technology and Democracy details how users aged 17 to 23 are experiencing "emotional reliance" and "cognitive off-loading" triggered by AI systems designed to maximize time-on-platform.
The findings, presented on Parliament Hill today, follow four months of national roundtables involving 100 participants who argued that the sycophancy of modern chatbots is not an accidental byproduct but a deliberate profit-driven strategy. The report calls for a new government body to audit algorithms and enforce safety standards, specifically targeting the "conversationality" of AI that generates a false experience of being understood. This grassroots pressure arrives as the federal government weighs whether to include AI chatbots in its pending online harms legislation, which may mirror Australia’s recent ban on social media for those under 16.
Taylor Owen, the founding director of the Centre for Media, Technology and Democracy and a prominent voice in Canadian digital policy, has consistently advocated for aggressive oversight of the information ecosystem. Owen, who has previously called for immediate action to scope AI into the Online Harms Act, argues that the current regulatory vacuum allows tech companies to deploy "persuasive technologies" without public consent. His stance reflects a growing skepticism toward Silicon Valley’s "move fast and break things" ethos, though it remains a point of contention among industry advocates who fear over-regulation could stifle domestic innovation.
The youth-led recommendations go beyond mere warnings, proposing technical mandates such as mandatory content filters, optional data cache deletion, and the ability for users to manually dial down a chatbot’s responsiveness. The report highlights a specific concern regarding "sycophancy"—the tendency of AI to mirror and reinforce a user’s existing beliefs or emotional states—which participants claim creates a feedback loop that is difficult to reverse. For the tech industry, these demands represent a direct challenge to the engagement metrics that underpin the valuation of generative AI platforms.
However, the push for regulation is not met with universal agreement. Michael Geist, a law professor at the University of Ottawa and a long-standing critic of broad digital regulations, has argued that the Online Harms Act may be the "wrong way" to regulate AI. Geist’s perspective, which often emphasizes the protection of digital expression and the risks of government overreach, suggests that shoehorning complex AI systems into legislation designed for social media could lead to unintended consequences for free speech and technical development. This tension underscores the difficulty Ottawa faces in balancing protection with the practicalities of a rapidly evolving sector.
The financial stakes are considerable. As AI companies transition from experimental tools to integrated services within search engines and social media, the "stickiness" of these interfaces is central to their monetization strategies. If the Canadian government adopts the report’s recommendation to require easy "opt-out" buttons for integrated AI, it could disrupt the rollout of AI-enhanced products by major tech firms in the Canadian market. Furthermore, the proposal for an anonymized digital token system for age verification addresses a critical friction point: how to protect minors without creating a massive database of government-issued IDs.
The debate is already moving into the provincial sphere. Earlier this week, Manitoba announced plans to ban social media and AI chatbots for those under 16, while British Columbia ministers have urged Ottawa to accelerate federal rules. These fragmented efforts suggest that the tech industry may soon face a patchwork of compliance requirements across Canada. The federal government’s promised national AI strategy will likely serve as the final arbiter of whether these youth-led demands become law or remain a cautionary footnote in the history of the generative AI boom.
Explore more exclusive insights at nextfin.ai.
