Supreme Court Flags Fake AI-Generated Judgments: Calls It A Serious Threat To Justice System

The Supreme Court of India has issued a stern warning regarding the rising misuse of artificial intelligence (AI) to generate fake judicial judgments that are being cited in court proceedings despite lacking any official record. The court highlighted that such practices pose a serious risk to the integrity of the judicial system, both in India and internationally.

AI: A Powerful Tool with Potential Risks

The issue surfaced during the hearing of a Special Leave Petition filed by a private company director seeking to remove remarks made by the Bombay High Court. The remarks had been based on a judgment that later turned out to be entirely AI-generated and non-existent. The Supreme Court expressed deep concern over the increasing reliance on AI tools to fabricate legal content and present it as authentic precedent.

The bench emphasized that while AI can serve as a useful research and analytical tool, its unverified use threatens the credibility of judicial proceedings. Presenting AI-generated content in court without rigorous verification violates professional ethics and can mislead the administration of justice.

A Global Challenge for Legal Systems

The court noted that this is not just an Indian problem but a growing global challenge. With AI technology becoming widely accessible, the creation and circulation of misleading or fabricated legal documents is becoming easier. The Supreme Court urged courts, legal professionals, and institutions to exercise heightened vigilance to prevent misuse.

Legal experts have warned that AI-driven fake judgments could result in serious institutional and legal consequences if left unchecked. Accuracy, authenticity, and careful verification remain essential in ensuring the judicial process remains credible.

Steps Toward Safeguards and Oversight

In the specific case, the Supreme Court ordered the removal of the Bombay High Court remarks tied to the AI-generated content. At the same time, the bench indicated that broader guidelines and stricter measures may be needed to address AI misuse in legal practice in the future. The court advised all stakeholders to maintain vigilance to preserve transparency, accuracy, and trust in the legal system.

As AI adoption in legal research and documentation grows, ensuring responsible usage and robust verification processes will be critical to preventing technology from undermining justice.