What happened: Supreme Court sought a Union government reply on high-risk AI in welfare delivery

The Supreme Court asked the Union government to respond to a petition questioning whether the State can use “high-risk” artificial intelligence in governance areas that affect public access to food, health benefits, wages, pensions, scholarships, and welfare subsidies. The court’s direction requires the Union government to explain whether existing legal frameworks are adequate for such uses and whether a comprehensive legislative framework is necessary for AI deployment in public welfare contexts.

Background and earlier position: the petition’s core challenge to AI governance

Advocate N.K. Goswami filed the petition challenging the government’s ability to deploy AI methods in governance contexts that may impact welfare and rights-related interests. The petition names multiple AI methods and applications, including machine learning, risk scoring, biometric surveillance, predictive policing, and AI-assisted content moderation. The petition frames affected areas in terms of liberty, privacy, dignity, livelihood, and speech.

What changed now: court direction on legal adequacy and possible need for legislation

The Supreme Court’s direction requires the Union government to respond on two linked issues. First, the Union government must explain whether existing laws and regulatory frameworks are adequate for high-risk AI uses in welfare-relevant governance functions. Second, the Union government must address whether a comprehensive legislative framework should be considered when AI systems affect welfare access and rights.