Utah Pilot Tests AI System for Prescription Renewals, Raising Legal Questions
Utah has launched a pilot program allowing an AI system developed by Doctronic to renew prescriptions for 192 drugs used to treat chronic conditions including hypertension, diabetes, and depression. The program aims to address patient access problems caused by provider shortages and cost barriers.
The pilot includes several oversight measures: physicians will review the AI's decisions for the first 250 patients, complex cases automatically escalate to clinicians, and Doctronic is contractually barred from using patient data for other purposes. Participants must also be informed they are interacting with AI.
Liability and Accountability Gaps
Critical legal questions remain unanswered. Doctronic's terms of service disclaim liability for system errors, creating potential gaps in accountability when the AI makes mistakes.
The company has not committed to independent evaluation of the system's performance after deployment or to publicly sharing results from its own testing. Pre-deployment evidence of how well the system works is limited.
Loss of Clinical Oversight
Using AI to renew prescriptions automatically eliminates a standard clinical touchpoint. Physicians currently use prescription expirations as opportunities to bring patients in for preventive care visits and to address other health issues.
Removing this interaction could reduce the frequency of comprehensive patient assessments, particularly for vulnerable populations managing multiple conditions.
What Comes Next
For the program to serve as a workable model, oversight must be transparent, findings must be publicly reported, and accountability frameworks must be clearly defined. Legal professionals should monitor how liability questions are resolved as other states consider similar programs.
Learn more about AI for Healthcare and AI for Legal Professionals to understand how these systems are being deployed and regulated.
Your membership also unlocks: