Many healthcare provider organizations are deploying artificial intelligence tools without a complete inventory of what systems are in use, raising governance and safety concerns, according to Dr. Deepti Pandita, CMIO and VP of clinical informatics at UC Irvine Health.
"Provider organizations may not always know where every artificial intelligence tool exists," Pandita said, calling system-wide AI awareness and governance essential.
The challenge of AI discovery in healthcare
Pandita's comments highlight a growing issue as health systems adopt AI at an accelerating pace. Clinical departments, IT teams, and individual practitioners often acquire or build AI tools independently, creating blind spots for leadership. Without visibility, organizations cannot audit these tools for safety, bias, or compliance with regulations.
UC Irvine Health has worked to create a centralized registry of all AI tools in use, along with standardized evaluation criteria. Pandita said this transparency enables IT and clinical leadership to track performance, flag problems, and ensure every tool benefits patient care.
Governance structures that work
Pandita recommended organizations establish formal committees to assess and approve AI tools before deployment. These committees should include clinicians, IT staff, legal experts, and quality and safety officers. "AI governance needs to be multidisciplinary," she said. "No single group has the full picture."
She also stressed that governance does not end at approval. Tools must be monitored over time for changes in performance, drift in data inputs, and evolving regulatory requirements. Without ongoing oversight, an early problematic tool remains unchecked.
Why this matters for management
For management professionals, Pandita's core message is direct: you cannot regulate what you cannot see. Establish an AI inventory and vetting process. If your organization does not have a platform for documenting all AI tools, building one is a starting point.
AI for Healthcare training can equip managers to understand the fundamentals of AI governance and risk assessment. Ensure you develop that capability before your organization encounters a compliance issue that requires it.
Your membership also unlocks:
