California tightens AI vendor oversight through executive order
California Gov. Gavin Newsom issued an executive order Monday requiring state agencies to overhaul procurement standards and demand that AI companies contracting with the state demonstrate how their systems mitigate risks including bias, civil rights violations, and illegal content.
The order reflects escalating tension between states and Washington over AI regulation. The federal government has discouraged state-level rules in favor of a national framework, but California officials argue stronger guardrails are needed as AI systems become embedded in public services.
"California leads in AI, and we're going to use every tool we have to ensure companies protect people's rights, not exploit them or put them in harm's way," Newsom said in a statement.
What the order requires
California's Government Operations Agency and Department of Technology have 120 days to develop new certification and vetting processes for state vendors. Contractors must document safeguards against discrimination, privacy harms, and other misuse before deploying tools in public services.
The order also calls for statewide standards on watermarking AI-generated content to help curb misinformation and improve transparency. This builds on legislation California passed last year requiring large AI developers to disclose safety practices.
Broader AI expansion plans
Alongside the order, Newsom announced plans to expand the state's use of generative AI tools to improve public services. The state is developing systems designed to help residents navigate benefits and programs based on life events, such as starting a business or finding a job.
Government officials implementing these policies may benefit from understanding the broader context of AI governance. Resources like the AI Learning Path for Policy Makers cover regulatory frameworks and oversight standards relevant to procurement decisions.
Your membership also unlocks:
