US Commerce Department Signs AI Model Review Agreements with Google, Microsoft, and xAI

Microsoft will work with US government scientists to test AI systems in ways that probe unexpected behaviors. Microsoft and the US government will develop shared datasets and workflows for testing Microsoft's models. Microsoft regularly undertakes many types of AI testing on its own, but testing for national security and large-scale public safety risks must be a collaborative endeavor with governments, according to a Microsoft blog post.

Microsoft announced a similar agreement in the UK on Tuesday with the government-backed AI Security Institute, which focuses on safe AI development. Evaluations of AI models from the companies will cover testing, collaborative research, and best practice development related to commercial AI systems.

These expanded industry collaborations help scale work in the public interest at a critical moment, Chris Fall, CAISI director, stated.

Google and xAI did not immediately respond to requests for comment. The new pacts expand on agreements by OpenAI and Anthropic reached during the Biden administration.

Anthropic limited its rollout of Mythos to a few companies. Anthropic initiated Project Glasswing to bring together tech companies to secure the world's most critical software. Anthropic has been embroiled in a dispute with the Pentagon over guardrails on the military's use of its AI tools.

The Pentagon reached agreements last week with seven AI companies to deploy their advanced capabilities on the Defense Department's classified networks. The Pentagon announcement did not include Anthropic. Anthropic is mired in a lawsuit with the US Department of Defense over refusal to drop safety guardrails for government use of its models.

Senior members of Trump's staff met last month with Anthropic CEO Dario Amodei. The New York Times and Wall Street Journal reported on Monday that the Trump administration was mulling a potential executive order to create government oversight for AI tools. The Trump administration characterized the reporting on the executive order as speculation.

The White House is considering a new AI working group that would explore potential oversight and vet models before release, according to CNBC. Leading AI companies will give the Commerce Department early access to new systems, The Washington Post reported. Microsoft, Google, and xAI agreed to share AI models with the White House for security reviews, as stated by the New York Post.

CAISI will conduct pre-deployment evaluations and targeted research to understand capabilities and risks of new tools. The deal comes days after the Pentagon announced an agreement with seven tech giants to use AI in classified systems, according to Al Jazeera. Google, Microsoft, and xAI agreed to voluntarily submit their models for testing through CAISI, The BBC reported.