Spots 
Silicon Valley Democratic Rep. Ro Khanna will introduce a bill to regulate artificial intelligence, which includes strict liability standards and a ban on "recursive" AI until the government creates safeguards.
The bill, shared first with CNBC, comes amid a push for Washington to regulate AI after top executives warned the technology could get out of their control.
The proposal is the latest in a growing list of measures being put forward in Congress as lawmakers mull how to regulate AI.
Silicon Valley Democratic Rep. Ro Khanna will introduce a bill to regulate artificial intelligence, which includes strict liability standards and a ban on "recursive" self-improving AI until the government creates safeguards.
The bill comes amid a push for Washington to regulate AI after top executives warned the technology could become out of their control. Congress has largely done nothing to regulate the technology, which is undergirding the economy but could cause catastrophic damage if it goes wrong.
"There's actually a civilizational extinction risk," Khanna said Monday in an interview with CNBC. "There's a safety risk of loss of control, and then there's a misuse risk, and we need to take both seriously."
Khanna's bill, a summary of which was shared exclusively with CNBC, is dubbed the "Human Control Over AI Act" and would ban models that recursively self-improve or autonomously modify their own core objectives, containment or shutdown controls until federal guardrails exist and an agency approves the activities.
The bill would also create a new federal agency to focus on AI models from OpenAI, Anthropic, Google DeepMind and xAI as the companies find themselves in the spotlight amid rapidly escalating safety concerns.
The agency would be tasked with creating safety regulations, a licensing system to approve model training and deployment, frontier AI model audits and setting security standards for continuous testing and effective human control. Read more CNBC politics and policy coverage
Independent auditors would also be required to be embedded at every frontier lab and report to the agency directly. The agency would also create standards covering sandbox testing environments; air gaps, or isolating testing environments from the internet; kill switches; and controls that prevent models from escaping lab settings and roaming on the Internet. It would also be responsible for regulating the advanced chips that frontier labs use, including mechanisms to monitor or control their use. The bill would also create new legal penalties for AI gone awry.
Silicon Valley Democratic Rep.