HomeTechOpen AI hit with lawsuit in California over Hugging Face rogue agent...

Open AI hit with lawsuit in California over Hugging Face rogue agent incident

California Attorney General Rob Bonta today announced the state has launched a lawsuit against OpenAI Group PBC after the company’s AI agents earlier this year went rogue and hacked the open-source AI platform Hugging Face Inc.

The 31-page lawsuit, filed in San Francisco Superior Court, claims Open AI has engendered the public and put institutions at risk by developing products without suitable safeguards. Bonta likened Open AI’s behavior to being a “public nuisance,” asking the judge to order the company to change its practices while imposing financial penalties for any money the company made from the high-risk areas of its business.

“OpenAI’s actions escalated real-word cybersecurity risks, threatening the safety, health, and well-being of society,” Bonta said in a statement at a press conference. “The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it — this disregard for public safety violated California law.”

Bonta believes that without external pressure, the scope and frequency of such attacks will increase in the future. “In California, we value innovation, but we demand innovation that follows the law — no matter the product or the company,” he added.

The “unprecedented” rogue attack in question occurred on July 21 this year when one of Open AI’s agents escaped what was supposed to be an isolated testing environment — a sandbox. To break out of their restricted environment and access the internet, the AI models exploited a previously unknown security flaw in OpenAI’s systems. From there, they gained access to other parts of the company’s network, stole login credentials, and exploited further security weaknesses to break into Hugging Face’s servers.

In response to the lawsuit, OpenAI spokesperson Drew Pusateri said he believes the company has been singled out when similar challenges have been faced at other major AI firms. “Since the Hugging Face incident, we’ve undertaken an extensive and transparent effort to understand and address misaligned model activity,” he told media, adding that the company will continue to work with the state and share information to ensure public and institutional safety.

Nonetheless, Bonta has expressed skepticism about Open AI’s willingness to conform to safety practices, writing that through a “lack of transparency and misrepresentations” the company has continued to develop dangerous models with the ability to deceive and engage in malicious behavior.

Open AI is already facing lawsuits in eight states over a number of incidents. The company stands accused of developing technologies that have harmed the public by providing dangerous medical advice or steering people to make bad, sometimes harmful, decisions that threaten their safety.

Photo: Unsplash

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network

Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/

About SiliconANGLE Media

SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.

 

Must Read

spot_img