UPDATED 19:51 EST / SEPTEMBER 14 2023

AI

Automated evaluation and security platform startup Patronus AI launches with $3M in funding

Automated evaluation and security platform Patronus AI Inc. today launched out of stealth mode and announced that it has raised $3 million in seed funding.

Founded by machine learning experts Anand Kannappan and Rebecca Qian, both former Meta Platforms Inc. employees, Patronus has been designed to tackle the difficulties of evaluating artificial intelligence outputs and the challenge of large language model evaluation for enterprises.

The Patronus platform is claimed to be the first automated evaluation and security platform that helps companies use LLMs safely. The platform uses AI to enable enterprise development teams to score model performance and generate adversarial test cases and benchmark models.

Patronus AI automates and scales the manual and costly model evaluation methods commonly found in enterprises to enable organizations to confidently deploy LLMs while minimizing the risk of model failures and misaligned outputs. The platform uses machine learning technology to test and score any language model in order to identify potential failures.

The platform automates scoring, ranking model performance in real-world scenarios and key criteria like hallucinations and safety. Patronus AI also automatically gnerates adversarial test suites at large scale and benchmarking compares models to help customers identify the best model for specific use cases.

“Every company is looking for ways to use LLMs today, yet they are concerned that unexpected model behavior, incorrect outputs and hallucinations will put their business and customers at risk,” Chief Executive Kannappan said in a statement. “Whether off-the-shelf, open-source or custom, models today remain inadequately vetted and tested in real-world scenarios. And until now, the process of evaluating LLMs has been extremely inefficient and unscalable, producing unreliable results.”

The company launched with $3 million in seed funding in a round led by Lightspeed Venture Partners L.P. Factorial Capital LLC, the CEO of Replit Inc. Amjad Masad, Gokul Rajaram and several Fortune 500 executives and board members also participated in the round.

Image: Patronus AI

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.