

Application security testing firm Checkmarx Ltd. today announced the CheckAI GPT Plugin, a plugin designed to detect and prevent potential attacks against ChatGPT-generated code.
The CheckAI GPT Plugin is designed to allow developers and security teams to defend against attacks instigated by malicious open-source packages and dependencies within the ChatGPT interface. When combined with Checkmarx’s Supply Chain Threat Intelligence, the plugin provides a comprehensive security framework.
Using the plugin, development teams can leverage GenAI tools such as ChatGPT while staying compliant with AppSec standards. The plugin allows for scanning GPT-generated code for vulnerabilities directly within the ChatGPT interface and provides instant feedback on potential vulnerabilities or open-source package validation.
The plugin is designed to counter emerging generative AI-specific attacks, including “AI hallucinations” and prompt injections. AI hallucinations are instances where AI systems produce outputs that are not based on actual data or relevant context but are instead anomalous or unexpected results because of biases, limitations or errors in training data or algorithms. Future releases of CheckAI GPT are planned to expand use cases to prompt protection, infrastructure-as-code validations and application programming interface validation.
CheckAI GPT is powered by Checkmarx One, an application security platform that offers scalability and seamless integration within preferred development environments. Combined with its Supply Chain Threat Intelligence, the CheckAI plugin delivers protection against malicious open-source packages and dependencies.
“We’re already seeing new attacks against generative AI solutions, including ‘AI hallucinations’ and prompt injections, and the OWASP Foundation has already published the first draft of the OWASP Top 10 list for LLMs,” Ori Bendet, vice president of product management at Checkmarx, said ahead of the release.
As more and more people embrace AI, particularly at an enterprise level, security vetting systems and plugins like Checkmarx’s CheckAI GPT are likely to become more prevalent relative to the uptake of AI technology.
Support our open free content by sharing and engaging with our content and community.
Where Technology Leaders Connect, Share Intelligence & Create Opportunities
SiliconANGLE Media is a recognized leader in digital media innovation serving innovative audiences and brands, bringing together cutting-edge technology, influential content, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — such as those established in Silicon Valley and the New York Stock Exchange (NYSE) — SiliconANGLE Media operates at the intersection of media, technology, and AI. .
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a powerful ecosystem of industry-leading digital media brands, with a reach of 15+ million elite tech professionals. The company’s new, proprietary theCUBE AI Video cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.