Sitemap
Cloud Security

Cybersecurity Attacks and Defenses. New blog: teriradichel.substack.com

ChatBot Security

Taking a look at the security risks associated with ChatBots

19 min readSep 18, 2024

--

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

⚙️ A series on Security Automation. The Code.

🔒 Related Stories: Cybersecurity | Penetration Tests | AI

💻 Free Content on Jobs in Cybersecurity | ✉️ Sign up for the Email List

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

I was just sent a message related to ChatBots and it led me to write this quick post on the topic. There may be typos as I’m in a hurry with too much to do, as always. Here’s a summary of some of the security issues related to ChatBots.

Illegal Activity

Let’s just start by saying AI chatbots are being used by cybercriminals — a lot. Here’s an example of one study that found 3,000 discussions on the dark web related to using AI ChatBots for illegal purposes.

3000 discussions on Dark Web Posts:

https://cybersecuritynews.com/3000-discussions-on-dark-web-posts/

Jail Breaking

Jail breaking tries to make an AI engine ignore it’s guardrails. An attacker is trying to bypass restrictions set for the chatbot.

In a study by Immersive Labs, people were giving 10 levels of challenges to retrieve a password from a Chatbot. 17% of users could still defeat system GuardRails at level 10…

--

--

Teri Radichel
Teri Radichel

Written by Teri Radichel⁠

CEO 2nd Sight Lab | Pentesting | Research | AWS Security Hero | Masters of Infosec & Masters Software Engineering | GSE | IANS | SANS Difference Makers Award