Frightening AI data blind spot for businesses revealed

Your staff could be feeding confidential business data straight into the public domain via AI platforms like ChatGPT.

96% of organisations don’t know how to stop ChatGPT training on their data, according to compliance specialist Legal Island.

Legal Island has issued a stark warning to employers: Your staff could be feeding confidential business data straight into the public domain; and you, or in fact they,  probably don’t even know it.

“If your staff are using ChatGPT with the training function left on, you’re potentially leaking commercially sensitive data into a giant AI engine. That data could pop up in someone else’s prompt next week”

Before using ChatGPT, users can disable its training mode, a setting that, when left on, allows OpenAI to store and use input data to refine future responses.

With offices in Northern Ireland and the Republic of Ireland, Legal Island has been guiding HR professionals through the complexities of workplace compliance since 1998.

A data breach in the making

It became apparent to Legal Island that many employers are allowing the use of ChatGPT without any proper training, and without making their employees aware of the importance of turning off the training function before using the tool. 

A new survey of 100+ organisations, conducted by Legal Island, found that just 4% of users knew how to disable ChatGPT’s training function, the simple privacy toggle that prevents OpenAI from reusing sensitive data. 

“When the training feature is left switched on, OpenAI can capture the information entered into ChatGPT and recycle it to improve future outputs,” said Barry Phillips, chair of Legal Island and author of a new book, ‘ChatGPT in HR’.

“If your staff are using ChatGPT with the training function left on, you’re potentially leaking commercially sensitive data into a giant AI engine. That data could pop up in someone else’s prompt next week. It’s a legal, reputational, and regulatory mess waiting to happen.”

Phillips continued: “While it’s encouraging that employees are embracing ChatGPT and teaching themselves how to use it, the lack of formal training is alarming. Our research shows a worrying knowledge gap as most employees in Ireland don’t even know the tool has a training function, let alone how to disable it.”

To address this compliance crisis, Legal Island has developed a free 10-minute e-learning module for employees, showing them exactly how to use ChatGPT safely, including how to switch off the training function before entering any data.

Kellie Shields, chief compliance officer at Legal Island, added: “People treat GenAI like a harmless toy, it’s anything but. Without proper training, it’s a data breach in the making. This issue is too important to ignore, so we’re encouraging employers to take action today and avail of the free compliance training.”

  • Bank of Ireland is welcoming new customers every day – funding investments, working capital and expansions across multiple sectors. To learn more, click here

  • Listen to the ThinkBusiness Podcast for business insights and inspiration. All episodes are here. You can also listen to the Podcast on:

  • Spotify

  • SoundCloud

  • Apple

 
ThinkBusiness
ThinkBusiness.ie, powered by Bank of Ireland, has been created for Irish business owners and managers who are seeking information, resources and help on a range of business topics. It provides practical, actionable information and guidance on starting, growing and running a business.

Recommended