ChatGPT's Reliability Questioned – Not in Line With GDPR

Questions about AI tools like ChatGPT and their ability to provide accurate information under GDPR have drawn increasing attention. The case involving NOYB's request for an investigation into OpenAI's processing of personal data highlights the legal and ethical challenges that come with new…

Share
ChatGPT's Reliability Questioned – Not in Line With GDPR

Since the launch of ChatGPT, use of this chatbot has increased dramatically. ChatGPT is used for various purposes, from homework help to research tasks. According to OpenAI, the application generates responses by predicting the most likely words to follow a user's question. The problem is that there's no way to guarantee that the information ChatGPT provides is actually accurate. This type of generative AI tool is known to regularly "hallucinate," meaning it makes up answers.

In the EU, requirements regarding the accuracy of personal data are strict, as set out in Article 5 of the GDPR. Individuals also have the right to rectification under Article 16 of the GDPR if the information is incorrect, and can request that inaccurate information be deleted. This also includes the right of access under Article 15, which requires companies to be able to account for what data they hold about individuals and its sources.

OpenAI's Challenges With GDPR

Maartje de Graaf, data protection lawyer at NOYB (short for None of Your Business), points out that it's problematic when false information about individuals is generated. OpenAI has been unable to demonstrate that it can make ChatGPT compliant with EU data protection laws when it comes to processing individuals' data. If the system can't produce accurate and transparent results, it shouldn't be used to generate data about individuals.

Specific Cases and Shortcomings

According to a report from The New York Times, "chatbots invent information at least 3 percent of the time – and up to 27 percent." This includes incorrect data about individuals' birthdays, which ChatGPT has repeatedly given wrong answers about. Despite the inaccuracy of the data ChatGPT provided about a complainant's date of birth, OpenAI has refused to correct or delete the information, arguing that it wasn't possible to correct the data.

Actions and Progress

NOYB has now filed a complaint with the Austrian data protection authority (DSB) to investigate OpenAI's data processing and the measures taken to ensure the accuracy of the personal data being processed. They're also requesting that the DSB require OpenAI to comply with the complainant's access request and align its processing with the GDPR.