Categories: Technology

However, this online tool can recognize AI-generated texts, the developers warn

Let ChatGPT do their homework quickly? The developer company behind the hyped AI chatbot, OpenAI, is making a tool available for free that claims to recognize computer-generated text.

Despite all the enthusiasm, there are many reservations about the text robot ChatGPT. For example, he could help with cheating at school or college. But in the future, a new tool should be able to distinguish between AI-generated texts and content written by humans.

The makers of the writing software ChatGPT are now trying to get a grip on the consequences of their invention. The developer company OpenAI has released a program that has to distinguish whether a text is written by a human or a computer.

How does it work?

To the «AI Text Classification» go here, which requires prior registration on the OpenAi website.

The developers point out limitations:

  • The text to be checked must contain at least 1000 characters, which corresponds to approximately 150-250 words.
  • The tool is likely to make mistakes with children’s texts and texts that are not in English because it is mainly trained on English content written by adults.
  • AI-generated text can be “easily edited” to circumvent or fool the tool.
  • Both AI-generated and human-written text can be misjudged.

After checking, the text is classified as “very unlikely”, “unlikely”, “unclear” (unclear if so), “possible” or “likely” (probably) AI generated.

The detection still works poorly, as OpenAI admitted in a blog post on Tuesday. In test runs, the software correctly identified texts written by a computer in 26 percent of cases.

At the same time, however, nine percent of human-formulated texts were wrongly assigned to a machine. It is therefore recommended not to rely primarily on the assessment of the “classifier” when assessing the texts.

Can the tool be used to detect fraud?

ChatGPT is so good at mimicking human speech that there are concerns, among other things, that it could be used to cheat schoolwork or create large-scale disinformation campaigns.

In education in particular, there is discussion about how the content of a text robot can be exposed. It seems certain: with a classic plagiarism scanner, with which you can effectively check the authenticity of texts, you will not get any further. These scanners only check whether the text or parts of it already exist in other sources. However, ChatGPT’s AI writer produces unique texts that have never been precisely worded.

The developers of OpenAI point out that their online tool is not suitable for unequivocally recognizing texts generated by the AI. Accordingly, it is not suitable for exposing cheating in housework and the like.

“The results can be useful in deciding whether a document has been created using AI, but should not be the only piece of evidence. The model is trained on human-written text from various sources. These are not necessarily representative of all types of texts written by humans.”

The AI ​​text rating is intended to encourage discussion about the distinction between human-written and AI-generated content, the developers said.

And what about texts written in collaboration between man and machine? The effectiveness of the tool has not been studied in detail before this.

American journalists (BleepingComputer) have already tested the AI ​​text classification and come to the conclusion that the results are largely inconclusive.

The success rate should increase as the tool is trained with even more data. It is currently not a reliable tool for detecting AI-generated content.

What about privacy?

The American company states that anyone who inserts a (copied) text for automatic checking on the OpenAI website and forwards it to the server agrees to the terms of use and data protection rules. That means, among other things:

  • Personal information is transferred to facilities and servers in the United States, which are known to have less stringent data protection regulations.
  • The entered data (texts) can be used to train and improve the AI.
  • OpenAI does not guarantee the security of this data, which could fall into the wrong hands.
  • OpenAI may transfer personal data to third party companies and service providers.

Why should AI-generated texts be treated with caution?

ChatGPT is artificial intelligence based software trained on massive amounts of text and data to mimic human speech. OpenAI made ChatGPT publicly available last year, sparking admiration for the software’s capabilities and concerns about fraud.

The system convinces above all by the linguistic quality of its answers. At the same time, users cannot trust ChatGPT to actually answer truthfully and get the facts straight. Critics of the system are also annoyed that the AI ​​system cannot cite sources for its statements.

With OpenAI, the use of a kind of digital watermark for ChatGPT in a conversation that would be invisible to the human eye. A special verification software would then signal whether it is an AI text or not.

Where’s Google?

The hype around ChatGPT is now also scaring the hell out of the competition. The Google group Alphabet in particular sees this as a serious threat to its own business model. Google has also been developing software that can write and speak like a human for years, but has not yet published it.

Now the internet company has employees test a chatbot that works similar to ChatGPT, broadcaster CNBC reports Wednesday evening. An internal mail states that an answer to ChatGPT has priority. Google is also experimenting with a question-and-answer version of its Internet search engine.

Sources

  • openai.com: New AI classification for indicating AI-written text
  • bloodcomputer.com: OpenAI releases tool to detect text written by AI

(dsc/sda/awp/dpa)

Source: Watson

Share
Published by
Ella

Recent Posts

Terror suspect Chechen ‘hanged himself’ in Russian custody Egyptian President al-Sisi has been sworn in for a third term

On the same day of the terrorist attack on the Krokus City Hall in Moscow,…

1 year ago

Locals demand tourist tax for Tenerife: “Like a cancer consuming the island”

class="sc-cffd1e67-0 iQNQmc">1/4Residents of Tenerife have had enough of noisy and dirty tourists.It's too loud, the…

1 year ago

Agreement reached: this is how much Tuchel will receive for his departure from Bayern

class="sc-cffd1e67-0 iQNQmc">1/7Packing his things in Munich in the summer: Thomas Tuchel.After just over a year,…

1 year ago

Worst earthquake in 25 years in Taiwan +++ Number of deaths increased Is Russia running out of tanks? Now ‘Chinese coffins’ are used

At least seven people have been killed and 57 injured in severe earthquakes in the…

1 year ago

Now the moon should also have its own time (and its own clocks). These 11 photos and videos show just how intense the Taiwan earthquake was

The American space agency NASA would establish a uniform lunar time on behalf of the…

1 year ago

This is how the Swiss experienced the earthquake in Taiwan: “I saw a crack in the wall”

class="sc-cffd1e67-0 iQNQmc">1/8Bode Obwegeser was surprised by the earthquake while he was sleeping. “It was a…

1 year ago