OpenAI shutters AI detector due to low accuracy

1 year ago

OpenAI has softly pulled the plug connected its AI Classifier, which aimed to assistance teachers, professors and others separate betwixt human- and AI-written substance

1763 Total views

13 Total shares

OpenAI shutters AI detector owed  to debased  accuracy

Artificial quality powerhouse OpenAI has discreetly pulled the pin connected its AI-detection software, citing a debased complaint of accuracy.

The OpenAI-developed AI classifier was archetypal launched connected Jan. 31 and aimed to assistance users, specified arsenic teachers and professors, successful distinguishing human-written substance from AI-generated text.

However, per the archetypal blog post that announced the motorboat of the tool, the AI classifier has been unopen down arsenic of July 20:

“As of July 20, 2023, the AI classifier is nary longer disposable owed to its debased complaint of accuracy.”

The nexus to the instrumentality is nary longer functional, portion the enactment offered lone elemental reasoning arsenic to wherefore the instrumentality was unopen down. However, the institution explained that it was looking astatine new, much effectual ways of identifying AI-generated content.

“We are moving to incorporated feedback and are presently researching much effectual provenance techniques for text, and person made a committedness to make and deploy mechanisms that alteration users to recognize if audio oregon ocular contented is AI-generated,” the enactment read.

OpenAI's erstwhile AI classifier successful action. Source: OriginalityAI

From the get go, OpenAI made it wide the detection instrumentality was prone to errors and could not beryllium considered “fully reliable.”

The institution said limitations of its AI detection instrumentality included being “very inaccurate” astatine verifying substance with little than 1,000 characters and could “confidently” statement substance written by humans arsenic AI-generated.

Related: Apple has its ain GPT AI strategy but nary stated plans for nationalist release: Report

The classifier is the latest of OpenAI’s products to travel nether scrutiny.

On July 18, researchers from Stanford and UC Berkeley published a survey indicating that OpenAI’s flagship merchandise ChatGPT was getting importantly worse with age.

We evaluated #ChatGPT's behaviour implicit clip and recovered important diffs successful its responses to the *same questions* betwixt the June mentation of GPT4 and GPT3.5 and the March versions. The newer versions got worse connected immoderate tasks. w/ Lingjiao Chen @matei_zaharia https://t.co/TGeN4T18Fd https://t.co/36mjnejERy pic.twitter.com/FEiqrUVbg6

— James Zou (@james_y_zou) July 19, 2023

Researchers recovered that implicit the people of the past fewer months, ChatGPT-4’s quality to accurately place premier numbers had plummeted from 97.6% to conscionable 2.4%. Additionally, some ChatGPT-3.5 and ChatGPT-4 witnessed a important diminution successful being capable to make caller lines of code.

Collect this nonfiction arsenic an NFT to sphere this infinitesimal successful past and amusement your enactment for autarkic journalism successful the crypto space.

AI Eye: AI’s trained connected AI contented spell MAD, is Threads a nonaccomplishment person for AI data?

View source