GPT-2 text generator released at full strength


AI text generator GPT-2 is now fully available. The complete code and associated data was released by OpenAI, the California AI lab that created the model. The algorithm extrapolates text from a prompt phrase or sentence.

You can try out the full strength version on an independent website, TalkToTransformer.com.

  • OpenAI made headlines for GPT-2 in February when its initial release withheld much of the underlying data. The company said the model was ‘too dangerous’ to make available in its entirety. Subsequent updates provided progressively larger pieces.
  • Concern centred on bad actors using GPT-2 to generate convincing deceitful narratives, for example for news fakery or flooding websites with adverse reviews.
  • Early reviews of GPT-2 storytelling are mixed. Some commentators say text coherence is convincing to start and then deteriorates as more words are generated.

A study at Cornell University gives the full model a credibility score of 6.91 out of a possible 10 points. OpenAI says its decision to release the complete version was influenced by this score not changing significantly from its previous release.

  • The company has noticed ‘no strong evidence of misuse so far,’ but ‘humans find GPT-2 outputs convincing.’
  • Still, they warn GPT-2 can be fine-tuned for misuse‘ and the text it creates can be ‘challenging’ to detect.
  • OpenAI has created its own detection model to combat malicious uses of their model. ZDNET and THE VERGE report the OpenAI counter-model has reached about 95% effectiveness. OpenAI continues to encourage increased human vigilance regarding possible deceptions.

The original decision to phase release of GPT-2 split opinions in the AI research community.

  • Some argued it was a publicity stunt, counter to conventional practices of releasing source materials to assist research efforts by others.
  • Others believed it was responsible practice given the potential for abuse and its consequences.
  • Either way, the nine months from first to full release provided OpenAI a head-start to study possible uses of the full model.

SEE RELATED STORIES

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.