“ChatGPT is nothing revolutionary,” says Meta’s chief scientist

ChatGPT is undoubtedly one of the most discussed topics on the web in recent months, due to the promise of being a totally innovative technological tool. However, that’s not the thinking of some AI experts, like Yann LeCun, chief scientist on Meta’s AI team.

The scientist claims that the ChatGPT company has not particularly brought a breakthrough compared to the other works of various laboratories. “It’s not just Google and Meta, but there are half a dozen startups that basically have very similar technology,” LeCun said. “I don’t want to say it’s not rocket science, but it’s really shared, there’s no secret behind it,” he added.

Additionally, LeCun noted that ChatGPT and its core program, GPT-3 by OpenAI, are made up of different technologies developed over the years. And they are works that have been produced by several subjects.

“You have to realize that ChatGPT uses Transformer architectures that are pre-trained in this self-supervised way,” he noted. “Self-supervised learning is something I’ve been advocating for a long time, even before OpenAI existed,” she added.

LeCun pointed out that Transformers is an invention of Google. He was referring to the linguistic neural network that the tech giant launched in 2017 and which has become the basis for a wide range of linguistic programs, including ChatGPT’s GPT-3.

Meta’s lead scientist also mentioned the extensive use of ChatGPT’s “reinforcement learning” technique. According to him, this feature uses human feedback and has real agents help rank the performance of the machine to optimize it, something very similar to Google’s Page Rank algorithmic process.

LeCun’s comments came in response to the The New York Times on the involvement of the Meta AI team in a work similar to that of OpenAI. The question asks if the team could get noticed by the public with previews like ChatGPT.

“Will we see it from Meta? Yeah, let’s see,” he replied. “And not only generate text, but also help creation,” added LeCun, who called generative art a “great thing,” a technique that creates artistic images using algorithms software.

information via ZDNet

The post “ChatGPT is nothing revolutionary,” says Meta’s chief scientist, first appeared on Olhar Digital.

Source: Olhar Digital