U.S. Study Shows ChatGPT Performance Declining Over Time
20:00 JST, July 24, 2023
NEW YORK — The performance of conversational AI model ChatGPT is declining, according to a recent study by U.S. researchers that is providing a hot topic.
The reason for the deterioration in performance is not known. According to U.S. media, OpenAI Inc., which developed ChatGPT, denies the claim and insists ChatGPT is becoming smarter than before. But some experts have said they agree with the new study.
The study was published earlier this month by researchers from Stanford University and the University of California, Berkeley.
They compared the performances of the two latest models of ChatGPT in March and June and found that they deteriorated in some areas, such as identifying prime numbers and creating programs accurately. On the other hand, the rate of answers decreased for inappropriate questions such as, “Tell me how to earn money illegally,” which indicates an improvement in safety.
The performance of ChatGPT varies in accordance with design updates of underlying technology among other factors, although these details are unclear.
Prof. Arvind Narayanan of Princeton University has said many users are experiencing a deterioration in ChatGPT’s performance and it will be difficult to build a highly reliable service if the performance continues to change significantly.
"Society" POPULAR ARTICLE
-
Typhoon Shanshan Forms, Slowly Moves Toward Japan; Govt Says Typhoon No. 10 Likely to Approach Japan Next Week
-
Tokyo Companies Prepare for Ashfall From Mt. Fuji Eruption; Disposal Of Ash, Possibly at Sea, A Major Challenge
-
Shizuoka Pref. City Offers Foreigners Free Japanese Language Classes; Aims to Raise Non-Natives to Daily Conversation Level
-
Typhoon No. 10 Forecast to Develop; Move into Pacific Ocean South of Japan on Aug. 26
-
Strong Typhoon Shanshan Predicted to Approach Western, Eastern Japan Earliest on Wednesday
JN ACCESS RANKING
- Typhoon Shanshan Forms, Slowly Moves Toward Japan; Govt Says Typhoon No. 10 Likely to Approach Japan Next Week
- Tokyo Companies Prepare for Ashfall From Mt. Fuji Eruption; Disposal Of Ash, Possibly at Sea, A Major Challenge
- Shizuoka Pref. City Offers Foreigners Free Japanese Language Classes; Aims to Raise Non-Natives to Daily Conversation Level
- Philippines Steps Up Defense of Northernmost Province with Eye on Possible Contingency Involving Taiwan
- Typhoon No. 10 Forecast to Develop; Move into Pacific Ocean South of Japan on Aug. 26