A University of Pennsylvania professor recently conducted research and found that ChatGPT, an artificial intelligence-based chatbot, aced the MBA final exam at the university’s Wharton School.
The University of Pennsylvania is ranked 13th in the QS World University Rankings 2023 and 14th in THE World University Rankings 2023.
Titled “Would Chat GPT3 Get a Wharton MBA? A prediction based on his performance in the operations management course,” the survey revealed that the GPT-3 got grades between B- and B.
Professor Christian Terwiesch, the author of the research paper, revealed that GPT-3 demonstrated a “remarkable ability to automate some of the skills of highly rewarded workers in general and knowledge workers in particular in the jobs held by MBA graduates, including analysts , managers. , and advisors.”
According to the survey, GPT-3 did an “amazing job on key operations management and process analysis questions, including those based on case studies.”
Professor Terwiesch also noted that the GPT-3 responses proved to be “excellent”.
In addition, GPT-3 showed an “extremely good” ability to modify its explanations in response to human cues, the professor concluded.
However, Terwiesch’s findings have raised concern among educators who fear that AI-based chatbots like GPT-3 could inspire cheating. The New York Department of Education recently banned ChatGPT from its schools.
Many experts working in both education and artificial intelligence have stated that chatbots like ChatGPT could be a disruption to education in the coming years. However, a few experts say they’re not worried just yet.
Professor Terwiesch and a spokesman for OpenAI, the company behind GPT, had no comment on the development.
It is worth noting that the GPT-3 model used in the research was an older version of the more recent ChatGPT bot. The latest variant, ChatGPT, is “optimized from a GPT-3.5 series model,” according to OpenAI’s website.
While the GPT-3’s results were remarkable, Terwiesch noted that the GPT-3 “occasionally makes surprising mistakes on relatively simple calculations at the 6th grade math level.”
The current version of ChatGPT “is not capable of handling more advanced process analysis questions, even when they are based on fairly standard patterns,” Terwiesch said.
Still, Terwiesch said Chat GPT-3’s performance in the test has:
Important implications for business school education include the need for testing policies, curriculum design that focuses on human-AI collaboration, opportunities to simulate real-world decision-making processes, the need to teach creative problem solving, improved teaching productivity, and more .