
The developers of GPT-4 reclaimed that the program may exhibit “human level performance” on certain tests. While the score chart for various academic tests seems impressive at first, the software failed both AP English exams with a 2 out of 5. It scored extremely well on tests where all a computer program needed was the correct information, which is not very impressive to anyone who has used Google in the last few decades.
Again, I don’t think we’re suddenly bloody lawyers. As someone who has actually done reasonably well on the LSAT, I can also tell you that taking the test and practicing law are very different things. Law exams are all about pattern recognition, which is exactly what AI was created for. AP exams work in a similar way, and you can answer a large number of questions by word association.
In fact, I’m glad the GPT-4 can score well on the more routine tests that just measure how much time you’ve spent punching cards. I have never believed in exams that require students to memorize tons of information. Your failure to pass your English exams is proof that critical thinking is the most important skill you can get from education.