Can AI Compete with Human Lawyers?
AI Takes the Bar Exam
One of the United Kingdom’s largest law firms Linklaters conducts artificial intelligence experiments where the AI participates in bar examinations. The LinksAI English Law Benchmark serves as the name for this initiative. The LinksAI English Law Benchmark already exists in two separate formats. The study aims to evaluate if AI systems possess the capability to perform advanced legal analysis and provide reliable legal advice.
How complex are the tests? They are more than basic multiple-choice quizzes. The legal challenges become increasingly complex for AI models like OpenAI’s GPT and Google’s Gemini. Responding to the benchmark requires answering detailed legal questions through extensive reasoning and precise citations while providing clear explanations. Human experts scrutinize the responses to detect errors and logical issues as well as AI “hallucinations” which generate invented legal details.
The Results: A Mixed Verdict
The preliminary evaluations in 2023 failed to generate positive expectations. AI models experienced significant accuracy problems when attempting legal source citations. The top performer at that time which became Gemini as Bard managed to score only a mediocre 4.4 out of 10. The feedback showed many responses with invented legal references that appeared legitimate despite being false.
After two years AI systems now promise enhanced performance. OpenAI’s current model achieved a score of 6.4 but Google Gemini was close behind at 6. Even though AI systems demonstrate increasing accuracy levels and fewer citation mistakes their performance is currently not comparable to that of trained legal professionals.
Can AI Replace Lawyers?
Linklaters maintains that AI technology still lacks the capability to deliver independent legal advice. The intricacies of legal interpretation and ethical analysis combined with context-specific understanding demand human supervision. AI functions as a fast legal assistant by performing document reviews and research while lacking the capability to represent clients in court.
Other firms are also wary. Hill Dickinson is limiting its use of AI technology within its UK operations because of doubts about its consistent performance and risk of improper application.
Currently, artificial intelligence systems function as supportive tools in legal advice without replacing human lawyers. Legal professionals pay close attention to technological progress since AI could eventually pass bar exams with exceptional results.
If you are interested about the Top AI Project Ideas for 2025 click here.
