Volume 1 · Issue 2

AI, Legal Research & Judgment

Research on the tools that retrieve, read and analyze legal sources, with attention to benchmarks, judicial data, explainability and the cost of error.

100 Creative Commons readings · Ahmed Allem, Editor-in-Chief

Issue 2 · Reading list

Explore the research

Download issue catalog

100 readings · Page 5 of 5

  1. Evaluation, bias and explainability · CC BY 4.0

    Assessing trustworthy AI: Technical and legal perspectives of fairness in AI

    Markus Kattnig, Alessa Angerschmid, Thomas Reichel, Roman Kern

    Computer Law & Security Review · 2024

    Original article
  2. Evaluation, bias and explainability · CC BY 4.0

    Towards Mitigating Perceived Unfairness in Contracts from a Non-Legal Stakeholder’s Perspective

    Anmol Singhal, Preethu Rose Anish, Shirish Karande, Smita Ghaisas

    Proceedings of the Natural Legal Language Processing Workshop 2023 · 2023

    Original article
  3. Evaluation, bias and explainability · CC BY 4.0

    Retrieval-based Evaluation for LLMs: A Case Study in Korean Legal QA

    Cheol Ryu, Seolhwa Lee, Subeen Pang, Chanyeol Choi et al.

    Proceedings of the Natural Legal Language Processing Workshop 2023 · 2023

    Original article
  4. Evaluation, bias and explainability · CC BY 4.0

    Towards an Automated Pointwise Evaluation Metric for Generated Long-Form Legal Summaries

    Shao Min Tan, Quentin Grail, Lee Quartey

    Proceedings of the Natural Legal Language Processing Workshop 2024 · 2024

    Original article
  5. Evaluation, bias and explainability · CC BY 4.0

    Comparative Study of Explainability Methods for Legal Outcome Prediction

    Ieva Staliunaite, Josef Valvoda, Ken Satoh

    Proceedings of the Natural Legal Language Processing Workshop 2024 · 2024

    Original article
  6. Evaluation, bias and explainability · CC BY 4.0

    Gaps or Hallucinations? Scrutinizing Machine-Generated Legal Analysis for Fine-grained Text Evaluations

    Abe Hou, William Jurayj, Nils Holzenberger, Andrew Blair-Stanek et al.

    Proceedings of the Natural Legal Language Processing Workshop 2024 · 2024

    Original article
  7. Evaluation, bias and explainability · CC BY 4.0

    Enhancing Legal Expertise in Large Language Models through Composite Model Integration: The Development and Evaluation of Law-Neo

    Zhihao Liu, Yanzhen Zhu, Mengyuan Lu

    Proceedings of the Natural Legal Language Processing Workshop 2024 · 2024

    Original article
  8. Evaluation, bias and explainability · CC BY 4.0

    Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketing

    Haoyang Gui, Thales Bertaglia, Taylor Annabell, Catalina Goanta et al.

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  9. Evaluation, bias and explainability · CC BY 4.0

    Evaluating the Role of Verifiers in Test-Time Scaling for Legal Reasoning Tasks

    Davide Romano, Jonathan Richard Schwarz, Daniele Giofrè

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  10. Evaluation, bias and explainability · CC BY 4.0

    PILOT-Bench: A Benchmark for Legal Reasoning in the Patent Domain with IRAC-Aligned Classification Tasks

    Yehoon Jang, Chaewon Lee, Hyun-seok Min, Sungchul Choi

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  11. Evaluation, bias and explainability · CC BY 4.0

    Efficient Prompt Optimisation for Legal Text Classification with Proxy Prompt Evaluator

    Hyunji Lee, Kevin Chenhao Li, Matthias Grabmair, Shanshan Xu

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  12. Evaluation, bias and explainability · CC BY 4.0

    ContractEval: Benchmarking LLMs for Clause-Level Legal Risk Identification in Commercial Contracts

    Shuang Liu, Zelong Li, Ruoyun Ma, Haiyan Zhao et al.

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  13. Evaluation, bias and explainability · CC BY 4.0

    LeMAJ (Legal LLM-as-a-Judge): Bridging Legal Reasoning and LLM Evaluation

    Joseph Enguehard, Morgane Van Ermengem, Kate Atkinson, Sujeong Cha et al.

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  14. Evaluation, bias and explainability · CC BY 4.0

    Are LLMs Court-Ready? Evaluating Frontier Models on Indian Legal Reasoning

    Kush Juvekar, Arghya Bhattacharya, Sai Khadloya, Utkarsh Saxena

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  15. Evaluation, bias and explainability · CC BY 4.0

    Translating Tax Law to Code with LLMs: A Benchmark and Evaluation Framework

    Gabriele Lorenzo, Aldo Pietromatera, Nils Holzenberger

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  16. Evaluation, bias and explainability · CC BY 4.0

    Modeling Motivated Reasoning in Law: Evaluating Strategic Role Conditioning in LLM Summarization

    Eunjung Cho, Alexander Miserlis Hoyle, Yoan Hermstrüwer

    Proceedings of the Natural Legal Language Processing Workshop 2025 · 2025

    Original article
  17. Evaluation, bias and explainability · CC BY 4.0

    A LEGAL FRAMEWORK FOR ARTIFICIAL INTELLIGENCE FAIRNESS REPORTING

    Jia Qing Yap, Ernest Lim

    The Cambridge Law Journal · 2022

    Original article
  18. Evaluation, bias and explainability · CC BY 4.0

    AI Model for Predicting Legal Judgments to Improve Accuracy and Explainability of Online Privacy Invasion Cases

    Minjung Park, Sangmi Chai

    Applied Sciences · 2021

    Original article
  19. Evaluation, bias and explainability · CC BY 4.0

    There is no free benchmark: An institutional view of legal AI benchmarking

    Neel Guha, Andy K. Zhang, Christine Tsang, Christopher D. Manning et al.

    Proceedings of the National Academy of Sciences · 2026

    Original article
  20. Evaluation, bias and explainability · CC BY 4.0

    Automation Bias in the AI Act: On the Legal Implications of Attempting to De-Bias Human Oversight of AI

    Johann Laux, Hannah Ruschemeier

    European Journal of Risk Regulation · 2025

    Original article