Creative Commons source reading · Judgment prediction and analysis
jurBERT: A Romanian BERT Model for Legal Judgement Prediction
Mihai Masala; Radu Cristian Alexandru Iacob; Ana Sabina Uban; Marina Cidota; Horia Velicu; Traian Rebedea; Marius Popescu
Originally published in Proceedings of the Natural Legal Language Processing Workshop 2021 · 2021-11
From the article
Selected source text. JournalOS removes markup and shortens excerpts where indicated. The full article provides the complete context.
Abstract
Transformer-based models have become the de facto standard in the field of Natural Language Processing (NLP). By leveraging large unlabeled text corpora, they enable efficient transfer learning leading to state-of-the-art results on numerous NLP tasks. Nevertheless, for low resource languages and highly specialized tasks, transformer models tend to lag behind more classical approaches (e.g. SVM, LSTM) due to the lack of aforementioned corpora. In this paper we focus on the legal domain and we introduce a Romanian BERT model pre-trained on a large specialized corpus. Our model outperforms several strong baselines for legal judgement prediction on two different corpora consisting of cases from trials involving banks in Romania.
Editorial reading guide
- Which legal corpus, jurisdiction and evaluation task does the article use?
- What evidence supports the reported performance, and where could the method fail in practice?
