Verbal idioms of European Portuguese: An annotated corpus

Le résumé fourni par la source

This chapter introduces VIDiom-PT, a corpus of European Portuguese annotatedfor verbal idioms (e.g. O Rui bateu a bota ”Rui hit the boot” ”Rui died”). This linguistic resource is intended to support the development of Natural Language Processing systems capable of identifying and handling such constructions in this language variety. Two custom tools were developed to facilitate the annotation process: one for detecting potential instances of verbal idioms in texts, and another offering a graphical interface for manual annotation. The annotation effort resultedin a corpus comprising 5,178 instances of 747 distinct verbal idioms, drawn from adataset of over 200,000 sentences. Annotation reliability was assessed using Krippendorff’s alpha for nominal data, achieving a high agreement score of 0.869 basedon 5% of the data independently annotated by three experts. A portion of the annotated corpus has been made publicly available. We perform a series of experimentswith a Large Language Model to assess its ability to identify instances of idiomaticexpressions. We explore prompts with varying degrees of information, as well asdifferent approaches to example selection. Overall, the results show that providingseveral examples that are tailored to the expression being analyzed has a positiveimpact on the performance of the LLM in this task.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.