Posts by Category

The INLG 2024 Tutorial on Human Evaluation of NLP System Quality: Background, Overall Aims, and Summaries of Taught Units Permalink

A Belz, J Sedoc, C Thomson, S Mille, R Huidrom Proceedings of the 17th International Natural Language Generation Conference …, 2024 ...

The 2024 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results Permalink

A Belz, C Thomson Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems …, 2024 Paper ...

Reproducing the metric-based evaluation of a set of controllable text generation techniques Permalink

M Lorandi, A Belz arXiv preprint arXiv:2405.07875, 2024 Paper Abstract

Qcet: An interactive taxonomy of quality criteria for comparable and repeatable evaluation of NLP systems Permalink

A Belz, S Mille, C Thomson, R Huidrom Proceedings of the 17th International Natural Language Generation Conference …, 2024 P...

Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval)@ LREC-COLING 2024 Permalink

S Balloccu, A Belz, R Huidrom, E Reiter, J Sedoc, C Thomson Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems …, 2024 ...

Proceedings of the 2nd Workshop on Practical LLM-assisted Data-to-Text Generation Permalink

S Balloccu, Z Kasner, O Plátek, P Schmidtová, K Onderková, M Lango, … Proceedings of the 2nd Workshop on Practical LLM-assisted Data-to-Text …, 2024 ...

Proceedings of the 17th International Natural Language Generation Conference: Tutorial Abstract Permalink

A Belz, J Sedo, C Thomson, S Mille, R Huidrom Proceedings of the 17th International Natural Language Generation Conference …, 2024 ...

Preliminary wmt24 ranking of general mt systems and llms Permalink

T Kocmi, E Avramidis, R Bawden, O Bojar, A Dvorkovich, C Federmann, … arXiv preprint arXiv:2407.19884, 2024 Paper ...

On the Role of Summary Content Units in Text Summarization Evaluation Permalink

M Nawrath, A Nowak, T Ratz, DC Walenta, J Opitz, LFR Ribeiro, J Sedoc, … arXiv preprint arXiv:2404.01701, 2024 Paper ...

High-quality Data-to-Text Generation for Severely Under-Resourced Languages with Out-of-the-box Large Language Models Permalink

M Lorandi, A Belz arXiv preprint arXiv:2402.12267, 2024 Paper Abstract

Findings of the WMT24 general machine translation shared task: the LLM era is here but mt is not solved yet Permalink

T Kocmi, E Avramidis, R Bawden, O Bojar, A Dvorkovich, C Federmann, … Proceedings of the Ninth Conference on Machine Translation, 1-46, 2024 ...

Filling Gaps in Wikipedia: Leveraging Data-to-Text Generation to Improve Encyclopedic Coverage of Underrepresented Groups Permalink

S Mille, M Pronesti, C Thomson, M Lorandi, S Fitzpatrick, R Huidrom, … Proceedings of the 17th International Natural Language Generation Conference …, 2024 ...

Differences in Semantic Errors Made by Different Types of Data-to-text Systems Permalink

R Huidrom, A Belz, M Lorandi Proceedings of the 17th International Natural Language Generation Conference …, 2024 Paper ...

DCU-NLG-Small at the GEM’24 Data-to-Text Task: Rule-based generation and post-processing with T5-Base Permalink

S Mille, M Sabry, A Belz Proceedings of the 17th International Natural Language Generation Conference, 2024 Paper ...

DCU-NLG-PBN at the GEM’24 Data-to-Text Task: Open-Source LLM PEFT-Tuning for Effective Data-to-Text Generation Permalink

M Lorandi, A Belz Proceedings of the 17th International Natural Language Generation Conference, 2024 Paper ...

DCU ADAPT at WMT24: English to Low-resource Multi-Modal Translation Task Permalink

S Haq, R Huidrom, S Castilho Proceedings of the Ninth Conference on Machine Translation, 810-814, 2024 Paper ...

Common Flaws in Running Human Evaluation Experiments in NLP Permalink

C Thomson, E Reiter, A Belz Computational Linguistics, 1-11, 2024 Paper Abstra...

Beyond Abstracts: A New Dataset, Prompt Design Strategy and Method for Biomedical Synthesis Generation Permalink

J O’Doherty, C Nolan, Y Hou, A Belz Proceedings of the 62nd Annual Meeting of the Association for Computational …, 2024 Pape...

ATHAR: A High-Quality and Diverse Dataset for Classical Arabic to English Translation Permalink

M Khalil, M Sabry arXiv preprint arXiv:2407.19835, 2024 Paper Abstract

Assessing the Portability of Parameter Matrices Trained by Parameter-Efficient Finetuning Methods Permalink

M Sabry, A Belz Findings of the Association for Computational Linguistics: EACL 2024, 1548-1556, 2024 Paper ...

(Mostly) Automatic Experiment Execution for Human Evaluations of NLP Systems Permalink

C Thomson, A Belz Proceedings of the 17th International Natural Language Generation Conference …, 2024 Paper ...

Using MT for multilingual covid-19 case load prediction from social media texts Permalink

M Popović, V Nedumpozhimana, M Gower, S Rautmare, N Jain, … Proceedings of the 24th Annual Conference of the European Association for …, 2023 ...

Towards a Consensus Taxonomy for Annotating Errors in Automatically Generated Text Permalink

R Huidrom, A Belz Proceedings of the 14th International Conference on Recent Advances in …, 2023 Paper ...

The 2023 webnlg shared task on low resource languages overview and evaluation results (webnlg 2023) Permalink

L Cripwell, A Belz, C Gardent, A Gatt, C Borg, M Borg, J Judge, M Lorandi, … Proceedings of the Workshop on Multimodal, Multilingual Natural Language …, 2023...

The 2023 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results Permalink

A Belz, C Thomson The Third Workhop on Human Evaluation of NLP Systems, 2023 Paper ...

Proceedings of the 3rd Workshop on Human Evaluation of NLP Systems Permalink

A Belz, M Popović, E Reiter, C Thomson, J Sedoc Proceedings of the 3rd Workshop on Human Evaluation of NLP Systems, 2023 Pap...

Proceedings of the 16th International Natural Language Generation Conference: Generation Challenges Permalink

S Mille Proceedings of the 16th International Natural Language Generation Conference …, 2023 Paper ...

Peft-ref: A modular reference architecture and typology for parameter-efficient finetuning techniques Permalink

M Sabry, A Belz arXiv preprint arXiv:2304.12410, 2023 Paper Abstract

Non-repeatable experiments and non-reproducible results: The reproducibility crisis in human evaluation in NLP Permalink

A Belz, C Thomson, E Reiter, S Mille Findings of the Association for Computational Linguistics: ACL 2023, 3676-3687, 2023 Pa...

Mod-D2T: A Multi-layer Dataset for Modular Data-to-Text Generation Permalink

S Mille, F Lareau, S Dasiopoulou, A Belz Proceedings of the 16th International Natural Language Generation Conference …, 2023 ...

Missing information, unresponsive authors, experimental flaws: The impossibility of assessing the reproducibility of previous human evaluations in NLP Permalink

A Belz, C Thomson, E Reiter, G Abercrombie, JM Alonso-Moral, M Arvan, … arXiv preprint arXiv:2305.01633, 2023 Paper ...

Migrant communities living in the Netherlands and their use of MT in health contexts Permalink

S Valdez, AG Arenas, K Ligtenberg 24th Annual Conference of the European Association for Machine Translation …, 2023 Paper ...

Medical Concept Mention Identification in Social Media Posts using a Small Number of Sample References Permalink

V Nedumpozhimana, S Rautmare, M Gower, M Popovic, N Jain, P Buffini, … Technological University Dublin, 2023 Paper ...

How to Control Sentiment in Text Generation: A Survey of the State-of-the-Art in Sentiment-Control Techniques Permalink

M Lorandi, A Belz Proceedings of the 13th Workshop on Computational Approaches to Subjectivity …, 2023 Paper ...

Generating Irish Text with a Flexible Plug-and-Play Architecture Permalink

S Mille, EU Dhonnchadha, L Cassidy, B Davis, S Dasiopoulou, A Belz Proceedings of the 2nd Workshop on Pattern-based Approaches to NLP in the …, 2023 ...

Exploring Variation of Results from Different Experimental Conditions Permalink

M Popović, M Arvan, N Parde, A Belz Findings of the Association for Computational Linguistics: ACL 2023, 2746-2757, 2023 Pap...

Evaluating factual accuracy in complex data-to-text Permalink

C Thomson, E Reiter, B Sundararajan Computer Speech & Language 80, 101482, 2023 Paper ...

Enhancing factualness and controllability of Data-to-Text Generation via data Views and constraints Permalink

C Thomson, C Rebuffel, E Reiter, L Soulier, S Sripada, P Gallinari Proceedings of the 16th international natural language generation conference …, 2023 ...

Do Humans Translate Like Machines? Students’ Conceptualisations of Human and Machine Translation Permalink

S Leena, AG Dorst, M Koponen, K Zeven Proceedings of the 24th Annual Conference of the European Association for …, 2023 Pape...

DCU/TCD-FORGe at WebNLG’23: Irish rules! Permalink

AB Simon Mille, Elaine Uí Dhonnchadha, Stamatia Dasiopoulou, Lauren Cassidy … Workshop on Multimodal, Multilingual Natural Language Generation (MM-NLG’23), 2...

DCU/TCD-FORGe at WebNLG’23: Irish rules!(WegNLG 2023) Permalink

S Mille, EU Dhonnchadha, S Dasiopoulou, L Cassidy, B Davis, A Belz Proceedings of the Workshop on Multimodal, Multilingual Natural Language …, 2023 ...

Data-to-text generation for severely under-resourced languages with gpt-3.5: A bit of help needed from google translate Permalink

M Lorandi, A Belz arXiv preprint arXiv:2308.09957, 2023 Paper Abstract

Computational analysis of different translations: by professionals, students and machines Permalink

M Popović, E Lapshinova-Koltunski, M Koponen European Association for Machine Translation (EAMT), 2023 Paper ...

Barriers and enabling factors for error analysis in NLG research Permalink

E Van Miltenburg, M Clinciu, O Dušek, D Gkatzia, S Inglis, L Leppänen, … Northern European Journal of Language Technology 9 (1), 2023 ...

Adapting the CycleGAN architecture for text style transfer Permalink

M Lorandi, A Mohamed, K McGuinness Zenodo, 2023 Paper Abstract

A Pipeline for Extracting Abstract Dependency Templates for Data-to-Text Natural Language Generation Permalink

S Mille, J Ricci, A Shvets, A Belz Proceedings of the Seventh International Conference on Dependency …, 2023 Paper ...

A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization Permalink

L Zhang, S Mille, Y Hou, D Deutsch, E Clark, Y Liu, S Mahamood, … Proceedings of the 61st Annual Meeting of the Association for Computational …, 2023 ...

User-driven Development of a Medical Note Generation System Permalink

T Knoll, F Moramarco, RY Alex Papadopoulos Korfiatis, C Ruffini, … Proceedings of the 20th Annual Conference of the North American Chapter of …, 2022 ...

Two Reproductions of a Human-Assessed Comparative Evaluation of a Semantic Error Detection System Permalink

R Huidrom, O Dusek, Z Kasner, T Castro Ferrera, A Belz International Natural Language Generation Conference, 2022 Paper ...

The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP Permalink

A Shimorina, A Belz 2nd Workshop on Human Evaluation of NLP Systems, 2022 Paper ...

The accuracy evaluation shared task as a retrospective reproduction study Permalink

C Thomson, E Reiter Proceedings of the 15th International Conference on Natural Language …, 2022 Paper ...

The 2022 ReproGen shared task on reproducibility of evaluations in NLG: Overview and results Permalink

A Belz, A Shimorina, M Popović, E Reiter Association for Computational Linguistics (ACL), 2022 Paper ...

Reproducing a Manual Evaluation of Simplicity in Text Simplification System Outputs Permalink

M Popovic, R Huidrom, S Castilho, A Belz International Natural Language Generation Conference, 2022 Paper ...

Quantified Reproducibility Assessment of NLP Results Permalink

A Belz, M Popovic, S Mille Proceedings of the 60th Annual Meeting of the Association for Computational …, 2022 Paper ...

Proceedings of the 2nd Workshop on Human Evaluation of NLP Systems (HumEval) Permalink

A Belz, M Popović, E Reiter, A Shimorina Proceedings of the 2nd Workshop on Human Evaluation of NLP Systems (HumEval), 2022 ...

On reporting scores and agreement for error annotation tasks Permalink

M Popović, A Belz Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation …, 2022 Paper ...

Leveraging pre-trained language models for gender debiasing Permalink

N Jain, M Popović, D Groves, L Specia European Language Resources Association (ELRA), 2022 Paper ...

Introducing EM-FT for Manipuri-English Neural Machine Translation Permalink

R Huidrom, Y Lepage Proceedings of the WILDRE-6 Workshop @LREC2022, 1-6, 2022 Paper ...

Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation Permalink

F Moramarco, AP Korfiatis, M Perera, D Juric, J Flann, E Reiter, A Belz, … Proceedings of the 60th Annual Meeting of the Association for Computational …, 202...

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code Permalink

S Gehrmann, A Bhattacharjee, A Mahendiran, A Wang, A Papangelis, … arXiv preprint arXiv:2206.11249, 2022 Paper ...

Findings of the 2022 conference on machine translation (WMT22) Permalink

T Kocmi, R Bawden, O Bojar, A Dvorkovich, C Federmann, M Fishel, … Proceedings of the Seventh Conference on Machine Translation (WMT), 1-45, 2022 ...

Evaluation of Response Generation Models: Shouldn’t It Be Shareable and Replicable? Permalink

SM Mousavi, G Roccabruna, M Lorandi, S Caldarella, G Riccardi Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation …, 2022 ...

DiHuTra: a Parallel Corpus to Analyse Differences between Human Translations Permalink

MK Ekaterina Lapshinova-Koltunski, Maja Popović Proceedings of the 23rd Annual Conference of the European Association for …, 2022 ...

Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation Permalink

A Savkov, F Moramarco, AP Korfiatis, M Perera, A Belz, E Reiter arXiv preprint arXiv:2211.09455, 2022 Paper ...

Building machine translation system for software product descriptions using domain-specific sub-corpora extraction Permalink

P Lohar, M Popović, T Habruseva Association for Machine Translation in the Americas, 2022 Paper ...

Posts by Category

Publications

Teaching