About ETRO  |  News  |  Events  |  Vacancies  |  Contact  
Home Research Education Industry Publications About ETRO

Master theses

Current and past ideas and concepts for Master Theses.

Explaining Model Decisions with Natural Text


Explainable AI is a very important topic in the field of machine learning and deep learning. For AI models to be deployed in everyday life, explaining their decision-making process becomes critical for several reasons such as trust, accountability, and model bias understanding and correctness. Can we deploy a self-driving car if it stops just because it saw a red color, or did it really stop because it saw a stop sign? In fact, in one of the earlier competitions for object detection, it was discovered that models are learning to look at a watermark when detecting the object “elephant”, simply because all elephant images in the dataset had a watermark. And therefore when presented with new images outside of the test set (without any watermark), the model gave a wrong decision. Natural Language Explanations refer to explaining the decision-making process of an AI models with natural text rather than heatmaps. This text is human-friendly, detailed and fine-grained.

Kind of work

The student is required to develop a new models for natural language explanations for several tasks such as visual question answering, visual entailment, visual reasoning, visual recognition…etc. The student may have a look at examples in the following papers:
• NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks
• Multimodal Explanations: Justifying Decisions and Pointing to the Evidence
• Faithful Multimodal Explanation for Visual Question Answering
• e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks

Number of Students


Expected Student Profile

Prior knowledge in Machine Learning
Prior knowledge in Python and PyTorch


Prof. Dr. Ir. Nikos Deligiannis

+32 (0)2 629 1683

more info

- Contact person




- Contact person

- Thesis proposals

- ETRO Courses

- Contact person

- Spin-offs

- Know How

- Journals

- Conferences

- Books

- Vacancies

- News

- Events

- Press


ETRO Department

Tel: +32 2 629 29 30

©2024 • Vrije Universiteit Brussel • ETRO Dept. • Pleinlaan 2 • 1050 Brussels • Tel: +32 2 629 2930 (secretariat) • Fax: +32 2 629 2883 • WebmasterDisclaimer