Publications - interpretability

Traducción automática de lengua de señas en español utilizando Deep LearningPhD thesis

Pedro Dal Bianco

PhD thesis, Facultad de Informática, Universidad Nacional de La Plata, 2026

PhD thesis (in Spanish) on translating Argentinian Sign Language into written Spanish with little data: the LSA-T corpus, a compact gloss-free pose-based Transformer, multilingual training and LLM paraphrases of the targets, and a study of what the model's attention learns.

sign-language-translation argentinian-sign-language multilingual interpretability

SignAttention: On the Interpretability of Transformer Models for Sign Language TranslationWorkshop paper

Pedro Dal Bianco*, Oscar Stanchi*, Facundo Quiroga, Franco Ronchetti, Enzo Ferrante

Interpretable AI Workshop (IAI) and LatinX in AI Workshop (oral), NeurIPS 2024

The first comprehensive interpretability analysis of a Transformer sign language translation model, on Greek Sign Language. The model attends to clusters of frames aligned diagonally with the glosses, and shifts from the video to its previous predictions as the translation progresses.

sign-language-translation interpretability transformers