A Neuro-Symbolic ASP Pipeline for Visual Question Answering

1 code implementation • 16 May 2022 • Thomas Eiter, Nelson Higuera, Johannes Oetsch, Michael Pritz

Our pipeline covers (i) training neural networks for object classification and bounding-box prediction of the CLEVR scenes, (ii) statistical analysis on the distribution of prediction values of the neural networks to determine a threshold for high-confidence predictions, and (iii) a translation of CLEVR questions and network predictions that pass confidence thresholds into logic programs so that we can compute the answers using an ASP solver.

Question Answering Visual Question Answering