Search Results for author:
Found 6 papers, 5 papers with code
HyperBERT: Mixing Hypergraph-Aware Layers with Language Models for Node Classification on Text-Attributed Hypergraphs
In this paper, we propose a new architecture, HyperBERT, a mixed text-hypergraph model which simultaneously models hypergraph relational structure while maintaining the high-quality text encoding capabilities of a pre-trained BERT.
Language Model Knowledge Distillation for Efficient Question Answering in Spanish
Recent advances in the development of pre-trained Spanish language models has led to significant progress in many Natural Language Processing (NLP) tasks, such as question answering.
SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation
In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access.
Unsupervised Pretraining for Fact Verification by Language Model Distillation
Fact verification aims to verify a claim using evidence from a trustworthy knowledge base.
Learning from learning machines: a new generation of AI technology to meet the needs of science
We outline emerging opportunities and challenges to enhance the utility of AI for scientific discovery.
Translating synthetic natural language to database queries: a polyglot deep learning framework
In this work we describe a machine learning framework, Polyglotter, that in a general way supports the mapping of natural language searches to database queries.
