Guide to building open-domain question answering systems
Source: Lilian Weng28/10/2020, 21:00
This technical overview presents approaches for constructing systems that answer factual questions across diverse knowledge domains without domain-specific context. The article distinguishes open-domain question answering from reading comprehension tasks, where context is explicitly provided. Multiple architectures are examined including those leveraging external knowledge sources like Wikipedia and closed-book approaches operating from model parameters alone. The guide discusses evaluation methodology for factoid question answering tasks and examines classification schemes for question difficulty levels. Implementation considerations address the challenge of fine-tuning models on common QA datasets and the importance of distinguishing between in-distribution performance and real-world effectiveness. Practical applications in chatbots and AI assistants are explored.