Skip to yearly menu bar Skip to main content


Presentation
in
Expo Workshop: DAQA – Domain Adaptation and Question Answering

Multi-Stage Transfer Learning for Technical Support Domain Question Answering

Rong Zhang


Abstract:

This talk presents our research work on three transfer learning approaches Including domain-specific LM pre-training with vocabulary extension, QA model Pre-training with synthetic examples, and QA model pre-training with labeled data augmentation. These approaches are applied incrementally on the Roberta large LM and adapt it to the TechQA task in technical support domain. Substantial improvements of QA performance are observed from leaderboard testing result.

Chat is not available.