飞桨工具组件简介——ERNIE
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding Pre-Training 任务 Word-aware Tasks Knowledge Masking Task Capitalization Prediction Task Token-Document Relation Prediction Task Structure-aware Tasks Sentence Reordering Task Sentence Distance Task Semantic-aware Tasks Discourse Relation Task IR Relevance Task ERNIE 1.0: E nhanced R epresentation through k N owledge I nt E gration 对比 ERNIE 1.0 和 ERNIE 2.0 效果验证 中文效果验证 英文效果验证 ERNIE tiny 技术交流 使用 arxiv: ERNIE 2.0: A Continual Pre-training Framework for Language Understanding , link ERNIE 2.0 是基于持续学习的语义理解预训练框架,使用多任务学习增量式构建预训练任务