Using subword information in OOV token from fasttext in word embedding layer (keras/tensorflow)

我们两清 提交于 2019-12-11 10:57:35

问题


I have my own Fasttext model and trained with it a keras classification model with a word embedding layer.

But, I wonder how I can make use of the subword information of my model for OOV words? Since the word embedding layer operated via indices to look up word vectors and OOV words have no index. Even if a OOV token has a index how would I assign it the proper word vector to this OOV on the fly for an already trained model?

Thanks in advance!

来源:https://stackoverflow.com/questions/56043487/using-subword-information-in-oov-token-from-fasttext-in-word-embedding-layer-ke

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!