Is it possible to combine domain specific word2vec embeddings and off the shelf ELMo embeddings for a downstream unsupervised task?

Question

Is it possible to combine word2vec embeddings (trained on a specific domain) and (off the shelf) ELMo embeddings to generate a single embedding and use these embeddings for a do