When running a regression, is it possible to replace one hot encoding with embeddings?

Question

I am doing a regression on a data frame and wanted to add another data frame that has many categorical data to improve results. But the data with all the categorical data is