Is there any way to self create Transformer to run on Coral board?

Question

I want to use a transformer applied on Coral Board edge device. But I cant find any source that apply this.

The transformer can be trained on CloudTPU, but I am not s