why is the timm visual transformer position embedding initializing to zeros

后端 未结 0 345
长情又很酷
长情又很酷 2021-02-05 04:29

I\'m looking at the timm implementation of visual transformers and for the positional embedding, he is initializing his position embedding with zeros

self.pos_emb         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题