I installed CPU version of pytorch using this:
conda install pytorch==1.6.0 torchvision==0.7.0 cpuonly -c pytorch
Unfortunately when I import