Solution:
Reduce pytorch version to 1.7.0;
#Uninstall the original torch and torch vision first
pip uninstall torch pip uninstall torchvision
#Install pytorh1.7
pip install torch==1.7.0+cu110 torchvision==0.8.1+cu110 -f https://download.pytorch.org/whl/torch_stable.html
Recompile.