From the anaconda docs, you can uninstall with conda uninstall
Try
conda uninstall pytorch torchvision cuda80 -c soumith
Alternatively, the pytorch docs suggest
conda uninstall pytorch
pip uninstall torch
pip uninstall torch # run this command twice
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…