If a shrub is scraggly, isn't doing well, is in a bad place, and (most importantly!) I DON'T LIKE IT, I don't have to keep it just because it's established.
Why yes, I DID cut down the two boxwoods on the east side of the house while I was home unsupervised this afternoon. Why do you ask? :-)