You cancelled Direct TV because of politics in sports?
For many, the ONLY reason they haven't cut the cord is because of ESPN. You hear it all the time.
As you said, politics isn't the main reason ESPN is in trouble, but I bet it does account for at least some drop off. Especially if you have a family in a budget crunch (which there are plenty) and the main reason for having cable i.e...ESPN is reflecting a worldview opposite the way they see it. I don't think it is that big a stretch.