Partisans only have to look at idiots on one side, while assuming people on their own side are not idiots. Independents are literally surrounded by idiots.
Partisans only have to look at one ideology they hate, and one they love. Independents are offered two ideologies that don't work for them, and none they love.
The world is literally a more negative place for people that don't like extremes.