Like if they achieved some threshold like 25...
I think it won't be easy to get to 25, but it may allow also trolls or haters to gang up on someone who doesn't deserve a ban. There are also a couple of pretty large fanbases out there who would be more likely to "vote out" a user inconvenient to them, while some of them will continue to drag players with smaller fanbases, who may not have the same "fire power" to kick out an inconvenient hater.
Also, how would you make the vote:
- open vote would mean you can see who voted you (or a friend of yours) out, which would aggravate the hate among users
- hidden vote would mean us, as mods/admins, won't know who cast those votes: for all we know it can be a lot of trolls, haters and worst of all, double accounts
I think instead of polls with a threshold of 25, you're better off with just 5 exposing reports, proving the guy is a troll or a flamer based on his/her activity here and there. As seen in this latest case, we didn't need more than 1-2 reports from some of you putting one of his posts against another, proving the guy's only intention was to spark controversy.