Mostly it is sportswriters I believe, and perhaps living HoFers for those that are beyond their normal voting cycle (but I cannot remember correctly). There have always been a cadre of sportwriters who are the smuggest most sanctimonious asshats who think that no one should get in on their first ballot or believe that no one should be unanimous and will vote against them just to prove a stupid point. Think of all the players that were not unanimous: Jackie [uck fay]ing Robinson is all you need to say, and I imagine his had a lot more to do with him being black than simply an anti-unanimous bent. More recently, Greg Maddux (I think he got all but one vote). It is stupid and am glad that the precedent has been set.
I can’t even talk about the BWAA or Bud Selig without working myself into a later. And I have to leave it a that.