"Drunk Nate Silver" became a Twitter thing recently, which makes perfect sense. People intuitively know prophecy is a gift...and a burden. In the face of such relentless clarity he might well crave some oblivion--if you or I had to deal with that kind of insight we'd probably go straight to the bottle and get messy as Rasmussen.
And cm'on, if you don't buy his book you're going to have a much harder time pretending you've read it. Don't be the last person at the party to act like you understand Bayesian processes vis-a-vis free market economics, you're going to look like a real a-hole.
So if the web wants to superimpose Charles Bukowski on Nate Silver, let it. No matter how unlikely it is, I would personally rather fantasize that he's a booze-hungry seer of visions than learn all that damn math. Reality sounds like a lot of work.