President Barack Obama sat down to chat with David Letterman on Tuesday, and while they discussed more than just politics, it seemed that his response to the leaked Romney fundraiser video was on everyone's mind. The video had over 2 million views on Monday alone.

Taking Mitt Romney to task, Obama said that "There are not a lot of people out there who think they are victims," and that voters want to make sure that their president is "not writing off big chunks of the country."

The secretly taped video showed the Republican presidential nominee describing "47 percent of the people" as Obama supporters who depend on government and believe they are victims. Romney said it is not his job "to worry about those people," referring to what he called Obama's locked-in supporters who believe they are "entitled to health care, to food, to housing, to you name it."

"My expectation is that if you want to be president, you have to work for everyone, not just for some," Obama said during Letterman's "Late Show."

Romney has since said he made his point "inelegantly" in trying to describe differing visions for the nation.

Obama said people understand that the presidential candidates will make mistakes on the campaign trail. He said that includes one he regrets from 2008, when audio from one of his own private fundraisers had him saying that some residents of depressed rural areas get bitter and "cling to guns or religion or antipathy to people who aren't like them."

Having said that, Obama added, "One thing I've learned as president is that you represent the entire country."

The president and Letterman also chatted about lighter topics, with Obama joking about the Florida pizza restaurant owner who lifted him off the ground in a bear hug last week. `'I think he fixed something in my back," Obama said.

The two also exchanged compliments on their appearances:

"You look good," Obama said.

"You haven't seen me naked," Letterman said.

Obama replied: "We're going to keep it that way."