raking in big bucks in his role as "historian" for Freddie Mac.

"The other thing that really should annoy a lot of people, he received a lot of money from Freddie Mac," Paul asserted. "So in a way, Newt, I think you probably got some of our taxpayers' money. They got money and they're still getting bailed out. But you were a spokesmen for them and you received money."

For his part, Gingrich has denied that he ever acted as a spokesman or a lobbyist for Freddie Mac, which he claims was part of the "private sector."

On Sunday, NBC host David Gregory asked Paul if Gingrich should apologize and give the money back.

"Well, legally he doesn't have to," Paul admitted. "But I would think, morally, him having received this money, yes. I wouldn't have taken their money. Just for the fact that I think it was an immoral thing to take money."

The Texas Republican added: "Besides I don't like this idea that you are going to influence somebody that is a pseudo-government agency. ... It was as far as I'm concerned about as close to the government as you can get -- and to call that private is not exactly accurate."