President Barack Obama on Sunday told a pro-Israel lobbying group that "loose talk of war" was only serving to benefit Iran because it was driving up the price of oil.