The Attorney-General said he was joking when he dismissed Hawaii as just "an island in the Pacific".