Leaving the US with other country's pport?

If you hold another country's pport and you're traveling out of the US, I'm sure you can get out just fine. It's just ping through customs to get back into a country that will be the big issue when you already have a GC.