If you have those items in your possession I'd go ahead and bring them (but don't worry if you'd need to obtain a copy for example). The foreign birth certificate will probably be irrelevant (your naturalization certificate would be what you'd use to show that you're legally in the country and a citizen).