Does my voice sound goofy and unmanly?

Your voice sounds perfectly fine. You have a rather deep voice. You do have a slight accent (but maybe that's just because I grew up in California) but it's not very noticeable. :)