No it's not a big problem.
Yes I know there are people how don't like gay people, and there are people who don't like people because they are black, white, Japanese, etc. Generally most people don't care one way or another. Yes there is the whole marriage debate, but in that debate people are asking the wrong question. It shouldn't be should gay's be allowed to get married, but instead the question should be why is the government involved in marriage at all?
Again most people don't care who or what you do, with any willing partner, it's the few screaming people, on both sides, that get the attention of the media.