How many times should you have sex if you are trying to conceive?

I've heard the same thing that if you have sex too much then it will deplete the sperm count. But I asked a Dr about it and he said that it only really matters if you have sex more than once in a day, not so much how many days in a row. Good luck to you....