It sounds like you are describing the bulbus glandis. It's a perfectly normal part of the anatomy. When the dog is aroused, two glands swell at the base of the penis. In breeding, these glands help to maintain the "tie" between the male and female.
I would not be worried.
Let me know if you still have questions.