display:inline; will turn the div into the equivalent of a span. It will be unaffected by margin-top, margin-bottom, padding-top, padding-bottom, height, etc.
You can also consider changing the elements. The div element is intended for document divisions, I usually use a label and a span element for a construct like this: