Your husband may require hormonal work-up. Fertility shots can be used to normalize sperm counts, although this may require 6-12 months of treatment.
I found the below link very informative about this condition.
http://www.pituitary.org.uk/information/pituitary-conditions/rarer-disorders/kallmanns-syndrome/