Any process that modulates the rate, frequency, or extent of olfactory learning. Olfactory learning is any process in an organism in which a relatively long-lasting adaptive behavioral change occurs in response to (repeated) exposure to an olfactory cue.