Any process that modulates the frequency, rate, or extent of retinal ganglion cell axon guidance, the process in which the migration of an axon growth cone of a retinal ganglion cell (RGC) is directed to its target in the brain in response to a combination of attractive and repulsive cues.