Catalysis of the transfer of a solute or solutes from one side of a membrane to the other according to the reaction: thiamine(out) + H+(out) = thiamine(in) + H+(in). In high affinity transport the transporter is able to bind the solute even if it is only present at very low concentrations.