Any process that modulates the rate, frequency, or extent of cholesterol metabolism, the chemical reactions and pathways involving cholesterol, cholest-5-en-3 beta-ol, the principal sterol of vertebrates and the precursor of many steroids, including bile acids and steroid hormones.