Unless you buy unlacquered brass, the gold hardware has a protective top coat on it. It protects the finish whether gold, chrome, brushed nickel etc. If you constantly use harsh chemicals while cleaning, you can risk stripping off some of that protection and can get some pitting or even color change where you are always touching.

Generally, with a good quality handle, that should not happen.

Look into Top Knobs or Emtek - they make excellent hardware.