Aha, so calcium carbonate reacts with lactic acid to form calcium lactate, which has an unpleasant flavor?
I detect a basic misunderstanding of ionic chemistry. The reactants above do react, but their products remain calcium and lactate ions until their concentrations exceed their solubility limit and they precipitate from solution as calcium lactate. At the concentrations we typically employ, precipitation is not likely.
I also noted a mention that lactate is just H, C, and O. While that is true, that fact is that they are combined into a molecule and are not ions by themselves. The lactate molecule can be an ion. How atoms are assembled into a molecule has profound consequences...take C and N, when they are combined into a CN form (cyanide), they are deadly. They weren't when they were just C and N.
Citric acid is a chelator in the presence of divalent metals. There are water softening systems that employ citric acid. The Ca does precipitate as calcium citrate and generally can't create scale on surfaces. However, a small portion of the calcium and citrate remain in solution as ions.
In those cases where brewers use phosphoric acid, high Ca content can cause a precipitation reaction creating calcium phosphate. It can reduce the calcium content of the brewing liquor, but that is not a problem since this reaction does not occur unless the calcium content of the water is already high. Since beer and yeast do not benefit from excessive Ca content in the water, loosing some Ca is not a problem. The concern with using phosphoric acid is a 'red-herring' and is not a concern.