For the disposable O2 tanks, it's not a regulator, it's just a valve. If it's whistling, turn it down.
It's always better to start the gas flow before you submerge the stone. Otherwise the liquid can make its way into the tiny pores and disrupt gas flow.