Back in the day, I used to remove all the labels from my bottles before even considering them for beer. Then I would sanitize them just prior to filling. I’m guessing the glue is “food grade” and probably won’t cause harm. But may alter the taste and/or clarity.