Ask a neutral party if it bothers them. Do they even see the problem? Based on what they say, reassess whether it's worth fixing.
If you decide to fix it, the previous posters are correct. Try these solutions and stop when it's fixed:
1) Roto each lens. - often, a single roto-shape, blurred, and tracked to the glasses will suffice.
2) Gamma the lens darker to blend the boom operator into the reflection.
3) Blur the lenses, a little, and composite a sharp version of the highlights (only) back on-top-of the comp.
Messing with white/black point, or adding too much blur, or tracking in a still image, will often result in a composite that looks worse the original photography.