Uhnitas,
It did not move left or right as far as it could tell. I did this in compare mode in Lightroom so I could switch quickly. Only a couple of the peaks and valleys move up and down but so small you could barely see it. I did try the viewer trick like you suggested and the brightness did not change as far as I could tell. BTW, I had the quality of the JPG set to 100.