Same issue. But also noticed that the case plastic holder tends to add tension to the stem, specially there are about 4 tabs that make contact with the caseback and that pushes the movement and dial up into the crystal. I cut those tabs off and the tension was relieved.@mclarendude as you also build one, do you have issues with manual winding?
Cutting the stem at the right length was laborious, and the crown does not seem to have a spring in it. So in position, it's almost impossible to wind. Movement winds good outside the case.