All the HUD stuff should go on a separate layer above all the other layers with its scroll speed set to 0.