Lock always the address space if we changing the virtual mapping.