You need a bare x window before you can start a window manager and accessories, and if someone logs off and back on, all their x window clients may be destroyed and recreated, but the x window could...
The XDM or console login X session is not the only sort. The X session is really on the Xserver, which in general might not even be local. Any sort of X process can attach to it regardless of the...