Connectivity of chamber graphs of buildings and related complexes