We discuss and review recent advances in our understanding of quantum Hall systems where additional quantum numbers associated with spin and/or layer (pseudospin) indices play crucial roles in creating exotic quantum phases. Among the novel quantum phases we discuss are the recently discovered canted antiferromagnetic phase, the spontaneous interlayer coherent phase, and various spin Bose glass phases. We describe the theoretical models used in studying these novel phases and the various experimental techniques being used to search for these phases. Both zero temperature quantum phase transitions and finite temperature phase transitions are discussed. Emphasis in this article is on the recent developments in novel quantum phases and quantum phase transitions in bilayer quantum Hall systems where non-trivial magnetic ground states associated with spontaneous spin symmetry breaking play central role.