Minimal, open quantum systems that are governed by non-Hermitian Hamiltonians have been realized across multiple platforms in the past two years. Here we investigate the dynamics of open systems with Hermitian or anti-Hermitian Hamiltonians, both of which can be implemented in such platforms. For a single system, the subject to unitary and thermal dynamics in a periodic manner, we show that the corresponding Floquet Hamiltonian has a rich phase diagram with numerous exceptional-point (EP) degeneracy contours. This protocol can be used to realize a quantum Hatano-Nelson model that is characterized by asymmetric tunneling. For one unitary and one thermal qubit, we show that the concurrence is maximized at the EP that is controlled by the strength of Hermitian coupling between them. Surprisingly, the entropy of each qubit is also maximized at the EP. Our results point to the multifarious phenomenology of systems undergoing unitary and thermal dynamics.