We used Raman and terahertz spectroscopies to investigate lattice and magnetic excitations and their cross-coupling in the hexagonal YMnO3 multiferroic. Two phonon modes are strongly affected by the magnetic order. Magnon excitations have been identified thanks to comparison with neutron measurements and spin wave calculations but no electromagnon has been observed. In addition, we evidenced two additional Raman active peaks. We have compared this observation with the anti-crossing between magnon and acoustic phonon branches measured by neutron. These optical measurements underly the unusual strong spin-phonon coupling.