Holonomies, arising from non-Abelian geometric transformations of quantum states in Hilbert space, offer a promising way for quantum computation. The non-community of these holonomies renders them suitable for realization of a universal set of quantum logic gates, while the global geometric feature may result in some noise-resilient advantages. Here we report on the first on-chip realization of the non-Abelian geometric controlled-Not gate, which is a buidling block for constructing a holonomic quantum computer. The conditional dynamics is achieved in an all-to-all connected architecture involving multiple frequency-tunable superconducting qubits controllably coupled to a resonator; a holonomic gate between any two qubits can be implemented by tuning their frequencies on resonance with the resonator and applying a two-tone drive to one of them. The combination of the present gate and previously demonstrated holonomic single-qubit operations represents an all-holonomic approach to scalable quantum computation on a superconducting platform.