Analysis of images from the Messenger MDIS narrow angle camera imply that at least part of the radial graben of the Pantheon Fossae structure, and probably the structure as a whole, predate the deformation that led to circumferential ridges on the Caloris interior plains. This follows from structural analysis and comparison with similar geological relationships on Venus and the Moon, where graben are known to both postdate and predate ridges. Observations suggest that the Pantheon Fossae radial graben (extension) formed first, pre-dating observed circumferential graben (also extension), with ridges (compression) formed in between. This scenario puts constraints on the models for the deformation of the Caloris basin and its vicinity. Our observations and analysis are consistent with Pantheon Fossae having formed in a similar manner to Venusian astra/novae, where radial dikes that propagate away from a magmatic center led to graben formation. Our results also have implications for the length of time between the emplacement of the basin volcanic fill and the onset of the compressional stresss regime that led to ridge-formation. If the Pantheon Fossae structure formed before the emplacement of ridges, as we suggest, this means that compressional stresses took some time to develop sufficiently to deform the volcanic plains. Since the Caloris interior plains had to have been already in place when Pantheon Fossae formed, and since these plains represented a significant load to the underlying lithosphere, it is striking that compression took some time to develop. These observations may provide new information about the rigidity of the basin-filling material and will help constrain models for the mechanisms and timing of events within and around the Caloris basin.