Calibrating DKIST Data

The DKIST Data Center has been working hard on implementing the automated pipelines necessary to calibrate DKIST data. Starting with the codes supplied by Instrument Teams, these pipelines have seen multiple iterations now. From fixing initial bugs in the software implementation, to finding issues with metadata in the raw data, a number of problems have been discovered and fixed or remediated. The calibration process has moved into a new phase now, whereby the scientific quality of the calibrated data is being closely scrutinized and we have discovered areas where improved algorithms have been required, and likely news steps in the calibration will need to be implemented. This has required a close collaboration between the Data Center, the Instrument Scientists, DKIST Scientists and Engineers and the DKIST Operations Team together with input from the Heliophysics Community. In this presentation I will detail the state of the calibrations for all the current instruments at the telescope, though concentrating on the Visible Spectro-Polarimeter (ViSP), to which the most effort in calibration has been directed so far. I will talk about the challenges that have been faced, and overcome, and what needs to be done to qualify a scientific pipeline to deliver the quality of data required by the Heliophysics Community, to fully exploit the scientific possibilities of DKIST.