Check if REF diagnostics have been implemented correctly

[bouweandela]

Maintainers, please check if your recipe was integrated with the REF correctly. Check e.g. if the correct input data is selected.

Code lives here: https://github.com/Climate-REF/climate-ref/tree/main/packages/climate-ref-esmvaltool/src/climate_ref_esmvaltool/diagnostics

The REF output data is available here and in /work/bd0854/b381141/ref_output/esmvaltool/ on Levante. Each folder contains a file called recipe.yml which contains a recipe modified by the REF.

diagnostic	available on Levante	reviewer	integration into REF looks good?	(Optional) Issue or pull request in REF repository with improvements
climate-at-global-warming-levels	yes	@rswamina	There should be a single CSV file generated as part of the first step which I cannot see. Also, there should be mean and standard deviation plots produced. I only see the mean plots.
cloud-radiative-effects	yes	@LisaBock	results look good; time period for models and obs must be updated (PR in ESMValTool)
cloud-scatterplots-clt-swcre	yes	@LisaBock	captions needs to be improved, also the time period (see ESMValTool PR)
cloud-scatterplots-reference	yes	@LisaBock	captions needs to be improved, also the time period (see ESMValTool PR)
equilibrium-climate-sensitivity	yes	@schlunma	recipe contains superfluous keys; model time ranges need to be selected based on branch time from parent exp	Climate-REF/climate-ref#310; Climate-REF/climate-ref#212
sea-ice-area-seasonal-cycle	yes	@axel-lauer	time range for the "min" diagnostics is not optimum	Climate-REF/climate-ref#300
transient-climate-response	yes	@schlunma	recipe contains superfluous keys; model time ranges need to be selected based on branch time from parent exp	Climate-REF/climate-ref#311; Climate-REF/climate-ref#212
zero-emission-commitment	yes	@bettina-gier
transient-climate-response-emissions	not yet	@schlunma

[lewisjared]

We also have some tracked output that we use for regression testing that might of interest: https://github.com/Climate-REF/climate-ref/tree/main/tests/test-data/regression/esmvaltool

[LisaBock]

Hi @bouweandela , I didn't see the code for the cloud scatterplots in packages/climate-ref-esmvaltool/src/climate_ref_esmvaltool/diagnostics. Could you tell me where to find it?

[lewisjared]

It's in this PR Climate-REF/climate-ref#261

[rswamina]

@bouweandela - Some of the output files are missing in the climate-atglobal-warming-levels diagnostic as I have mentioned above. These should all be produced as part of the run, are they not?