Different community open-source evaluation and benchmarking tools with their respective characteristics

E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B E C M e a n C V D P A M B E R M D T F P M P B g c v a l 2 E S M V a l T o o l I L A M B GSM ESM Hydrological models CTM Sea-ice models Land models Point models Other Regional models Daily Sub-daily Seasonal Monthly Decadal Other Annual Atmosphere Ocean Sea-Ice Land Cross domain Other Multi-domain Upon request Open source No: executable only No: preinstalled modules After registration No Interactive download for online use Other Download scripts with offline use Native model format CMIP standard Other Nc following CF Yes Limited functionality Other No Model performance statistics Runtime diagnostics Other Climate metrics Model evaluation Model verification Other Model benchmarking Laptop Local cluster Other HPC Tool contains the feature Tool does not contain the feature Tools Features Tool purpose Available metric types Accepted formats Reference dataset availability Applicable hardware Internet connections necessary Model class Accepted data frequency Domain Source code availability