ILAMB on Gadi
What is ILAMB?
The International Land Model Benchmarking (ILAMB) benchmarking system is a python framework used to quantitatively compare a defined set of observable variables with a number of land models.
Support Level: Supported on Gadi, but not owned by ACCESS-NRI
ILAMB is a community-developed climate model diagnostics and evaluation software package.
While ACCESS-NRI does not own the code, it actively supports the use of ILAMB software on Gadi.
ACCESS-NRI provides access to the latest version of ILAMB via the xp65
access-med
conda environment for Model Evaluation on Gadi.
This documentation is tailored to using ILAMB on Gadi and, hence, it supplements rather than replaces the official documentation. Users are encouraged to read the ILAMB documentation and relevant tutorials.
Using ILAMB on Gadi
ILAMB is provided through both the xp65
and hh5
NCI projects on Gadi, so you need to have an NCI account and be a member of these projects to use it.
For ACCESS-NRI documentation on how to run ILAMB on Gadi, visit:
To run ILAMB, you need to execute the command ilamb-run
with a number of arguments/ files:
ilamb-run --config config.cfg --model_setup model_setup.txt --regions regions.txt
-
config.cfg
defines which observables and observational datasets to be compared. -
model_setup.txt
defines the paths of models that to be compared. -
regions.txt
defines the regions to be compared, e.g.,global
,aust
(Australia), etc.
While these files can be self-defined, ACCESS-NRI provides the necessary files and tools to set your model paths to run on Gadi. All you need to do is decide which observations and models you wish to compare.
NCI hosts replicas of the ILAMB observational data sets through the NCI project ct11
as well as a large amount of model outputs are available on Gadi, such as ACCESS model output.
For more information, refer to Observational Data Catalogue on how to find observational data on NCI and ACCESS-NRI Intake Catalog for how to find model outputs.
To learn more about how to adjust the ILAMB setup, refer to the official ILAMB documentation and relevant tutorials.
Showcase: CMIP6 comparisons and ACCESS ESM1.5 benchmarking
ACCESS-NRI is maintaining a collection of benchmark comparisons for the ACCESS community, such as that with Coupled Model Intercomparison Project (CMIP) data:
In the following example, the supported ACCESS Earth System Model (ESM) ACCESS-ESM1.5 is compared with two other ESM models:
- BCC ESM1 (Beijing Climate Center Earth System Model version 1)
- CanESM5 (Canadian Earth System Model version 5)
Numerous benchmark comparisons have been defined in the configuration file. The comparison of variables have been organised under different sections, such as the Hydrology Cycle.
For other variables, such as the git Gross Primary Productivity gpp
, one or more datasets are available. For example, the gross primary productivity measurements of FLUXNET2015.
By clicking on a row in the table, you can expand it to see the underlying datasets used. The table's colourmap extends from best values in purple to worse data in orange.
Clicking on one of these datasets, for example CERESed4.1
, will take you to an interactive and quantitative comparison page for Albedo measurements of the Clouds and the Earth’s Radiant Energy System (CERES) project: