CIME.XML package

Submodules

CIME.XML.archive module

Interface to the archive.xml file. This class inherits from GenericXML.py

class CIME.XML.archive.Archive(infile=None, files=None)

Bases: CIME.XML.archive_base.ArchiveBase

get_all_config_archive_files(files)

Returns the list of ARCHIVE_SPEC_FILES that exist on disk as defined in config_files.xml

setup(env_archive, components, files=None)

CIME.XML.archive_base module

Base class for archive files. This class inherits from generic_xml.py

class CIME.XML.archive_base.ArchiveBase(infile=None, schema=None, root_name_override=None, root_attrib_override=None, read_only=True)

Bases: CIME.XML.generic_xml.GenericXML

get_all_hist_files(casename, model, from_dir, suffix='', ref_case=None)

gets all history files in directory from_dir with suffix (if provided) ignores files with ref_case in the name if ref_case is provided

get_entry(compname)

Returns an xml node corresponding to compname in comp_archive_spec

get_entry_value(name, archive_entry)

get the xml text associated with name under root archive_entry returns None if no entry is found, expects only one entry

get_hist_file_extensions(archive_entry)

get the xml text associated with each of the hist_file_extensions based at root archive_entry (root is based on component name) returns a list of text entries or an empty list if no entries are found

get_latest_hist_files(casename, model, from_dir, suffix='', ref_case=None)

get the most recent history files in directory from_dir with suffix if provided

get_rest_file_extensions(archive_entry)

get the xml text associated with each of the rest_file_extensions based at root archive_entry (root is based on component name) returns a list of text entries or an empty list if no entries are found

CIME.XML.batch module

Interface to the config_batch.xml file. This class inherits from GenericXML.py

The batch_system type=”foo” blocks define most things. Machine-specific overrides can be defined by providing a batch_system MACH=”mach” block.

class CIME.XML.batch.Batch(batch_system=None, machine=None, infile=None, files=None, extra_machines_dir=None)

Bases: CIME.XML.generic_xml.GenericXML

get_batch_jobs()

Return a list of jobs with the first element the name of the case script and the second a dict of qualifiers for the job

get_batch_system()

Return the name of the batch system

get_optional_batch_node(nodename, attributes=None)

Return data on a node for a batch system

get_value(name, attribute=None, resolved=True, subgroup=None)

Get Value of fields in the config_batch.xml file

set_batch_system(batch_system, machine=None)

Sets the batch system block in the Batch object

CIME.XML.compilerblock module

Classes used to build the CIME Macros file.

The main “public” class here is Build. It is initialized with machine-specific information, and its write_macros method is the driver for translating the config_compilers.xml file into a Makefile or CMake-format Macros file.

For developers, here’s the role of the other classes in the process:

• A CompilerBlock is responsible for translating the XML code in a <compiler> tag into Python data structures.

• A PossibleValues object keeps track of all the settings that could affect a particular variable, and is the main way that these settings are stored.

• A MacroConditionTree is the structure that is responsible for writing out the settings. While the PossibleValues objects are organized by variable name, the MacroConditionTree is organized by conditional blocks, and thus roughly plays the role of a syntax tree corresponding to the Makefile/CMake output.

In more detail:

• Build.write_macros immediately creates a MakeMacroWriter or CMakeMacroWriter to translate strings for the build system.

• It also creates value_lists, a dictionary of PossibleValues objects, with variable names as the keys. Each variable has a single PossibleValues object associated with it.

• For each <compiler> element, Build.write_macros creates a CompilerBlock instance. This object is responsible for translating the XML in its block, in order to populate the PossibleValues instances. This includes handling the $VAR, $ENV{…} and $SHELL{…} and keeping track of dependencies induced by one variable referencing another’s value.

• The PossibleValues object holds the information about how one variable can be set, based on various build options. It has two main roles:

  1. As we iterate through the XML input file, each setting is added to the relevant PossibleValues object. The PossibleValues object contains lists of settings sorted by how machine-specific those settings are.

  2. The PossibleValues object iterates through the list of settings to check for ambiguities. E.g. if there is a setting for DEBUG=TRUE, and another setting for MPILIB=mpi-serial, it is ambiguous in the case where both conditions hold.

• A ValueSetting object is a simple struct that a setting from the XML file is translated to. The lists in the PossibleValues class contain these objects.

• Once the XML has all been read in and the PossibleValues objects are populated, the dependencies among variables are checked in Build.write_macros. For each variable, if all its dependencies have been handled, it is converted to a MacroConditionTree merged with all other trees for variables that are ready, and written out. Then we loop through the variable list again to check for variables whose dependencies are all handled.

• The MacroConditionTree acts as a primitive syntax tree. Its __init__ method reorganizes the data into conditional blocks, and its write_out method writes uses the MakeMacroWriter/CMakeMacroWrite object to write to the Macros file. MacroConditionTree objects can be merged to reduce the length of the output.

class CIME.XML.compilerblock.CompilerBlock(writer, compiler_elem, machobj, db)

Bases: object

Data used to translate a single <compiler> element.

This is used during write_macros to traverse the XML and create a list of settings specified in the element.

Public methods: add_settings_to_lists matches_machine

add_settings_to_lists(flag_vars, value_lists)

Add all data in the <compiler> element to lists of settings.

Arguments: flag_vars - A set of variables containing “flag-like” data. value_lists - A dictionary of PossibleValues, containing the lists

of all settings for each variable.

matches_machine()

Check whether this block matches a machine/os. This also sets the specificity of the block, so this must be called before add_settings_to_lists if machine-specific output is needed.

CIME.XML.compilers module

Interface to the config_compilers.xml file. This class inherits from GenericXML.py

class CIME.XML.compilers.Compilers(machobj, infile=None, compiler=None, mpilib=None, files=None, version=None, extra_machines_dir=None)

Bases: CIME.XML.generic_xml.GenericXML

get_compiler()

Return the name of the compiler

get_optional_compiler_node(nodename, attributes=None)

Return data on a node for a compiler

get_value(name, attribute=None, resolved=True, subgroup=None)

Get Value of fields in the config_compilers.xml file

set_compiler(compiler, machine=None, os_=None, mpilib=None)

Sets the compiler block in the Compilers object >>> from CIME.XML.machines import Machines >>> compobj = Compilers(Machines(machine=”melvin”)) >>> compobj.set_compiler(“gnu”) >>> compobj.get_compiler() ‘gnu’

write_macros_file(macros_file='Macros.make', output_format='make', xml=None)

CIME.XML.component module

Interface to the config_component.xml files. This class inherits from EntryID.py

class CIME.XML.component.Component(infile, comp_class)

Bases: CIME.XML.entry_id.EntryID

get_description(compsetname)

get_forcing_description(compsetname)

get_valid_model_components()

return a list of all possible valid generic (e.g. atm, clm, …) model components from the entries in the model CONFIG_CPL_FILE

get_value(name, attribute=None, resolved=False, subgroup=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

print_values()

print values for help and description in target config_component.xml file

return_values()

return a list of hashes from target config_component.xml file This routine is used by external tools in https://github.com/NCAR/CESM_xml2html

CIME.XML.compsets module

Common interface to XML files which follow the compsets format,

class CIME.XML.compsets.Compsets(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_compset_longnames()

get_compset_match(name)

science support is used in cesm to determine if this compset and grid is scientifically supported. science_support is returned as an array of grids for this compset

get_compset_var_settings(compset, grid)

Variables can be set in config_compsets.xml in entry id settings with compset and grid attributes find and return id value pairs here

get_value(name, attribute=None, resolved=False, subgroup=None)

get_value is expected to be defined by the derived classes, if you get here the value was not found in the class.

print_values(arg_help=True)

CIME.XML.entry_id module

Common interface to XML files which follow the entry id format, this is an abstract class and is expected to be used by other XML interface modules and not directly.

class CIME.XML.entry_id.EntryID(infile=None, schema=None, read_only=True)

Bases: CIME.XML.generic_xml.GenericXML

add_elements_by_group(srcobj, attributes=None, infile=None)

Add elements from srcobj to self under the appropriate group element, entries to be added must have a child element <file> with value “infile”

check_if_comp_var(vid, attribute=None, node=None)

cleanupnode(node)

in env_base.py, not expected to get here

compare_xml(other, root=None, otherroot=None)

get_child_content(vid, childname)

get_default_value(node, attributes=None)

Set the value of an entry to the default value for that entry

get_description(node)

get_elements_from_child_content(childname, childcontent)

get_groups(node)

get_node_element_info(vid, element_name)

get_nodes_by_id(vid)

get_type_info(vid)

get_valid_value_string(node, value, vid=None, ignore_type=False)

get_valid_values(vid)

get_value(vid, attribute=None, resolved=True, subgroup=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

get_value_match(vid, attributes=None, exact_match=False, entry_node=None)

get_values(vid, attribute=None, resolved=True, subgroup=None)

Same functionality as get_value but it returns a list, if the value in xml contains commas the list have multiple elements split on commas

overwrite_existing_entries()

set_default_value(vid, val)

set_valid_values(vid, new_valid_values)

set_value(vid, value, subgroup=None, ignore_type=False)

Set the value of an entry-id field to value Returns the value or None if not found subgroup is ignored in the general routine and applied in specific methods

CIME.XML.env_archive module

Interface to the env_archive.xml file. This class inherits from EnvBase

class CIME.XML.env_archive.EnvArchive(case_root=None, infile='env_archive.xml', read_only=False)

Bases: CIME.XML.archive_base.ArchiveBase, CIME.XML.env_base.EnvBase

get_entries()

get_entry_info(archive_entry)

get_rpointer_contents(archive_entry)

get_type_info(vid)

CIME.XML.env_base module

Base class for env files. This class inherits from EntryID.py

class CIME.XML.env_base.EnvBase(case_root, infile, schema=None, read_only=False)

Bases: CIME.XML.entry_id.EntryID

change_file(newfile, copy=False)

check_if_comp_var(vid, attribute=None, node=None)

cleanupnode(node)

Remove the <group>, <file>, <values> and <value> childnodes from node

get_children(name=None, attributes=None, root=None)

This is the critical function, its interface and performance are crucial.

You can specify attributes={key:None} if you want to select children with the key attribute but you don’t care what its value is.

get_nodes_by_id(varid)

get_value(vid, attribute=None, resolved=True, subgroup=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

scan_children(nodename, attributes=None, root=None)

set_components(components)

set_value(vid, value, subgroup=None, ignore_type=False)

Set the value of an entry-id field to value Returns the value or None if not found subgroup is ignored in the general routine and applied in specific methods

CIME.XML.env_batch module

Interface to the env_batch.xml file. This class inherits from EnvBase

class CIME.XML.env_batch.EnvBatch(case_root=None, infile='env_batch.xml', read_only=False)

Bases: CIME.XML.env_base.EnvBase

cancel_job(jobid)

cleanupnode(node)

Remove the <group>, <file>, <values> and <value> childnodes from node

compare_xml(other)

create_job_groups(batch_jobs, is_test)

get_all_queues(name=None)

get_batch_directives(case, job, overrides=None, output_format='default')

get_batch_mail_type(mail_type)

get_batch_system_type()

get_children(name=None, attributes=None, root=None)

This is the critical function, its interface and performance are crucial.

You can specify attributes={key:None} if you want to select children with the key attribute but you don’t care what its value is.

get_default_queue()

get_job_id(output)

get_job_overrides(job, case)

get_jobs()

get_queue_specs(qnode)

Get queue specifications from node.

Returns (nodemin, nodemax, jobname, walltimemax, jobmin, jobmax, is_strict)

get_status(jobid)

get_submit_args(case, job)

return a list of touples (flag, name)

get_type_info(vid)

get_value(item, attribute=None, resolved=True, subgroup=None)

Must default subgroup to something in order to provide single return value

make_all_batch_files(case)

make_batch_script(input_template, job, case, outfile=None)

queue_meets_spec(queue, num_nodes, num_tasks, walltime=None, job=None)

select_best_queue(num_nodes, num_tasks, name=None, walltime=None, job=None)

set_batch_system(batchobj, batch_system_type=None)

set_batch_system_type(batchtype)

set_job_defaults(batch_jobs, case)

set_value(item, value, subgroup=None, ignore_type=False)

Override the entry_id set_value function with some special cases for this class

submit_jobs(case, no_batch=False, job=None, user_prereq=None, skip_pnl=False, allow_fail=False, resubmit_immediate=False, mail_user=None, mail_type=None, batch_args=None, dry_run=False, workflow=True)

no_batch indicates that the jobs should be run directly rather that submitted to a queueing system job is the first job in the workflow sequence to start user_prereq is a batch system prerequisite as requested by the user skip_pnl indicates that the preview_namelist should not be run by this job allow_fail indicates that the prereq job need only complete not nessasarily successfully to start the next job resubmit_immediate indicates that all jobs indicated by the RESUBMIT option should be submitted at the same time instead of

waiting to resubmit at the end of the first sequence

workflow is a logical indicating whether only “job” is submitted or the workflow sequence starting with “job” is submitted

CIME.XML.env_build module

Interface to the env_build.xml file. This class inherits from EnvBase

class CIME.XML.env_build.EnvBuild(case_root=None, infile='env_build.xml', components=None, read_only=False)

Bases: CIME.XML.env_base.EnvBase

CIME.XML.env_case module

Interface to the env_case.xml file. This class inherits from EnvBase

class CIME.XML.env_case.EnvCase(case_root=None, infile='env_case.xml', components=None, read_only=False)

Bases: CIME.XML.env_base.EnvBase

CIME.XML.env_mach_pes module

Interface to the env_mach_pes.xml file. This class inherits from EntryID

class CIME.XML.env_mach_pes.EnvMachPes(case_root=None, infile='env_mach_pes.xml', components=None, read_only=False)

Bases: CIME.XML.env_base.EnvBase

add_comment(comment)

get_max_thread_count(comp_classes)

Find the maximum number of openmp threads for any component in the case

get_spare_nodes(num_nodes)

get_tasks_per_node(total_tasks, max_thread_count)

get_total_nodes(total_tasks, max_thread_count)

Return (num_active_nodes, num_spare_nodes)

get_total_tasks(comp_classes)

get_value(vid, attribute=None, resolved=True, subgroup=None, max_mpitasks_per_node=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

set_value(vid, value, subgroup=None, ignore_type=False)

Set the value of an entry-id field to value Returns the value or None if not found subgroup is ignored in the general routine and applied in specific methods

CIME.XML.env_mach_specific module

Interface to the env_mach_specific.xml file. This class inherits from EnvBase

class CIME.XML.env_mach_specific.EnvMachSpecific(caseroot=None, infile='env_mach_specific.xml', components=None, unit_testing=False, read_only=False, standalone_configure=False)

Bases: CIME.XML.env_base.EnvBase

allow_error()

Return True if stderr output from module commands should be assumed to be an error. Default False. This is necessary since implementations of environment modules are highlty variable and some systems produce stderr output even when things are working fine.

get_module_system_cmd_path(lang)

get_module_system_init_path(lang)

get_module_system_type()

Return the module system used on this machine

get_mpirun(case, attribs, job, exe_only=False, overrides=None)

Find best match, return (executable, {arg_name : text})

get_type_info(vid)

list_modules()

load_env(case, force_method=None, job=None, verbose=False)

Should only be called by case.load_env

make_env_mach_specific_file(shell, case, output_dir='')

Writes .env_mach_specific.sh or .env_mach_specific.csh

Args: shell: string - ‘sh’ or ‘csh’ case: case object output_dir: string - path to output directory (if empty string, uses current directory)

populate(machobj)

Add entries to the file using information from a Machines object.

save_all_env_info(filename)

Get a string representation of all current environment info and save it to file.

CIME.XML.env_run module

Interface to the env_run.xml file. This class inherits from EnvBase

class CIME.XML.env_run.EnvRun(case_root=None, infile='env_run.xml', components=None, read_only=False)

Bases: CIME.XML.env_base.EnvBase

CIME.XML.env_test module

Interface to the env_test.xml file. This class inherits from EnvBase

class CIME.XML.env_test.EnvTest(case_root=None, infile='env_test.xml', components=None, read_only=False)

Bases: CIME.XML.env_base.EnvBase

add_test(testnode)

cleanupnode(node)

keep the values component set

get_settings_for_phase(name, cnt)

get_step_phase_cnt(step)

get_test_parameter(name)

get_value(vid, attribute=None, resolved=True, subgroup=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

run_phase_get_clone_name(phase)

set_initial_values(case)

The values to initialize a test are defined in env_test.xml copy them to the appropriate case env files to initialize a test ignore fields set in the BUILD and RUN clauses, they are set in the appropriate build and run phases.

set_test_parameter(name, value)

If a node already exists update the value otherwise create a node and initialize it to value

set_value(vid, value, subgroup=None, ignore_type=False)

check if vid is in test section of file

CIME.XML.env_workflow module

Interface to the env_workflow.xml file. This class inherits from EnvBase

class CIME.XML.env_workflow.EnvWorkflow(case_root=None, infile='env_workflow.xml', read_only=False)

Bases: CIME.XML.env_base.EnvBase

create_job_groups(batch_jobs, is_test)

get_children(name=None, attributes=None, root=None)

This is the critical function, its interface and performance are crucial.

You can specify attributes={key:None} if you want to select children with the key attribute but you don’t care what its value is.

get_job_specs(case, job)

get_jobs()

get_type_info(vid)

get_value(item, attribute=None, resolved=True, subgroup='PRIMARY')

Must default subgroup to something in order to provide single return value

set_value(item, value, subgroup=None, ignore_type=False)

Override the entry_id set_value function with some special cases for this class

CIME.XML.expected_fails_file module

Interface to an expected failure xml file

Here is an example:

<?xml version= “1.0”?>

<expectedFails version=”1.1”>

<test name=”ERP_D_Ld10_P36x2.f10_f10_musgs.IHistClm50BgcCrop.cheyenne_intel.clm-ciso_decStart”>

<phase name=”RUN”>

<status>FAIL</status> <issue>#404</issue>

</phase> <phase name=”COMPARE_base_rest”>

<status>PEND</status> <issue>#404</issue> <comment>Because of the RUN failure, this phase is listed as PEND</comment>

</phase>

</test> <test name=”PFS_Ld20.f09_g17.I2000Clm50BgcCrop.cheyenne_intel”>

<phase name=”GENERATE”>

<status>FAIL</status> <issue>ESMCI/cime#2917</issue>

</phase> <phase name=”BASELINE”>

<status>FAIL</status> <issue>ESMCI/cime#2917</issue>

</phase>

</test>

</expectedFails>

However, many of the above elements are optional, for human consumption only (i.e., not parsed here). The only required elements are given by this example:

<?xml version= “1.0”?>

<expectedFails version=”1.1”>

<test name=”…”>

<phase name=”…”>

<status>…</status>

</phase>

</test>

</expectedFails>

class CIME.XML.expected_fails_file.ExpectedFailsFile(infile)

Bases: CIME.XML.generic_xml.GenericXML

get_expected_fails()

Returns a dictionary of ExpectedFails objects, where the keys are test names

CIME.XML.files module

Interface to the config_files.xml file. This class inherits from EntryID.py

class CIME.XML.files.Files(comp_interface='mct')

Bases: CIME.XML.entry_id.EntryID

get_components(nodename)

get_schema(nodename, attributes=None)

get_value(vid, attribute=None, resolved=True, subgroup=None)

Get a value for entry with id attribute vid. or from the values field if the attribute argument is provided and matches

set_value(vid, value, subgroup=None, ignore_type=False)

Set the value of an entry-id field to value Returns the value or None if not found subgroup is ignored in the general routine and applied in specific methods

CIME.XML.generic_xml module

Common interface to XML files, this is an abstract class and is expected to be used by other XML interface modules and not directly.

class CIME.XML.generic_xml.GenericXML(infile=None, schema=None, root_name_override=None, root_attrib_override=None, read_only=True)

Bases: object

class CacheEntry(tree, root, modtime)

Bases: tuple

property modtime

Alias for field number 2

property root

Alias for field number 1

property tree

Alias for field number 0

DISABLE_CACHING = False

add_child(node, root=None, position=None)

Add element node to self at root

attrib(node)

change_file(newfile, copy=False)

check_timestamp()

Returns True if timestamp matches what is expected

copy(node)

get(node, attrib_name, default=None)

get_child(name=None, attributes=None, root=None, err_msg=None)

get_children(name=None, attributes=None, root=None)

This is the critical function, its interface and performance are crucial.

You can specify attributes={key:None} if you want to select children with the key attribute but you don’t care what its value is.

get_element_text(element_name, attributes=None, root=None)

get_id()

get_optional_child(name=None, attributes=None, root=None, err_msg=None)

get_raw_record(root=None)

get_resolved_value(raw_value, allow_unresolved_envvars=False)

A value in the xml file may contain references to other xml variables or to environment variables. These are refered to in the perl style with $name and $ENV{name}.

>>> obj = GenericXML()
>>> os.environ["FOO"] = "BAR"
>>> os.environ["BAZ"] = "BARF"
>>> obj.get_resolved_value("one $ENV{FOO} two $ENV{BAZ} three")
'one BAR two BARF three'
>>> obj.get_resolved_value("2 + 3 - 1")
'4'
>>> obj.get_resolved_value("0001-01-01")
'0001-01-01'
>>> obj.get_resolved_value("$SHELL{echo hi}") == 'hi'
True

get_value(item, attribute=None, resolved=True, subgroup=None)

get_value is expected to be defined by the derived classes, if you get here the value was not found in the class.

get_values(vid, attribute=None, resolved=True, subgroup=None)

get_version()

has(node, attrib_name)

classmethod invalidate(filename)

lock()

A subclass is doing caching, we need to lock the tree structure in order to avoid invalidating cache.

make_child(name, attributes=None, root=None, text=None)

make_child_comment(root=None, text=None)

name(node)

pop(node, attrib_name)

read(infile, schema=None)

Read and parse an xml file into the object

read_fd(fd)

remove_child(node, root=None)

scan_child(nodename, attributes=None, root=None)

Get an xml element matching nodename with optional attributes.

Error unless exactly one match.

scan_children(nodename, attributes=None, root=None)

scan_optional_child(nodename, attributes=None, root=None)

Get an xml element matching nodename with optional attributes.

Return None if no match.

set(node, attrib_name, value)

set_element_text(element_name, new_text, attributes=None, root=None)

set_name(node, name)

set_text(node, text)

set_value(vid, value, subgroup=None, ignore_type=True)

ignore_type is not used in this flavor

text(node)

to_string(node, method='xml', encoding='us-ascii')

unlock()

validate_timestamp()

validate_xml_file(filename, schema)

validate an XML file against a provided schema file using pylint

write(outfile=None, force_write=False)

Write an xml file from data in self

CIME.XML.grids module

Common interface to XML files which follow the grids format, This is not an abstract class - but inherits from the abstact class GenericXML

class CIME.XML.grids.Grids(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_grid_info(name, compset, driver)

Find the matching grid node

print_values(long_output=None)

CIME.XML.headers module

Interface to the config_headers.xml file. This class inherits from EntryID.py

class CIME.XML.headers.Headers(infile=None)

Bases: CIME.XML.generic_xml.GenericXML

get_header_node(fname)

CIME.XML.inputdata module

Interface to the config_inputdata.xml file. This class inherits from GenericXML.py

class CIME.XML.inputdata.Inputdata(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_next_server()

CIME.XML.machines module

Interface to the config_machines.xml file. This class inherits from GenericXML.py

class CIME.XML.machines.Machines(infile=None, files=None, machine=None, extra_machines_dir=None)

Bases: CIME.XML.generic_xml.GenericXML

get_child(name=None, attributes=None, root=None, err_msg=None)

get_default_MPIlib(attributes=None)

Get the MPILIB to use from the list of MPILIBS

get_default_compiler()

Get the compiler to use from the list of COMPILERS

get_field_from_list(listname, reqval=None, attributes=None)

Some of the fields have lists of valid values in the xml, parse these lists and return the first value if reqval is not provided and reqval if it is a valid setting for the machine

get_first_child_nodes(nodename)

Return the names of all the child nodes for the target machine

get_machine_name()

Return the name of the machine

get_machines_dir()

Return the directory of the machines file

get_node_names()

Return the names of all the child nodes for the target machine

get_suffix(suffix_type)

get_value(name, attributes=None, resolved=True, subgroup=None)

Get Value of fields in the config_machines.xml file

has_batch_system()

Return if this machine has a batch system

>>> machobj = Machines(machine="cori-knl")
>>> machobj.has_batch_system()
True
>>> machobj.set_machine("melvin")
'melvin'
>>> machobj.has_batch_system()
False

is_valid_MPIlib(mpilib, attributes=None)

Check the MPILIB is valid for the current machine

>>> machobj = Machines(machine="cori-knl")
>>> machobj.is_valid_MPIlib("mpi-serial")
True
>>> machobj.is_valid_MPIlib("fake-mpi")
False

is_valid_compiler(compiler)

Check the compiler is valid for the current machine

>>> machobj = Machines(machine="cori-knl")
>>> machobj.get_default_compiler()
'intel'
>>> machobj.is_valid_compiler("gnu")
True
>>> machobj.is_valid_compiler("nag")
False

list_available_machines()

Return a list of machines defined for a given CIME_MODEL

print_values()

probe_machine_name(warn=True)

Find a matching regular expression for hostname in the NODENAME_REGEX field in the file. First match wins.

return_values()

return a dictionary of machine info This routine is used by external tools in https://github.com/NCAR/CESM_xml2html

set_machine(machine)

Sets the machine block in the Machines object

>>> machobj = Machines(machine="melvin")
>>> machobj.get_machine_name()
'melvin'
>>> machobj.set_machine("trump") 
Traceback (most recent call last):
...
CIMEError: ERROR: No machine trump found

set_value(vid, value, subgroup=None, ignore_type=True)

ignore_type is not used in this flavor

CIME.XML.namelist_definition module

Interface to namelist_definition.xml.

This module contains only one class, NamelistDefinition, inheriting from EntryID.

class CIME.XML.namelist_definition.CaseInsensitiveDict(data)

Bases: dict

Basic case insensitive dict with strings only keys. From https://stackoverflow.com/a/27890005

get(k, default=None)

Return the value for key if key is in the dictionary, else default.

proxy = {}

class CIME.XML.namelist_definition.NamelistDefinition(infile, files=None)

Bases: CIME.XML.entry_id.EntryID

Class representing variable definitions for a namelist. This class inherits from EntryID, and supports most inherited methods; however, set_value is unsupported.

Additional public methods: - dict_to_namelist. - is_valid_value - validate

add_attributes(attributes)

dict_to_namelist(dict_, filename=None)

Converts a dictionary of name-value pairs to a Namelist.

The input is assumed to be similar to the output of parse when groupless=True is set. This function uses the namelist definition file to look up the namelist group associated with each variable, and uses this information to create a true Namelist object.

The optional filename argument can be used to assist in error reporting when the namelist comes from a specific, known file.

get_default_value(item, attribute=None)

Return the default value for the variable named item.

The return value is a list of strings corresponding to the comma-separated list of entries for the value (length 1 for scalars). If there is no default value in the file, this returns None.

get_entry_nodes()

get_group(name)

get_input_pathname(name)

get_per_stream_entries()

get_value_match(vid, attributes=None, exact_match=True, entry_node=None)

Return the default value for the variable named vid.

The return value is a list of strings corresponding to the comma-separated list of entries for the value (length 1 for scalars). If there is no default value in the file, this returns None.

is_valid_value(name, value)

Determine whether a value is valid for the named variable.

The value argument must be a list of strings formatted as they would appear in the namelist (even for scalar variables, in which case the length of the list is always 1).

set_nodes(skip_groups=None)

populates the object data types for all nodes that are not part of the skip_groups array returns nodes that do not have attributes of skip_default_entry or per_stream_entry

set_value(vid, value, subgroup=None, ignore_type=True)

This function is not implemented.

split_type_string(name)

Split a ‘type’ attribute string into its component parts.

The name argument is the variable name. This is used for error reporting purposes.

The return value is a tuple consisting of the type itself, a length (which is an integer for character variables, otherwise None), and the size of the array (which is 1 for scalar variables).

validate(namelist, filename=None)

Validate a namelist object against this definition.

The optional filename argument can be used to assist in error reporting when the namelist comes from a specific, known file.

CIME.XML.pes module

Interface to the config_pes.xml file. This class inherits from GenericXML.py

class CIME.XML.pes.Pes(infile, files=None)

Bases: CIME.XML.generic_xml.GenericXML

find_pes_layout(grid, compset, machine, pesize_opts='M', mpilib=None)

CIME.XML.pio module

Class for config_pio files . This class inherits from EntryID.py

class CIME.XML.pio.PIO(comp_classes, infile=None, files=None)

Bases: CIME.XML.entry_id.EntryID

check_if_comp_var(vid, attribute=None, node=None)

get_defaults(grid=None, compset=None, mach=None, compiler=None, mpilib=None)

CIME.XML.standard_module_setup module

CIME.XML.stream module

Interface to the streams.xml style files. This class inherits from GenericXML.py

stream files predate cime and so do not conform to entry id format

class CIME.XML.stream.Stream(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_value(item, attribute=None, resolved=True, subgroup=None)

Get Value of fields in a stream.xml file

CIME.XML.test_reporter module

Interface to the testreporter xml. This class inherits from GenericXML.py

class CIME.XML.test_reporter.TestReporter

Bases: CIME.XML.generic_xml.GenericXML

add_result(test_name, test_status)

push2testdb()

setup_header(tagname, machine, compiler, mpilib, testroot, testtype, baseline)

CIME.XML.testlist module

Interface to the config_files.xml file. This class inherits from generic_xml.py It supports version 2.0 of the testlist.xml file

In version 2 of the file options can be specified to further refine a test or set of tests. They can be specified either at the top level, in which case they apply to all machines/compilers for this test:

<test …>

<options>

<option name=”wallclock”>00:20</option>

</options> …

</test>

or at the level of a particular machine/compiler:

<test …>

<machines>

<machine …>

<options>

<option name=”wallclock”>00:20</option>

</options>

</machine>

</machines>

</test>

Currently supported options are:

• walltime: sets the wallclock limit in the queuing system

• memleak_tolerance: specifies the relative memory growth expected for this test

• comment: has no effect, but is written out when printing the test list

• workflow: adds a workflow to the test

class CIME.XML.testlist.Testlist(infile, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_tests(machine=None, category=None, compiler=None, compset=None, grid=None, supported_only=False)

CIME.XML.tests module

Interface to the config_tests.xml file. This class inherits from GenericEntry

class CIME.XML.tests.Tests(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_test_node(testname)

print_values(skip_infrastructure_tests=True)

Print each test type and its description.

If skip_infrastructure_tests is True, then this does not write information for tests with the attribute INFRASTRUCTURE_TEST=”TRUE”.

CIME.XML.testspec module

Interface to the testspec.xml file. This class inherits from generic_xml.py

class CIME.XML.testspec.TestSpec(infile)

Bases: CIME.XML.generic_xml.GenericXML

add_test(compiler, mpilib, testname)

set_header(testroot, machine, testid, baselinetag=None, baselineroot=None)

update_test_status(testname, phase, status)

CIME.XML.workflow module

Interface to the config_workflow.xml file. This class inherits from GenericXML.py

class CIME.XML.workflow.Workflow(infile=None, files=None)

Bases: CIME.XML.generic_xml.GenericXML

get_workflow_jobs(machine, workflowid='default')

Return a list of jobs with the first element the name of the script and the second a dict of qualifiers for the job

Module contents