WDL Source to WOM Conversion
Parsing Flowchart
For the various versions of WDL supported in Cromwell, the conversion to WOM follows these paths:
Process Description
You can think of WDL parsing in Cromwell in terms of the following major steps:
- Lexing: Converting the raw WDL string into a one dimensional stream of "tokens".
- Parsing: Converting the stream of tokens into an abstract syntax tree (AST).
- Transliteration: Transforming the language-specific AST into a standard set of Scala objects
- Import Resolution: Recursively processing any import statements into WOM bundles.
- Linking: Discovering, resolving and recording all references within the AST and imports.
- WOM Building: Creating a set of WOM objects
- Input Validation: Link any provided inputs to inputs on the WOM objects.
Intermediate Data Formats
- WDL Object Model (WDLOM):
- A Scala case class representation of WDL grammar ASTs.
- Linked inputs:
- The original WDL source's WDLOM representation
- And WOM bundles imported
- Links from any references to their definitions
- Including custom type references, variable references, task calls, subworkflow calls
- WOM Bundle:
- A set of tasks, workflows and custom types, and the fully qualified names by which they can be referenced.
- In Cromwell's WOM format (the WOM format is the ultimate destination for all languages, including WDL)
- Validated WOM Namespace:
- The conjunction of a WOM bundle with an input set.
- The entry point workflow is known.