Skip to main content

Ecosystem

WDL has a rich, distributed ecosystem of interconnected developer tools and execution engines to ensure (a) users can quickly write high-quality, idiomatic workflows, and (b) scaling the execution of those workflows within any computation environment is a breeze.

Tip

The WDL ecosystem is rapidly evolving, and, while we're always looking to expand the list of known ecosystem tools, sometimes tools get missed. If you know of a tool that needs to be listed here but isn't, we encourage you to create a pull request and let us know!

Execution Engines

The following list contains the known execution engines listed alphabetically.

EngineTypeVersionLocalSlurmIBM LSFAmazon AWSMicrosoft AzureGoogle Cloud
AWS HealthOmicsHostedv1.1———✓——
CromwellBinaryv1.0✓✓✓✓—✓
dxCompilerBinaryv1.1———✓ (DNAnexus)✓ (DNAnexus)—
miniwdlBinaryv1.2✓✓ (plugin)✓ (plugin)✓ (plugin)——
SprocketBinaryv1.3✓✓✓✓ (TES)✓ (TES)✓ (TES)
TerraHostedv1.0—————✓
ToilBinaryv1.1✓✓✓✓—✓

IDE Support

Extensions and other IDE support tools listed sorted by the editor.

NameActive*EditorSupports
Sprocket (LSP)★Editors with LSPFormatting, linting, snippets, syntax highlighting, and validation.
wdl-mode☆EmacsSyntax highlighting.
poly-wdl☆EmacsIntegration with polymode.
Sprocket for IntelliJ★JetBrains IDEsFormatting, completions, diagnostics, navigation, and syntax highlighting.
Winstanly WDL☆JetBrains IDEsLinting and syntax highlighting.
wdl-sublime☆Sublime TextSyntax highlighting.
sprocket.nvim★NeovimFormatting, linting, snippets, syntax highlighting, and validation.
wdl-vim☆VimSyntax highlighting.
Sprocket (extension)★Visual Studio CodeFormatting, linting, snippets, syntax highlighting, and validation.
Syntax Highlighter☆Visual Studio CodeSyntax highlighting.
Sprocket for Zed★ZedCompletions, diagnostics, navigation, and syntax highlighting.

* Active: A filled star (★) marks a project with a commit or release within the past 12 months; an unfilled star (☆) marks one without qualifying activity. Archived and deprecated projects receive an unfilled star.

Development Tools

The following are tools to enhance the experience of working with WDL sorted by the category.

NameActive*CategoryDescription
wdl-tests☆Conformance testingConformance tests for WDL execution engines. (Deprecated)
wdl-aid☆Documentation generation"Automatic input generation for WDL worflows."
pytest-workflow☆TestingTesting framework for workflow languages (including WDL).
wdl-atlas★Documentation generationGenerate interactive HTML and workflow diagrams.
wdldoc☆Documentation generation"Create WDL documentation using Markdown."
wdl-packager☆Package management"Package a WDL and imports into a zip file."
pytest-wdl☆Testing"WDL plugin for pytest."
spectool★Conformance testing"A conformance testing tool for WDL."

* Active: A filled star (★) marks a project with a commit or release within the past 12 months; an unfilled star (☆) marks one without qualifying activity. Archived and deprecated projects receive an unfilled star.

Community Workflows

The following is an incomplete list of large WDL workflow repositories sorted by name.

NameDescription
BioWDL — LUMC"Bioinformatics workflows and tasks, written in WDL." BioWDL is a large GitHub organization that contains the WDL workflows developed at LUMC (link).
Chan Zuckerberg — Chan Zuckerberg InitiativeOfficial repository for the WDL workflows developed at the Chan Zuckerberg Initiative for the CZID platform (link).
Dockstore — MultipleDockstore describes itself as "an app store for bioinformatics"—it's an open source platform for sharing analytical tools and workflows. WDL is one of the supported languages.
ENCODE — ENCODE ConsortiumOfficial repository of the ENCODE Data Coordinating Center's Uniform Processing Pipelines. These pipelines are designed to "create high-quality, consistent, and reproducible data" for the ENCODE project.
GATK — Broad InstituteOfficial GATK best practices workflows developed at and published by the Broad Institute's Data Sciences Platform.
PacBio — Pacific BiosciencesOfficial repository for the best practices workflows for PacBio data.
St. Jude Cloud — St. Jude Children's Research HospitalOfficial repository for data processing pipelines used on St. Jude Cloud (link).
Thiagen — Theiagen GenomicsOfficial repository of Thiagen's WDL workflows.
WARP — Broad InstituteWARP stands for "WDL Research Analysis Pipelines" and contains cloud-optimized pipelines for processing biological data from the Broad Institute Data Sciences Platform.
WILDS WDL Library — Fred Hutch Cancer CenterA centralized collection of reusable WDL modules and pipelines for bioinformatics research, featuring tested components for tools like STAR, BWA, GATK, and more. See documentation for guides and usage examples.