Skip to main content

Ecosystem

WDL has a rich, distributed ecosystem of interconnected developer tools and execution engines to ensure (a) users can quickly write high-quality, idiomatic workflows, and (b) scaling the execution of those workflows within any computation environment is a breeze.

Tip

The WDL ecosystem is rapidly evolving, and, while we're always looking to expand the list of known ecosystem tools, sometimes tools get missed. If you know of a tool that needs to be listed here but isn't, we encourage you to create a pull request and let us know!

Execution Engines

The following list contains the known execution engines listed alphabetically.

EngineTypeVersionLocalSlurmIBM LSFAmazon AWSMicrosoft AzureGoogle Cloud
AWS HealthOmicsHostedv1.1
CromwellBinaryv1.0
dxCompilerBinaryv1.1✓ (DNAnexus)✓ (DNAnexus)
miniwdlBinaryv1.2✓ (plugin)✓ (plugin)✓ (plugin)
SprocketBinaryv1.3✓ (TES)✓ (TES)✓ (TES)
TerraHostedv1.0
ToilBinaryv1.1

IDE Support

Extensions and other IDE support tools listed sorted by the editor.

NameActive*EditorSupports
Sprocket (LSP)Editors with LSPFormatting, linting, snippets, syntax highlighting, and validation.
wdl-modeEmacsSyntax highlighting.
poly-wdlEmacsIntegration with polymode.
Sprocket for IntelliJJetBrains IDEsFormatting, completions, diagnostics, navigation, and syntax highlighting.
Winstanly WDLJetBrains IDEsLinting and syntax highlighting.
wdl-sublimeSublime TextSyntax highlighting.
sprocket.nvimNeovimFormatting, linting, snippets, syntax highlighting, and validation.
wdl-vimVimSyntax highlighting.
Sprocket (extension)Visual Studio CodeFormatting, linting, snippets, syntax highlighting, and validation.
Syntax HighlighterVisual Studio CodeSyntax highlighting.
Sprocket for ZedZedCompletions, diagnostics, navigation, and syntax highlighting.

* Active: A filled star (★) marks a project with a commit or release within the past 12 months; an unfilled star (☆) marks one without qualifying activity. Archived and deprecated projects receive an unfilled star.

Development Tools

The following are tools to enhance the experience of working with WDL sorted by the category.

NameActive*CategoryDescription
wdl-testsConformance testingConformance tests for WDL execution engines. (Deprecated)
wdl-aidDocumentation generation"Automatic input generation for WDL worflows."
pytest-workflowTestingTesting framework for workflow languages (including WDL).
wdl-atlasDocumentation generationGenerate interactive HTML and workflow diagrams.
wdldocDocumentation generation"Create WDL documentation using Markdown."
wdl-packagerPackage management"Package a WDL and imports into a zip file."
pytest-wdlTesting"WDL plugin for pytest."
spectoolConformance testing"A conformance testing tool for WDL."

* Active: A filled star (★) marks a project with a commit or release within the past 12 months; an unfilled star (☆) marks one without qualifying activity. Archived and deprecated projects receive an unfilled star.

Community Workflows

The following is an incomplete list of large WDL workflow repositories sorted by name.

NameDescription
BioWDLLUMC"Bioinformatics workflows and tasks, written in WDL." BioWDL is a large GitHub organization that contains the WDL workflows developed at LUMC (link).
Chan ZuckerbergChan Zuckerberg InitiativeOfficial repository for the WDL workflows developed at the Chan Zuckerberg Initiative for the CZID platform (link).
DockstoreMultipleDockstore describes itself as "an app store for bioinformatics"—it's an open source platform for sharing analytical tools and workflows. WDL is one of the supported languages.
ENCODEENCODE ConsortiumOfficial repository of the ENCODE Data Coordinating Center's Uniform Processing Pipelines. These pipelines are designed to "create high-quality, consistent, and reproducible data" for the ENCODE project.
GATKBroad InstituteOfficial GATK best practices workflows developed at and published by the Broad Institute's Data Sciences Platform.
PacBioPacific BiosciencesOfficial repository for the best practices workflows for PacBio data.
St. Jude CloudSt. Jude Children's Research HospitalOfficial repository for data processing pipelines used on St. Jude Cloud (link).
ThiagenTheiagen GenomicsOfficial repository of Thiagen's WDL workflows.
WARPBroad InstituteWARP stands for "WDL Research Analysis Pipelines" and contains cloud-optimized pipelines for processing biological data from the Broad Institute Data Sciences Platform.
WILDS WDL LibraryFred Hutch Cancer CenterA centralized collection of reusable WDL modules and pipelines for bioinformatics research, featuring tested components for tools like STAR, BWA, GATK, and more. See documentation for guides and usage examples.