Travis builds by user access
For infrastructures that require secured credentials, cloud backend tests only run for developers with write access to the broadinstitute/cromwell GitHub. Secure tests are skipped for all other users.
Other backends run tests for any user.
Backend | Read-only users | Write/Admin users |
---|---|---|
AWS | ✅ | |
Local | ✅ | ✅ |
PAPI V2alpha1 | ✅ | |
PAPI V2beta | ✅ | |
SLURM | ✅ | ✅ |
TES | ✅ | ✅ |
Upgrade / Horicromtal / etc.
CI Test Type | Cromwell Config | Centaur Config |
---|---|---|
Engine Upgrade | (backend)_application.conf |
centaur_application.conf * |
Horicromtal | papi_[v2beta or v2alpha1]_horicromtal_application.conf ** |
centaur_application_ horicromtal.conf |
Horicromtal Engine Upgrade |
papi_v2beta_application.conf ** |
centaur_application_ horicromtal_no_assert.conf |
Papi Upgrade | papi_v1_v2alpha1_upgrade_application.conf ** |
centaur_application.conf * |
Papi Upgrade New Workflows |
(backend)_application.conf |
centaur_application.conf * |
WDL Upgrade | (backend)_application.conf |
centaur_application.conf * |
(other) | (backend)_application.conf |
centaur_application.conf * |
CI Test Type | ScalaTest Spec | Test Directory |
---|---|---|
Engine Upgrade | EngineUpgradeTestCaseSpec |
engineUpgradeTestCases |
Horicromtal | CentaurTestSuite |
standardTestCases *** |
Horicromtal Engine Upgrade |
EngineUpgradeTestCaseSpec |
engineUpgradeTestCases *** |
PAPI Upgrade | PapiUpgradeTestCaseSpec |
papiUpgradeTestCases |
PAPI Upgrade New Workflows |
CentaurTestSuite |
papiUpgradeNewWorkflowsTestCases |
WDL Upgrade | WdlUpgradeTestCaseSpec |
standardTestCases **** |
(other) | CentaurTestSuite |
standardTestCases |
* Centaur Config always uses centaur_application.conf
except when overridden with papi_v2alpha1_centaur_application.conf
or papi_v2beta_centaur_application.conf
(48 preview link)
** Cromwell Config overrides
(47 link)
*** Test Directory overrides
(47 link)
**** Test Directory only tests tagged with wdl_upgrade
(47 link)
- Engine Upgrade: Retrieves the Cromwell Version then retrieves the previous jar/docker-image from DockerHub. Centaur starts with the prior version, then restarts with the compiled source code.
- Horicromtal: Runs a docker-compose with:
- db-mstr: started first
- sum-back: runs summarizer
- front-back: exposes HTTP
- Horicromtal Engine Upgrade: Combination of Horicromtal and Engine Upgrade
- PAPI Upgrade: Tests run with an older version of Papi and upon restart use a newer version of Papi
- PAPI Upgrade New Workflows: Test definition does not run any tests
- WDL Upgrade: Upgrades WDL from draft-2 to 1.0 before testing
- (other): Runs
*.test
files listing the configured backend names
RDBMS
Backend | MySQL | PostgreSQL | MariaDB |
---|---|---|---|
AWS | ✅ | ||
Local | ✅ | ✅ | |
PAPI V2 | ✅ | ⭕ | |
SLURM | ✅ | ||
TES | ✅ |
⭕ Tests Horicromtal Engine Upgrade versus standard Centaur suite
All backends run against MySQL. The Local backend also test PostgreSQL, allowing contributors ensure WDLs work with PostgreSQL. MariaDB is tested on a specialized upgrade, where the MySQL connector client is used first, and the MariaDB client is used after restart.