Skip to content

Test Reliability: Investigate improving reliability of unit tests that provision #150

Closed
@bryphe-coder

Description

@bryphe-coder

We're leveraging terraform for some of our unit tests, and ended up needing to bump up a timeout - this is the PR where the timeout was bumped up: #149

And an example failure log:
https://github.com/coder/coder/runs/5043435263?check_suite_focus=true#step:7:32

The challenge is that the current tests use terraform and need to wait for the provisioner job to complete - but terraform time to execution can vary a bit on our CI env, even for a very minimal HCL script.

An alternate approach we could consider is using an echo provisioner - a provisioner that just emits some output, and use that for these unit tests. In that case, though, we'd still want a test that exercises our terraform flow - so we'd need a category of integration tests that could take a bit more execution time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    apiArea: HTTP API

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions