Modern Quality Engineering Lab · reports Repository ↗ · ozgurcetintas.dev ↗

Published by CI · commit e69b65f · 2026-09-14

The evidence, not the claim.

Every push to main runs the lab's quality gates and publishes their evidence here. The repository README explains which layer each risk is tested at; these pages show what the last run actually saw.

run #10

Quality gates · what the last run proved
  1. 01

    Unit and API tests

    Table-driven validation boundaries and in-process HTTP semantics (400 vs 500, malformed JSON, failing repository). Coverage thresholds enforced.

    CI job ↗
  2. 02

    Mutation testing

    Stryker injects faults into src/ and counts how many the suites catch. CI fails under 80%. Surviving mutants are highlighted in source.

    Report ↗
  3. 03

    Contract tests

    The UI client's Pact is generated by the consumer test and replayed against the real Express app in the same job; the pact file is uploaded as an artifact.

    CI job ↗
  4. 04

    Integration with PostgreSQL

    A disposable postgres:16 container proves the CHECK and primary-key constraints and the full HTTP-to-database path.

    CI job ↗
  5. 05

    Browser E2E and accessibility

    The checkout journey verified through the API, two mocked failure paths, and axe-core WCAG scans before and after interaction.

    Report ↗
  6. 06

    Performance

    k6 protocol test against the lab booted inside the runner, gated on p95 and error-rate thresholds.

    1,000 requests · p95 2.22 ms · 0.00% failed · thresholds met · run #2 on 2026-09-14

    Summary ↗
  7. 07

    Observability

    The instrumented server is started during publishing, three requests are sent, and the exported spans are kept as evidence.

    12 spans exported by Node auto-instrumentation for three requests (health, checkout, order lookup)

    Spans ↗
  8. 08

    AI evaluation

    Promptfoo checks a fictional support assistant for valid JSON, mandatory escalation and refusal of data requests. Runs on demand with a model key.

    Not run yet: add an ANTHROPIC_API_KEY repository secret and dispatch the ai-eval workflow.

    Runs ↗
Also in the repository

Test strategy · Decision records · CI runs · TestPlan Studio, which uses this lab as its demo target