Project 02 / 04

Qyrus API Testing

Product Designer / 8 months / 2025


Qyrus could run API requests, but teams still had to clone scenarios, script advanced checks, hand-map dependencies, and piece together results across separate surfaces. I redesigned it into one workflow that starts with a real API, turns it into reusable coverage, connects end-to-end flows, and keeps the next action readable.

Qyrus-API Enterprise API testing screen
Qyrus API TestingAPI quality workspace

Impact

  • API Discovery

    Bring real requests into testing from live capture or import.

  • One test, many scenarios

    Parameterized data replaces cloned scenarios.

  • AI-assisted authoring

    AI explains endpoints and suggests editable tests and assertions.

  • End-to-end API Flows

    Functional and performance reporting stay tied to the journey.

Qualitative adoption signals from 2025 product research. These labels describe workflow capabilities, not measured deltas, and no unsupported percentages are claimed.


Complete coverage was hard to maintain

Running one request was manageable. The workflow broke down when teams added new datasets, advanced assertions, dependent APIs, performance checks, and release reporting. Each extra scenario created more setup to repeat and more places to lose the reason behind a failure.

Decision trailProblem decision chain
01
Evidence
Internal discovery showed that import, authoring, reusable setup, execution, and debugging lived across disconnected work.
Insight
The product risk was not only time loss; it was losing the reason behind each test decision.
Decision
Treat the API contract, generated checks, data, runs, and failure evidence as one reviewable record.
Product change
The case-study spine follows the lifecycle from source discovery or import to diagnosis.
Outcome or limitation
The workflow change is supported by screens and discovery notes; speed, adoption, and rollout impact remain unmeasured.
API libraryDefinitions, ownership, connections, and run modes stay visible in one workspace.
  • New datasets usually meant cloned requests.
  • Advanced checks and mappings often still needed scripts.
  • Dependent APIs were connected by hand.
  • Functional, performance, and reporting work lived apart.

Research showed two audiences and one workflow gap

Interviews with more than 30 QA professionals and managers followed the work from the first API to release readiness. We tracked where people duplicated effort, wrote code for routine setup, lost context between requests, or could not explain a failed run.

That split into two needs: QA engineers needed depth inside each test, while QA managers needed a fast read on release readiness across the whole journey. The July 2025 market review confirmed that import and execution were common; the bigger gap sat between them, in reuse, dependency mapping, and journey-level understanding.

Primary users

QA engineers

Build and maintain coverage across changing APIs, datasets, and environments.

What they need to do
Create reliable scenarios quickly and understand exactly why a run failed.
What gets in the way
  • Cloned requests created maintenance work.
  • Assertions, extraction, and chaining often required code.
How the design responds
Reusable data, no-code checks, AI assistance, and direct failure evidence.

QA managers

Review quality and release risk across projects, teams, and business journeys.

What they need to do
See pass rates, failure points, coverage, and performance at a glance.
What gets in the way
  • Results were fragmented across individual APIs.
  • Functional and performance views were separated.
How the design responds
Flow-level reporting that connects the summary to the failed step.

Internal discovery research, 2025. Interview material is not public, so no direct quotes are used.

Ten products reviewed

API clients
Postman · Insomnia · Bruno · Hoppscotch
Enterprise / no-code platforms
Testsigma · ReadyAPI · SoapUI · Katalon Studio
Code-first frameworks
Karate · REST Assured

Feature comparison

As it stood in July 2025

See what else was out there in July 2025
This is what each product's own public docs showed in July 2025, while I was deciding what Q-API still needed to do differently. A check means their docs showed it by then; an × means I couldn't confirm it there — not proof they didn't have it. Third-party integrations didn't count as a built-in feature.
CapabilityQ-APIPostmanTestsigmaReadyAPIKatalonKarate
Spec and collection import
AI-assisted test generation
Visual or no-code authoring
Reusable parameter and dataset mapping
Functional and performance continuity
AI generate → execute → saved report
Persistent reports and failure diagnosis
Enterprise orchestration and governance

Spec and collection import

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

AI-assisted test generation

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

Visual or no-code authoring

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

Reusable parameter and dataset mapping

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

Functional and performance continuity

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

AI generate → execute → saved report

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

Persistent reports and failure diagnosis

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

Enterprise orchestration and governance

Q-API
Postman
Testsigma
ReadyAPI
Katalon
Karate

This is what each product's own public docs showed in July 2025, while I was deciding what Q-API still needed to do differently. A check means their docs showed it by then; an × means I couldn't confirm it there — not proof they didn't have it. Third-party integrations didn't count as a built-in feature.

Sources: Postman performance, Testsigma 2025 AI, Testsigma API, ReadyAPI May 2025, ReadyAPI AI timing, Katalon 2024 AI, Karate 1.5.1

  • How an API enters the workspace
  • How one request becomes many scenarios
  • How data moves between dependent APIs
  • How engineers debug and managers judge a release

The clearest insight: teams needed to test both the request and the journey it belonged to.

An early MVP tested the direction

Before the refined workspace, a lower-fidelity MVP explored one question: would testers use a single place to bring in an API, inspect it, add checks, and chain requests into a journey?

It tested the direction that later became the enterprise workflow shown below: start with a real API, reuse what changes, connect dependent steps, use AI where it helps, and keep results reviewable.

Product pillars

  1. 01

    Discover

    Before
    Testing began with manual setup or a static file.
    Design decision
    Support familiar imports and capture live API activity.
    Why it helps
    Start with real request and response context.
  2. 02

    Reuse

    Before
    A new dataset meant another copy of the same test.
    Design decision
    Parameterize one request with reusable scenario data.
    Why it helps
    Grow coverage without growing maintenance at the same rate.
  3. 03

    Connect

    Before
    Dependencies were mapped one response at a time.
    Design decision
    Build API Flows with visible order, mappings, and conditions.
    Why it helps
    Test the business journey, not isolated requests.
  4. 04

    Assist

    Before
    Understanding, assertions, and mappings demanded specialist effort.
    Design decision
    Use AI to suggest editable tests, checks, data, and flows.
    Why it helps
    Move faster while keeping the tester in control.
  5. 05

    Read

    Before
    Functional, performance, and failure evidence were separated.
    Design decision
    Run both modes from the same setup and connect summaries to detail.
    Why it helps
    Give engineers and managers one shared view of quality.
Playground (MVP)The first cut brought an API in by link, file, extension, or manual setup.
Explore and assert (MVP)One request could be sent and checked with header and path test cases against a live response.
Flow builder (MVP)Early API Flows connected requests with a wait step on a drag-and-drop canvas.
Flow report (MVP)The MVP already tied a run's passed and failed steps back to the flow that produced them.

The MVP explored the loop; the sections that follow show how it was refined into the enterprise workspace.

Method note: these are early wireframes shown to document how the direction was tested. They are not evidence of measured adoption or validated results.

Start with a real API

Teams could import OpenAPI, Postman, or cURL, configure an API manually, or capture live traffic through API Discovery. Captured requests stayed visible and editable before moving into a suite, so discovery became part of testing instead of a disconnected pre-step.

Discovery entrySetup and recording actions stay explicit.
Live captureBring real browser requests into the testing workflow.
Workflow handoffKeep the completed capture visible while selecting what moves forward.
Browser recorderSync requests from the active page into the Qyrus workspace.
Loading stateProgress remains visible while the next workspace view prepares.
Request configurationDefine the request and its reusable inputs before connecting it to a larger flow.

Let AI explain and generate

AI did not replace authoring; it reduced blank-page setup. After import, it explained what an endpoint did, surfaced the request and response details, and suggested checks the tester could review before anything entered a suite.

That made the assistive layer concrete: explain the endpoint, show what matters, generate header, JSON path, and schema checks, then keep everything editable so the tester remains in control.

AI workspaceThe empty state explains the available starting points.
Imported API reviewChoose which endpoints move into testing.
Endpoint explanationKeep the API purpose beside its request and response details.
Generated test casesReview and edit checks before they enter a suite.

Build one test for many scenarios

Instead of cloning a request for every edge case, testers selected the values that changed and mapped them to reusable datasets across path, header, query, and body fields. One suite could then cover valid, invalid, boundary, role, environment, functional, and performance scenarios while preserving a single test definition.

That changed maintenance as much as authoring. When the request or assertion changed, teams updated the shared definition and reran the suite instead of repairing a stack of near-identical copies.

Parameterized testingOne test definition can use changing scenario data without being cloned.
SchedulerKeep cadence, run type, ownership, and history together.

Read test-suite results without losing context

Once one reusable definition powered many runs, results had to stay attached to that same definition. Functional reports showed suite and API status, expected-versus-actual values, timing, and the failed step without forcing teams into a separate debugging flow.

The same context carried into repair. The test-case editor kept assertions editable for the next run, while performance reports reused the suite setup to show completion and response-time behavior across the execution.

Test-suite resultsIdentify the failed API and preserve the execution evidence around it.
Assertion repairKeep the test case that needs work editable for the next run.
Performance reportReview completion and response-time behavior for the test suite execution.

Build and report the end-to-end API journey

API Flows started with an explicit empty canvas, then kept dependent requests, reusable values, conditions, and validations visible as one business journey. The structure made the order of operations and the dependency logic reviewable before execution started.

Flow reports preserved that same continuity. Teams could read overall journey status, inspect the failed or skipped step, and trace the execution back through the exact chain of requests instead of treating each API as an isolated result.

First-time flowMake the starting action and available API workspace clear before the journey is configured.
Flow constructionKeep branch rules, reusable outputs, and connected requests visible while building.
End-to-end API FlowBranching, inputs, outputs, transformations, and wait steps stay visible across the complete Place Order journey.
Flow reportRead the end-to-end journey status, then inspect the failed or skipped step.

From API execution to API quality

This redesign repositioned Qyrus from isolated API execution toward an API-quality workspace. The shipped system could start from discovery or import, generate editable checks with AI, reuse one definition across many scenarios, connect API Flows, and keep functional and performance evidence in context.

The evidence here is structural, not statistical. The archive supports workflow change, screen-level proof, and qualitative research signals; it does not support claimed baselines, adoption percentages, or post-release outcome metrics.

Measurement plan, not current results

Time from API discovery or import to first executable test
Closest signal for whether the connected path reduces setup friction.Needs timestamped product analytics or moderated task timing.
AI suggestion acceptance and edit rate
Shows whether generated checks are useful while preserving expert review.Needs event tracking for generated, edited, accepted, and discarded checks.
Mapping completion and errors
Tests whether reusable data setup is clearer or still blocks execution.Needs setup-funnel events and validation-error logs.
Failure-resolution time
Measures whether report evidence helps testers repair and rerun faster.Needs linked failure, edit, rerun, and pass events.
Support dependency
Checks whether teams still need help to move from failure evidence to action.Needs support-ticket tagging or customer-success notes.

These signals are intentionally listed as future measurement needs because the archive does not include a complete baseline, result, period, population, or source.

Ownership and collaboration

Led

  • Product UX direction for the API discovery-or-contract-to-report workflow.
  • UI structure for import review, AI-generated checks, reusable data, execution, and diagnosis.
  • Case-study evidence framing and removal of unsupported outcome metrics.

Partnered

  • QA practitioners and leads for workflow pain points and product language.
  • Engineering partners for API testing constraints, execution states, and report feasibility.
  • Product managers for prioritizing the connected lifecycle over isolated AI moments.

The map states only the ownership supported by the project record; it does not convert team participation into invented attribution.

  • API Discovery brought live traffic and imports into the same workspace.
  • Parameterized suites kept one test definition reusable across many scenarios.
  • AI could explain endpoints and generate editable checks before execution.
  • API Flows connected journey-level status to the failed or skipped step.

The strongest verified change is structural: the same API context can move from discovery to suite authoring, from reusable data to flow execution, and from failed runs to the next repair step without rebuilding context.

Metadata

Year
2025
Role
Product Designer
Focus
UI/UX Design, Product Design, AI Workflow Design, Enterprise UX
Last updated
May 01, 2026