Skip to main content
Quick Test CLI Hero Light

Welcome to Quick Test CLI

Quick Test CLI is a cross-platform tool designed for fast and easy stress testing in competitive programming, allowing you to focus entirely on the contest. Test your algorithms with confidence using automated test generation and validation.

Compare solutions

Verify your algorithm by comparing it against a brute-force solution across hundreds of test cases

Stress test

Ensure your code executes within time limits using random test case generation

Custom checkers

Validate problems with multiple correct answers using custom checker scripts

Multi-language

Support for C++, Java, Python, Rust, Go, GNU C, and Kotlin

What is stress testing?

In competitive programming, stress testing is a technique to validate your solution by running it against randomly generated test cases. Quick Test CLI automates this process by:
  1. Generating random test cases using a generator program
  2. Running your solution and a reference solution (or checker)
  3. Comparing outputs to find discrepancies
  4. Reporting errors with the exact test case that failed
This helps you catch edge cases and bugs that sample test cases might miss.

Key features

Works seamlessly on Linux, Windows, and macOS with a single binary executable and no external dependencies.
Choose from cmp (compare with correct solution), stress (time limit testing), check (custom validation), or output (batch test execution).
Native support for C++, Java, Python, Rust, Go, GNU C, and Kotlin with automatic compilation and execution.
Run hundreds or thousands of test cases in seconds with configurable timeouts and memory limits.
Save failing test cases automatically and re-run specific categories (WA, TLE, RTE, AC).
Get clear error messages with diff output showing exactly where your solution differs from expected results.

How it works

Quick Test CLI operates in different modes depending on your testing needs:

Compare mode (cmp)

Verify your optimized solution against a slower but guaranteed-correct brute-force solution:
qt cmp -t main.cpp -c correct.cpp -g gen.cpp --tc 1000
The tool will:
  • Compile all three files
  • Generate 1000 random test cases using gen.cpp
  • Run both main.cpp and correct.cpp on each test case
  • Compare outputs and report any differences

Stress mode (stress)

Test if your solution runs within time and memory limits:
qt stress -t main.cpp -g gen.cpp --tout 1000 --tc 500

Check mode (check)

For problems with multiple valid answers, use a custom checker:
qt check -t main.cpp -c checker.cpp -g gen.cpp --tc 1000

Why Quick Test CLI?

Save time

No need to manually create test cases or write testing scripts

Catch bugs

Find edge cases that sample tests miss before submitting

Build confidence

Submit with confidence knowing your solution works on thousands of test cases

Stay focused

Spend time solving problems, not debugging infrastructure

Ready to get started?

1

Install Quick Test CLI

Follow the installation guide to install on your platform
2

Learn the basics

Complete the quickstart tutorial to run your first stress test
3

Explore commands

Discover all testing modes in the commands documentation

Build docs developers (and LLMs) love