Commit 8236b0c7 authored by Paul Cammish's avatar Paul Cammish
Browse files

Update README.md

parent c9178e1d
# Sympl Testing Suite # Sympl Testing Suite
A suite of tests to confirm various functionality of Sympl is working consistently between revisions. A planned suite of tests to confirm various functionality of Sympl is working consistently between revisions.
\ No newline at end of file
Tests must:
1. Each individual test must clean up after itself *fully*, even when failing, unless the `--dirty` switch is passed.
2. Be able to be run using `run-parts`, with normal `00-aaaaaaa`
3. Numbering should run tests in order that they are likely to fail. Later tests will be skipped if one fails.
4. Each test must output minimal data (see below) unless the `--debug` switch is passed.
5. Failed tests must report errorcode 1 or higher and output a red (if running in a colour terminal) 'F', followed by the test name, and precicely what failed.
6. Detected errors (things not installed, or other unhandled errors) must report errorcode 255 and output a yellow (if running in a colour terminal) 'E', followed by diagnostic information.
7. Successful tests must exit 0, and echo a green (if running in a colour terminal) '.' with no line break as each part completes okay.
8. Be written in any language which is avilable on all supported Sympl versions, without extra libraries from a minimal install.
9. Fail safe at all times.
Tests will be run by git-pulling this repo, and running a single script within it, and must be self-contained.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment