6 years agoMerge 3af51efdb2ef4250c513f4d4eb127a8c4d5b0a9f into e6c259f333f038abd32a31c4138775045... 27/merge
fix so that assert-true and assert-false work with local functions
Define an expand-t-or-f macro to properly handle arguments in assert-true/false form.
Add the arguments of the test form to extras in assert-true and assert-false.
Merge remote-tracking branch 'jimka2001/assert-test' into feature/assert-test
added assert-test macro
Correctly RETURN from FINALLY in LOOP.
Merge unit test results from multiple packages into a single results DB.
Contribution by Mark Cox, https://github.com/markcox80.
Contribution by Mark Cox, https://github.com/markcox80.
New parameter, *summarize-results*, to suppress the unit test summary.
Store the test in the appropriate package.
Organization
Store the test based on the SYMBOL-PACKAGE of the test name, not *PACKAGE*.
Correct error in parse-body that was discarding the test documentation.
Fix issue 17 in remove-tags.
Ignore CCL FASL files.
Trim trailing white space.
Trim trailing white space.
Remove redundant function print-warning.
Ensure that a package object is used as the hash-key for tests and tags DB.
Warn when there are no tests or tags defined for a package.
Return NIL from functions that are returning lists of things.
Return NIL from functions that are returning lists of things.
Use a function instead of a generic function to generate the failure instance.
Version 0.9.5 README.
Make the list of test names and tags optional.
* remove-tests
* tagged-tests
* remove-tags
* run-tests
* run-tags
* remove-tests
* tagged-tests
* remove-tags
* run-tests
* run-tags
Signal an error if no tests are defined in the package.
Also clean up warning messages for test-documentation and test-code.
Also clean up warning messages for test-documentation and test-code.
Correctly quote name and use valid-test-name in define-test.
Replace assert-class function with generic function record-failure.
Better facilitates extensions.
Better facilitates extensions.
Replace assert-function with a generic function assert-result.
Specialize on the type of assertion. This better facilitates extensions.
Specialize on the type of assertion. This better facilitates extensions.
Signal a type-error if anything besides a symbol is used for a test name.
Update the README for version 0.9.4.
Cover the new TAP features.
Cover the new TAP features.
Merge branch 'tap'
Conflicts:
lisp-unit.lisp
Conflicts:
lisp-unit.lisp
Correct the macro expansion assertion to number GENSYMS from 1.
Improve the comparison of the expanded forms.
Improve the comparison of the expanded forms.
Merge pull request #12 from AccelerationNet/tap-with-test-times
Tap with test times
Tap with test times
print out test duration, in seconds
record the run time of the test
Warn on missing tags to remove and continue on.
Warn on missing tests to remove and continue on.
Do no collect the removed names, the collected list wasn't used.
Do no collect the removed names, the collected list wasn't used.
Add an optional stream argument to all print and output functions.
Count passed assertions and only store details for failed assertions.
Optionally signal results.
Merge pull request #9 from AccelerationNet/master
new *keep-passing-asserts* flag to restrict memory usage
new *keep-passing-asserts* flag to restrict memory usage
Merge pull request #10 from AccelerationNet/tap
Tap output based off existing tap branch
Tap output based off existing tap branch
remove extraneous hyphen
enable print-pretty for TAP results
support test output using the test anything protocol
Converts a test-result object into TAP format. Two new functions:
* `write-tap`
* `write-tap-to-file`
To manage the indentation levels TAP wants, this uses
[pprint-logical-block] and heavily uses the [~I] format directive,
which is shorthand for [pprint-indent]. This gets a little tricky
because indentation levels only take effect after a newline.
[pprint-logical-block]: http://www.lispworks.com/documentation/HyperSpec/Body/m_ppr_lo.htm
[~I]: http://www.lispworks.com/documentation/HyperSpec/Body/22_cec.htm
[pprint-indent]: http://www.lispworks.com/documentation/HyperSpec/Body/f_ppr_in.htm
refs #3
Converts a test-result object into TAP format. Two new functions:
* `write-tap`
* `write-tap-to-file`
To manage the indentation levels TAP wants, this uses
[pprint-logical-block] and heavily uses the [~I] format directive,
which is shorthand for [pprint-indent]. This gets a little tricky
because indentation levels only take effect after a newline.
[pprint-logical-block]: http://www.lispworks.com/documentation/HyperSpec/Body/m_ppr_lo.htm
[~I]: http://www.lispworks.com/documentation/HyperSpec/Body/22_cec.htm
[pprint-indent]: http://www.lispworks.com/documentation/HyperSpec/Body/f_ppr_in.htm
refs #3
introduce a new `test-run-complete` condition, and signal it when test
runs are complete.
This serves as an integration/extensibility point for other systems.
In my case, I'm going to have my continuous integration server listen
for this condition and process the test results, something like:
```lisp
(handler-bind ((lisp-unit:test-run-complete
#'(lambda (trc)
(process (lisp-unit:results trc)))))
(asdf:test-system :foo))
```
refs #3
runs are complete.
This serves as an integration/extensibility point for other systems.
In my case, I'm going to have my continuous integration server listen
for this condition and process the test results, something like:
```lisp
(handler-bind ((lisp-unit:test-run-complete
#'(lambda (trc)
(process (lisp-unit:results trc)))))
(asdf:test-system :foo))
```
refs #3
introduce a `*keep-passing-asserts*` flag to toggle keeping details
about passing asserts.
When non-nil, passing test assertions will be collected as objects and
accessible in test-result objects. When nil, only the type of the
passing assertion will be collected, saving significant memory.
The default is T, which can consume lots of memory for large numbers
of asserts (in my case, sbcl heap exhaustion with 95K assertions).
refs #8
about passing asserts.
When non-nil, passing test assertions will be collected as objects and
accessible in test-result objects. When nil, only the type of the
passing assertion will be collected, saving significant memory.
The default is T, which can consume lots of memory for large numbers
of asserts (in my case, sbcl heap exhaustion with 95K assertions).
refs #8
Merge branch 'master' of github.com:OdonataResearchLLC/lisp-unit
Perform evaluation of actual, expected, and extra forms in internal-assert.
This was prompted by CCL checking the slot type and signaling a condition
when a function was provided as an initarg. In the original code, the slot
ultimately contained a list, but only after INITIALIZE-INSTANCE.
This was prompted by CCL checking the slot type and signaling a condition
when a function was provided as an initarg. In the original code, the slot
ultimately contained a list, but only after INITIALIZE-INSTANCE.
Guard against multiple evaluations of a unit test name.
FIXME note for the norm of an array in the floating point extensions.
README for version 0.9.3.
Examples of using tags.
Warn if there are no tests for a tag.
Clean up the equality predicates.
Merge branch 'master' into assertion-records
Conflicts:
lisp-unit.lisp
Conflicts:
lisp-unit.lisp
Resurrect the use-debugger function.
A victim of over-zealous factoring.
A victim of over-zealous factoring.
Update %run-thunks to make a test-results-db instance.
Reset the global counters whenever run-tests or run-tags is called.
Results are pushed to the global counters whenever assertions are
directly evaluated. These counters cannot, should not, be used directly,
so it is a good idea to reset them periodically. A good time to do that
is when run-tests or run-tags is called.
Results are pushed to the global counters whenever assertions are
directly evaluated. These counters cannot, should not, be used directly,
so it is a good idea to reset them periodically. A good time to do that
is when run-tests or run-tags is called.
Use the local exerr in print-errors.
Refine and export the failure and error print functions.
Print failures and errors as test results are generated.
Print failures and errors during tests if requested.
Properly handle the extra results.
Update print-error to work with result objects.
Update print-failure to work with result objects.
Organize the main lisp-unit file.
Preliminary implementation of comprehensive test results objects.
Merge pull request #1 from OdonataResearchLLC/master
Return the condition instead of :error
Return the condition instead of :error
Merge branch 'master' into assertion-records
Conflicts:
lisp-unit.lisp
Conflicts:
lisp-unit.lisp
Return the actual condition instead of :error.
Merge pull request #4 from AccelerationNet/master
Make use-debugger more useful
Make use-debugger more useful
make use-debugger actually allow the debugger to get called with the
original stack (use handler-bind instead of case)
original stack (use handler-bind instead of case)
Update print-failure and print-error to handle various output formats.
- Add a format argument to print-failure
- Convert print-error to a generic function
- Add a format argument to print-error
- Add a global variable *output-format*
- Add a format argument to print-failure
- Convert print-error to a generic function
- Add a format argument to print-error
- Add a global variable *output-format*
Unpdated norms with internal unit tests.
Obsolete call to get-tagged-tests in run-tags.
Clean up sumsq sump.
Implement default-epsilon for sequences using LOOP.
Miscellaneous clean-up.
Match the ASDF definition version to the code.
Use the string name of the test for documentation if none provided.
Correct merge edit typo.
Merge branch 'devel-0.9.0'
Conflicts:
lisp-unit.lisp
Conflicts:
lisp-unit.lisp
Unmatched right parenthesis and bad format split in print-failure.
Update remove-tests to also from the tests from tag lists.
- Remove or replace get-* from all function names.
- Remove or replace get-* from all function names.
Merge failure-control-string with print-failure.
Expanded on new features in 0.9.0 in the README.
Add a documentation string to the unit test object.
Initial implementation of test tags.
Functions for managing the tags DB.
Parse tag definitions in the unit test body.
Define a unit test class to store code and documentation.
Fix typos in the 'How to use' comment, correct reference link in README.
Update the simplified interface link in the README
Update get-tests and get-test-code for managing tests.
Describe and link to the simplified interface in the README.
Compatibility version 0.8.1.
Warn if no test are defined in the package.
Improve formatting of summarize-results.
Improve formatting of summarize-results.
Correct some bugs with the resurrected API.
Roll back the run-tests,run-all-tests,remove-tests,remove-all-tests API.
Do this to facilitate a Quicklisp release.
Do this to facilitate a Quicklisp release.
Wrap the new run-tests function in the old interface.
Do this temporarily for Quicklisp compatibility.
Do this temporarily for Quicklisp compatibility.
Version 0.8.0
Update some comments to reflect the new documentation.
Update some comments to reflect the new documentation.
Remove the obsolete lisp-unit documentation.