Write a script to help automate the running of PHP OSS Framework unit tests
This is an initial verison of a script that will allow us to unit test all
of the OSS PHP frameworks that we care about for parity. A more detailed
summary is available at the top of the code, but here are some highlights:
- Autodownload of frameworks; not added to our official repo
- Mulit-process test runs
- Full phpunit stats in a file after each run
- Summary file for all tests run showing pass percentage. Appended with latest
result for multiple test runs of a given framework. Initial inspiration for
this file was for our MPK TV parity chart population.
Future:
- Integration with our "test/run" infrastructure
- Special case frameworks that don't use PHPUnit
- Enhance the script to allow "diff" stats that specify what changed from the
previous run of a test of a framework to the current test (beyond pass
percentage). For example, what tests caused the pass percentage to increase
or decrease.
New Files for this diff:
- oss_framework_test_script: The script
- phpunit.phar: Used to actually run the phpunit tests for each framework
- composer.phar: Used for installing framework dependencies for phpunit
- sample_multiple_test_config.cfg: A sample configuration file to run multiple, but
not necessarily all testsi
NOTE: I am only including 3 of the OSS frameworks as part of the code for this diff.
When this diff is accepted, I will send out another diff with the rest added. Having
just 3 makes for easier initial testing.
Another note: I removed the comment that command_line_lib does not support options with
arguments. It does. I am using that functionality in this script.
THANKS TO @ptarjan for process ideas from both running the tests and getting through
the proxy!
Reviewed By: @ptarjan
Differential Revision:
D971897