|
sl@0
|
1 |
This script is for the purpose of comparing test runs run on Mistral or a developer's machine against a Known Failure sheet and/or comparison Mistral build to identify any new regressions introduced in the current run.
|
|
sl@0
|
2 |
|
|
sl@0
|
3 |
For usage call ResultsComparison.pl -h
|
|
sl@0
|
4 |
|
|
sl@0
|
5 |
Whenever updating the script please run the regression suite prior to submission. The steps are as follows:
|
|
sl@0
|
6 |
|
|
sl@0
|
7 |
1. Install Apache Web Server and host a server on port 8080.
|
|
sl@0
|
8 |
2. Map the contents of the RegressionSuite folder to the root of the web server's source location.
|
|
sl@0
|
9 |
3. Copy RegressionTestKF.xml to the C:\ drive.
|
|
sl@0
|
10 |
4. Call RunTesting.bat
|
|
sl@0
|
11 |
5. Compare the output files to the contents of the ExpectedResultLogs folder and ensure they match.
|
|
sl@0
|
12 |
|
|
sl@0
|
13 |
N.B. If adding new tests that affect the Known Failure sheet remember to regenerate the XML version from within Excel:
|
|
sl@0
|
14 |
File --> Save As --> XML Spreadsheet 2003 filetype
|
|
sl@0
|
15 |
|