1.1 --- /dev/null Thu Jan 01 00:00:00 1970 +0000
1.2 +++ b/os/mm/mmtestenv/mmtesttools/Scripts/TestResultsComparisonTool/README.txt Fri Jun 15 03:10:57 2012 +0200
1.3 @@ -0,0 +1,15 @@
1.4 +This script is for the purpose of comparing test runs run on Mistral or a developer's machine against a Known Failure sheet and/or comparison Mistral build to identify any new regressions introduced in the current run.
1.5 +
1.6 +For usage call ResultsComparison.pl -h
1.7 +
1.8 +Whenever updating the script please run the regression suite prior to submission. The steps are as follows:
1.9 +
1.10 +1. Install Apache Web Server and host a server on port 8080.
1.11 +2. Map the contents of the RegressionSuite folder to the root of the web server's source location.
1.12 +3. Copy RegressionTestKF.xml to the C:\ drive.
1.13 +4. Call RunTesting.bat
1.14 +5. Compare the output files to the contents of the ExpectedResultLogs folder and ensure they match.
1.15 +
1.16 +N.B. If adding new tests that affect the Known Failure sheet remember to regenerate the XML version from within Excel:
1.17 +File --> Save As --> XML Spreadsheet 2003 filetype
1.18 +