|pycsw||Home | Demos | Docs | Issue Tracker | FAQ | Download|
Compliance benchmarking is done via the OGC Compliance & Interoperability Testing & Evaluation Initiative. The pycsw wiki documents testing procedures and status.
The pycsw tester framework (in tester) is a collection of testsuites to perform automated regession testing of the codebase.
The tester framework can be run from tester:
$ cd /path/to/pycsw $ cd tester $ python ./run_tests.py # lots of output
The tester runs HTTP GET and POST requests. The expected output for each test can be found in expected. Results are categorized as passed, failed, or initialized. A summary of results is output at the end of the run.
If a given test has failed, the output is saved in results. The resulting failure can be analyzed by running diff expected/name_of_test.xml results/name_of_test.xml to find variances.
The tester framework is run against a series of ‘suites’ (in tester/suites), each of which specifies a given configuration to test various functionality of the codebase. Each suite is structured as follows:
When the tester is invoked, the following operations are run:
The CSV format of tester/suite/get/requests.txt is testname,request, with one line for each test. The testname value is a unique test name (this value sets the name of the output file in the test results). The request value is the HTTP GET request. The PYCSW_SERVER token is replaced at runtime with the URL to the pycsw install.
To add tests to an existing suite:
To add a new test suite:
You can also use the pycsw tester via your web browser to perform sample requests against your pycsw install. The tester is located in tester/. To generate the HTML page, run gen_html.py:
$ python ./gen_html.py > index.html
Then navigate to http://host/path/to/pycsw/tester/index.html.