brl/mutter
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2a6782dc10
mutter/clutter/tests/README

39 lines
1.8 KiB
Plaintext
Raw Normal View History

Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
Outline of test categories:
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
The conform/ tests should be non-interactive unit-tests that verify a single
docs: Update the test-related documentation The test suite layout and usage have been changed, so the documentation needs to be updated to reflect the change.
2014-01-17 07:07:58 -05:00
feature is behaving as documented. Use the GLib and Clutter test API and macros
to write the test units. The conformance test suites are meant to be used with
continuous integration builds.
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
tests: Add performance tracking framework This adds a performance tracking framework that can run a set of tests over specified git revisions. The ruby script for generating the reports comes from similar performance tracking in GEGL. The framework permits evaluating new tests against older version of clutter. The tests themselves go through a few hoops for disabling framerate limiting in both mesa and clutter. When running make check the tests will be run and lines of the form: @ test-state: 40.51 fps will be left in the output, a script can scrape these lines out of a build log on a buildbot to in other ways track performance.
2011-01-19 06:38:25 -05:00
The performance/ tests are performance tests, both focused tests testing single
metrics and larger tests. These tests are used to report one or more
performance markers for the build of Clutter. Each performance marker is picked
up from the standard output of running the tests from strings having the form
"\n@ marker-name: 42.23" where 'marker-name' and '42.23' are the key/value pairs
of a single metric. Each test can provide multiple key/value pairs. Note that
if framerate is the feedback metric the test should forcibly enable FPS
debugging itself. The file test-common.h contains utility function helping to
do fps reporting.
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
The interactive/ tests are any tests whose status can not be determined without
a user looking at some visual output, or providing some manual input etc. This
covers most of the original Clutter tests. Ideally some of these tests will be
docs: Update the test-related documentation The test suite layout and usage have been changed, so the documentation needs to be updated to reflect the change.
2014-01-17 07:07:58 -05:00
migrated into the conform/ directory.
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
Add accessibility tests http://bugzilla.clutter-project.org/show_bug.cgi?id=2099 Signed-off-by: Emmanuele Bassi <ebassi@linux.intel.com>
2010-04-26 14:07:22 -04:00
The accessibility/ tests are tests created to test the accessibility support of
clutter, testing some of the atk interfaces.
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
Other notes:
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
• All tests should ideally include a detailed description in the source
explaining exactly what the test is for, how the test was designed to work,
docs: Update the test-related documentation The test suite layout and usage have been changed, so the documentation needs to be updated to reflect the change.
2014-01-17 07:07:58 -05:00
and possibly a rationale for the approach taken for testing. Tests for specific
bugs should reference the bug report URL or number.
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
• When running tests under Valgrind, you should follow the instructions
available here:
docs: Update the test-related documentation The test suite layout and usage have been changed, so the documentation needs to be updated to reflect the change.
2014-01-17 07:07:58 -05:00
https://wiki.gnome.org/Valgrind
tests: Add a Valgrind suppression file When running tests under Valgrind it would be useful to pass a suppression file for the known one-off allocations done by Clutter and by its dependencies. This trims the output of Valgrind and improves the ability to actually spot leaks.
2010-02-04 11:49:06 -05:00
docs: Update the test-related documentation The test suite layout and usage have been changed, so the documentation needs to be updated to reflect the change.
2014-01-17 07:07:58 -05:00
and also use the suppression file available in the Git repository.
Reference in New Issue Copy Permalink