isa/mutter
1
0
Fork 0
mirror of https://github.com/brl/mutter.git synced 2024-11-23 16:40:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
effbbe2e1e
mutter/tests/conform/Makefile.am

137 lines
4.2 KiB
Makefile
Raw Normal View History

[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
NULL =
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
noinst_PROGRAMS = test-conformance
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
test_conformance_SOURCES = \
test-conform-main.c \
test-conform-common.c \
test-conform-common.h \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
\
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
test-timeline-dup-frames.c \
test-timeline-interpolate.c \
test-timeline-rewind.c \
test-timeline-smoothness.c \
test-timeline.c \
Renames the mesh api to the "vertex buffer api". This better reflects the fact that the api manages sets of vertex attributes, and the attributes really have no implied form. It is only when you use the attributes to draw that they become mesh like; when you specify how they should be interpreted, e.g. as triangle lists or fans etc. This rename frees up the term "mesh", which can later be applied to a concept slightly more fitting. E.g. at some point it would be nice to have a higher level abstraction that sits on top of cogl vertex buffers that adds the concept of faces. (Somthing like Blender's mesh objects.) There have also been some discussions over particle engines, and these can be defined in terms of emitter faces; so some other kind of mesh abstraction might be usefull here.
2009-01-20 16:12:44 -05:00
test-vertex-buffer-contiguous.c \
test-vertex-buffer-interleved.c \
test-vertex-buffer-mutability.c \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
test-path.c \
test-pick.c \
test-clutter-rectangle.c \
test-clutter-fixed.c \
test-actor-invariants.c \
test-paint-opacity.c \
test-backface-culling.c \
test-binding-pool.c \
Merge the ClutterText actor Merge branch 'text-actor' * text-actor: (108 commits) Re-align ClutterText header file [text] Fix cursor sizing Comments and whitespace fixes to ClutterText [docs] Add newly added :single-line-mode accessors Update the ignore file [tests] Add text field interactive test [text] Add single-line-mode to ClutterText [text] Fix the deletion actions [text] Use cached length when possible [tests] Add unit for the ClutterText:password-char property [docs] Update the Text section [text] Coalesce text visibility and password character Allow localizations to change the text direction Clean up the update_pango_context() function Pass the PangoContext, not the MainContext Revert the logic of the PangoContext check Remove the binding pool entry from the list Remove BindingPool::list_actions() Add ClutterActor::create_pango_context() Rename the PangoContext creation functions ...
2009-01-07 07:06:33 -05:00
test-clutter-text.c \
test-text-cache.c \
Add a conformance test for the anchor point This verifies that the anchor point can be set from a gravity and then it moves when the anchor point changes size.
2009-01-22 08:14:02 -05:00
test-anchors.c \
Added a test for non-power-of-two sized textures The test simply creates an odd sized texture with different colors at each of the four corners. It then renders the texture and verifies that the colors are the expected values. This should help ensure that the sliced texture rendering code is working properly.
2009-02-09 07:47:41 -05:00
test-npot-texture.c \
[tests] Add conformance tests for ClutterModel ClutterModel has an interactive test but lacks a conformance unit for automatic testing. This is the beginning of that unit, which covers the population and iteration over a ListModel.
2009-02-14 06:45:27 -05:00
test-model.c \
Merge the ClutterText actor Merge branch 'text-actor' * text-actor: (108 commits) Re-align ClutterText header file [text] Fix cursor sizing Comments and whitespace fixes to ClutterText [docs] Add newly added :single-line-mode accessors Update the ignore file [tests] Add text field interactive test [text] Add single-line-mode to ClutterText [text] Fix the deletion actions [text] Use cached length when possible [tests] Add unit for the ClutterText:password-char property [docs] Update the Text section [text] Coalesce text visibility and password character Allow localizations to change the text direction Clean up the update_pango_context() function Pass the PangoContext, not the MainContext Revert the logic of the PangoContext check Remove the binding pool entry from the list Remove BindingPool::list_actions() Add ClutterActor::create_pango_context() Rename the PangoContext creation functions ...
2009-01-07 07:06:33 -05:00
$(NULL)
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
# For convenience, this provides a way to easily run individual unit tests:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
.PHONY: wrappers clean-wrappers
UNIT_TESTS = `./test-conformance -l -m thorough | $(GREP) '^/'`
* tests/interactive/Makefile.am: * tests/conform/Makefile.am: Use $(EXEEXT) when specifying a dependency on an executable otherwise there won't be a rule to build it on Windows.
2008-11-21 11:18:47 -05:00
wrappers: test-conformance$(EXEEXT)
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@for i in $(UNIT_TESTS); \
do \
unit=`basename $$i | sed -e s/_/-/g`; \
[build] Beautify autotools' output Use shave (http://git.lespiau.name/cgit/shave) to make compilation more human friendly.
2009-02-17 09:56:35 -05:00
echo " GEN $$unit"; \
[tests] Ensure that test-launcher.sh is found for out of tree builds When building out of tree the generated scripts for the unit tests need to explicitly reference the original src dir to be able to find test-launcher.sh, like this: $(top_srcdir)/tests/conform/test-launcher.sh Also test-launcher.sh now passes -m slow --verbose to gtester. Without -m slow then the wrappers dont work for some of the timeline tests.
2008-12-19 16:22:45 -05:00
( echo "#!/bin/sh" ; echo "$(top_srcdir)/tests/conform/test-launcher.sh '$$i'" ) > $$unit$(EXEEXT) ; \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
chmod +x $$unit$(EXEEXT); \
done
clean-wrappers:
@for i in $(UNIT_TESTS); \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
do \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
unit=`basename $$i | sed -e s/_/-/g`; \
echo "RM $$unit"; \
rm -f $$unit$(EXEEXT) ; \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
done
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
# NB: BUILT_SOURCES here a misnomer. We aren't building source, just inserting
# a phony rule that will generate symlink scripts for running individual tests
BUILT_SOURCES = wrappers
test_conformance_CFLAGS = \
-I$(top_srcdir)/ \
-I$(top_srcdir)/clutter \
-I$(top_builddir)/clutter \
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 08:09:51 -05:00
$(CLUTTER_CFLAGS) \
$(MAINTAINER_CFLAGS)
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
test_conformance_LDADD = $(top_builddir)/clutter/libclutter-@CLUTTER_FLAVOUR@-@CLUTTER_MAJORMINOR@.la
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
.PHONY: test
.PHONY: test-report test-report-normal test-report-disable-npots
.PHONY: full-report full-report-normal full-report-disable-npots
.PHONY: full-report-generate
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
test:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@gtester -o=test-conformance-results.xml ./test-conformance
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
test-report-normal:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@gtester -o=test-conformance-results.xml -k ./test-conformance \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
&& ( gtester-report test-conformance-results.xml \
| sed 's/>GTester Unit Test Report</>GTester Unit Test Report (normal)</' \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
> test-conformance-results.html ) \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
&& gnome-open ./test-conformance-results.html
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
test-report-disable-npots:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@../tools/disable-npots.sh \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
gtester -o=test-conformance-results-dn.xml -k ./test-conformance \
&& ( gtester-report test-conformance-results-dn.xml \
| sed 's/>GTester Unit Test Report</>GTester Unit Test Report (no NPOTs)</' \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
> test-conformance-results-dn.html ) \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
&& gnome-open ./test-conformance-results-dn.html
test-report: test-report-normal
full-report-normal:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@gtester -o=test-conformance-results.xml -k -m=slow ./test-conformance \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
&& ( gtester-report test-conformance-results.xml \
| sed 's/>GTester Unit Test Report</>GTester Unit Test Report (normal)</' \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
> test-conformance-results.html )
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
full-report-disable-npots:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
@../tools/disable-npots.sh \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
gtester -o=test-conformance-results-dn.xml -k -m=slow ./test-conformance \
&& ( gtester-report test-conformance-results-dn.xml \
| sed 's/>GTester Unit Test Report</>GTester Unit Test Report (no NPOTs)</' \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
> test-conformance-results-dn.html )
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 08:09:51 -05:00
XML_REPORTS = test-conformance-results.xml
HTML_REPORTS = test-conformance-results.html
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
if HAVE_LIBDL
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 08:09:51 -05:00
XML_REPORTS += test-conformance-results-dn.xml
HTML_REPORTS += test-conformance-results-dn.html
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
full-report-generate: full-report-normal full-report-disable-npots
else
full-report-generate: full-report-normal
endif
full-report: full-report-generate
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 08:09:51 -05:00
@for x in $(HTML_REPORTS); do \
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 10:44:16 -05:00
gnome-open "$$x"; \
done
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
[tests/conform] Copy in redhand.png test-vertex-buffer-configuous now needs redhand.png so it should be copied in to the build directory. This is copied from similar code in the tests/interactive Makefile.
2009-02-19 12:14:00 -05:00
redhand.png:
ln -sf $(top_srcdir)/tests/data/redhand.png
# NB: BUILT_SOURCES here a misnomer. We aren't building source, just inserting
# a phony rule that will generate symlink scripts for running individual tests
[build] Do not overwrite BUILT_SOURCES The conformance test suite Makefile template already defines the BUILT_SOURCES variable, so we need to append redhand.png to it.
2009-02-19 12:24:06 -05:00
BUILT_SOURCES += redhand.png
[tests/conform] Copy in redhand.png test-vertex-buffer-configuous now needs redhand.png so it should be copied in to the build directory. This is copied from similar code in the tests/interactive Makefile.
2009-02-19 12:14:00 -05:00
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 08:09:51 -05:00
EXTRA_DIST = ADDING_NEW_TESTS test-launcher.sh
Clean up the test reports Since we override the clean-generic target in order to remove the shell scripts we create for each conformance test unit, we cannot use CLEANFILES to remove the test reports.
2009-01-23 08:29:55 -05:00
# we override the clean-generic target to clean up the wrappers so
# we cannot use CLEANFILES
clean-generic: clean-wrappers
rm -f $(XML_REPORTS) $(HTML_REPORTS)
Reference in New Issue Copy Permalink