brl/mutter
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8f1575b970
mutter/tests/conform/Makefile.am

333 lines
11 KiB
Makefile
Raw Normal View History

[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 16:43:58 +00:00
include $(top_srcdir)/build/autotools/Makefile.am.silent
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
NULL =
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
noinst_PROGRAMS = test-conformance
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
# the common sources
common_sources = \
test-conform-common.h \
test-conform-common.c \
test-conform-main.c \
$(NULL)
# the unit-specific sources; please: keep all sections in alphabetical order!
units_sources =
# animation tests
units_sources += \
test-animator.c \
test-behaviours.c \
test-score.c \
test-state.c \
test-timeline.c \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
test-timeline-interpolate.c \
test-timeline-rewind.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
$(NULL)
# cogl tests
units_sources += \
test-cogl-backface-culling.c \
test-cogl-blend-strings.c \
test-cogl-depth-test.c \
test-cogl-fixed.c \
test-cogl-materials.c \
Add a conformance test for cogl_pipeline_set_layer_matrix This adds a conformance test which paints using a pipeline that has two layers containing textures. Each layer has a different user matrix. When the two layers are combined with the right matrices then all of the colors end up white. The test then verifies this by reading back the pixels.
2011-02-09 15:12:13 +00:00
test-cogl-pipeline-user-matrix.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-cogl-viewport.c \
test-cogl-multitexture.c \
test-cogl-npot-texture.c \
test-cogl-object.c \
test-cogl-offscreen.c \
test-cogl-path.c \
test-cogl-pixel-buffer.c \
test-cogl-premult.c \
test-cogl-readpixels.c \
test-cogl-sub-texture.c \
test-cogl-texture-3d.c \
test-cogl-texture-get-set-data.c \
test-cogl-texture-mipmaps.c \
test-cogl-texture-pixmap-x11.c \
test-cogl-texture-rectangle.c \
Add a conformance test for atlas migration This adds a conformance test which creates a lot of textures with increasing size and destroys them again a number of times in order to cause a few atlas migrations. The last time the textures are created they are all read back and the data is verified to confirm that the atlas migration successfully preserved the data.
2011-02-24 20:30:30 +00:00
test-cogl-atlas-migration.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-cogl-vertex-buffer-contiguous.c \
test-cogl-vertex-buffer-interleved.c \
test-cogl-vertex-buffer-mutability.c \
test-cogl-wrap-modes.c \
Add a conformance test for the CoglPrimitive convenience constructors This adds a simple conformance test which calls all of the convenience constructors for CoglPrimitive.
2010-11-04 17:31:59 +00:00
test-cogl-primitive.c \
Add a conformance test that uses a vertex shader with no frag shader This creates a material which users a layer to override the color of the rectangle. A simple vertex shader is then created which just emulates the fixed function pipeline. No fragment shader is added. This demonstrates a bug where the layer state is getting ignored when a vertex shader is in use. http://bugzilla.clutter-project.org/show_bug.cgi?id=2221
2010-07-17 13:11:02 +00:00
test-cogl-just-vertex-shader.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
$(NULL)
# actors tests
units_sources += \
conform: Add a suite for the Actor scene graph API Verify that insertion and removal maintain a stable graph, with pointers to the various children. This should help out tracking regressions in the scene graph API.
2011-12-18 20:59:07 +00:00
test-actor-graph.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-actor-destroy.c \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
test-actor-invariants.c \
conform: Begin a test suite for layout options A simple sampling check to validate that we're painting the right thing at the right place.
2011-11-28 17:42:49 +00:00
test-actor-layout.c \
test-actor-size.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-anchors.c \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
test-binding-pool.c \
Revert "clutter.modules: Remove deps on gir-repository" This reverts commit 0ce9cf730b2a8c3b3ac4786afee0579a3795fd9e. The commit contained unrelated changes
2010-08-13 17:12:43 +00:00
test-clutter-cairo-texture.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-clutter-rectangle.c \
test-clutter-text.c \
test-clutter-texture.c \
Revert "clutter.modules: Remove deps on gir-repository" This reverts commit 0ce9cf730b2a8c3b3ac4786afee0579a3795fd9e. The commit contained unrelated changes
2010-08-13 17:12:43 +00:00
test-group.c \
Add a conformance test for the offscreen-redirect property This adds a conformance test for redirecting offscreen. It verifies that the redirected actor has the right paint opacity, that it gets redrawn only when the image cache needs to be invalidated and that it ends up with the right appearance.
2011-03-04 16:48:59 +00:00
test-offscreen-redirect.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-path.c \
test-paint-opacity.c \
test-pick.c \
Revert "clutter.modules: Remove deps on gir-repository" This reverts commit 0ce9cf730b2a8c3b3ac4786afee0579a3795fd9e. The commit contained unrelated changes
2010-08-13 17:12:43 +00:00
test-texture-fbo.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test-text-cache.c \
Add a conformance test for ClutterShaderEffect This adds a simple conformance test which sets up a few shader effects using both the old style with clutter_shader_effect_set_source and the new style by overriding get_static_shader_source. The effects are then verified to confirm that they drew the right pixel colour. https://bugzilla.gnome.org/show_bug.cgi?id=660512 Reviewed-by: Emmanuele Bassi <ebassi@linux.intel.com>
2011-09-29 19:14:26 +00:00
test-shader-effect.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
$(NULL)
# objects tests
units_sources += \
test-clutter-units.c \
test-color.c \
test-model.c \
conform: Add the beginnings of a ClutterScript test suite ClutterScript is a very complicated piece of machinery, with a parser that has custom variations on top of the basic JSON format; it could also be extended in the future, so if we don't want to introduce regressions or break existing ClutterScript definitions, we'd better have a conformance test suite.
2009-11-04 11:50:45 +00:00
test-script-parser.c \
Merge the ClutterText actor Merge branch 'text-actor' * text-actor: (108 commits) Re-align ClutterText header file [text] Fix cursor sizing Comments and whitespace fixes to ClutterText [docs] Add newly added :single-line-mode accessors Update the ignore file [tests] Add text field interactive test [text] Add single-line-mode to ClutterText [text] Fix the deletion actions [text] Use cached length when possible [tests] Add unit for the ClutterText:password-char property [docs] Update the Text section [text] Coalesce text visibility and password character Allow localizations to change the text direction Clean up the update_pango_context() function Pass the PangoContext, not the MainContext Revert the logic of the PangoContext check Remove the binding pool entry from the list Remove BindingPool::list_actions() Add ClutterActor::create_pango_context() Rename the PangoContext creation functions ...
2009-01-07 12:06:33 +00:00
$(NULL)
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
tests: initial support for cally-text conform tests
2011-02-07 10:59:19 +00:00
# cally tests
units_sources += \
test-cally-text.c \
$(NULL)
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 17:15:01 +00:00
test_conformance_SOURCES = $(common_sources) $(units_sources)
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 11:49:44 +00:00
if OS_WIN32
SHEXT =
else
SHEXT = $(EXEEXT)
endif
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
# For convenience, this provides a way to easily run individual unit tests:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
.PHONY: wrappers clean-wrappers
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-13 01:01:50 +00:00
#UNIT_TESTS = `./test-conformance -l -m thorough | $(GREP) '^/'`
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 07:32:46 +00:00
wrappers: stamp-test-conformance
@true
tests: Generate the stub scripts using sed Instead of trying to run ./test-conformance with the -l option to generate a list of available tests it now runs sed on the test-conform-main.c file instead. Running the generated executable is a pain for cross-compiling so it would be nice to avoid it unless it's absolutely necessary. Although you could tell people who are cross compiling to just disable the conformance tests, this seems a shame because they could still be useful along with the wrappers for example if the cross compile is built to a shared network folder where the tests can be run on the actual device. The sed script is a little more ugly than it could be because it tries to avoid using the GNU extensions '\+' and '\|'. The script ends up placing restrictions on the format of the C file because the tests must all be listed on one line each. There is now a comment to explain this. Hopefully the trade off is worth it. http://bugzilla.clutter-project.org/show_bug.cgi?id=2363
2010-10-11 15:16:45 +00:00
stamp-test-conformance: Makefile $(srcdir)/test-conform-main.c
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 13:53:50 +00:00
@mkdir -p wrappers
conform: Implement TEST_CONFORM_TODO() correctly The TODO() macro for adding new tests to the test suite has always meant to be implemented like the TODO block in Test::More, i.e. a test that is assumed to fail, and which warns if it unexpectedly succeeds. Since GTest lacks the expressivity of Test::More, the implementation just verifies that the tests marked as TODO actually fail, and will fail if they happen to succeed - at which point the developer will have to change the macro to SIMPLE or SKIP.
2010-10-12 16:11:52 +00:00
@sed -n \
-e 's/^ \{1,\}TEST_CONFORM_SIMPLE *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
-e 's/^ \{1,\}TEST_CONFORM_SKIP *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
-e 's/^ \{1,\}TEST_CONFORM_TODO *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
tests: Generate the stub scripts using sed Instead of trying to run ./test-conformance with the -l option to generate a list of available tests it now runs sed on the test-conform-main.c file instead. Running the generated executable is a pain for cross-compiling so it would be nice to avoid it unless it's absolutely necessary. Although you could tell people who are cross compiling to just disable the conformance tests, this seems a shame because they could still be useful along with the wrappers for example if the cross compile is built to a shared network folder where the tests can be run on the actual device. The sed script is a little more ugly than it could be because it tries to avoid using the GNU extensions '\+' and '\|'. The script ends up placing restrictions on the format of the C file because the tests must all be listed on one line each. There is now a comment to explain this. Hopefully the trade off is worth it. http://bugzilla.clutter-project.org/show_bug.cgi?id=2363
2010-10-11 15:16:45 +00:00
$(srcdir)/test-conform-main.c > unit-tests
build: Allow to run the tests from any directory I was fed up to cd into the tests/conform or tests/interactive directories to launch a specific test. Now, with the power the abs_ variants of builddir and srcdir we can run specific test from any directory. http://bugzilla.clutter-project.org/show_bug.cgi?id=2159
2010-06-06 21:47:02 +00:00
@chmod +x test-launcher.sh
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 17:22:12 +00:00
@( echo "/stamp-test-conformance" ; \
echo "/test-conformance" ; \
echo "*.o" ; \
build: Add XML files to the ignore blacklist
2010-09-08 16:50:38 +00:00
echo "*.xml" ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 14:43:42 +00:00
echo "*.html" ; \
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 17:22:12 +00:00
echo ".gitignore" ; \
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-13 01:01:50 +00:00
echo "unit-tests" ; \
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 17:22:12 +00:00
echo "/wrappers/" ) > .gitignore
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-13 01:01:50 +00:00
@for i in `cat unit-tests`; \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
do \
unit=`basename $$i | sed -e s/_/-/g`; \
[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 16:43:58 +00:00
echo " GEN $$unit"; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 11:49:44 +00:00
( echo "#!/bin/sh" ; echo "$(abs_builddir)/test-launcher.sh '$$i' \"\$$@\"" ) > $$unit$(SHEXT) ; \
( echo "#!/bin/sh" ; echo "exec $(abs_builddir)/test-conformance$(EXEEXT) -p $$i \"\$$@\"" ) > wrappers/$$unit$(SHEXT) ; \
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
( echo "test-conformance-clutter$(EXEEXT) -p $$i" ) > $(top_builddir)/build/win32/$$unit-clutter.bat ; \
conform/Makefile.am: Update Win32 test .bat name Rename to test-conformance-clutter.bat to make the file name clearer to users
2011-12-07 10:14:17 +00:00
( echo "test-conformance-clutter$(EXEEXT) -p $$i" ) >> $(top_builddir)/build/win32/test-conformance-clutter.bat ; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 11:49:44 +00:00
chmod +x $$unit$(SHEXT); \
chmod +x wrappers/$$unit$(SHEXT); \
echo "/$$unit$(SHEXT)" >> .gitignore; \
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 07:32:46 +00:00
done \
&& echo timestamp > $(@F)
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
clean-wrappers:
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-13 01:01:50 +00:00
@for i in `cat unit-tests`; \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
do \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
unit=`basename $$i | sed -e s/_/-/g`; \
[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 16:43:58 +00:00
echo " RM $$unit"; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 11:49:44 +00:00
rm -f $$unit$(SHEXT) ; \
rm -f wrappers/$$unit$(SHEXT) ; \
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 07:32:46 +00:00
done \
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-13 01:01:50 +00:00
&& rm -f unit-tests \
build: Fix distcheck
2011-11-22 12:11:06 +00:00
&& rm -f $(top_builddir)/build/win32/*.bat \
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 07:32:46 +00:00
&& rm -f stamp-test-conformance
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 13:59:56 +00:00
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
# NB: BUILT_SOURCES here a misnomer. We aren't building source, just inserting
# a phony rule that will generate symlink scripts for running individual tests
BUILT_SOURCES = wrappers
[cogl-material] Support string based blending and layer combine descriptions Setting up layer combine functions and blend modes is very awkward to do programatically. This adds a parser for string based descriptions which are more consise and readable. E.g. a material layer combine function could now be given as: "RGBA = ADD (TEXTURE[A], PREVIOUS[RGB])" or "RGB = REPLACE (PREVIOUS)" "A = MODULATE (PREVIOUS, TEXTURE)" The simple syntax and grammar are only designed to expose standard fixed function hardware, more advanced combining must be done with shaders. This includes standalone documentation of blend strings covering the aspects that are common to blending and texture combining, and adds documentation with examples specific to the new cogl_material_set_blend() and cogl_material_layer_set_combine() functions. Note: The hope is to remove the now redundant bits of the material API before 1.0
2009-05-10 23:40:41 +00:00
tests: Allow getting data files from the tests/data directory The units under the conformance test suite should be able to use external files. Linking the files in tests/conform like the interactive tests do seems like a hack piled on top of a hack, so instead we should provide a programmatic way for a conformance test unit to get the full path of a file, regardless of where the tests/data directory is. We can use a define to get the full path of tests/data and then a function using g_build_filename() to construct the path to the file we want.
2009-11-04 11:47:09 +00:00
INCLUDES = \
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
-I$(top_srcdir)/ \
-I$(top_srcdir)/clutter \
build: Fix distcheck
2011-11-22 12:11:06 +00:00
-I$(top_builddir)/clutter
tests: Allow getting data files from the tests/data directory The units under the conformance test suite should be able to use external files. Linking the files in tests/conform like the interactive tests do seems like a hack piled on top of a hack, so instead we should provide a programmatic way for a conformance test unit to get the full path of a file, regardless of where the tests/data directory is. We can use a define to get the full path of tests/data and then a function using g_build_filename() to construct the path to the file we want.
2009-11-04 11:47:09 +00:00
test_conformance_CPPFLAGS = \
Disable single header inclusion for GLib In order to be ready for the next major version of GLib we need to disable single header inclusion by using the G_DISABLE_SINGLE_INCLUDES define in the build process.
2009-06-15 09:48:56 +00:00
-DG_DISABLE_SINGLE_INCLUDES \
build: Enable experimental COGL API in tests/conform Enable the experimental API when building the conformance test suite.
2010-02-15 11:58:55 +00:00
-DCOGL_ENABLE_EXPERIMENTAL_API \
Disable deprecation warnings for the test suite We test deprecated functionality as well as current one, so we need to enable all symbols and disable the deprecation warnings.
2011-10-13 16:50:25 +00:00
-DG_DISABLE_DEPRECATION_WARNINGS \
-DCLUTTER_DISABLE_DEPRECATION_WARNINGS \
tests: Allow getting data files from the tests/data directory The units under the conformance test suite should be able to use external files. Linking the files in tests/conform like the interactive tests do seems like a hack piled on top of a hack, so instead we should provide a programmatic way for a conformance test unit to get the full path of a file, regardless of where the tests/data directory is. We can use a define to get the full path of tests/data and then a function using g_build_filename() to construct the path to the file we want.
2009-11-04 11:47:09 +00:00
-DTESTS_DATADIR=\""$(top_srcdir)/tests/data"\"
build: Always build conformance tests with debug symbols Having the conformance test suite build without debug symbols doesn't make any sense.
2010-02-09 11:29:39 +00:00
test_conformance_CFLAGS = -g $(CLUTTER_CFLAGS) $(MAINTAINER_CFLAGS)
Split maintainer-flags from the compiler flags The maintainer compiler flags we use trigger warnings and errors in the autogenerated code that gtk-doc creates to scan the header and source files. Since we cannot control that, and we must run a distcheck with both --enable-gtk-doc and --enable-maintainer-flags turned on, we need to use less-strict compiler flags when inside the doc/reference subdirectories. The way to do this is to split the maintainer compiler flags into their own Makefile variable, called MAINTAINER_CFLAGS. The we can use $(MAINTAINER_CFLAGS) in the INCLUDES or _CFLAGS sections of each part of the source directories we wish to check with the anal retentiveness suited for maintainers.
2009-01-23 13:09:51 +00:00
Implement multi-backend support The Clutter backend split is opaque enough that should allow us to just build all possible backends inside the same shared object, and select the wanted backend at initialization time. This requires some work in the build system, as well as the initialization code, to remove duplicate functions that might cause conflicts at build and link time. We also need to defer all the checks of the internal state of the platform-specific API to run-time type checks.
2011-09-21 17:05:03 +00:00
test_conformance_LDADD = $(top_builddir)/clutter/libclutter-@CLUTTER_API_VERSION@.la $(CLUTTER_LIBS)
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
test-conformance: Use -export-dynamic instead of -rdynamic The -rdynamic linker option is specific to ELF so it was breaking builds on systems with other object formats such as Windows and Solaris. This patch replaces that option with -export-dynamic which is a portable libtool option which should do the right thing on each platform. http://bugzilla.clutter-project.org/show_bug.cgi?id=1930
2010-06-24 16:33:43 +00:00
test_conformance_LDFLAGS = -export-dynamic
script: Allow parsing child properties The ClutterScript parser needs to be extended to parse child properties and apply them after an actor has been added to a container. In order to distinguish child properties from regular GObject properties we can use the "child::" prefix, e.g.: { "type" : "ClutterRectangle", "id" : "child-01", "child::has-focus" : true, ... } Parsing child properties can be deferred to the ClutterScriptable interface, just like regular properties.
2009-11-04 16:45:44 +00:00
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 13:53:50 +00:00
test: wrappers
@$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
./test-conformance$(EXEEXT) -o test-report.xml
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 13:53:50 +00:00
test-verbose: wrappers
@$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
./test-conformance$(EXEEXT) -o test-report.xml --verbose
Uniformly use floats in Actor properties All the underlying implementation and the public entry points have been switched to floats; the only missing bits are the Actor properties that deal with positioning and sizing. This usually means a major pain when dealing with GValues and varargs functions. While GValue will warn you when dealing with the wrong conversions, varags will simply die an horrible (and hard to debug) death via segfault. Nothing much to do here, except warn people in the release notes and hope for the best.
2009-05-31 14:15:46 +00:00
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
GTESTER = gtester
GTESTER_REPORT = gtester-report
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 15:44:16 +00:00
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
# XXX: we could prevent the conformance test suite from running
# by simply defining this variable conditionally
TEST_PROGS = test-conformance
Add a wrapper library to help testing without NPOTs. * tests/tools/Makefile.am: Optionally build the libdisable-npots.la library depending on whether libdl was detected in the configure script. A helper script is also generated to setup the LD_PRELOAD. * tests/conform/Makefile.am: There are now two versions of the test-report and full-report rules. test-report-normal is the same as before and test-report-disable-npots runs the tests with the disable-npots wrapper script. The full-report rule runs both of them and displays two separate HTML files. The test-report rule just runs the normal version as before. * configure.ac: Add a test for libdl * tests/tools/disable-npots.sh.in: New file. Template for the helper script * tests/tools/disable-npots.c: New file
2008-11-24 15:44:16 +00:00
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
.PHONY: test
.PHONY: test-report perf-report full-report
.PHONY: test-report-npot perf-report-npot full-report-npot
# test-report: run tests and generate report
# perf-report: run tests with -m perf and generate report
# full-report: like test-report: with -m perf and -m slow
test-report perf-report full-report: ${TEST_PROGS}
@test -z "${TEST_PROGS}" || { \
export GTESTER_LOGDIR=`mktemp -d "$(srcdir)/.testlogs-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 14:43:42 +00:00
if test -d "$(top_srcdir)/.git"; then \
export REVISION="`git describe`" ; \
else \
export REVISION="$(VERSION) $(CLUTTER_RELEASE_STATUS)" ; \
fi ; \
export TIMESTAMP=`date +%Y-%m-%dT%H:%M:%S%z` ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
case $@ in \
test-report) test_options="-k";; \
perf-report) test_options="-k -m=perf";; \
full-report) test_options="-k -m=perf -m=slow";; \
esac ; \
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 13:53:50 +00:00
$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
./test-conformance$(EXEEXT) \
--verbose \
$$test_options \
-o `mktemp "$$GTESTER_LOGDIR/log-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 14:43:42 +00:00
echo '<?xml version="1.0"?>' > $@.xml ; \
echo '<report-collection>' >> $@.xml ; \
echo '<info>' >> $@.xml ; \
echo ' <package>$(PACKAGE)</package>' >> $@.xml ; \
echo ' <version>$(VERSION)</version>' >> $@.xml ; \
echo " <revision>$$REVISION</revision>" >> $@.xml ; \
echo " <date>$$TIMESTAMP</date>" >> $@.xml ; \
echo '</info>' >> $@.xml ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
for lf in `ls -L "$$GTESTER_LOGDIR"/.` ; do \
sed '1,1s/^<?xml\b[^>?]*?>//' <"$$GTESTER_LOGDIR"/"$$lf" >> $@.xml ; \
done ; \
echo >> $@.xml ; \
echo '</report-collection>' >> $@.xml ; \
${GTESTER_REPORT} --version 2>/dev/null 1>&2 ; test "$$?" != 0 || ${GTESTER_REPORT} $@.xml >$@.html ; \
rm -rf "$$GTESTER_LOGDIR" ; \
}
# same as above, but with a wrapper that forcibly disables non-power of
# two textures
test-report-npot perf-report-npot full-report-npot: ${TEST_PROGS}
@test -z "${TEST_PROGS}" || { \
Replace the disable-npots tool with a COGL_DEBUG option Previously in the tests/tools directory we build a disable-npots library which was used as an LD_PRELOAD to trick Cogl in to thinking there is no NPOT texture extension. This is a little awkward to use so it seems much simpler to just define a COGL_DEBUG option to disable npot textures.
2010-11-05 14:55:46 +00:00
export COGL_DEBUG="$COGL_DEBUG,disable-npot-textures"; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
export GTESTER_LOGDIR=`mktemp -d "$(srcdir)/.testlogs-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 14:43:42 +00:00
if test -d "$(top_srcdir)/.git"; then \
export REVISION="`git describe`" ; \
else \
export REVISION="$(VERSION) $(CLUTTER_RELEASE_STATUS)" ; \
fi ; \
export TIMESTAMP=`date +%Y-%m-%dT%H:%M:%S%z` ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
case $@ in \
test-report-npot) test_options="-k";; \
perf-report-npot) test_options="-k -m=perf";; \
full-report-npot) test_options="-k -m=perf -m=slow";; \
esac ; \
$(top_srcdir)/tests/conform/run-tests.sh \
./test-conformance$(EXEEXT) \
--verbose \
$$test_options \
-o `mktemp "$$GTESTER_LOGDIR/log-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 14:43:42 +00:00
echo '<?xml version="1.0"?>' > $@.xml ; \
echo '<report-collection>' >> $@.xml ; \
echo '<info>' >> $@.xml ; \
echo ' <package>$(PACKAGE)</package>' >> $@.xml ; \
echo ' <version>$(VERSION)</version>' >> $@.xml ; \
echo " <revision>$$REVISION</revision>" >> $@.xml ; \
echo " <date>$$TIMESTAMP</date>" >> $@.xml ; \
echo '</info>' >> $@.xml ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 13:50:24 +00:00
for lf in `ls -L "$$GTESTER_LOGDIR"/.` ; do \
sed '1,1s/^<?xml\b[^>?]*?>//' <"$$GTESTER_LOGDIR"/"$$lf" >> $@.xml ; \
done ; \
echo >> $@.xml ; \
echo '</report-collection>' >> $@.xml ; \
${GTESTER_REPORT} --version 2>/dev/null 1>&2 ; test "$$?" != 0 || ${GTESTER_REPORT} $@.xml >$@.html ; \
rm -rf "$$GTESTER_LOGDIR" ; \
}
XML_REPORTS = \
test-report.xml \
perf-report.xml \
full-report.xml \
test-report-npot.xml \
perf-report-npot.xml \
full-report-npot.xml
HTML_REPORTS = \
test-report.html \
perf-report.html \
full-report.html \
test-report-npot.html \
perf-report-npot.html \
full-report-npot.html
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 19:32:28 +00:00
build: Allow to run the tests from any directory I was fed up to cd into the tests/conform or tests/interactive directories to launch a specific test. Now, with the power the abs_ variants of builddir and srcdir we can run specific test from any directory. http://bugzilla.clutter-project.org/show_bug.cgi?id=2159
2010-06-06 21:47:02 +00:00
EXTRA_DIST = ADDING_NEW_TESTS test-launcher.sh.in run-tests.sh
build: Fix distcheck errors
2010-08-16 12:23:10 +00:00
DISTCLEANFILES = test-launcher.sh .gitignore
build: Use maintainer-clean for the ignore files removal Instead of distclean.
2010-08-15 17:42:54 +00:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
dist-hook: $(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj $(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj $(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
$(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj: $(top_srcdir)/build/win32/vs9/test-conformance-clutter.vcprojin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
case $$F in \
*.c) echo ' <File RelativePath="..\..\..\tests\conform\'$$F'" />' \
;; \
esac; \
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
done > testconformance.sourcefiles
Rename conform/interactive tests VS projects Add a -clutter suffix for their project names to avoid clashes with the COGL test executables
2011-10-20 08:35:38 +00:00
$(CPP) -P - <$(top_srcdir)/build/win32/vs9/test-conformance-clutter.vcprojin >$@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
rm -f testconformance.sourcefiles
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj: $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxprojin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
case $$F in \
*.c) echo ' <ClCompile Include="..\..\..\tests\conform\'$$F'" />' \
;; \
esac; \
done >testconformance.vs10.sourcefiles
Rename conform/interactive tests VS projects Add a -clutter suffix for their project names to avoid clashes with the COGL test executables
2011-10-20 08:35:38 +00:00
$(CPP) -P - <$(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxprojin >$@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
rm -f testconformance.vs10.sourcefiles
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters: $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxproj.filtersin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
case $$F in \
*.c) echo ' <ClCompile Include="..\..\..\tests\conform\'$$F'"><Filter>Sources</Filter></ClCompile>' \
;; \
esac; \
build: Fix distcheck
2011-11-22 12:11:06 +00:00
done > testconformance.vs10.sourcefiles.filters
$(CPP) -P - < $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxproj.filtersin > $@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 15:12:45 +00:00
rm -f testconformance.vs10.sourcefiles.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
# Let the VS9/VS10 Project files be cleared out before they are re-expanded...
build: Fix distcheck
2011-11-22 12:11:06 +00:00
DISTCLEANFILES += \
$(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj \
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj \
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 09:25:47 +00:00
Clean up the test reports Since we override the clean-generic target in order to remove the shell scripts we create for each conformance test unit, we cannot use CLEANFILES to remove the test reports.
2009-01-23 13:29:55 +00:00
# we override the clean-generic target to clean up the wrappers so
# we cannot use CLEANFILES
clean-generic: clean-wrappers
[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 16:43:58 +00:00
$(QUIET_RM)rm -f $(XML_REPORTS) $(HTML_REPORTS)
Reference in New Issue Copy Permalink