isa/mutter
1
0
Fork 0
mirror of https://github.com/brl/mutter.git synced 2024-11-23 16:40:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
fa72540246
mutter/tests/conform/Makefile.am

315 lines
9.5 KiB
Makefile
Raw Normal View History

[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 12:43:58 -04:00
include $(top_srcdir)/build/autotools/Makefile.am.silent
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
NULL =
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
BUILT_SOURCES =
TESTS =
check_PROGRAMS =
check_SCRIPTS =
EXTRA_DIST =
DISTCLEANFILES =
TEST_PROGS =
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 13:15:01 -04:00
# the common sources
common_sources = \
test-conform-common.h \
test-conform-common.c \
test-conform-main.c \
$(NULL)
# the unit-specific sources; please: keep all sections in alphabetical order!
units_sources =
# animation tests
units_sources += \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
animator.c \
behaviours.c \
score.c \
state.c \
timeline.c \
timeline-interpolate.c \
timeline: Add support for step() progress The CSS3 Transitions specification from the W3C defines the possibility of using a parametrized step() timing function, with the following prototype: steps(n_steps, [ start | end ]) where @n_steps represents the number of steps used to divide an interval between 0 and 1; the 'start' and 'end' tokens describe whether the value change should happen at the start of the transition, or at the end. For instance, the "steps(3, start)" timing function has the following profile: 1 | x | | | x---| | ' | | x---' | | ' | 0 |---' | Whereas the "steps(3, end)" timing function has the following profile: 1 | x---| | ' | | x---' | | ' | x---' | | | 0 | | Since ClutterTimeline uses an enumeration for controlling the progress mode, we need additional API to define the parameters of the steps() progress; for this reason, we need a CLUTTER_STEPS enumeration value, and a method for setting the number of steps and the value transition policy. The CSS3 Transitions spec helpfully also defines a step-start and a step-end shorthands, which expand to step(1, start) and step(1, end) respectively; we can provide a CLUTTER_STEP_START and CLUTTER_STEP_END enumeration values for those.
2012-07-19 19:47:48 -04:00
timeline-progress.c \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
timeline-rewind.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 13:15:01 -04:00
$(NULL)
# actors tests
units_sources += \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
actor-anchors.c \
actor-graph.c \
actor-destroy.c \
actor-invariants.c \
actor-iter.c \
actor-layout.c \
conform: Add suite for actor's meta objects
2013-06-12 05:01:50 -04:00
actor-meta.c \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
actor-offscreen-redirect.c \
conform: add offscreen effects fbo size check https://bugzilla.gnome.org/show_bug.cgi?id=699675
2013-05-15 09:23:53 -04:00
actor-offscreen-limit-max-size.c\
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
actor-paint-opacity.c \
actor-pick.c \
conformance: Clean up Remove the last inconsistent bits.
2012-02-27 08:08:31 -05:00
actor-shader-effect.c \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
actor-size.c \
binding-pool.c \
cairo-texture.c \
group.c \
conform: Initial suite for ClutterInterval ClutterInterval is undertested, so we should start adding a unit test for it.
2012-06-18 12:51:48 -04:00
interval.c \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
path.c \
rectangle.c \
texture-fbo.c \
texture.c \
text-cache.c \
text.c \
build: Split up the test-conformance SOURCES Having different sections should make it easier to add new test units to the build.
2010-08-13 13:15:01 -04:00
$(NULL)
# objects tests
units_sources += \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
color.c \
model.c \
script-parser.c \
units.c \
Merge the ClutterText actor Merge branch 'text-actor' * text-actor: (108 commits) Re-align ClutterText header file [text] Fix cursor sizing Comments and whitespace fixes to ClutterText [docs] Add newly added :single-line-mode accessors Update the ignore file [tests] Add text field interactive test [text] Add single-line-mode to ClutterText [text] Fix the deletion actions [text] Use cached length when possible [tests] Add unit for the ClutterText:password-char property [docs] Update the Text section [text] Coalesce text visibility and password character Allow localizations to change the text direction Clean up the update_pango_context() function Pass the PangoContext, not the MainContext Revert the logic of the PangoContext check Remove the binding pool entry from the list Remove BindingPool::list_actions() Add ClutterActor::create_pango_context() Rename the PangoContext creation functions ...
2009-01-07 07:06:33 -05:00
$(NULL)
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
tests: initial support for cally-text conform tests
2011-02-07 05:59:19 -05:00
# cally tests
units_sources += \
conformance: Rename the source files It's the conformance test suite: there's no need to namespace the files, just like there's no need to namespace the units. This commit does not change the Cogl tests: they will be moved to Cogl over time, and it's easier to do if we leave them as they are.
2012-02-27 08:02:01 -05:00
cally-text.c \
tests: initial support for cally-text conform tests
2011-02-07 05:59:19 -05:00
$(NULL)
tests: Add unit test for touch event handling For now, it just generates a simple horizontal slide (by writing to /dev/uinput) and checks that the stage gets the events at the expected coordinates. The test won't run if it doesn't have read/write permissions to /dev/uinput. It also adds OS_LINUX to config.h.
2012-06-07 05:08:49 -04:00
# events tests
units_sources += \
events-touch.c \
$(NULL)
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 07:49:44 -04:00
if OS_WIN32
SHEXT =
else
SHEXT = $(EXEEXT)
endif
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
EXTRA_DIST += ADDING_NEW_TESTS test-launcher.sh.in run-tests.sh
DISTCLEANFILES += test-launcher.sh .gitignore
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
# For convenience, this provides a way to easily run individual unit tests:
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
.PHONY: wrappers clean-wrappers
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-12 21:01:50 -04:00
#UNIT_TESTS = `./test-conformance -l -m thorough | $(GREP) '^/'`
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 03:32:46 -04:00
wrappers: stamp-test-conformance
@true
tests: Generate the stub scripts using sed Instead of trying to run ./test-conformance with the -l option to generate a list of available tests it now runs sed on the test-conform-main.c file instead. Running the generated executable is a pain for cross-compiling so it would be nice to avoid it unless it's absolutely necessary. Although you could tell people who are cross compiling to just disable the conformance tests, this seems a shame because they could still be useful along with the wrappers for example if the cross compile is built to a shared network folder where the tests can be run on the actual device. The sed script is a little more ugly than it could be because it tries to avoid using the GNU extensions '\+' and '\|'. The script ends up placing restrictions on the format of the C file because the tests must all be listed on one line each. There is now a comment to explain this. Hopefully the trade off is worth it. http://bugzilla.clutter-project.org/show_bug.cgi?id=2363
2010-10-11 11:16:45 -04:00
stamp-test-conformance: Makefile $(srcdir)/test-conform-main.c
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 09:53:50 -04:00
@mkdir -p wrappers
conform: Implement TEST_CONFORM_TODO() correctly The TODO() macro for adding new tests to the test suite has always meant to be implemented like the TODO block in Test::More, i.e. a test that is assumed to fail, and which warns if it unexpectedly succeeds. Since GTest lacks the expressivity of Test::More, the implementation just verifies that the tests marked as TODO actually fail, and will fail if they happen to succeed - at which point the developer will have to change the macro to SIMPLE or SKIP.
2010-10-12 12:11:52 -04:00
@sed -n \
-e 's/^ \{1,\}TEST_CONFORM_SIMPLE *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
-e 's/^ \{1,\}TEST_CONFORM_SKIP *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
-e 's/^ \{1,\}TEST_CONFORM_TODO *(.*"\([^",]\{1,\}\)", *\([a-zA-Z0-9_]\{1,\}\).*/\/conform\1\/\2/p' \
tests: Generate the stub scripts using sed Instead of trying to run ./test-conformance with the -l option to generate a list of available tests it now runs sed on the test-conform-main.c file instead. Running the generated executable is a pain for cross-compiling so it would be nice to avoid it unless it's absolutely necessary. Although you could tell people who are cross compiling to just disable the conformance tests, this seems a shame because they could still be useful along with the wrappers for example if the cross compile is built to a shared network folder where the tests can be run on the actual device. The sed script is a little more ugly than it could be because it tries to avoid using the GNU extensions '\+' and '\|'. The script ends up placing restrictions on the format of the C file because the tests must all be listed on one line each. There is now a comment to explain this. Hopefully the trade off is worth it. http://bugzilla.clutter-project.org/show_bug.cgi?id=2363
2010-10-11 11:16:45 -04:00
$(srcdir)/test-conform-main.c > unit-tests
build: Allow to run the tests from any directory I was fed up to cd into the tests/conform or tests/interactive directories to launch a specific test. Now, with the power the abs_ variants of builddir and srcdir we can run specific test from any directory. http://bugzilla.clutter-project.org/show_bug.cgi?id=2159
2010-06-06 17:47:02 -04:00
@chmod +x test-launcher.sh
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 13:22:12 -04:00
@( echo "/stamp-test-conformance" ; \
echo "/test-conformance" ; \
echo "*.o" ; \
build: Add XML files to the ignore blacklist
2010-09-08 12:50:38 -04:00
echo "*.xml" ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 10:43:42 -04:00
echo "*.html" ; \
build: Add *.test pattern to the ignored files list
2013-07-03 08:08:26 -04:00
echo "*.test" ; \
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 13:22:12 -04:00
echo ".gitignore" ; \
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
echo "test-suite.log" ; \
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-12 21:01:50 -04:00
echo "unit-tests" ; \
build: Generate the conformance/.gitignore file Since we are generating a lot of files that we should ignore, we should generate the Git ignore file as well.
2010-08-13 13:22:12 -04:00
echo "/wrappers/" ) > .gitignore
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-12 21:01:50 -04:00
@for i in `cat unit-tests`; \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
do \
unit=`basename $$i | sed -e s/_/-/g`; \
build: Fix up the silent rules prefixes Automake increased the whitespace, so we need to do that for our "I Can't Believe It's Not Autotool™" rules.
2013-05-15 10:07:15 -04:00
echo " GEN $$unit"; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 07:49:44 -04:00
( echo "#!/bin/sh" ; echo "$(abs_builddir)/test-launcher.sh '$$i' \"\$$@\"" ) > $$unit$(SHEXT) ; \
( echo "#!/bin/sh" ; echo "exec $(abs_builddir)/test-conformance$(EXEEXT) -p $$i \"\$$@\"" ) > wrappers/$$unit$(SHEXT) ; \
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
( echo "test-conformance-clutter$(EXEEXT) -p $$i" ) > $(top_builddir)/build/win32/$$unit-clutter.bat ; \
conform/Makefile.am: Update Win32 test .bat name Rename to test-conformance-clutter.bat to make the file name clearer to users
2011-12-07 05:14:17 -05:00
( echo "test-conformance-clutter$(EXEEXT) -p $$i" ) >> $(top_builddir)/build/win32/test-conformance-clutter.bat ; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 07:49:44 -04:00
chmod +x $$unit$(SHEXT); \
chmod +x wrappers/$$unit$(SHEXT); \
echo "/$$unit$(SHEXT)" >> .gitignore; \
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 03:32:46 -04:00
done \
&& echo timestamp > $(@F)
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
clean-wrappers:
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
@if test -f "unit-tests"; then \
for i in `cat unit-tests`; \
do \
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
unit=`basename $$i | sed -e s/_/-/g`; \
build: Fix up the silent rules prefixes Automake increased the whitespace, so we need to do that for our "I Can't Believe It's Not Autotool™" rules.
2013-05-15 10:07:15 -04:00
echo " RM $$unit"; \
Removes the addition of the .exe extension to unit-test scripts, on win32. On win32, test scripts are created with a .exe extension. Under mingw, a .exe script is launched in 16 bit compatibility mode (through ntvdm), and so it just does not run. http://bugzilla.clutter-project.org/show_bug.cgi?id=2619
2011-03-25 07:49:44 -04:00
rm -f $$unit$(SHEXT) ; \
rm -f wrappers/$$unit$(SHEXT) ; \
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
done \
fi \
&& rm -rf wrappers \
build: List the units inside a file This avoids trying to run test-conformance -l multiple times.
2010-09-12 21:01:50 -04:00
&& rm -f unit-tests \
build: Fix distcheck
2011-11-22 07:11:06 -05:00
&& rm -f $(top_builddir)/build/win32/*.bat \
[build] Do not rebuild the conformance tests scripts Make the build output a little bit cleaner by not re-creating the small shell scripts that allow launching the test units separately.
2009-05-14 03:32:46 -04:00
&& rm -f stamp-test-conformance
[tests] Create a real file for each test unit Currently, the conformance test suite creates symbolic links pointing to a wrapper script that just parses the name used to invoke it and calls the gtester with the correct path. Unfortunately, this presents two issues: - it does not really work on file systems that do not support symbolic links - it leaves behind the symbolic links, which cannot be automatically cleaning by 'make clean' Both can be solved by creating a small script that invokes the wrapper one with the test unit path. The Makefile will use test-conform to extract the unit test paths and generate a list that will be iterated over to create the executable name (using the "test-name" convention also used by the interactive tests, instead of "test_name"); the executable is then just a simple shell script that invokes the wrapper script passing the unit test path on the command line. The wrapper script will use the first argument to work correctly, so it could be simply executed like: ./test-wrapper.sh /path/to/unit_test Which is another improvement over the current implementation, where the wrapper script does not work when invoked directly.
2008-12-17 08:59:56 -05:00
tests: Allow getting data files from the tests/data directory The units under the conformance test suite should be able to use external files. Linking the files in tests/conform like the interactive tests do seems like a hack piled on top of a hack, so instead we should provide a programmatic way for a conformance test unit to get the full path of a file, regardless of where the tests/data directory is. We can use a define to get the full path of tests/data and then a function using g_build_filename() to construct the path to the file we want.
2009-11-04 06:47:09 -05:00
test_conformance_CPPFLAGS = \
Disable single header inclusion for GLib In order to be ready for the next major version of GLib we need to disable single header inclusion by using the G_DISABLE_SINGLE_INCLUDES define in the build process.
2009-06-15 05:48:56 -04:00
-DG_DISABLE_SINGLE_INCLUDES \
build: Enable experimental COGL API in tests/conform Enable the experimental API when building the conformance test suite.
2010-02-15 06:58:55 -05:00
-DCOGL_ENABLE_EXPERIMENTAL_API \
Disable deprecation warnings for the test suite We test deprecated functionality as well as current one, so we need to enable all symbols and disable the deprecation warnings.
2011-10-13 12:50:25 -04:00
-DG_DISABLE_DEPRECATION_WARNINGS \
build: Disable Cogl deprecation warnings for tests We are exercising all sorts of deprecated API anyway.
2013-07-02 17:24:31 -04:00
-DCOGL_DISABLE_DEPRECATION_WARNINGS \
Disable deprecation warnings for the test suite We test deprecated functionality as well as current one, so we need to enable all symbols and disable the deprecation warnings.
2011-10-13 12:50:25 -04:00
-DCLUTTER_DISABLE_DEPRECATION_WARNINGS \
build: Remove INCLUDES directives They have been deprecated for a while, replaced by AM_CPPFLAGS.
2013-05-15 10:18:13 -04:00
-DTESTS_DATADIR=\""$(top_srcdir)/tests/data"\" \
-I$(top_srcdir) \
-I$(top_builddir) \
-I$(top_srcdir)/clutter \
-I$(top_builddir)/clutter
tests: Allow getting data files from the tests/data directory The units under the conformance test suite should be able to use external files. Linking the files in tests/conform like the interactive tests do seems like a hack piled on top of a hack, so instead we should provide a programmatic way for a conformance test unit to get the full path of a file, regardless of where the tests/data directory is. We can use a define to get the full path of tests/data and then a function using g_build_filename() to construct the path to the file we want.
2009-11-04 06:47:09 -05:00
build: Remove maintainer flags from test build Part of the test infrastructure relies on relaxed build conditions, so there's no point to enforce the anal retentive maintainer flags.
2012-03-07 07:34:48 -05:00
test_conformance_CFLAGS = -g $(CLUTTER_CFLAGS)
tests: link test-conformance against libm https://bugzilla.gnome.org/show_bug.cgi?id=677921
2012-06-12 02:25:05 -04:00
test_conformance_LDADD = $(top_builddir)/clutter/libclutter-@CLUTTER_API_VERSION@.la $(CLUTTER_LIBS) -lm
test-conformance: Use -export-dynamic instead of -rdynamic The -rdynamic linker option is specific to ELF so it was breaking builds on systems with other object formats such as Windows and Solaris. This patch replaces that option with -export-dynamic which is a portable libtool option which should do the right thing on each platform. http://bugzilla.clutter-project.org/show_bug.cgi?id=1930
2010-06-24 12:33:43 -04:00
test_conformance_LDFLAGS = -export-dynamic
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
test_conformance_SOURCES = $(common_sources) $(units_sources)
if OS_WIN32
TESTS += test-conformance
endif
TEST_PROGS += test-conformance
check_PROGRAMS += test-conformance
check_SCRIPTS += wrappers
script: Allow parsing child properties The ClutterScript parser needs to be extended to parse child properties and apply them after an actor has been added to a container. In order to distinguish child properties from regular GObject properties we can use the "child::" prefix, e.g.: { "type" : "ClutterRectangle", "id" : "child-01", "child::has-focus" : true, ... } Parsing child properties can be deferred to the ClutterScriptable interface, just like regular properties.
2009-11-04 11:45:44 -05:00
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 09:53:50 -04:00
test: wrappers
build: Fix distcheck for conformance tests We need to export G_TEST_SRCDIR and G_TEST_BUILDDIR if we want to be able to build the path to the tests data.
2013-07-10 07:31:32 -04:00
@export G_TEST_SRCDIR="$(abs_srcdir)" ; \
export G_TEST_BUILDDIR="$(abs_builddir)" ; \
$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
./test-conformance$(EXEEXT) -o test-report.xml
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 09:53:50 -04:00
test-verbose: wrappers
build: Fix distcheck for conformance tests We need to export G_TEST_SRCDIR and G_TEST_BUILDDIR if we want to be able to build the path to the tests data.
2013-07-10 07:31:32 -04:00
@export G_TEST_SRCDIR="$(abs_srcdir)" ; \
export G_TEST_BUILDDIR="$(abs_builddir)" ; \
$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
./test-conformance$(EXEEXT) -o test-report.xml --verbose
Uniformly use floats in Actor properties All the underlying implementation and the public entry points have been switched to floats; the only missing bits are the Actor properties that deal with positioning and sizing. This usually means a major pain when dealing with GValues and varargs functions. While GValue will warn you when dealing with the wrong conversions, varags will simply die an horrible (and hard to debug) death via segfault. Nothing much to do here, except warn people in the release notes and hope for the best.
2009-05-31 10:15:46 -04:00
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
.PHONY: test
.PHONY: test-report perf-report full-report
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
check-local: test
GTESTER = gtester
GTESTER_REPORT = gtester-report
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
# test-report: run tests and generate report
# perf-report: run tests with -m perf and generate report
# full-report: like test-report: with -m perf and -m slow
build: Ensure tests are built only on make check Tests should only be enabled when we want to run them, or when we are generating a tarball.
2013-08-16 05:57:54 -04:00
test-report perf-report full-report: ${TEST_PROGS}
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
@test -z "${TEST_PROGS}" || { \
export GTESTER_LOGDIR=`mktemp -d "$(srcdir)/.testlogs-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 10:43:42 -04:00
if test -d "$(top_srcdir)/.git"; then \
export REVISION="`git describe`" ; \
else \
export REVISION="$(VERSION) $(CLUTTER_RELEASE_STATUS)" ; \
fi ; \
export TIMESTAMP=`date +%Y-%m-%dT%H:%M:%S%z` ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
case $@ in \
test-report) test_options="-k";; \
perf-report) test_options="-k -m=perf";; \
full-report) test_options="-k -m=perf -m=slow";; \
esac ; \
build: Fix distcheck for conformance tests We need to export G_TEST_SRCDIR and G_TEST_BUILDDIR if we want to be able to build the path to the tests data.
2013-07-10 07:31:32 -04:00
export G_TEST_SRCDIR="$(abs_srcdir)" ; \
export G_TEST_BUILDDIR="$(abs_builddir)" ; \
conform: Make gtester run a list of wrappers Instead of asking gtester to run ./test-conformance directly we now tell it to run a list of wrapper scripts. This results in each test being spawned in a separate process avoiding leakage of state between tests which has been a big problem with the conformance tests for quite a while now.
2010-05-06 09:53:50 -04:00
$(top_srcdir)/tests/conform/run-tests.sh \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
./test-conformance$(EXEEXT) \
--verbose \
$$test_options \
-o `mktemp "$$GTESTER_LOGDIR/log-XXXXXX"` ; \
conform: Save the revision and date inside the test report Even if gtester-report doesn't use that information (yet), we should store the revision of Clutter that generated the report, and the date in which the test suite was ran.
2010-10-12 10:43:42 -04:00
echo '<?xml version="1.0"?>' > $@.xml ; \
echo '<report-collection>' >> $@.xml ; \
echo '<info>' >> $@.xml ; \
echo ' <package>$(PACKAGE)</package>' >> $@.xml ; \
echo ' <version>$(VERSION)</version>' >> $@.xml ; \
echo " <revision>$$REVISION</revision>" >> $@.xml ; \
echo " <date>$$TIMESTAMP</date>" >> $@.xml ; \
echo '</info>' >> $@.xml ; \
Restore the report on the conformance test suite The report generation was broken by the split of the various test units; also, we were using GTest in a way that's not really sanctioned by upstream. This commit tries to re-use the targets from GLib's Makefile rules while compensating for our own set up.
2010-07-07 09:50:24 -04:00
for lf in `ls -L "$$GTESTER_LOGDIR"/.` ; do \
sed '1,1s/^<?xml\b[^>?]*?>//' <"$$GTESTER_LOGDIR"/"$$lf" >> $@.xml ; \
done ; \
echo >> $@.xml ; \
echo '</report-collection>' >> $@.xml ; \
${GTESTER_REPORT} --version 2>/dev/null 1>&2 ; test "$$?" != 0 || ${GTESTER_REPORT} $@.xml >$@.html ; \
rm -rf "$$GTESTER_LOGDIR" ; \
}
XML_REPORTS = \
test-report.xml \
perf-report.xml \
full-report.xml \
test-report-npot.xml \
perf-report-npot.xml \
full-report-npot.xml
HTML_REPORTS = \
test-report.html \
perf-report.html \
full-report.html \
test-report-npot.html \
perf-report-npot.html \
full-report-npot.html
Bug 1162 - Re-works the tests/ to use the glib-2.16 unit testing framework * configure.ac: * tests/*: The tests have been reorganised into different categories: conformance, interactive and micro benchmarks. - conformance tests can be run as part of automated tests - interactive tests are basically all the existing tests - micro benchmarks focus on a single performance metric I converted the timeline tests to conformance tests and also added some tests from Neil Roberts and Ebassi. Note: currently only the conformance tests use the glib test APIs, though the micro benchmarks should too. The other change is to make the unit tests link into monolithic binaries which makes the build time for unit tests considerably faster. To deal with the extra complexity this adds to debugging individual tests I have added some sugar to the makefiles so all the tests can be run directly via a symlink and when an individual test is run this way, then a note is printed to the terminal explaining exactly how that test may be debugged using GDB. There is a convenience make rule: 'make test-report', that will run all the conformance tests and hopefully even open the results in your web browser. It skips some of the slower timeline tests, but you can run those using 'make full-report'
2008-11-07 14:32:28 -05:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
dist-hook: $(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj $(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj $(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
$(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj: $(top_srcdir)/build/win32/vs9/test-conformance-clutter.vcprojin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
case $$F in \
*.c) echo ' <File RelativePath="..\..\..\tests\conform\'$$F'" />' \
;; \
esac; \
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
done > testconformance.sourcefiles
Rename conform/interactive tests VS projects Add a -clutter suffix for their project names to avoid clashes with the COGL test executables
2011-10-20 04:35:38 -04:00
$(CPP) -P - <$(top_srcdir)/build/win32/vs9/test-conformance-clutter.vcprojin >$@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
rm -f testconformance.sourcefiles
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj: $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxprojin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
case $$F in \
*.c) echo ' <ClCompile Include="..\..\..\tests\conform\'$$F'" />' \
;; \
esac; \
done >testconformance.vs10.sourcefiles
Rename conform/interactive tests VS projects Add a -clutter suffix for their project names to avoid clashes with the COGL test executables
2011-10-20 04:35:38 -04:00
$(CPP) -P - <$(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxprojin >$@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
rm -f testconformance.vs10.sourcefiles
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters: $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxproj.filtersin
@for F in $(test_conformance_SOURCES); do \
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
case $$F in \
*.c) echo ' <ClCompile Include="..\..\..\tests\conform\'$$F'"><Filter>Sources</Filter></ClCompile>' \
;; \
esac; \
build: Fix distcheck
2011-11-22 07:11:06 -05:00
done > testconformance.vs10.sourcefiles.filters
$(CPP) -P - < $(top_srcdir)/build/win32/vs10/test-conformance-clutter.vcxproj.filtersin > $@
build: Clean up the VS build rules Some minor cleanups of the Visual Studio rules in the interactive and conformance test suites.
2011-11-18 10:12:45 -05:00
rm -f testconformance.vs10.sourcefiles.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
# Let the VS9/VS10 Project files be cleared out before they are re-expanded...
build: Fix distcheck
2011-11-22 07:11:06 -05:00
DISTCLEANFILES += \
$(top_builddir)/build/win32/vs9/test-conformance-clutter.vcproj \
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj \
$(top_builddir)/build/win32/vs10/test-conformance-clutter.vcxproj.filters
msvc-support: Recover wrecked branch Recover the branch! :|
2011-09-16 05:25:47 -04:00
Clean up the test reports Since we override the clean-generic target in order to remove the shell scripts we create for each conformance test unit, we cannot use CLEANFILES to remove the test reports.
2009-01-23 08:29:55 -05:00
# we override the clean-generic target to clean up the wrappers so
# we cannot use CLEANFILES
Install conformance tests Install the conformance tests, and metadata to run them with gnome-desktop-testing-runner. https://bugzilla.gnome.org/show_bug.cgi?id=702941
2013-06-23 22:53:13 -04:00
clean-generic: clean-wrappers clean-tests
[build] Split out the custom silent rules The silent rules we use for custom targets should be moved into a separate Makefile.am that gets included from all the others.
2009-09-16 12:43:58 -04:00
$(QUIET_RM)rm -f $(XML_REPORTS) $(HTML_REPORTS)
Install conformance tests Install the conformance tests, and metadata to run them with gnome-desktop-testing-runner. https://bugzilla.gnome.org/show_bug.cgi?id=702941
2013-06-23 22:53:13 -04:00
if ENABLE_INSTALLED_TESTS
# installed tests
insttestdir = $(libexecdir)/installed-tests/$(PACKAGE)/conform
insttest_PROGRAMS = test-conformance
testmetadir = $(datadir)/installed-tests/$(PACKAGE)
testmeta_DATA = $(wildcard *.test)
BUILT_SOURCES += tests
endif
.PHONY: tests clean-tests
tests: stamp-test-conformance
@for i in `cat unit-tests`; do \
unit=`basename $$i | sed -e s/_/-/g`; \
echo " GEN $$unit"; \
echo "[Test]" > $$unit.test; \
echo "Type=session" >> $$unit.test; \
echo "Exec=$(libexecdir)/installed-tests/$(PACKAGE)/conform/test-conformance -p $$i" >> $$unit.test; \
done
clean-tests:
$(QUIET_RM) rm -f *.test
Reference in New Issue Copy Permalink