If we have to make override changes to the user's source material to handle cogl_polygon then we need to make sure we unref the override material at the end.