Since the plugins are tested in that job, and if they are changed
we want the tests to run too.