> Pierre wrote:
> > I forgot to mention how vicious such changes can be. Most
> of times the
> > related tests are "updated" in the same commit (or right after) to
> > follow the new behavior. Making nearly impossible to know about the
> > breakages without duplicating core tests in our apps. Also commit
> > messages or changelog entries are rarely explicit enough to mention
> > them.
>
> Maybe we could set up a testing system that runs the tests
> from PHP_4_4, PHP_5_0, PHP_5_1, and HEAD and shows the
> differences? That way we would notice that a test that
> passed with a previous version fails with a newer one.
Would have to diff the various tests too.
Perhaps the tests cases should never be removed, but the expected results altered so a diff between
differing test suite versions
can show what behaviour has changed.
Jared