Remove an assert.

It seems to fire because of precision issues. Added
more debug info to the warn to try to figure out for sure.