Perhaps it's an alignment issue. Have you checked the fence against a known flat surface?

Just a thought.

Greg