Build: configure: remove dead code

The intended match was "x/*", but it turns out it's unnecessary to treat that
as a special case.