On my Pentium 4 HT the problem, which persisted when building without -j, has been solved by adding -j2.