Likely it's something that screws up with optimization since when compiling with symbols the makefile uses -O0 (no optimizations) while compiling without symbols defaults to -O3. I'll do some tests.