Thanks for the hint. The .exe file is still oversized (1.6 GB), but can now be opened.

Originally Posted by Jezze
The last version of MAME I could compile as debug build with .pdb file was 0.159 [...]
To be more precise, it was UME not MAME.