This happens if you only changed subtitles. You must change the Audio language in the game’s main menu (before loading a save).

If you switch back to English later, Steam will delete the German pack to save space. You will have to re-download it if you want it again.