I just did a fresh install of Windows 10 Pro version 1903 build 18362.116 and Visual Studio Code. Now the integrated terminal only launches externally.

Pressing Ctrl + ~ results in this.

What am I missing? How do I get it to open integrated again?

EDIT

After working with VSCode team it is a verified bug. See the Github issue here. I posted the workaround as an answer here.