Mistake with app settings in web.config file

Make sure to put the settings under the correct appSettings section. In my case it was the <appSettings> section under <configSections>