After investigation, Microsoft has identified a third-party certificate issue as the source of the prompts. The certificate provider is working on a fix.
Users may be experiencing certificate prompts when accessing Exchange Online using Outlook. The prompt is "Security Alert - api.diagnostics.office.com". Clicking "Yes" will bypass the prompt. Microsoft is working on a fix.