How to remove an unwanted invitee from Calendar

Sign into the Outlook Calendar on the web and remove it. When you sync a Calendar from a Microsoft email address, everything on the Calendar server is synced to the Calendar app. There is also a setting in Outlook on the web to prevent Calendar Invites from being added when they are scraped from the email account, where then they won't sync to the Calendar app on your phone.