When you clicked Remove device, was it the trash can circled here?
As to your Outlook issue, I do not use it so I have no experience to help. Was it working correctly before?
One thing that might be affecting things is your Win 8.1. An issue with Windows 8/8.1 is the Fast Start feature. With this enabled, you never actually get a full shutdown, which is needed by Norton, and other programs, every once in a while to fully update itself. See this information from Windows Eight Forums on how to turn off this feature. http://www.eightforums.com/tutorials/6320-fast-startup-turn-off-windows-8-a.html
With Win 8.1, you can right click on the Start button on the Windows desktop and select Shut Down to force a complete shut down.