You can change what the Power Button does when you press it. Make it Shut down, Hibernate, Sleep or Do Nothing via Control panel.

If Outlook is stuck on updating Inbox or is not updating Inbox, and you are not receiving new emails, follow the solutions mentioned in this post to resolve the issue.