I am amazed at how many people don't use the Quick Access Toolbar in Office. I use it all the time in Outlook, Word, and Excel. Basically -the QAT allows you to pin functions that you use regularly to the top toolbar. This is an advantage because the top toolbar is always available regardless of where you are in an application. I have the undo, save all attachments, out of office settings, and contact look up pinned to my toolbar.
To make these work for you in Outlook - go to File-Options-Quick Access Toolbar.
Then simply choose the items you want in your QAT. You can use the arrows on the right and left to change the order.