Open the tab "File" and click on "Account settings". Choose your email account and click on edit to open the account settings and click on "More Settings". In the new window you can change the port over the tab "Advanced".

For detailed information how to set up Outlook manually please look here (step 4 and step 6).