An 'incoming mail server' is one that collects all email that is sent to your addresses.
From there you can access them online (see our FAQ on accessing your email) or you can access the email through an email client on your device.
An 'outgoing mail server' is one that sends your emails out into the world wide web to find where it is meant to be delivered. You computer has nothing to do with the email once it has been sent. This server is usually provided by the company you have your internet connection through for example Telstra - it has nothing to do with your website.