To exit the client application – the Systray application will remain active.  If you want to close the whole application then you should select close from the systray icon menu – see Close

Exit