Add delay before stopping server

Let some time to print any exception trace before killing it.