High: Core: Ensure failed IPC connections are cleaned up

Do so before invoking the callback because it may call exit() and result
in stale shared memory files on disk