[dlopen] compress: fix load/unload of libraries and add extensive test

each handle should only unload libraries that has loaded or referenced
on exit, attempt to close all libraries from that handle
on compress_fini close only the one that's open

Signed-off-by: Fabio M. Di Nitto <fdinitto@redhat.com>