Check the total size. It should be slightly smaller than the original ISO due to removed padding.
I can provide specific settings to get your library running perfectly. convert iso to xex exclusive