Forgot to say: not stopping the swap also meant that, with encrypted swaps, the LUKS device couldn't be detached (since it's still in use) and would result in errors on shutdown: systemd-cryptsetup[3327]: Failed to deactivate: Invalid argument