[systemd-devel] odd behaviour on corrupted journal/further analysis

Sun Feb 18 09:43:25 UTC 2024

Hi folks,

I've had a system crash I'd like to look into, with reasons to think
some valuable informations will be in the journal (I have a raid1 setup
and it looks like a disk wasn't written to at all in the minutes leading
to the crash, so I'm hopeful dmesg will have been logged on the working
disk.. Yes, I know, remote logs etc -- maybe after I'm done with this
mess; back on topic).

Unfortunately journalctl seems pretty unhappy with my logs, I would have
expected it to rename the corrupted journal and at least get very old
logs but this is actually borderline a bug:

- all journalctl commands say one of the files is corrupted, but don't
seem to try to rename it to foo.journal~ or do anything with it:
Journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b531a7b-00060f1593b6379e.journal corrupted, ignoring file.

- plain 'journalctl' lists six lines of logs less than an hour before
the current boot, then full current boot (including its boot id), but it
doesn't list very old files that I have no reason to believe would be
corrupted

- journalctl --list-boots doesn't like anything at all except the above
error; running with SYSTEMD_LOG_LEVEL=debug mentions another boot id
than the boot found but sayinig it ignores it because it culdn't find
its first entry, fair enough, but it should at least find the current
boot that journalctl lists properly as:
-- Boot a94118c9af32466d83c139018a023f52 --

Interestingly it's also saying the directory my logs are in is 'removed' ?..

I've attached full log in case it rings a bell; this is with a
journalctl compiled from master as of just now, commit ff509772f1f9
("TODO: fix typo")

- journalctl --verify with debug level might hint why there's no older
messages: they all seem to fail to open with 'Bad message' error, but it
only provides infos about the last files in normal output.. Also
attached that.

Anyway, my main question stays there same: I couldn't find any
diagnostic utility; I don't care if I just get a garbled mess but is
there a way to try to decompress what we can or whatever is needed to
get infos out of the corrupted files? Or is journalctl already doing as
much as is possible?
I've checked the files with xxd and they're not empty, I can't tell if
it's random garbage or if there's anything useful in here but would be
happy to send a couple of files to a few individuals (probably nothing
too sensible in there, but would rather not make it public as it
might contain some mail addresses or whatsnot)

Thanks!
-- 
Dominique Martinet | Asmadeus
-------------- next part --------------
Considering root directory '/run/log/journal'.
Root directory /run/log/journal added.
Considering root directory '/var/log/journal'.
Root directory /var/log/journal added.
Considering directory '/var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8'.
Directory /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8 added.
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b531a7b-00060f1593b6379e.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b53b7f5-00060f1fcebd0c6a.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b53d849-00060f2225f1f1e2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b5448cf-00060f287b18ffe2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b5479f9-00060f2b1a9334bf.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b54fd22-00060f3643c94623.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b55836c-00060f3fe3e6075d.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b55b85a-00060f43a75273db.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b55f6f0-00060f4a61a0aa02.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b56a9db-00060f53615ecbf6.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b577b97-00060f5ec56ad975.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b577852-00060f5e7f780a22.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b57ccc5-00060f61ca701cb7.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b585153-00060f680848ec19.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b58eee8-00060f7035dc3fa9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5913cd-00060f729d4f6a0f.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b5b2a72-00060f8f6dedd3f2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b5b4abe-00060f91a0f8c147.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5bd4bd-00060f9ad8fe2611.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5db5d3-00060fc314acea02.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b61040f-00060ffd48fc1634.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6105f0-00060ffd8f292ab0.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b61152b-00060fff6e333140.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b623145-00061011673a117b.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b633362-0006101f6ecf8901.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b6261e0-000610138c0a75d7.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6356ec-0006102139eaa8b1.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b638a61-00061025af3cc686.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b63b327-00061027a9e1c9e9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b64955b-00061039cfde0c35.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b64bc97-0006103d13d24252.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b64aec0-0006103bc7b92dd2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b65c2c9-00061052ac2ab208.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b665ecc-0006105f99c33ba5.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b66966f-000610640367f5d9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6738e8-00061071214c5917.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6949a3-0006109577b57b98.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b69545d-0006109640344716.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b69e309-000610a05cee0581.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6ba9c6-000610bc5c617240.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6e98b4-000610e8f9634f21.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b72d9c4-0006112a9233ddca.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b777769-00061170987ab1e9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b789d7f-0006117d68c87a58.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b79546c-000611871627159f.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 000611a3547cb7dc-30ac75b8bb548880.journal~: Bad message
Journal effective settings seal=no keyed_hash=yes compress=ZSTD compress_threshold_bytes=8B
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 564158f161f142e1a9acea4b9e126e5e-000000000b7be30e-000611a354771f2f.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 000611a38b8b4850-ea9184a7bb465911.journal~ added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at 000611a38c9f0a95-15a0ef6c330d1d0d.journal~ added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001.journal added.
Considering directory '/var/log/journal/78ec99a9df634351bd4d46f7cfb77966'.
Considering directory '/var/log/journal/681c914a243940b0ae0f5502f4ea96a6'.
Considering directory '/var/log/journal/4a664f11d8b84f96896037fdac66876e'.
Journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b531a7b-00060f1593b6379e.journal corrupted, ignoring file.
Attempt to move to data object at non-64-bit boundary: 464051021516019646
Can't iterate through /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal, ignoring: Bad message
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal removed.
Whoopsie! We found a boot ID 7cb4b67c37a54662b5a6188731f821fd but can't read its first entry. The journal seems to be corrupted. Ignoring the boot ID.
Root directory /run/log/journal removed.
Directory /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8 removed.
Root directory /var/log/journal removed.
mmap cache statistics: 129 category cache hit, 54 window list hit, 57 miss
-------------- next part --------------
Considering root directory '/run/log/journal'.
Root directory /run/log/journal added.
Considering root directory '/var/log/journal'.
Root directory /var/log/journal added.
Considering directory '/var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8'.
Directory /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8 added.
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b531a7b-00060f1593b6379e.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b53b7f5-00060f1fcebd0c6a.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b53d849-00060f2225f1f1e2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b5448cf-00060f287b18ffe2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b5479f9-00060f2b1a9334bf.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b54fd22-00060f3643c94623.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b55836c-00060f3fe3e6075d.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b55b85a-00060f43a75273db.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b55f6f0-00060f4a61a0aa02.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b56a9db-00060f53615ecbf6.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b577b97-00060f5ec56ad975.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b577852-00060f5e7f780a22.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b57ccc5-00060f61ca701cb7.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b585153-00060f680848ec19.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b58eee8-00060f7035dc3fa9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5913cd-00060f729d4f6a0f.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b5b2a72-00060f8f6dedd3f2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b5b4abe-00060f91a0f8c147.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5bd4bd-00060f9ad8fe2611.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b5db5d3-00060fc314acea02.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b61040f-00060ffd48fc1634.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6105f0-00060ffd8f292ab0.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b61152b-00060fff6e333140.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b623145-00061011673a117b.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b633362-0006101f6ecf8901.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b6261e0-000610138c0a75d7.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6356ec-0006102139eaa8b1.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b638a61-00061025af3cc686.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b63b327-00061027a9e1c9e9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b64955b-00061039cfde0c35.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b64bc97-0006103d13d24252.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b64aec0-0006103bc7b92dd2.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b65c2c9-00061052ac2ab208.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b665ecc-0006105f99c33ba5.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b66966f-000610640367f5d9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6738e8-00061071214c5917.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6949a3-0006109577b57b98.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b69545d-0006109640344716.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001 at a10c5e2030f04d2d89a350feb75bc384-000000000b69e309-000610a05cee0581.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b6ba9c6-000610bc5c617240.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b6e98b4-000610e8f9634f21.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b72d9c4-0006112a9233ddca.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b777769-00061170987ab1e9.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b789d7f-0006117d68c87a58.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b79546c-000611871627159f.journal: Bad message
Failed to open journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 000611a3547cb7dc-30ac75b8bb548880.journal~: Bad message
Journal effective settings seal=no keyed_hash=yes compress=ZSTD compress_threshold_bytes=8B
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 564158f161f142e1a9acea4b9e126e5e-000000000b7be30e-000611a354771f2f.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 000611a38b8b4850-ea9184a7bb465911.journal~ added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at 000611a38c9f0a95-15a0ef6c330d1d0d.journal~ added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000.journal added.
File /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001.journal added.
Considering directory '/var/log/journal/78ec99a9df634351bd4d46f7cfb77966'.
Considering directory '/var/log/journal/681c914a243940b0ae0f5502f4ea96a6'.
Considering directory '/var/log/journal/4a664f11d8b84f96896037fdac66876e'.
Journal file /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at a10c5e2030f04d2d89a350feb75bc384-000000000b531a7b-00060f1593b6379e.journal corrupted, ignoring file.
PASS: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 564158f161f142e1a9acea4b9e126e5e-000000000b7be30e-000611a354771f2f.journal
000110: Invalid field hash table hash table item (238/333) head_hash_offset: 6b25254088ccc5cc
000110: Invalid object contents: Bad message
File corruption detected at /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal:272 (of 8388608 bytes, 0%).
FAIL: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at a10c5e2030f04d2d89a350feb75bc384-000000000b7bd2dc-000611a29a8c1866.journal (Bad message)
PASS: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system at 000611a38b8b4850-ea9184a7bb465911.journal~
38fef0: Data object references invalid entry at 1280298
File corruption detected at /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system.journal:19398760 (of 25165824 bytes, 77%).
FAIL: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/system.journal (Bad message)
PASS: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000 at 000611a38c9f0a95-15a0ef6c330d1d0d.journal~
PASS: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1000.journal
PASS: /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8/user-1001.journal
Root directory /run/log/journal removed.
Root directory /var/log/journal removed.
Directory /var/log/journal/ad8b3335f41a4e2d8b67321a1cabc1b8 removed.
mmap cache statistics: 37233351 category cache hit, 849970 window list hit, 77 miss