[systemd-devel] systemd-oomd kill a lot of process instead of one service
maxime.deroucy at gmail.com
maxime.deroucy at gmail.com
Mon Mar 4 15:08:14 UTC 2024
Hello,
I am running an uptodate archlinux, with gnome desktop.
Please find the logs attached.
In those logs we see that systemd-oomd is triggered, and select this scope for killing:
/user.slice/user-1000.slice/user at 1000.service/app.slice/app-org.gnome.Terminal.slice/tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope
But it also kills a lot of other processes on other scopes.
Why ?
>From what I understand, it should selecte "A" (one) cgroup and kill it… not multiple process in multiple cgroups.
https://www.freedesktop.org/software/systemd/man/latest/systemd.resource-control.html#ManagedOOMSwap=auto%7Ckill
> systemd-oomd will select a descendant cgroup and send SIGKILL to all of the processes under it.
Thank you in advance.
--
Regards
Maxime de Roucy
-------------- next part --------------
mars 04 15:41:09 systemd[1407]: amazon-music.service: systemd-oomd killed some process(es) in this unit.
mars 04 15:41:09 systemd-oomd[884]: Considered 93 cgroups for killing, top candidates were:
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/amazon-music.service
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 11.79 Avg60: 3.60 Avg300: 0.82 Total: 6s
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 767.6M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 5938984
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 5787930
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-gnome-firefox\x2dw-43368.scope
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 213ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 3.7G
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 446008
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 446008
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/slack.service
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 689ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 1.2G
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 366303
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 366303
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-gnome-org.gnome.Evolution-5266.scope
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 405ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 652.3M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 92829
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 92829
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-org.gnome.Terminal.slice/tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 2ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 633.1M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 276
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 276
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-org.gnome.Terminal.slice/tmux-spawn-1058a64d-7fc6-4566-ba25-660c5ea5cde9.scope
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 120us
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 210.8M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 18544
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 18544
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/background.slice/tracker-miner-fs-3.service
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 39ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 187.4M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 115135
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 115135
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/xdg-desktop-portal-gnome.service
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 3ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 181.2M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 17884
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 17884
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-dbus\x2d:1.2\x2dorg.gnome.Nautilus.slice
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 166us
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 90.7M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 25639
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 25639
mars 04 15:41:09 systemd-oomd[884]: Path: /user.slice/user-1000.slice/user at 1000.service/app.slice/app-gnome-org.gnome.Software-1794.scope
mars 04 15:41:09 systemd-oomd[884]: Memory Pressure Limit: 0.00%
mars 04 15:41:09 systemd-oomd[884]: Pressure: Avg10: 0.00 Avg60: 0.00 Avg300: 0.00 Total: 65ms
mars 04 15:41:09 systemd-oomd[884]: Current Memory Usage: 74.7M
mars 04 15:41:09 systemd-oomd[884]: Memory Min: 0B
mars 04 15:41:09 systemd-oomd[884]: Memory Low: 0B
mars 04 15:41:09 systemd-oomd[884]: Pgscan: 11167
mars 04 15:41:09 systemd-oomd[884]: Last Pgscan: 11167
mars 04 15:41:09 systemd-oomd[884]: Killed /user.slice/user-1000.slice/user at 1000.service/app.slice/app-org.gnome.Terminal.slice/tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope due to memory pressure for /user.slice/user-1000.slice/user at 1000.service being 11.87% > 10.00% for > 5s with reclaim activity
mars 04 15:41:09 systemd[1407]: slack.service: systemd-oomd killed some process(es) in this unit.
mars 04 15:41:09 systemd[1407]: tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope: systemd-oomd killed 2 process(es) in this unit.
mars 04 15:41:09 systemd[1407]: tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope: Failed with result 'oom-kill'.
mars 04 15:41:09 systemd[1407]: tmux-spawn-c9dc150a-603e-4815-b501-1863913b09a4.scope: Consumed 53.169s CPU time.
mars 04 15:41:09 systemd[1407]: app-gnome-firefox\x2dw-43368.scope: systemd-oomd killed some process(es) in this unit.
mars 04 15:41:09 systemd[1407]: app-gnome-org.gnome.Evolution-5266.scope: systemd-oomd killed some process(es) in this unit.
mars 04 15:41:09 systemd[1407]: app-gnome-org.gnome.Evolution-5266.scope: Failed with result 'oom-kill'.
mars 04 15:41:09 systemd[1407]: app-gnome-org.gnome.Evolution-5266.scope: Consumed 3min 56.270s CPU time.
mars 04 15:41:09 systemd[1407]: amazon-music.service: Main process exited, code=killed, status=9/KILL
mars 04 15:41:09 systemd[1407]: amazon-music.service: Failed to kill control group /user.slice/user-1000.slice/user at 1000.service/app.slice/amazon-music.service, ignoring: Invalid argument
mars 04 15:41:09 systemd[1407]: amazon-music.service: Failed with result 'oom-kill'.
mars 04 15:41:09 systemd[1407]: amazon-music.service: Triggering OnFailure= dependencies.
mars 04 15:41:09 systemd[1407]: amazon-music.service: Consumed 48min 1.476s CPU time, 798.3M memory peak, 397.3M memory swap peak.
mars 04 15:41:09 systemd[1407]: Starting Notify the user whe a service fail...
mars 04 15:41:09 systemd[1407]: app-gnome-firefox\x2dw-43368.scope: Failed with result 'oom-kill'.
mars 04 15:41:09 systemd[1407]: app-gnome-firefox\x2dw-43368.scope: Consumed 45min 48.329s CPU time.
mars 04 15:41:09 systemd[1407]: Finished Notify the user whe a service fail.
mars 04 15:41:09 systemd[1407]: slack.service: Main process exited, code=killed, status=9/KILL
mars 04 15:41:09 systemd[1407]: slack.service: Failed with result 'oom-kill'.
mars 04 15:41:09 systemd[1407]: slack.service: Triggering OnFailure= dependencies.
mars 04 15:41:09 systemd[1407]: slack.service: Consumed 58min 50.619s CPU time.
mars 04 15:41:09 systemd[1407]: Starting Notify the user whe a service fail...
mars 04 15:41:09 systemd[1407]: Finished Notify the user whe a service fail.
More information about the systemd-devel
mailing list