No space left on device

Jan 24 07:14:12 MACHINE_NAME rsyslogd[953]: file '7' write error: No space left on device [v8.32.0 try http://www.rsyslog.com/e/2027]

Jan 15 12:39:03 MACHINE_NAME systemd-networkd-wait-online[29924]: Could not create manager: No space left on device

Jan 25 15:58:36 SERVER systemd-logind[876]: Failed to save user data /run/systemd/users/0: No space left on device

Sep 22 08:00:35 SERVER systemd[1]: rpm-ostreed.service: Failed to add control inotify watch descriptor for control group /system.slice/rpm-ostreed.service: No space left on device

Aug 25 19:58:00 SERVER_NAME dockerd[1322]: time="2020-08-25T19:58:00.476149096Z" level=error msg="Failed to log msg \"\" for logger json-file: write /srv/docker/containers/6f20b6203bd6872e25d5d61a64722cc4b4a550b9ac0bad5f178c1bb3f5/14e6676f20b6203bd6872e25d5d61a64722cc550b9ac0bad5f178c1bb3f5-json.log: no space left on device"

Sep 24 05:24:58 SERVER_NAME systemd[1]: rpm-ostreed.service: Failed to add control inotify watch descriptor for control group /system.slice/rpm-ostreed.service: No space left on device

PostgreSQL logs

ERROR:  could not extend file "base/16385/t17_174219": No space left on device

Related commands

• journalctl --disk-usage, journalctl --vacuum-size=200M
• journalctl -r | grep "No space left on device"
• sar -F
• docker system df or docker system df --verbose
• docker system prune
• find . -ls | sort -rnk7 | more
• du -hs -- *

• ls -ltr | sort -rnk7

• ls -ld $(find ./) | sort -rnk5 | more
  • Argument list too long
• ENOSPC
• apt clean, apt autoclean, apt purge, apt autoremove
• /proc/kcore
• Artifactory 2020-10-05T08:37:25.312Z [jfrt ] [WARN ] [887efcf06c050966] [r.s.RepositoryServiceImpl:1822] [tp-nio-8081-exec-289] - 90% storage space reached. Your maximum limit is 93%. It is recommended to add disk space.
• growpart, resize2fs

See also

• File system, du, df, find, ls, mkdir, touch, locate
• systemd-journald: journalctl, /etc/systemd/journald.conf, journalctl logs, journalctl --list-boots, journalctl --disk-usage, journalctl -u kubelet, journalctl -u prometheus, journalctl --help
• Monitoring: On call, Monitoring software, Monitoring services, Resource monitoring, Metric colletion tools, network monitoring, SLA Management Monitoring Tools, Alarm/Alert, Resource starvation, Alerts and notifications, Monitoring Kubernetes, VictoriaMetrics, Sensu, LogicMonitor, Distributed tracing, Datadog Monitors
• du, du -hs, Disk space usage, df, ls, tree, find, docker system df, journalctl --disk-usage, No space left on device, ENOSPC, sar -F, growpart, resize2fs, ncdu, duf, dua-cli