Huntarr docker rebooting. Failed healthcheck

[darknicht66]

Recently installed Huntarr on my docker swarm. It appears to only stay alive for 20-60 minutes before failing with exit code 0 or 137. Container logs indicate that it is failing health check. I have no heath check defined in the compose file so I have to assume this is a built-in check within the container file.

I have also had this cause database corruption, so #726 may be related.

Environment Details:
Huntarr version 8.2.10
Docker version 28.4.0

Compose file:

services:
  huntarr:
    image: huntarr/huntarr:latest
    # container_name: huntarr       # docker standalone only
    # restart: unless-stopped       # docker standalone only
    user: ${PUID}:${PGID}
    security_opt: ['no-new-privileges:true']
    ports:
      - ${HUNTARR_PORT:-9705}:9705
    volumes:
      - /mnt/docker_data/huntarr/config:/config
    environment:
      - TZ=${TZ}
    deploy:
    # swarm deployment options
      mode: replicated
      replicas: 1
      resources:
        limits:
          cpus: '1.0'
      restart_policy:
        condition: any
        delay: 5s
        max_attempts: 5
        window: 300s

Example service failure:

State:{
Dead:false,
Error:"",
ExitCode:137,
FinishedAt:"2025-10-05T15:17:57.190708045Z",
Health:{
FailingStreak:3,
Log:[
{
End:"2025-10-05T11:15:10.112250726-04:00",
ExitCode:-1,
Output:"Health check exceeded timeout (10s): % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0",
Start:"2025-10-05T11:15:00.037060292-04:00"
},
{
End:"2025-10-05T11:15:44.792273185-04:00",
ExitCode:0,
Output:" % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 100 119 100 119 0 0 26 0 0:00:04 0:00:04 --:--:-- 26 {"message":"Application is running normally","ready":true,"status":"healthy","timestamp":"2025-10-05T15:15:44.785316"} ",
Start:"2025-10-05T11:15:40.11400574-04:00"
},
{
End:"2025-10-05T11:16:24.89504425-04:00",
ExitCode:-1,
Output:"Health check exceeded timeout (10s): % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0",
Start:"2025-10-05T11:16:14.793588991-04:00"
},
{
End:"2025-10-05T11:17:04.993669275-04:00",
ExitCode:-1,
Output:"Health check exceeded timeout (10s): % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0",
Start:"2025-10-05T11:16:54.896218908-04:00"
},
{
End:"2025-10-05T11:17:45.093235457-04:00",
ExitCode:-1,
Output:"Health check exceeded timeout (10s): % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0",
Start:"2025-10-05T11:17:34.995939616-04:00"
}
],
Status:"unhealthy"
},

Container log at time of failure:

2025-10-05 11:15:55 America/Toronto - huntarr.sonarr - DEBUG - Still sleeping, 720 seconds remaining before next cycle...
2025-10-05 11:16:30 America/Toronto - huntarr - DEBUG - Local network access from 127.0.0.1 - Authentication bypassed! (Local Bypass Mode)
2025-10-05 11:17:06 America/Toronto - huntarr - DEBUG - Local network access from 127.0.0.1 - Authentication bypassed! (Local Bypass Mode)
2025-10-05 11:17:06 America/Toronto - huntarr - DEBUG - Checking schedules at 2025-10-05 11:17:06 (America/Toronto)
2025-10-05 11:17:06 America/Toronto - huntarr - DEBUG - Loaded schedules: {'global': 0, 'sonarr': 0, 'radarr': 0, 'lidarr': 0, 'readarr': 0, 'whisparr': 0, 'eros': 0}
2025-10-05 11:17:06 America/Toronto - huntarr - DEBUG - Scheduler history: 2025-10-05 11:17:06 America/Toronto - check for None - debug - Checking schedules at 2025-10-05 11:17:06
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Received SIGTERM. Initiating graceful shutdown...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Performing emergency database checkpoint...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Main database emergency checkpoint completed
2025-10-05 11:17:47 America/Toronto - huntarr - DEBUG - Local network access from 127.0.0.1 - Authentication bypassed! (Local Bypass Mode)
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Logs database emergency checkpoint completed
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Signaling Waitress server to shutdown...
2025-10-05 11:17:47 America/Toronto - huntarr.sonarr - INFO - Stop event detected during sleep. Breaking out of sleep cycle.
2025-10-05 11:17:47 America/Toronto - huntarr.swaparr - INFO - Swaparr thread stopped
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Prowlarr stats refresher thread stopped
2025-10-05 11:17:47 America/Toronto - huntarr.lidarr - INFO - Stop event detected during sleep. Breaking out of sleep cycle.
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Hourly API cap scheduler stopped
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Background task main loop exited. Shutting down threads...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Waiting for all app threads to stop...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Waiting for Swaparr thread to stop...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Shutdown signal received. Stopping Waitress server...
2025-10-05 11:17:47 America/Toronto - huntarr - INFO - Waitress server close() called.
2025-10-05 11:17:48 America/Toronto - huntarr - INFO - Server thread stopped successfully.
2025-10-05 11:17:48 America/Toronto - huntarr - INFO - Waitress server has stopped.
2025-10-05 11:17:48 America/Toronto - huntarr - INFO - Web server has stopped. Initiating final shutdown sequence...
2025-10-05 11:17:48 America/Toronto - huntarr - INFO - Waiting for background tasks to complete...
2025-10-05 11:17:52 America/Toronto - huntarr - WARNING - Swaparr thread did not stop gracefully
2025-10-05 11:17:52 America/Toronto - huntarr - INFO - Stopping schedule action engine...
2025-10-05 11:17:52 America/Toronto - huntarr - INFO - Scheduler loop stopped
2025-10-05 11:17:52 America/Toronto - huntarr - INFO - Scheduler stopped gracefully
2025-10-05 11:17:52 America/Toronto - huntarr - INFO - Schedule action engine stopped successfully
2025-10-05 11:17:52 America/Toronto - huntarr - INFO - Waiting for 2 app threads to stop: sonarr, lidarr
2025-10-05 11:17:52 America/Toronto - huntarr - DEBUG - Waiting for sonarr thread to stop...
2025-10-05 11:17:53 America/Toronto - huntarr - WARNING - Background thread did not stop gracefully within the timeout.
2025-10-05 11:17:53 America/Toronto - huntarr - INFO - --- Huntarr Main Process Exiting ---
2025-10-05 11:17:53 America/Toronto - huntarr - INFO - Clean shutdown completed - Exit code 0
2025-10-05 11:17:53 America/Toronto - huntarr - INFO - Exit cleanup handler called
2025-10-05 11:17:53 America/Toronto - huntarr - INFO - Database shutdown completed
2025-10-05 11:17:53 America/Toronto - huntarr - INFO - Cleanup completed in 0.00 seconds

[darknicht66]

A bit more info: I removed the cpu limits on the service but had no effect. CPU never gets above 12%. The web UI also gets extremely sluggish, taking 5 to 10 seconds to move between sections at times. In fact I can almost guarantee a failure if I click around in the web UI a bit without waiting for a full page refresh.

[SeanTumulakNguyen]

+1 I am also receiving these errors