Chat
Chat jobs are queued and processed by the worker. The chat HUD reports bot state, CPU, RAM, I/O, token rate, and active model requests so idle, queued, active, and offline states are visible.
Chat jobs are queued and processed by the worker. The chat HUD reports bot state, CPU, RAM, I/O, token rate, and active model requests so idle, queued, active, and offline states are visible.