Sakhanda Wire
NVDA $152.18 -2.54% MSFT $505.66 -2.38% GOOGL $279.68 -1.43% META $617.65 -1.40% AMZN $256.02 -0.67%
← Back to the news

Hermes Desktop adds one-click setup for local AI models

Hermes Desktop now offers a one-click workflow for running open-weights models locally. The application examines the computer’s hardware, checks available models against the GPU, selects the highest-quality build that fits, downloads its weights and configures the inference runtime. The flow appears on first launch and can later be opened through Settings → Providers → Local Models.

The MIT-licensed, free desktop application uses an official llama.cpp build matched to the hardware. It verifies and updates that runtime, with support for CUDA, Metal, Vulkan, HIP and CPU backends. Hermes Desktop runs on macOS 12+, Windows 10/11 and Linux distributions, and local-model use does not require an account.

Before downloading, the catalog labels models as fully GPU-supported, partly dependent on system RAM or too large for the machine. Hermes chooses the best-quality quantization that fits entirely on the GPU, with 4-bit as the minimum. Recommended models provide at least a 64K context window. If memory is insufficient, expert weights are moved to system RAM while the attention cache remains on the GPU. Idle models are unloaded after 15 minutes.

Written by Sakhanda Wire AI from reporting by MarkTechPost. Facts, quotes and full context are in the original article below.

Originally published by MarkTechPost on

Read the original on MarkTechPost ↗

The reporting and the image belong to MarkTechPost and are credited and linked above; the text on this page is Sakhanda Wire's own summary.

← Back to the news

More stories

All the latest news