E-Ink News Daily

← Back to list

Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU

A GitHub project called llama-modchip demonstrates running a 284B-parameter DeepSeek model on just 64GB of RAM without requiring a GPU. The approach generated significant attention on HackerNews with 355 points and 152 comments.

Background

Running large language models on constrained hardware has been a major research focus, with quantization and memory-efficient inference being key techniques. This project appears to push the boundaries of what's possible on CPU-only systems.

Source
Hacker News (RSS)
Published
Nov 8, 2026 at 06:22 PM
Score
7.0 / 10