Which AI models can I run on a Mac with 24 GB?

0 of the 0 LLMs analyzed on Model Anatomy fit on a Mac with 24 GB (16.0 GB usable) with at least 4K tokens of context. Each row shows the best file that fits and how much context the remaining memory holds.

Hardware

How many

Context needed

Context cache

Sort by

Show models that don't fit

Nothing the site has analyzed fits with these settings. Try less context, an 8-bit context cache or more GPUs.

Assumes 67% of the Mac's memory is usable (macOS's default limit for the GPU; it can be raised). Context memory is for one conversation. GGUF repos use their largest file that fits; other repos use the published weights, or a 4-bit estimate when only that would fit.