Can I run GPT-X3-150M on a Mac with 128 GB?
Yes
Its published weights (598 MB) fit in the 96.0 GB a Mac with 128 GB can use, with room for an unknown amount of context.
Full analysis of GPT-X3-150M
Everything that runs on Mac with 128 GB
Get the weights on Hugging Face
hf download AxiomicLabs/GPT-X3-150MFiles and context on Mac with 128 GB
Each file of GPT-X3-150M (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On Mac with 128 GB | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 598 MB | Fits | not known | not known |
| 4-bit (estimate) | 84.0 MB | Fits | not known | not known |