metaend.eth's cast | Paragraph

metaend.eth](https://paragraph.com/0xccc242144041042c3709cdd18d60ecc16669460a)

A private two-model AI stack on one 8GB GPU

Some data should never leave the building. Bank statements, payment rails, customer records, anything you would not paste into a hosted chatbot. We wanted an assistant that can reason over exactly that kind of material and call real tools against it, with a simple rule: no third party ever sees the prompt or the data. The only network traffic the models make is to localhost. The constraint that makes this interesting is the hardware. One consumer GPU with 8GB of VRAM (an RTX 3070 Ti), a six-c...