- Joined
- May 2, 2018
- Messages
- 4,809
There has been a lot of talk about AI recently, mostly about cloud AI models like ChatGPT, Claude (code) etc.
A few months ago Luke even wrote a guide on how to setup Hermes agent on a VPS server:
In this guide, I’d like to show how you can set up an AI locally on your own PC. Running a local AI model requires no API keys, there is no per-token billing, no rate limits, no account bans, and nothing leaving your hard drive.
The model I’ve chosen for this test is Qwen 3.5 9B, and later I’ll explain why.
Why bother running locally
I guess many of you will ask this question, since there are many cloud model subscriptions starting from $20 per month already.
There are a few reasons like:
A few months ago Luke even wrote a guide on how to setup Hermes agent on a VPS server:
In this guide, I’d like to show how you can set up an AI locally on your own PC. Running a local AI model requires no API keys, there is no per-token billing, no rate limits, no account bans, and nothing leaving your hard drive.
The model I’ve chosen for this test is Qwen 3.5 9B, and later I’ll explain why.
Why bother running locally
I guess many of you will ask this question, since there are many cloud model subscriptions starting from $20 per month already.
There are a few reasons like:
- Privacy - Your campaign data, your offers, your angles, none of it touches a third-party server. If you've ever hesitated before pasting a profitable funnel into a chatbot, you don’t have to worry about it any more.
- No ToS problems - Cloud models refuse a lot of legitimate affiliate work. Aggressive ad copy, certain verticals, competitor analysis
