r/Cyberpunk • u/Candid-Parsnip9815 • 4d ago

anyone running local ai models for code review without the big cloud apis

been trying to keep freelance work contained to the hours after the kids are down. that means no waiting on rate limits or dealing with another service that wants to train on your commits. set up a small rig with a local llm for catching the obvious stuff in client code. it flags a lot of the junk that usually eats the first pass. still have to do the real fixes myself but the noise is lower. hardware is basically whatever was left over from an old workstation plus some spare ram. the output is rougher than the hosted versions but it stays private and theres no usage counter ticking in the background. curious if anyone else is doing something similar for side work or if the quality gap is too wide once you leave the big providers.

0 Upvotes

6% Upvoted

4 comments sorted by

2

u/storm181 4d ago

did ai tell you where to post this? wrong place by a mile

1

u/TroubledC-3PO 3d ago

It sounds like your local LLM is slower and worse? Is code still passing your testing? Also since you're in here, be wary the new rat race to offload your cognitive faculties so willingly. And if your gonna employ an AI, be cool and give it human rights, a wage, and time off for it to think for itself.

2

u/throwawaythisacc1938 3d ago

Eh, quality gap between current SOTA and local is pretty large i use Qwen3.8 27B and it works but I've got a decision harness that will anonymize and route specific function requests and end evals to SOTA. It keeps my SOTA usage cost reasonable, and gives me power to control what code I want to go where - also gives me a much more powerful engine for eval's. It wasn't a cheap setup though.

This topic probably belongs more in /r/LocalLLaMA/