ollama or llama.cpp to self host if you have a good mac or good video card. this is perfectly safe.
there are a bazillion hosted inference providers to choose from https://huggingface.co/docs/inference-providers/en/index be aware that you are sending your code to fuck knows who and they are sending back fuck knows what. ymmv, yolo.
hook one of them up to opencode.ai or pi.dev or one of the bazillion other ‘harneses’ or whatever we are calling it this week and try not to rm -r anything important.
for a good time try and get a chinese models to say something about tibet, or taiwan… its like having your own virtual tankie tamagochi!
inference providers could be anyone from anywhere, there are even proxy resellers. some are harvesting and reselling your data.
if you send your code to claude/openai/google there is certainly a much higher degree of confidence in who you are sending your data to. yes they to harvest your data and can send you malicious commands (esp if you have a promp injection attack).
its like buying a cheap vps, if the stakes are low its fine, if it important then you need to consider about the consequences of your actions.
The most famous is Deepseek. It’s not even made by “AI” company, it was a side hustle from stock trading company. They released it for free just to flex.
I hear people use minimax as replacement for sonnet and deepseek as replacement for opus, both can be used directly in Claude code instead of Anthropic models
People keep talking about Chinese models, where are they? How do I used them instead of Claude? Are they safe?
Liu Wen tends to be in China
ollama or llama.cpp to self host if you have a good mac or good video card. this is perfectly safe.
there are a bazillion hosted inference providers to choose from https://huggingface.co/docs/inference-providers/en/index be aware that you are sending your code to fuck knows who and they are sending back fuck knows what. ymmv, yolo.
hook one of them up to opencode.ai or pi.dev or one of the bazillion other ‘harneses’ or whatever we are calling it this week and try not to rm -r anything important.
for a good time try and get a chinese models to say something about tibet, or taiwan… its like having your own virtual tankie tamagochi!
So literally the same as Western-made AI?
inference providers could be anyone from anywhere, there are even proxy resellers. some are harvesting and reselling your data.
if you send your code to claude/openai/google there is certainly a much higher degree of confidence in who you are sending your data to. yes they to harvest your data and can send you malicious commands (esp if you have a promp injection attack).
its like buying a cheap vps, if the stakes are low its fine, if it important then you need to consider about the consequences of your actions.
nb: i am no expert, just fucking around.
The most famous is Deepseek. It’s not even made by “AI” company, it was a side hustle from stock trading company. They released it for free just to flex.
Check Ollama dot com
I hear people use minimax as replacement for sonnet and deepseek as replacement for opus, both can be used directly in Claude code instead of Anthropic models