Does this require an Oriveo server proxy?
No. Native apps connect directly. The web app uses browser Local Network Access and CORS and does not proxy a private address through Oriveo servers.
llama.cpp on iPhone: a direct local compute client
Connect iPhone to llama.cpp running on your own computer. Configure the listener, firewall, private network, and Oriveo without exposing the engine to the public internet.
- Use the compute you already own from another device, with no API credential on local HTTP.
- Oriveo is a client: llama.cpp must run on a computer. It does not run the model on your phone.
- Never expose an unauthenticated engine to the public internet. Use local Wi-Fi or a supported private VPN such as Tailscale; public and mixed DNS targets are rejected.
Prepare llama.cpp
Start the engine on a private interface, confirm the port locally, then allow that port only on your LAN or private VPN.
- llama-server --host 0.0.0.0 --port 8080 --model /path/model.gguf
- --chat-template /path/template.jinja
- GET http://127.0.0.1:8080/health
Connect from iPhone
Choose Local compute in Providers, select the matching engine, enter the private address, and verify the discovered model before saving.
Keep the endpoint private
Never expose an unauthenticated engine to the public internet. Use local Wi-Fi or a supported private VPN such as Tailscale; public and mixed DNS targets are rejected.
Common app questions
Does the model run on the phone?
No. The model runs on your computer or server; the phone is the client.
Keep the endpoint private?
llama-server --host 0.0.0.0 --port 8080 --model /path/model.gguf · --chat-template /path/template.jinja · GET http://127.0.0.1:8080/health
Connect your own compute
Get the native Oriveo app or desktop download and connect the engine on your private network.
No API key yet? Oriveo Free lets you start without one.
Guides
Ollama · Android
Ollama on Android: a direct local compute client
Connect Android to Ollama running on your own computer. Configure the listener, firewall, private network, and Oriveo without exposing the engine to the public internet.
Local LLM · away from homeLocal LLM on away from home: a direct local compute client
Connect away from home to Local LLM running on your own computer. Configure the listener, firewall, private network, and Oriveo without exposing the engine to the public internet.
Open WebUI · mobileOpen WebUI on mobile: a direct local compute client
Connect mobile to Open WebUI running on your own computer. Configure the listener, firewall, private network, and Oriveo without exposing the engine to the public internet.