llama.cpp · iPhone

llama.cpp on iPhone: a direct local compute client

Connect iPhone to llama.cpp running on your own computer. Configure the listener, firewall, private network, and Oriveo without exposing the engine to the public internet.

Updated
  • Use the compute you already own from another device, with no API credential on local HTTP.
  • Oriveo is a client: llama.cpp must run on a computer. It does not run the model on your phone.
  • Never expose an unauthenticated engine to the public internet. Use local Wi-Fi or a supported private VPN such as Tailscale; public and mixed DNS targets are rejected.
Oriveo on iPhone: the providers screen, listing the providers you connected and this month’s spend.

Prepare llama.cpp

Start the engine on a private interface, confirm the port locally, then allow that port only on your LAN or private VPN.

  • llama-server --host 0.0.0.0 --port 8080 --model /path/model.gguf
  • --chat-template /path/template.jinja
  • GET http://127.0.0.1:8080/health

Connect from iPhone

Choose Local compute in Providers, select the matching engine, enter the private address, and verify the discovered model before saving.

Keep the endpoint private

Never expose an unauthenticated engine to the public internet. Use local Wi-Fi or a supported private VPN such as Tailscale; public and mixed DNS targets are rejected.

Common app questions

Does this require an Oriveo server proxy?
No. Native apps connect directly. The web app uses browser Local Network Access and CORS and does not proxy a private address through Oriveo servers.
Does the model run on the phone?
No. The model runs on your computer or server; the phone is the client.
Which commands and ports are involved?
llama-server --host 0.0.0.0 --port 8080 --model /path/model.gguf · --chat-template /path/template.jinja · GET http://127.0.0.1:8080/health

Related reads

Ollama on Android: a direct local compute clientYour local LLM away from home: a private Tailscale clientOpen WebUI on mobile: a direct local compute client

From the blog

What Is BYOK? Bring-Your-Own-Key AI Apps ExplainedUsing OpenRouter Free Models in a Chat AppUse Your Claude API Key in an App, No Code

Connect your own compute

Get the native Oriveo app on iOS or Android, or open Oriveo in your browser, then connect the engine on your private network.

Open the appGet Oriveo

No API key yet? Oriveo Free lets you start without one.