Novus Stream Solutions

Category

AI in the browser

The technical and practical side of running AI on your own device: why on-device AI is private by design, what actually runs locally vs in the cloud, how AI runs in your browser with WebGPU and WebAssembly, the privacy cost of free AI tools, and whether browser AI works offline.

13 articles

About the AI in the browser thread

On-device AI is the technical bet the whole portfolio rests on, and this cluster is where the bet gets examined honestly. Running a model in a browser tab means the user's data never moves, which resolves the privacy problem structurally instead of by promise, but it also means running inside a memory budget, on whatever GPU is present, over a model you had to download first.

The articles cover both sides: how WebGPU and WebAssembly make local inference viable, what genuinely runs locally versus what still needs a server, what free cloud AI tools actually cost you in data, and whether any of it works offline. The recurring conclusion is that "private by design" is an architecture claim you can verify by watching the network tab, not a policy claim you have to trust.

What this topic covers

  • Why on-device inference is private by design, and how to verify the claim yourself
  • WebGPU and WebAssembly: what makes browser inference fast enough to use
  • What runs locally today vs what still requires a server, as of 2026
  • The privacy cost of free cloud AI tools, stated plainly
  • Offline behaviour, model downloads, caching, and first-run cost

Who it's for

Developers evaluating client-side ML, privacy-conscious users deciding what to trust, and anyone trying to separate on-device marketing from on-device reality.

13 articles in this thread, newest first. Every one is free to read with no signup.

  1. Do browser AI tools work offline?

    AI in the browser · Jun 7, 2026

    Do browser AI tools work offline?

    How on-device AI tools keep working without a connection, and what still needs the network.

    NSS Background Remover

  2. A bar chart comparing in-browser AI model download sizes across Fast, Balanced, Best and frontier tiers

    AI in the browser · Jun 6, 2026

    How big are in-browser AI models (and why size matters)

    Why an on-device model is tens to hundreds of megabytes, and why that download is worth it.

    NSS Background Remover

  3. A user-hosted ONNX model URL loading into the browser and running with WebGPU and a WASM fallback

    AI in the browser · May 30, 2026

    Bring your own ONNX model: running your own weights in the browser

    The logical end state of on-device AI: if the computation happens on your machine, the model does not have to be ours. How BYO-ONNX works and why it exists.

    NSS Background Remover

  4. Auditing browser AI tools: on-device processing versus quiet uploads to a server

    AI in the browser · May 27, 2026

    Is my data safe with browser AI tools? A plain-English audit

    A practical, non-technical guide to whether your data is safe with browser-based AI tools: the upload-versus-on-device distinction, what each model protects, and a checklist for auditing any tool.

    NSS Background Remover

Browse every topic in the resource hub