The Startup Ideas Podcast · September 8, 2026

Greg Isenberg on where local AI pays, and three startups he would build with it

Greg Isenberg says the question to ask of a local model is whether it is good enough for one job. Pick a job where private data, offline work or a repeated review loop make local the better product. Then sell that job to a niche stuck on bad software. He recorded this solo episode of The Startup Ideas Podcast in September 2026. Google sponsored it, he says so up front, and he uses Google's Gemma as his example while telling viewers to pick any model that fits.

Speaker
Greg Isenberg
Where
The Startup Ideas Podcast
Published
Length
39 min

Greg Isenberg: Founder of Late Checkout, distribution-first builder.

Recording: I'm Obsessed With Local AI. Here's Why

Key points

  1. 1

    Ask if local is good enough

    Isenberg sets aside the usual question of whether a small model beats the biggest cloud model. His test is whether it can do this job, and whether running it on the user's own machine makes the product better. He keeps cloud models for deep research and hard reasoning. He points local models at private files, customer data, offline field work, fast responses, voice input and internal tasks that repeat.

    “is this model good enough for the job and does running it locally make the product better”
    Greg Isenberg, The Startup Ideas Podcast, 02:56
  2. 2

    Local first pass, cloud escalation

    He expects most serious products to mix the two. His example is a tool for a professional services firm. A local model reads the sensitive drafts and strips out the private details. A cloud model sees only that clean version, when the customer wants deeper reasoning. A person approves anything important before it goes out.

    “You basically have local handling the private files as a first pass and then cloud handles the heavy thinking when you need it”
    Greg Isenberg, The Startup Ideas Podcast, 14:01
  3. 3

    The filter for a local AI business

    Before his three ideas, Isenberg gives his screen. He wants small, cash-flowing businesses that need no venture money and fix a painful workflow. He looks for five traits together: sensitive data, repeated review work, bad incumbent software, costly mistakes, and work that happens close to the device. All three ideas pass it.

    “I look for a customer with sensitive data, repeated review work, bad software usually, uh expensive mistakes”
    Greg Isenberg, The Startup Ideas Podcast, 26:49
  4. 4

    Home health QA: start as a service

    Idea one is a desktop reviewer for home health agencies. It checks visit notes, care plans and dictated notes against each other before billing or audit. It would flag, say, dizziness noted with no vital signs recorded. He would start it as a service for five small agencies, run the reviews with local AI and check each one by hand. The issues that keep coming back become the product.

    “I would write down the 20 issues that keep showing up and those issues become the checklist and then the checklist eventually becomes the product”
    Greg Isenberg, The Startup Ideas Podcast, 29:02
  5. 5

    Restoration reports: sell with old jobs

    Idea two is an offline phone app for water, fire and mold restoration crews. The technician walks the site taking photos and voice notes. The app drafts the report and flags gaps before they leave, such as a ceiling photo with no moisture reading. He would pick one niche, study the owners' templates and their early-2000s software, and open with a demo on their own past jobs.

    “send me three old jobs and I'll show you how fast your techs could create reports”
    Greg Isenberg, The Startup Ideas Podcast, 31:14
  6. 6

    Pre-send review sells itself

    Idea three checks outgoing drafts at professional services firms. He calls it schmuck insurance. It flags a wealth advisor's line that sounds like a promised return, or an accountant's number that does not match the attached file. He would start with email review for independent wealth advisors, interview 10 of them and turn their worries into a checklist. The firm already pays a person to check drafts, so the product speeds up an existing habit.

    “this is so sellable because the buyer understands this behavior, and they already asked someone to check the draft”
    Greg Isenberg, The Startup Ideas Podcast, 34:11

How it compares

How this recording lines up with what Greg said before and with other operators Gavel cites.

Builds on

Isenberg's framework on Gavel is distribution first: grow an audience to about a thousand people, ask them what they need, then build. None of these three plans starts with an audience. Each one sells by hand into a narrow niche. That page already lists this case as one where audience-first fails: a buyer you reach through sales, not content.

Greg Isenberg's Distribution as Moat

Agrees with

On Gavel's Paul Graham page, Graham and Isenberg sit on opposite sides: recruit users by hand, or build the audience first. For these niche ideas Isenberg lands on Graham's side, with five agencies, hand-checked reviews, three old jobs as the demo and 10 advisor interviews. The page itself says Graham wins when the product needs a human touch, and a compliance reviewer does.

Paul Graham's Do Things That Don't Scale

Agrees with

YC partners argue the best AI startup targets are an industry's boring, repeated admin tasks. Isenberg ends on the same hunting ground and tells founders to find one boring workflow. He adds a test YC's version lacks: the work must also get better when the model runs close to the data, the device or the buyer.

YC partners on boring, repetitive tasks as AI startup targets

Builds on

A YC partners rule says that when open models match a general model on a task, fine-tune a smaller one. Isenberg calls fine-tuning an advanced move and puts a step before it. Run one folder through one model about 10 times, then compare the output with a top cloud model on the same inputs. That test tells you whether the YC condition holds for your job.

YC partners on fine-tuning smaller open models

Related

More talks

All talks