The Improviser · Lesson 4 — How Many ← Course

How many? — few-shot means few.

More example phrases help — but the payoff fades fast, and every one costs you.

You have seen that example phrases steer the answer, so ask the obvious next question: if two help, do twenty help ten times as much? Almost never.

The first phrase does the heavy lifting — it shows the player the shape. The second and third sharpen it. After that, each extra phrase barely moves the answer: the player has already caught on.

Meanwhile every phrase is more text in the prompt — more tokens (Lesson 2) — and you re-send all of them on every single call, since the model keeps nothing between turns. So past a handful you pay more and more for less and less.

The practical rule is to show the fewest phrases that lock the shape — usually two or three. Few-shot really does mean few.

Drag the number of example phrases up. Watch reliability shoot up, then flatten — while the token bill keeps climbing in a straight line.

Drag the number of example phrases up. Watch reliability climb — then flatten.
example phrases shown — n
n0
→ reliability · how often it nails the shape
reliable25%
→ prompt size · tokens spent
tokens90 tok

Same ask, more phrases.

Nothing changes in the code but the count. The reliability it buys saturates; the token cost does not.


      

Few, not many.

A couple of example phrases buys most of the reliability you are ever going to get. Beyond that the curve flattens while the token cost keeps rising in a straight line — a widening gap between what you spend and what you gain.

Show the fewest phrases that lock the shape — usually two or three. If that is not enough, the answer is better phrases, not more of them (next page).

Quick check · your ear
Three example phrases already lock the bluesy shape. You stack in five more. What mostly happens?
Next: the right phrases →
Go deeper — why more stops helping optional

Why the gains fade

Once the player has seen the shape a couple of times, more repetitions are largely redundant — it already knows the phrase it should copy. Example phrases inform the player; they do not stack up linearly the way adding rows to a spreadsheet would.

Cost is a straight line

Reliability saturates, but tokens grow with every single phrase — a straight line up and to the right. That widening gap between flat gain and rising cost is exactly why more is rarely worth it, and it draws straight from Lesson 2's budget.

When a few more do help

Harder or more varied tunes — ones with several distinct sub-cases — may need a couple more phrases to cover the range. Narrow, tightly structured jobs need fewer. The rule of thumb is a floor, not a law: start small and add only if the phrasing actually improves.

The ceiling

Few-shot has a ceiling: a level of reliability it will not pass no matter how many phrases you stack in. Getting above it needs a different tool, which the course reaches near the end — not a longer prompt.