The Third Umpire · Lesson 4 — How Many ← Course

How many? — few-shot means few.

More examples help — but only up to a point, and every one costs you.

Examples steer the answer, so the greedy next thought is obvious: if two help, surely twenty help ten times as much? Almost never. The gains fade fast.

The first example does the heavy lifting — it shows the model the pattern. The second and third sharpen it. After that, each extra example barely moves the answer: the model already has the idea.

Yet every example is more text in the prompt — more tokens (Lesson 2), which cost money and eat into the window. Past a handful you are paying steadily more for steadily less.

The practical rule is to use the fewest examples that lock the pattern — usually two or three. “Few-shot” really does mean few.

Drag the number of examples up. Watch reliability shoot up, then flatten — while the token bill keeps climbing in a straight line.

Drag the number of examples up. Watch reliability climb — then flatten.
examples shown — n
n0
→ reliability · how often it gets the call & format right
reliable25%
→ prompt size · tokens spent
tokens120 tok
Illustrative numbers — the shape is real, the percentages are not.

Same call, more examples.

Nothing changes in the code but the count. The reliability it buys saturates; the token cost does not.


      

Few, not many.

A couple of examples buys most of the reliability you are ever going to get. Beyond that the curve flattens, but the token cost keeps rising in a straight line — so you pay more and more for almost nothing.

Use the fewest examples that lock the pattern — usually two or three. If that is not enough, the answer is better examples, not more of them (next page).

Next: the right calls →
Go deeper — why more stops helping optional

Why the gains fade

Once the model has seen the pattern a couple of times, more repetitions are largely redundant — it already knows the shape it should copy. Examples inform the model; they do not stack up linearly the way adding data to a spreadsheet would.

Cost is a straight line

Reliability saturates, but tokens grow with every single example — a straight line up and to the right. That widening gap between flat gain and rising cost is exactly why more is rarely worth it, and it draws straight from Lesson 2's budget.

When a few more do help

Harder or more varied tasks — ones with several distinct sub-cases — may need a couple more examples to cover the range. Narrow, highly structured tasks need fewer. The rule of thumb is a floor, not a law: start small and add only if the answers actually improve.

The ceiling

Few-shot has a ceiling no number of examples will pass. Getting above it needs a different tool, which the course reaches near the end — not a longer prompt.