What context engineering actually means

Prompting is what you ask. Context engineering is what you put in the room before you ask it. The second is where most of the quality lives.

intermediate9 minChecked 2026-09-06

What you will be able to do

Assemble the right context for a task and recognise when more context is making things worse.

Before you start

  • Familiarity with the context window concept.

The shift

Early practice treated the prompt as the whole lever. As context windows grew and tools arrived, the more consequential question became what information the model has when it answers — source documents, prior decisions, examples, constraints, tool access.

The best-phrased request cannot beat the absence of the document that contains the answer.

More is not better

Padding the window with everything vaguely related dilutes the signal, raises cost and can push the important instruction out of the model's effective attention. Curation beats volume.

Ask of each item: does this change the answer? If not, it is noise with a price attached.

A hierarchy worth keeping

Instructions first — the task and its constraints. Then authoritative sources, clearly labelled as such. Then examples of the output you want. Then supporting material. Then, if it must be there, background.

Label the tiers. Telling the model which source wins when two disagree prevents a class of confident nonsense.

What good looks like

  • You can say why each item is in the context.
  • Sources are labelled and ranked.
  • You removed something and the output stayed as good.

What it cannot do

  • Effective attention across a very long window is uneven; the stated maximum is not a promise.
  • Relevance judgement remains yours.

When it goes wrong

Long context, worse answers.
Cut to the material that changes the answer. Put the instruction last.
It followed the wrong source.
You did not rank them. State which is authoritative.

Privacy and data handling

Context assembly is where sensitive data enters. Build the redaction step into the routine rather than remembering it.

Sources2 referenced
  1. Claude developer documentation

    Anthropic · official product documentation · link checked 2026-09-06

  2. OpenAI platform documentation

    OpenAI · official product documentation · link checked 2026-09-06

Links are checked at build time. If one has moved, tell us.

Written by
BLACK LDN
Last checked
2026-09-06
Content state
editorial

Product behaviour changes. If something here no longer matches the documentation, send a correction.

Read next

Next: Working with files, project instructions and memory