Context Management: How to teach AI to understand your organization

The context problem

Your employee opens Copilot and types: “Write a proposal for working from home.” The result? A generic document about remote work, with references to legislation that doesn’t apply. Unusable.

This is the context problem. AI tools are trained on billions of texts from the internet, but they know nothing about your organization. They don’t know your clients, your internal processes, your brand guidelines, or your employment agreements. Every time an employee opens a new chat, AI starts with a blank slate.

The difference between a new hire and an experienced colleague? The experienced colleague knows the context. You can make that same leap with AI, if you give it the right information.

This is the third and perhaps most underestimated AI skill: context management. The ability to consistently provide AI with the information it needs to deliver output that fits your specific situation.

What is a context document?

A context document is a file containing background information that you provide to AI. It’s not a prompt; it’s the knowledge behind the prompt.

Think of it as the difference between a briefing and an assignment. The assignment is: “Write a client email.” The briefing is everything the writer needs to write that email well: who’s the client, what’s the relationship, what tone do we use, what’s been discussed before.

Types of context documents

Organization context: company profile (sector, size), brand guidelines and tone of voice, internal terminology and jargon.

Team context: team composition and roles, active projects, workflows and procedures.

Personal context: your role and responsibilities, recurring tasks, preferred communication style.

Task-specific context: client profiles, product information, policy documents, meeting notes and project documentation.

The AI workspace: three folders

In our courses, we teach employees to set up a structured AI workspace. The principle is simple: three folders that organize your AI work.

AI-workspace/
├── Prompt library/        -> Tested, reusable prompts per task type
├── Context documents/     -> Organization, team, and personal context
└── Projects/              -> Active work, sources, and AI output

Prompt library

This is where you store prompts you’ve tested and refined. Not one-off experiments, but reusable templates for recurring work. An employee who writes meeting notes weekly has one tested prompt that works every time, instead of improvising from scratch each week.

Context documents

This is the heart of context management. You create a limited number of documents (usually 3 to 5) that you repeatedly send along or link to your AI tool. Set them up once properly and save time every week.

Projects

This is where you store active work: sources you feed to AI, intermediate results, and final output. This prevents you from having to re-enter the same information every time.

The result: employees who work with an AI workspace spend less time repeating instructions and more time refining output.

Employees with an organized AI workspace save time consistently because they don’t need to repeat instructions.

From generic to organization-specific output

The difference that context makes is dramatic. Here’s a real-world example:

Without context

Prompt: “Write a proposal for hybrid work at our healthcare institution.”

Result:

  • Generic American document about “remote work”
  • Standard office terminology, not relevant for healthcare
  • References to outdated or non-existent legislation
  • No consideration of 24/7 shifts or patient safety

With context

Prompt: “Write a proposal for hybrid work for our healthcare institution.”

Context document provided:

  • Organization: regional healthcare institution, 1,200 employees, 3 locations
  • Employment terms: Healthcare collective agreement with specific provisions on working hours
  • Situation: 24/7 shifts, patient safety is the priority
  • Audience: works council and executive board
  • Perspective: HR advisor

Result:

  • Specific to the Dutch healthcare sector
  • Correct reference to healthcare agreement conditions
  • Continuity of care as a guiding principle
  • Practical implementation plan per location
  • Written in language appropriate for the works council and executive board

Same model, same question, fundamentally different result. The only difference is the context.

Reusable templates: the prompt + context formula

The real power of context management lies in reusability. Instead of typing all the information from scratch every time, you combine a fixed prompt with a context document.

The formula

Starting prompt (TASK + ROLE + FORMAT) + Context document = Organization-specific output

Example: weekly client update

Starting prompt (saved in prompt library):

TASK: Write a concise client update for the account manager. ROLE: You are an experienced communications advisor in professional services. FORMAT: Max 200 words. Structure: progress (3 bullets), attention points (2 bullets), next step (1 sentence).

Context document (saved in context documents):

Client: [Company name], sector: financial, contact person: [Name] (head of operations). Relationship: existing client since 2023. Tone: professional but personal, use first name. Active project: [Project name], phase: implementation, deadline: Q2 2026. Note: client values transparency about risks.

Input (changes each week):

Last week: [paste relevant notes or action items here]

The starting prompt and context document stay the same. Only the input changes. Result: consistent, high-quality output in a fraction of the time.

Want to dive deeper into prompt structure? Read more about the four building blocks in our article on effective prompting.

Why context management makes AI adoption scalable

The first two AI skills (understanding AI and effective prompting) are individual skills. Context management is the skill that makes AI adoption scalable across an organization.

From individual to team

When one employee creates a good context document, the entire team can benefit. A brand guidelines document that everyone includes. A client profile the whole account team uses. Process descriptions that new employees can immediately feed to AI. Read how to scale this into a full AI knowledge base.

From one-off to systematic

Without an AI workspace, every use of AI is an isolated experiment. With a workspace, AI becomes a consistent part of how people work. Employees don’t have to reinvent the wheel every time.

The ROI argument

The biggest time savings don’t come from generating answers (AI does that in seconds). They come from not having to rewrite unusable output. Employees with good context spend less time correcting generic results and more time on work that actually matters.

Organizations with a structured AI approach consistently report spending less time rewriting unusable output.

Organizations that take context management seriously see a shift: from “AI doesn’t work for us” to “AI understands how we work.”

Observable behavior per level

How do you recognize whether employees have mastered context management? The table below describes concrete behavior at each level:

StarterBasicProficient
Context usageProvides minimal or no context to AISends relevant context documents for complex tasksManages project-wide context, keeps documents up to date
AI workspaceSaves output sporadically, no fixed structureHas a working folder structure (3 folders) on their own systemMaintains a shared AI workspace for the team
ReusabilityStarts every AI interaction from scratchHas at least 1 reusable context document, combines it with fixed promptsBuilds and maintains templates that colleagues can use
EfficiencySpends significant time correcting generic outputGets usable output on the first try through good contextExperiences noticeable time savings, can quantify this

How to measure this:

  • Starter: intake assessment, employee describes how they currently use AI
  • Basic: after the Copilot Fundamentals course (portfolio assignment: working AI workspace with at least 1 context document)
  • Proficient: after the AI Workflow Training and certification

Next step: the complete framework

You’ve now explored the three AI skills: understanding AI, effective prompting, and context management. Together, they form the framework for teaching your employees to work with AI in a structured, sustainable way.

Go back to the overview for the complete picture: The 3 AI skills your organization needs

context managementAI workspacecontext documentsAI skillsHR
Casimir Morreau
Written by Casimir Morreau

Co-founder & Lead Trainer

20+ years of experience, incl. Professor of Digital at HvA, Leadership training.

LinkedIn