Back to Speaking

ConFoo 2027· February 24, 2027 · Montreal, Canada

Context Engineering for Java Developers

A live-coding session on building the context around the prompt with Spring AI: instructions, memory, retrieval, tools, and structured output.

Prompt engineering was only the beginning. Reliable AI applications depend on the context around the prompt: system instructions, memory, retrieved knowledge, tools, and structured output.

In this live-coding session, we'll use Spring AI to build that context deliberately. We'll load the right information at the right time and avoid overwhelming the model. You'll leave with a practical mental model for building AI applications Java can trust.

What You'll Learn

  • Why the context around the prompt, not the prompt itself, decides whether an AI feature is reliable
  • System instructions that set the rules for every request
  • Chat memory, and how much of it the model actually needs
  • Retrieval augmented generation (RAG) that loads the right knowledge at the right time
  • Tools that let the model call your Java code
  • Structured output that turns responses into Java records
  • How to keep the context window focused instead of stuffed