Course Outline
Foundational Architecture for AI Systems
- Layers, boundaries, and separation of concerns
- Applying ports and adapters to AI components
- Quality attribute scenarios specific to AI features
- Using architecture decision records as a governance tool
Evolution of Existing Applications
- Incremental modernisation rather than complete rewrites
- Integrating AI services alongside existing monoliths
- Utilising Strangler and anti-corruption layer patterns
- Creating integration points for current APIs and data
Architectural Patterns for LLM Integration
- Model gateways as abstraction boundaries
- Synchronous, asynchronous, and streaming integration methods
- Strategies for fallback, degradation, and provider failover
- Managing prompts and model configurations as version-controlled assets
Contracts, APIs, and Data Exchange
- Structured output schemas and validation processes
- Ensuring idempotency, retries, and rate limiting
- Defining latency budgets and timeout orchestration
- Treating cost per request as an architectural constraint
End-to-End RAG Architecture
- Ingestion, chunking, and embedding pipelines
- Stages of indexing, retrieval, reranking, and generation
- Positioning retrieval relative to application services
- Trade-offs and potential failure modes at each stage
Vector Databases and Retrieval Design
- Managed versus self-hosted vector stores
- Dense, sparse, and hybrid search techniques
- Metadata filtering and tenant isolation strategies
- Re-embedding strategies when underlying models change
Retrieval Quality, Grounding, and Evaluation
- Building evaluation sets from real-world queries
- Metrics for retrieval and answer quality
- Citation, grounding, and containing hallucinations
- Implementing feedback loops into the index
Agent Architectures
- The agent loop and tool invocation mechanics
- Deterministic workflows versus autonomous planners
- Identifying scenarios where an agent is unsuitable
- Defining agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Supervisor and orchestrator topologies
- Handoff protocols and message contracts
- Managing shared memory and context
- Comparing frameworks based on architectural criteria
Service Communication and Tool Protocols
- Event-driven and queue-based coordination
- Exposing tools via standard protocols
- Sagas, compensation, and long-running transactions
- Observability across multiple service hops
AI Agents in the Development Workflow
- Integrating coding agents within the delivery pipeline
- Spec-driven development and review gates
- Test generation and automated quality checks
- Guardrails that maintain architectural integrity
Governance and Software Quality
- Design reviews for AI features
- Managing changes to models and prompts
- Regression evaluation as a pipeline stage
- Defining ownership, policy, and approval paths
Security, Privacy, and Data Governance
- Addressing prompt injection and defence in depth
- Managing secrets, access control, and least privilege
- Data residency, personal data, and retention policies
- Auditability and human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing across agent chains
- Token and cost telemetry
- Caching and latency optimisation
- Service levels and incident response for AI services
Capstone: Architecture for an AI-Driven Solution
- Context, component, and deployment views
- Designing retrieval and agent orchestration
- Security, governance, and cost planning
- Peer review, critique, and migration roadmap
Requirements
- Experience in designing and maintaining production-level software systems
- Practical knowledge of REST APIs and service integration
- Familiarity with relational databases and data modelling
- Basic exposure to LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers accountable for architecture decisions
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customised Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from £4800 + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny