Get in Touch
 Duration 14 hours

Course Outline

Overview of LLM Architecture and Attack Surface

  • How LLMs are constructed, deployed, and accessed via APIs
  • Key components within LLM application stacks (e.g., prompts, agents, memory, APIs)
  • Identification of where and how security issues manifest in real-world scenarios

Prompt Injection and Jailbreak Attacks

  • The nature of prompt injection and why it poses a significant threat
  • Direct and indirect prompt injection scenarios
  • Jailbreaking techniques used to circumvent safety filters
  • Strategies for detection and mitigation

Data Leakage and Privacy Risks

  • Preventing accidental data exposure through model responses
  • Addressing PII leaks and the misuse of model memory
  • Designing privacy-conscious prompts and retrieval-augmented generation (RAG) systems

LLM Output Filtering and Guarding

  • Utilising Guardrails AI for content filtering and validation
  • Defining output schemas and constraints
  • Monitoring and logging unsafe outputs

Human-in-the-Loop and Workflow Approaches

  • Determining when and where to introduce human oversight
  • Implementing approval queues, scoring thresholds, and fallback handling
  • Calibrating trust and understanding the role of explainability

Secure LLM App Design Patterns

  • Enforcing least privilege and sandboxing for API calls and agents
  • Implementing rate limiting, throttling, and abuse detection
  • Creating robust chaining with LangChain and prompt isolation

Compliance, Logging, and Governance

  • Ensuring the auditability of LLM outputs
  • Maintaining traceability and prompt/version control
  • Aligning systems with internal security policies and regulatory requirements

Summary and Next Steps

Requirements

  • A solid understanding of large language models and prompt-based interfaces
  • Experience in developing LLM applications using Python
  • Familiarity with API integrations and cloud-based deployments

Target Audience

  • AI developers
  • Application and solution architects
  • Technical product managers working with LLM tools

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customised Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from £3200 + VAT*

Contact us for an exact quote and to hear our latest promotions

Provisional Upcoming Courses (Contact Us For More Information)

Related Categories