Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Overview of LLM Architecture and Attack Surface
- How LLMs are constructed, deployed, and accessed via APIs
- Key components within LLM application stacks (e.g., prompts, agents, memory, APIs)
- Identification of where and how security issues manifest in real-world scenarios
Prompt Injection and Jailbreak Attacks
- The nature of prompt injection and why it poses a significant threat
- Direct and indirect prompt injection scenarios
- Jailbreaking techniques used to circumvent safety filters
- Strategies for detection and mitigation
Data Leakage and Privacy Risks
- Preventing accidental data exposure through model responses
- Addressing PII leaks and the misuse of model memory
- Designing privacy-conscious prompts and retrieval-augmented generation (RAG) systems
LLM Output Filtering and Guarding
- Utilising Guardrails AI for content filtering and validation
- Defining output schemas and constraints
- Monitoring and logging unsafe outputs
Human-in-the-Loop and Workflow Approaches
- Determining when and where to introduce human oversight
- Implementing approval queues, scoring thresholds, and fallback handling
- Calibrating trust and understanding the role of explainability
Secure LLM App Design Patterns
- Enforcing least privilege and sandboxing for API calls and agents
- Implementing rate limiting, throttling, and abuse detection
- Creating robust chaining with LangChain and prompt isolation
Compliance, Logging, and Governance
- Ensuring the auditability of LLM outputs
- Maintaining traceability and prompt/version control
- Aligning systems with internal security policies and regulatory requirements
Summary and Next Steps
Requirements
- A solid understanding of large language models and prompt-based interfaces
- Experience in developing LLM applications using Python
- Familiarity with API integrations and cloud-based deployments
Target Audience
- AI developers
- Application and solution architects
- Technical product managers working with LLM tools
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customised Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from £3200 + VAT*
Contact us for an exact quote and to hear our latest promotions