ASign in
← All skills

Operations

LLMOps observability & SLOs

Trace, monitor and deploy AI systems safely against cost and latency SLOs.

Target proficiency: Applied

Course outcomes

  • AIN 401 CO4

    Evaluate AI systems with golden sets, calibrated LLM-as-judge, cost/latency metrics and CI regression gates, and justify engineering decisions with evidence.

  • AIN 401 CO6

    Collaborate in a team to ship, operate and present an AI-native product with runbook, AI-use log and individual oral defence.

  • MST 501 CO5

    Demonstrate Evaluation, Observability & Security competence: complete the Day 61–75 builds, explain the underlying theory, and defend the phase artefact under live questioning.

  • MST 502 CO4

    Demonstrate Evaluation & Observability competence: complete the Day 46–60 builds, explain the underlying theory, and defend the phase artefact under live questioning.

  • MST 505 CO5

    Demonstrate Evaluation, Caching, Multimodal & Observability competence: complete the Day 61–75 builds, explain the underlying theory, and defend the phase artefact under live questioning.

  • MST 506 CO4

    Demonstrate Evaluation, Observability & Retrieval Quality competence: complete the Day 46–60 builds, explain the underlying theory, and defend the phase artefact under live questioning.

  • MST 507 CO4

    Demonstrate Evaluation, Observability & the Verifier competence: complete the Day 46–60 builds, explain the underlying theory, and defend the phase artefact under live questioning.

  • MST 508 CO4

    Demonstrate Evaluation & Observability competence: complete the Day 46–60 builds, explain the underlying theory, and defend the phase artefact under live questioning.

Taught in weeks & phases

Textbook chapters