From AI engineer to inference engineer.

“The great part of this course is the real case studies from multi-tenancy clustering, and how to scaling up the cluster with the good practice. It make me complete the view of how inference company work, which cover from cluster level to kernel engineering. If you are going build the multi-tenacy inference clustering, should take this course.”

“This course doesn't stop at explaining how LLM inference works, it puts you inside the actual machinery: vLLM engines, GPU slicing with HAMi, KV-cache disaggregation over Mooncake, gateways that admit, place, and queue real traffic under real GPU scarcity. Every project runs against a GPU you actually rent and break, not a simulated one, and the final build with a control plane that has to defend its own design decisions on live metrics , it mirrors what serving infrastructure looks like in production, not in a textbook. Quite Intensive course. Highly recommended, Thanks to Abi.”

“This course was very helpful in giving me a broad, end-to-end understanding of the LLM inference space and connecting the key concepts. I also really liked Abi Aryan’s teaching style. She makes time for questions and prioritizes student understanding over simply covering the material.”

“This course has been a great learning experience. It goes beyond theory and dives into the practical challenges of building and scaling LLM inference systems, from KV cache management and batching to concurrency, routing, and admission control. The hands-on labs and real-world examples helped me connect the concepts to actual production systems.”

“I would give this course 10 stars if I could !! Abi is an outstanding instructor. She knows the AI inference stack in depth, both at the level of how the pieces actually work and where the industry is heading. Throughout the cohort she went out of her way to make sure we understood the material. We built every part of the inference stack by hand in this course, so we came out understanding the mechanics, not just the APIs. It is very hands-on. If you work through the homeworks diligently, you will learn more than from any other course I have seen on this topic. The guest sessions with engineers from leading inference companies were a bonus. If you are an engineer in the AI space and want to build your own local or cloud inference stack, or start your own business, I highly recommend this course.”

“Fantastic course for deep-diving into LLM systems. Each week features a great mix of lectures and code demos, supported by detailed documentation. The final project is a highlight, covering the full inference lifecycle: load balancing, agentic systems, and observability with metrics/traces. Abi is a dedicated instructor who truly listens to student feedback. The 1:1 career guidance and system design sessions make this an incredible value for infrastructure-focused engineers.”

“I got some truly insightful suggestions on my career path during my 1:1 with Abi. It felt amazing to wake up the next morning with absolute clarity on what I need to tackle next. Thanks for such a wonderful session, Abi! I can't wait to read your Packt book”

“I have had few calls through Topmate and she is legit the best I have talked to so far!”

“The depth of knowledge and the path provided by her was really great. It was an insightful session where I learned the details about transitioning into the inference side of LLM's and the gaps in my resume which I need to fill. Thanks again for this.”