Packt

Advanced Techniques and Interpretability in LLMs

Packt

Advanced Techniques and Interpretability in LLMs

Included with Coursera PlusLearn more

Ask Coursera

Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

9 hours to complete
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

9 hours to complete
Flexible schedule
Learn at your own pace

What you'll learn

  • Understand and compare major transformer models like BERT, GPT, and ViT

  • Fine-tune and pretrain large language models for specific tasks

  • Implement retrieval augmented generation to improve model reliability

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

July 2026

Assessments

9 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Transformers for NLP and Computer Vision Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 9 modules in this course

This module introduces the architecture and real-world applications of GPT models, highlighting their transformative impact on society and software development. Learners will explore key concepts such as context size, decoder layers, and the use of GPT-4 as an assistant, including hands-on experience with the GPT-4 API and Retrieval Augmented Generation (RAG). By the end, participants will understand how generative AI is revolutionizing productivity and innovation across domains.

What's included

1 video8 readings

This module guides learners through the process of fine-tuning OpenAI GPT models, including preparing datasets in JSONL format and executing completion tasks with custom models. Learners will gain practical skills to enhance model accuracy for specific applications.

What's included

1 video1 reading1 assignment

This module introduces a range of interpretability tools for transformer models, including BertViz, SHAP, LIME, LIT, and OpenAI's GPT-4 explainer. Learners will gain hands-on experience visualizing attention mechanisms, interpreting model outputs, and understanding the internal workings of large language models. By the end, you'll be equipped to make sense of complex AI systems and enhance their transparency.

What's included

1 video6 readings1 assignment

This module delves into the critical role of tokenizers in transformer-based language models, examining various tokenization techniques such as subword, regular expression, and SentencePiece. Learners will explore how tokenization quality impacts model performance and discover strategies for handling out-of-vocabulary words and token-ID mapping.

What's included

1 video6 readings1 assignment

This module introduces the use of large language model (LLM) embeddings as a practical alternative to fine-tuning for tasks such as retrieval-augmented generation (RAG) and question-answering. Learners will gain hands-on experience with embedding-based search, clustering techniques using Ada embeddings, and evaluating model responses without a dedicated knowledge base. The module emphasizes practical implementation and analysis of embedding-driven workflows.

What's included

1 video4 readings1 assignment

This module introduces syntax-free approaches to semantic role labeling (SRL) using advanced transformer models like ChatGPT and GPT-4. Learners will explore how these models handle complex sentence structures without relying on traditional syntactic analysis, and examine the challenges and strategies for standardizing input formats in NLP tasks.

What's included

1 video4 readings1 assignment

This module guides learners through the architectures and practical applications of T5 and ChatGPT for text summarization, with a focus on legal and financial domains. You will compare model configurations, implement summarization functions, and evaluate the strengths of each approach for different project needs.

What's included

1 video5 readings1 assignment

This module introduces learners to the architecture and applications of Google's PaLM 2 and Vertex AI, highlighting their roles in modern natural language processing tasks. Learners will explore advanced activation functions, interface navigation, and practical use cases such as sentiment analysis and code generation. By the end, participants will gain hands-on experience leveraging these tools for real-world AI solutions.

What's included

1 video8 readings1 assignment

This module examines the risks associated with large language models, including ethical concerns, memorization, influence operations, harmful content, and cybersecurity vulnerabilities. Learners will explore practical tools and strategies for risk mitigation, such as RAG, RLHF, and advanced tracking systems. By the end, participants will understand how to responsibly deploy and monitor LLMs in real-world scenarios.

What's included

1 video9 readings2 assignments

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Packt - Course Instructors
Packt
2,082 Courses614,592 learners

Offered by

Packt

Explore more from Software Development

Why people choose Coursera for their career

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Frequently asked questions