Generative AI Foundations on AWS is a brand new technical deep dive course that provides you the conceptual fundamentals, sensible recommendation, and hands-on steering to pre-train, fine-tune, and deploy state-of-the-art basis fashions on AWS and past. Developed by AWS generative AI worldwide foundations lead Emily Webber, this free hands-on course and the supporting GitHub supply code launched by way of AWS Youtube. In case you are on the lookout for a curated playlist of the highest sources, ideas, and steering to rise up to hurry on basis fashions, and particularly people who unlock generative capabilities in your information science and machine studying tasks, then look no additional.
Throughout this 8-hour deep dive, you may be launched to the important thing methods, companies, and traits that can aid you perceive basis fashions from the bottom up. This implies breaking down concept, arithmetic, and summary ideas mixed with hands-on workout routines to realize useful instinct for sensible software. All through the course, we give attention to a large spectrum of progressively complicated generative AI methods, supplying you with a robust base to know, design, and apply your individual fashions for one of the best efficiency. We’ll begin with recapping basis fashions, understanding the place they arrive from, how they work, how they relate to generative AI, and what you’ll be able to to do customise them. You’ll then find out about selecting the correct basis mannequin to fit your use case.
When you’ve developed a robust contextual understanding of basis fashions and methods to use them, you’ll be launched to the core topic of this course: pre-training new basis fashions. You’ll be taught why you’d need to do that in addition to how and the place it’s aggressive. You’ll even discover ways to use the scaling legal guidelines to choose the best mannequin, dataset, and compute sizes. We’ll cowl getting ready coaching datasets at scale on AWS, together with selecting the correct cases and storage methods. We’ll cowl fine-tuning your basis fashions, evaluating current methods, and understanding methods to run these together with your scripts and fashions. We’ll dive into reinforcement studying with human suggestions, exploring methods to use it skillfully and at scale to actually maximize your basis mannequin efficiency.
Lastly, you’ll discover ways to apply concept to manufacturing by deploying your new basis mannequin on Amazon SageMaker, together with throughout a number of GPUs and utilizing high design patterns like retrieval augmented technology and chained dialogue. As an added bonus, we’ll stroll you thru a Steady Diffusion deep dive, immediate engineering greatest practices, standing up LangChain, and extra.
Extra of a reader than a video shopper? You possibly can take a look at my 15-chapter e book “Pretrain Imaginative and prescient and Giant Language Fashions in Python: Finish-to-end methods for constructing and deploying basis fashions on AWS,” which launched Could 31, 2023, with Packt publishing and is on the market now on Amazon. Need to soar proper into the code? I’m with you—each video begins with a 45-minute overview of the important thing ideas and visuals. Then I’ll provide you with a 15-minute walkthrough of the hands-on portion. The entire instance notebooks and supporting code will ship in a public repository, which you should utilize to step by way of by yourself. Be at liberty to succeed in out to me on Medium, LinkedIn, GitHub, or by way of your AWS groups. Study extra about generative AI on AWS.
Blissful trails!
Course define
1. Introduction to Basis Fashions
|
2. Choosing the right basis mannequin
|
3. Utilizing pretrained basis fashions: immediate engineering and fine-tuning
|
4. Pretraining a brand new basis mannequin
|
5. Getting ready information and coaching at scale
|
6. Reinforcement studying with human suggestions
|
7. Deploying a basis mannequin
|
Abstract
Generative AI Foundations on AWS is considered one of seven new free and low-cost AWS programs out there that can assist you use generative AI for individuals of all roles and expertise ranges. Whether or not you’re a enterprise chief curious about how generative AI can remodel your enterprise or a developer looking for to make use of generative AI to spice up your productiveness, now we have coaching to assist construct your information and sensible abilities with Amazon’s generative AI companies. Discover the best coaching on your talent stage and use case on this weblog publish: 7 free and low-cost AWS courses that can help you use generative AI.
In regards to the creator
Emily Webber joined AWS simply after SageMaker launched, and has been attempting to inform the world about it ever since! Exterior of constructing new ML experiences for purchasers, Emily enjoys meditating and finding out Tibetan Buddhism.
