Buy new:
-10% $44.99
FREE delivery Saturday, July 27
Ships from: Amazon.com
Sold by: Amazon.com
$44.99 with 10 percent savings
List Price: $49.99

The List Price is the suggested retail price of a new product as provided by a manufacturer, supplier, or seller. Except for books, Amazon will display a List Price if the product was purchased by customers on Amazon or offered by other retailers at or above the List Price in at least the past 90 days. List prices may not necessarily reflect the product's prevailing market price.
Learn more
FREE pickup Saturday, July 27
Or fastest pickup Friday, July 26. Order within 5 hrs 23 mins

1.27 mi | ASHBURN 20147

How pickup works
Pick up from nearby pickup location
Step 1: Place Your Order
Select the “Pickup” option on the product page or during checkout.
Step 2: Receive Notification
Once your package is ready for pickup, you'll receive an email and app notification.
Step 3: Pick up
Bring your order ID or pickup code (if applicable) to your chosen pickup location to pick up your package.
In Stock
$$44.99 () Includes selected options. Includes initial monthly payment and selected options. Details
Price
Subtotal
$$44.99
Subtotal
Initial payment breakdown
Shipping cost, delivery date, and order total (including tax) shown at checkout.
Sold by
Amazon.com
Sold by
Amazon.com
Returns
Eligible for Return, Refund or Replacement within 30 days of receipt
Eligible for Return, Refund or Replacement within 30 days of receipt
This item can be returned in its original condition for a full refund or replacement within 30 days of receipt.
Returns
Eligible for Return, Refund or Replacement within 30 days of receipt
This item can be returned in its original condition for a full refund or replacement within 30 days of receipt.
Payment
Secure transaction
Your transaction is secure
We work hard to protect your security and privacy. Our payment security system encrypts your information during transmission. We don’t share your credit card details with third-party sellers, and we don’t sell your information to others. Learn more
Payment
Secure transaction
We work hard to protect your security and privacy. Our payment security system encrypts your information during transmission. We don’t share your credit card details with third-party sellers, and we don’t sell your information to others. Learn more
Kindle app logo image

Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.

Read instantly on your browser with Kindle for Web.

Using your mobile phone camera - scan the code below and download the Kindle app.

QR code to download the Kindle App

Follow the author

Something went wrong. Please try your request again later.

Pretrain Vision and Large Language Models in Python: End-to-end techniques for building and deploying foundation models on AWS


{"desktop_buybox_group_1":[{"displayPrice":"$44.99","priceAmount":44.99,"currencySymbol":"$","integerValue":"44","decimalSeparator":".","fractionalValue":"99","symbolPosition":"left","hasSpace":false,"showFractionalPartIfEmpty":true,"offerListingId":"jU%2BhMvjKJUtiWjmoQPXVt70y49HUsMr4%2BA92MxevYsLMHOw3qlZIK00bYtCKawTnCzJDBur65xz%2BuG8ZUJfeRMTBOEqYX6qo5X5fi1peKqXoQ46LXciIiLo9LL5kytuyFKPAp2XpHgUFHo69GjSeWg%3D%3D","locale":"en-US","buyingOptionType":"NEW","aapiBuyingOptionIndex":0}, {"displayPrice":"$38.75","priceAmount":38.75,"currencySymbol":"$","integerValue":"38","decimalSeparator":".","fractionalValue":"75","symbolPosition":"left","hasSpace":false,"showFractionalPartIfEmpty":true,"offerListingId":"jU%2BhMvjKJUtiWjmoQPXVt70y49HUsMr4HsY9H%2FFRp7%2BmC8mrpaaMnJ9vd%2BVXdVlurJdIJd1YsjG%2B8M3NH1X%2FiUVCa5%2FqyMCbUnXBK6NwMXqBqidCEaD5UmDIWDofYX86G0rQNd6tflNcoJHat%2BuFScoXcYHl%2BGpzHyoo%2FptkeOWA7IF%2B0C5VpUQhBjULtn0%2B","locale":"en-US","buyingOptionType":"USED","aapiBuyingOptionIndex":1}],"desktop_buybox_group_2":[{"displayPrice":"$44.99","priceAmount":44.99,"currencySymbol":"$","integerValue":"44","decimalSeparator":".","fractionalValue":"99","symbolPosition":"left","hasSpace":false,"showFractionalPartIfEmpty":true,"offerListingId":"jU%2BhMvjKJUtiWjmoQPXVt70y49HUsMr4%2BA92MxevYsLMHOw3qlZIK00bYtCKawTnCzJDBur65xz%2BuG8ZUJfeRMTBOEqYX6qo5X5fi1peKqXoQ46LXciIiLo9LL5kytuyFKPAp2XpHgUFHo69GjSeWg%3D%3D","locale":"en-US","buyingOptionType":"PICKUP","aapiBuyingOptionIndex":2}]}

Purchase options and add-ons

Master the art of training vision and large language models with conceptual fundaments and industry-expert guidance. Learn about AWS services and design patterns, with relevant coding examples


Key Features:

  • Learn to develop, train, tune, and apply foundation models with optimized end-to-end pipelines.
  • Explore large-scale distributed training for models and datasets with AWS and SageMaker examples.
  • Evaluate, deploy, and operationalize your custom models with bias detection and pipeline monitoring.


Book Description:

Foundation models have forever changed machine learning. From BERT to ChatGPT, CLIP to Stable Diffusion, when billions of parameters are combined with large datasets and hundreds to thousands of GPUs, the result is nothing short of record-breaking. The recommendations, advice, and code samples in this book will help you pretrain and fine-tune your own foundation models from scratch on AWS and Amazon SageMaker, while applying them to hundreds of use cases across your organization.


With advice from seasoned AWS and machine learning expert Emily Webber, this book helps you learn everything you need to go from project ideation to dataset preparation, training, evaluation, and deployment for large language, vision, and multimodal models. With step-by-step explanations of essential concepts and practical examples, you'll go from mastering the concept of pretraining to preparing your dataset and model, configuring your environment, training, fine-tuning, evaluating, deploying, and optimizing your foundation models.


You will learn how to apply the scaling laws to distributing your model and dataset over multiple GPUs, remove bias, achieve high throughput, and build deployment pipelines.


By the end of this book, you'll be well equipped to embark on your own project to pretrain and fine-tune the foundation models of the future.


What You Will Learn:

  • Find the right use cases and datasets for pretraining and fine-tuning
  • Prepare for large-scale training with custom accelerators and GPUs
  • Configure environments on AWS and SageMaker to maximize performance
  • Select hyperparameters based on your model and constraints
  • Distribute your model and dataset using many types of parallelism
  • Avoid pitfalls with job restarts, intermittent health checks, and more
  • Evaluate your model with quantitative and qualitative insights
  • Deploy your models with runtime improvements and monitoring pipelines


Who this book is for:

If you're a machine learning researcher or enthusiast who wants to start a foundation modelling project, this book is for you. Applied scientists, data scientists, machine learning engineers, solution architects, product managers, and students will all benefit from this book. Intermediate Python is a must, along with introductory concepts of cloud computing. A strong understanding of deep learning fundamentals is needed, while advanced topics will be explained. The content covers advanced machine learning and cloud techniques, explaining them in an actionable, easy-to-understand way.


Amazon First Reads | Editors' picks at exclusive prices

Frequently bought together

$44.99
Get it as soon as Saturday, Jul 27
In Stock
Ships from and sold by Amazon.com.
+
$53.99
Get it as soon as Saturday, Jul 27
In Stock
Ships from and sold by Amazon.com.
Total price:
To see our price, add these items to your cart.
Details
Added to Cart
Choose items to buy together.

Editorial Reviews

About the Author

Emily Webber is a Principal Machine Learning Specialist Solutions Architect at Amazon Web Services. She has assisted hundreds of customers on their journey to ML in the cloud, specializing in distributed training for large language and vision models. She mentors Machine Learning Solution Architects, authors countless feature designs for SageMaker and AWS, and guides the Amazon SageMaker product and engineering teams on best practices in regards around machine learning and customers. Emily is widely known in the AWS community for a 16-video YouTube series featuring SageMaker with 160,000 views, plus a Keynote at O’Reilly AI London 2019 on a novel reinforcement learning approach she developed for public policy.

Product details

  • Publisher ‏ : ‎ Packt Publishing (May 31, 2023)
  • Language ‏ : ‎ English
  • Paperback ‏ : ‎ 258 pages
  • ISBN-10 ‏ : ‎ 180461825X
  • ISBN-13 ‏ : ‎ 978-1804618257
  • Item Weight ‏ : ‎ 1.01 pounds
  • Dimensions ‏ : ‎ 9.25 x 7.52 x 0.54 inches
  • Customer Reviews:

About the author

Follow authors to get new release updates, plus improved recommendations.
Emily Webber
Brief content visible, double tap to read full content.
Full content visible, double tap to read brief content.

Emily Webber is a Principal Machine Learning Specialist Solutions Architect and keynote speaker at Amazon Web Services, where she has lead the development of countless solutions and features on Amazon SageMaker. She has guided and mentored hundreds of teams, developers, and customers in their machine learning journey on AWS. She specializes in large-scale distributed training in vision, language, generative AI, and is active in the scientific communities in these areas. She hosts YouTube and Twitch series on the topic, regularly speaks at re:Invent, writes many blog posts, and leads workshops in this domain worldwide.

Customer reviews

4.1 out of 5 stars
4.1 out of 5
22 global ratings
Useful guide to understand business and technical case for deploying foundation models on AWS
5 out of 5 stars
Useful guide to understand business and technical case for deploying foundation models on AWS
I would recommend this book to anyone (technical and non-technical) who is interested in learning about training foundational models. Given the explosion of GenAI and more specifically foundational models in 2023, I purchased this book to learn more about when, why, and how to pre-train these models for specific use-cases. As someone who is new to machine learning, let alone pre-training foundational models, I have found this book very digestable. It does a great job bridging high level considerations with deep and thoughtful technical guidance, and provides opinionated guidance on each step of the decesion making process.
Thank you for your feedback
Sorry, there was an error
Sorry we couldn't load the review

Top reviews from the United States

Reviewed in the United States on July 19, 2023
I would recommend this book to anyone (technical and non-technical) who is interested in learning about training foundational models. Given the explosion of GenAI and more specifically foundational models in 2023, I purchased this book to learn more about when, why, and how to pre-train these models for specific use-cases. As someone who is new to machine learning, let alone pre-training foundational models, I have found this book very digestable. It does a great job bridging high level considerations with deep and thoughtful technical guidance, and provides opinionated guidance on each step of the decesion making process.
Customer image
5.0 out of 5 stars Useful guide to understand business and technical case for deploying foundation models on AWS
Reviewed in the United States on July 19, 2023
I would recommend this book to anyone (technical and non-technical) who is interested in learning about training foundational models. Given the explosion of GenAI and more specifically foundational models in 2023, I purchased this book to learn more about when, why, and how to pre-train these models for specific use-cases. As someone who is new to machine learning, let alone pre-training foundational models, I have found this book very digestable. It does a great job bridging high level considerations with deep and thoughtful technical guidance, and provides opinionated guidance on each step of the decesion making process.
Images in this review
Customer image
Customer image
Reviewed in the United States on September 26, 2023
This is an excellent book to begin your journey in AI/ML.
Reviewed in the United States on June 5, 2023
As a long-time admirer of Emily Webber and an enthusiast of SageMaker and Large Language Models (LLMs), I've been eagerly anticipating the release of this book. As a regular user of AWS, I can confidently state that this book is a substantial contribution to the advanced field of Machine Learning (ML).

In the fast-paced world of ML, where LLMs are at the forefront of innovation, keeping up with the rapid advancements can be challenging. However, Emily's book, announced just before the LLM boom, provides a solid foundation that enables you to navigate these developments with ease. It has proven to be a timely resource for those keen on understanding and leveraging the power of LLMs.

Book Summary:

Comprehensive Coverage: The book offers an in-depth exploration of training vision and large language models, covering all stages from project ideation, dataset preparation, training, evaluation, to deployment for large language, vision, and multimodal models.

Expert Guidance: Authored by Emily Webber, a seasoned AWS and machine learning expert, the book provides industry-expert guidance and practical advice, making it a valuable resource for both beginners and experienced practitioners.

Practical Approach: The book is replete with practical examples and code samples that help readers understand how to pretrain and fine-tune their own foundation models on AWS and Amazon SageMaker.

Bias Detection: A unique feature of the book is its focus on bias detection and pipeline monitoring, which are critical aspects of model development and deployment.

Advanced Topics: The book delves into advanced topics like large-scale distributed training, hyperparameter selection, and model distribution, providing readers with a deep understanding of these complex areas.

Future Trends: The final chapter on future trends in pretraining foundation models gives readers a glimpse into what's next in the field, keeping them ahead of the curve.

In conclusion, if you're looking to ride the wave of LLMs and want to do so using AWS, this book is a must-read. It's more than just a guide; not a beginner's book!!! It's a comprehensive resource that empowers you to navigate the fast-paced world of ML with confidence and proficiency. Emily Webber's expertise shines through each page, making this book an invaluable asset for anyone in the field. As LLMs continue to evolve and revolutionize various sectors, this book stands as a testament to their transformative potential and a guide for those looking to be part of this exciting journey. This is just the start..... Transformers......... !!!
Customer image
5.0 out of 5 stars Riding the Wave of Large Language Models with Emily Webber.
Reviewed in the United States on June 5, 2023
As a long-time admirer of Emily Webber and an enthusiast of SageMaker and Large Language Models (LLMs), I've been eagerly anticipating the release of this book. As a regular user of AWS, I can confidently state that this book is a substantial contribution to the advanced field of Machine Learning (ML).

In the fast-paced world of ML, where LLMs are at the forefront of innovation, keeping up with the rapid advancements can be challenging. However, Emily's book, announced just before the LLM boom, provides a solid foundation that enables you to navigate these developments with ease. It has proven to be a timely resource for those keen on understanding and leveraging the power of LLMs.

Book Summary:

Comprehensive Coverage: The book offers an in-depth exploration of training vision and large language models, covering all stages from project ideation, dataset preparation, training, evaluation, to deployment for large language, vision, and multimodal models.

Expert Guidance: Authored by Emily Webber, a seasoned AWS and machine learning expert, the book provides industry-expert guidance and practical advice, making it a valuable resource for both beginners and experienced practitioners.

Practical Approach: The book is replete with practical examples and code samples that help readers understand how to pretrain and fine-tune their own foundation models on AWS and Amazon SageMaker.

Bias Detection: A unique feature of the book is its focus on bias detection and pipeline monitoring, which are critical aspects of model development and deployment.

Advanced Topics: The book delves into advanced topics like large-scale distributed training, hyperparameter selection, and model distribution, providing readers with a deep understanding of these complex areas.

Future Trends: The final chapter on future trends in pretraining foundation models gives readers a glimpse into what's next in the field, keeping them ahead of the curve.

In conclusion, if you're looking to ride the wave of LLMs and want to do so using AWS, this book is a must-read. It's more than just a guide; not a beginner's book!!! It's a comprehensive resource that empowers you to navigate the fast-paced world of ML with confidence and proficiency. Emily Webber's expertise shines through each page, making this book an invaluable asset for anyone in the field. As LLMs continue to evolve and revolutionize various sectors, this book stands as a testament to their transformative potential and a guide for those looking to be part of this exciting journey. This is just the start..... Transformers......... !!!
Images in this review
Customer image Customer image Customer image Customer image Customer image
Customer imageCustomer imageCustomer imageCustomer imageCustomer image
6 people found this helpful
Report
Reviewed in the United States on March 23, 2024
As a Sr. Fullstack engineer and punk AI hacker recently immersed in the world of building applications with Large Language Models (LLMs), I get that an emphasis on human-centered design will be vital in our LLM interactions going forward. This book reinforces that view with discussions of dataset preparation, fine-tuning, model evaluation, and human labeling as critical aspects that accelerate the ability of LLM applications.

Customizing data sets to be unique in purpose, depth, and completeness is recommended to stay competitive in this rapidly evolving landscape. My first pass through the content of this book helped me to understand that the incorporation of continuous learning and keeping humans in the loop throughout the application workflow is key to leveraging the full potential of LLMs.

The most important takeaway to me was the relationship and scaling between open-source ML models and fine-tuning them for specific tasks. This book provided an understanding of this relationship, describing it, identifying constants involved, and determining the appropriate scaling needed for optimization.

The author did a great job of breaking down the components of Pretraining for this novice. I can only assume that there are tidbits in this book for all levels of AI enthusiasts delving into the preparation of LLMs for purpose. Thank you for this solid information!
Customer image
4.0 out of 5 stars LLM Applications proficiency starts with the quality of input data and fine-tuning for purpose.
Reviewed in the United States on March 23, 2024
As a Sr. Fullstack engineer and punk AI hacker recently immersed in the world of building applications with Large Language Models (LLMs), I get that an emphasis on human-centered design will be vital in our LLM interactions going forward. This book reinforces that view with discussions of dataset preparation, fine-tuning, model evaluation, and human labeling as critical aspects that accelerate the ability of LLM applications.

Customizing data sets to be unique in purpose, depth, and completeness is recommended to stay competitive in this rapidly evolving landscape. My first pass through the content of this book helped me to understand that the incorporation of continuous learning and keeping humans in the loop throughout the application workflow is key to leveraging the full potential of LLMs.

The most important takeaway to me was the relationship and scaling between open-source ML models and fine-tuning them for specific tasks. This book provided an understanding of this relationship, describing it, identifying constants involved, and determining the appropriate scaling needed for optimization.

The author did a great job of breaking down the components of Pretraining for this novice. I can only assume that there are tidbits in this book for all levels of AI enthusiasts delving into the preparation of LLMs for purpose. Thank you for this solid information!
Images in this review
Customer image
Customer image
Reviewed in the United States on June 8, 2023
Got the book today as part of pre-order. They really botched it. The first 88 pages of the book are missing. Also pages are printed upside down. Sending it back. Maybe this was an anomaly.
Reviewed in the United States on September 27, 2023
Having had the chance to delve into "Pretrain Vision and Large Language Models in Python," I appreciate its detailed approach to building and deploying models on AWS. The combination of vision and language models addressed is quite unique and insightful. Practical examples offer real-world context, making the content richer.

However, it might be beneficial to have some prior knowledge in deep learning, as the book can get intricate at times. Some sections could be more streamlined for easier navigation.

Overall, if you're diving into large foundation models and AWS deployment, this is a worthy guide.

Top reviews from other countries

Mustafa
4.0 out of 5 stars Not a hands-on guide
Reviewed in Germany on June 28, 2023
It's discussing important aspects of the domain instead of explaining how to train large models
Zazu
2.0 out of 5 stars Bit messy
Reviewed in the United Kingdom on April 30, 2024
Expected it to be a lot better based on the authors YouTube series.

The first chapters are good introduction but the book tries to cover too much and ends up in not going into any detail in anything. Theres a lot of 'will cover more later in the book' but it never gets covered to any meaningful depth. Also, it often reads like a sales advert for SageMaker.

Would find it hard to recommend this book as you could just visit 4 or 5 blogs and get the same content whilst saving yourself £40