From the course: AWS Certified Machine Learning Engineer - Associate (MLA-C02) Cert Prep
Unlock this course with a free trial
Join today to access over 26,500 courses taught by industry experts.
Amazon SageMaker endpoints
From the course: AWS Certified Machine Learning Engineer - Associate (MLA-C02) Cert Prep
Amazon SageMaker endpoints
You have trained a powerful machine learning model. Now comes the critical question. How do you deploy it to production and serve millions of predictions reliably, securely, and cost-effectively? This is Amazon SageMaker Endpoints, AWS's fully managed model hosting service that deploys models with automatic scaling, monitoring, and multi-model support. No infrastructure management required. In this video, you will discover how SageMaker Endpoints work and watch a simple demo deploying a real-time endpoint for instant predictions. Amazon SageMaker Endpoints provide fully managed infrastructure to deploy machine learning models for making predictions. SageMaker handles server provisioning, model deployment, automatic scaling, and monitoring, allowing you to focus on your models, not infrastructure. SageMaker offers four inference options to match your workload requirements. First, real-time inference. Persistent endpoints for low-latency predictions with millisecond response times…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.
Contents
-
-
(Locked)
What are large language models (LLMs)?6m 37s
-
(Locked)
What are foundational models?5m 9s
-
(Locked)
What are embeddings?5m 22s
-
(Locked)
What is retrieval-augmented generation (RAG)?5m 17s
-
(Locked)
Sources of ML models2m 38s
-
(Locked)
Components of ML pipeline (overview)3m
-
(Locked)
Model fit2m 42s
-
(Locked)
What is LLM as a judge?5m
-
(Locked)
LLM as a judge on Amazon Bedrock model evaluation3m 57s
-
(Locked)
Vector databases, embeddings, and RAG explained9m 49s
-
(Locked)
Neural networks (basics and types)6m 55s
-
(Locked)
Transparent and explainable models4m 56s
-
(Locked)
Reinforcement learning and reinforcement learning from human feedback (RLHF)4m 33s
-
(Locked)
-
-
(Locked)
Feature engineering4m 25s
-
(Locked)
Bias and variance4m 2s
-
(Locked)
Effects of bias and variance3m 17s
-
(Locked)
Batch size, learning rate, and warm up11m 39s
-
(Locked)
Performance metrics5m 18s
-
(Locked)
Monitoring model performance9m 17s
-
(Locked)
Fine-tuning for specific tasks8m 55s
-
(Locked)
Fine-tuning in practice2m 43s
-
(Locked)
Inference parameters8m 8s
-
(Locked)
Inference parameters in action4m 9s
-
(Locked)
Introduction to hyperparameters5m 47s
-
(Locked)
Epoch count and model accuracy7m 55s
-
(Locked)
-
-
(Locked)
Amazon Bedrock12m 29s
-
(Locked)
Foundation models in Amazon Bedrock4m 44s
-
(Locked)
Amazon Bedrock playgrounds2m 32s
-
(Locked)
Amazon Bedrock Guardrails6m 35s
-
(Locked)
Amazon Bedrock knowledge bases12m 43s
-
(Locked)
Content chunking in Amazon Bedrock knowledge base3m 48s
-
(Locked)
Token management in Amazon Bedrock11m 40s
-
(Locked)
Cost optimization and model selection in Amazon Bedrock3m 29s
-
(Locked)
Provisioned throughput7m 7s
-
(Locked)
Implementing provisioned throughput2m 56s
-
(Locked)
Provisioned throughput model units (MUs) in Amazon Bedrock for increased invocation capacity4m 30s
-
(Locked)
-
-
(Locked)
How Amazon Bedrock agents work4m 43s
-
(Locked)
Amazon Bedrock prompt management4m 46s
-
(Locked)
Amazon Bedrock data automation: Transform unstructured data into insights7m 40s
-
(Locked)
Amazon Bedrock evaluations7m 35s
-
(Locked)
Amazon Bedrock flows: Understanding the building blocks of AI orchestration5m 47s
-
(Locked)
Understanding intelligent prompt routing in Amazon Bedrock6m 39s
-
(Locked)
Safety and governance with Amazon Bedrock guardrails7m 25s
-
(Locked)
-
-
(Locked)
Bedrock RAG serverless27m 10s
-
(Locked)
Reranker model in Amazon Bedrock5m 34s
-
(Locked)
Amazon Bedrock AgentCore: Overview5m 9s
-
(Locked)
Amazon Bedrock AgentCore: Gateway6m 43s
-
(Locked)
Amazon Bedrock AgentCore: Memory9m 7s
-
(Locked)
Amazon Bedrock AgentCore: Runtime6m 29s
-
(Locked)
Amazon Bedrock AgentCore: Identity6m 40s
-
(Locked)
Amazon Bedrock AgentCore: Observability6m 31s
-
(Locked)
Amazon Bedrock AgentCore: Code Interpreter8m 37s
-
(Locked)
Extracting text from unstructured data: Bedrock and Textract (hands-on lab)5m 30s
-
(Locked)
Bedrock serverless hands-on demo33m 8s
-
(Locked)
-
-
(Locked)
What is agentic AI?9m 21s
-
(Locked)
The architecture of agentic AI7m 30s
-
(Locked)
Agentic AI vs. generative AI (GenAI)5m 33s
-
(Locked)
Agentic AI in the cloud6m 32s
-
(Locked)
Types of agentic AI6m 54s
-
(Locked)
Multi-agent systems: When AI agents work together5m 7s
-
(Locked)
Memory and context in AI agents5m 12s
-
(Locked)
Model Context Protocol (MCP)5m 30s
-
(Locked)
Agent Communication Protocol (ACP)5m 4s
-
(Locked)
Agent2Agent (A2A)4m 55s
-
(Locked)
What is AWS Strands Agents?2m 45s
-
(Locked)
What is AWS Agent Squad?2m 55s
-
(Locked)
What is LangChain?10m 36s
-
(Locked)
What is LangGraph?4m 38s
-
(Locked)
What is LangSmith?3m 56s
-
(Locked)
-
-
(Locked)
Introduction to prompt engineering4m
-
(Locked)
Types of prompts and techniques5m 3s
-
(Locked)
Chain-of-thought prompting7m 5s
-
(Locked)
What are tokens in AI?5m 18s
-
(Locked)
Tokens and prompts in GenAI9m 16s
-
(Locked)
How tokenization works from sentences to parts of words8m
-
(Locked)
AWS Neuron for GenAI3m 44s
-
(Locked)
What is prompt caching?4m 57s
-
(Locked)
Generative AI Application Builder on AWS5m 37s
-
(Locked)
No-code GenAI with PartyRock4m 46s
-
(Locked)
-
-
(Locked)
Amazon Comprehend with hands-on labs7m 17s
-
(Locked)
Amazon Rekognition9m 47s
-
(Locked)
Amazon Augmented AI (A2I) overview2m 56s
-
(Locked)
Amazon Augmented AI (A2I) with hands-on labs7m 52s
-
(Locked)
Amazon Lex with hands-on labs10m 23s
-
(Locked)
Amazon Transcribe with hands-on labs7m 37s
-
(Locked)
Amazon Translate with hands-on labs7m 9s
-
(Locked)
Amazon Polly with hands-on labs5m 8s
-
(Locked)
Amazon Textract7m 43s
-
(Locked)
-
-
(Locked)
Amazon Q4m 9s
-
(Locked)
Getting started with Amazon Q Business9m 57s
-
(Locked)
Building a custom Amazon Q Business web experience5m 27s
-
(Locked)
Connecting Amazon Simple Storage Service (S3) to Amazon Q Business6m 47s
-
(Locked)
Getting started with Amazon Q Developer7m 1s
-
(Locked)
Amazon Quick Suite: Your agentic AI teammate5m 22s
-
(Locked)
AWS vector search across services5m
-
(Locked)
Amazon Nova8m 22s
-
(Locked)
-
-
(Locked)
Amazon SageMaker JumpStart9m 36s
-
(Locked)
Amazon SageMaker Feature Store4m 51s
-
(Locked)
SageMaker Data Wrangler5m 59s
-
(Locked)
SageMaker Clarify7m 40s
-
(Locked)
SageMaker Model Cards10m 37s
-
(Locked)
SageMaker Model Registry9m 33s
-
(Locked)
SageMaker model endpoints7m 55s
-
(Locked)
Amazon SageMaker Inference Recommender5m 55s
-
(Locked)
Understanding model drift in ML7m 27s
-
(Locked)
Amazon SageMaker HyperPod7m 7s
-
(Locked)
Amazon SageMaker Canvas5m 2s
-
(Locked)
Amazon SageMaker Catalog4m 45s
-
(Locked)
Amazon SageMaker Ground Truth7m 18s
-
(Locked)
Amazon SageMaker endpoints6m 56s
-
(Locked)
Amazon SageMaker Role Manager5m 3s
-
(Locked)
Amazon SageMaker Model Monitor5m 2s
-
(Locked)
-
-
(Locked)
Economic and business implications of GenAI solutions7m 4s
-
(Locked)
Integrating GenAI into business workflows8m 5s
-
(Locked)
GenAI: Use cases, models, and AWS tools4m 54s
-
(Locked)
Governance and compliance in AI6m 23s
-
(Locked)
Human-in-the-loop (HITL) validation patterns1m 52s
-
(Locked)
Generative AI Security Scoping Matrix4m 54s
-
(Locked)
Introduction to the Generative AI Security Scoping Matrix1m 56s
-
(Locked)
GenAI observability overview7m 57s
-
(Locked)
Validating compliance and scope1m 55s
-
(Locked)
Understanding pretrained models' scope2m 55s
-
(Locked)
Understanding self-trained models' scope2m 24s
-
(Locked)
Understanding fine-tuned models' scope3m 5s
-
(Locked)
Understanding enterprise applications' scope3m 1s
-
(Locked)
Understanding consumer applications' scope2m 35s
-
(Locked)
-
-
(Locked)
AWS services overview5m 18s
-
(Locked)
AWS ML services overview16m 41s
-
(Locked)
AWS compute services overview10m 44s
-
(Locked)
AWS deployment services overview14m 25s
-
(Locked)
AWS security services overview12m 56s
-
(Locked)
AWS application integration services overview10m 9s
-
(Locked)
AWS storage services overview17m 32s
-
(Locked)
AWS database services overview11m 51s
-
(Locked)
AWS networking and content delivery services overview13m 54s
-
(Locked)
AWS management and governance services overview9m 50s
-
(Locked)
AWS transfer and migration services overview9m 33s
-
(Locked)
AWS monitoring services overview6m 6s
-
(Locked)
AWS audit and compliance services overview3m 22s
-
(Locked)
AWS analytics services overview22m 32s
-
(Locked)
AWS identity services overview4m 32s
-
(Locked)
-
-
(Locked)
AWS Glue overview6m 6s
-
(Locked)
AWS Glue for beginners5m 51s
-
(Locked)
Data cleaning with AWS Glue DataBrew6m 21s
-
(Locked)
Building visual extract, transform, and load (ETL) jobs with AWS Glue Studio5m 5s
-
(Locked)
Getting started with AWS Glue crawler7m 59s
-
(Locked)
AWS Glue connections: Centralize your data source management6m 16s
-
(Locked)
Bulletproof your streaming data with AWS Glue Schema Registry6m 32s
-
(Locked)
AWS Glue job bookmarks explained4m 58s
-
(Locked)
Automate data discovery with AWS Glue classifiers5m 21s
-
(Locked)
Improve data with AWS Glue Data Quality6m 4s
-
(Locked)
Automate pipelines with AWS Glue triggers7m 20s
-
(Locked)
What is AWS Lake Formation?2m 32s
-
(Locked)
Amazon Elastic MapReduce (EMR) overview6m 46s
-
(Locked)
Processing data with Amazon EMR and Apache Spark8m 59s
-
(Locked)
-
-
(Locked)
Amazon Relational Database Service (RDS) overview10m 58s
-
(Locked)
Amazon RDS Read Replica13m
-
(Locked)
Amazon RDS multiple Availability Zone (multi-AZ) deployments11m 5s
-
(Locked)
Amazon RDS event notification6m 17s
-
(Locked)
Amazon RDS Proxy3m 49s
-
(Locked)
Amazon Aurora overview7m 10s
-
(Locked)
Amazon DynamoDB overview14m 30s
-
(Locked)
Amazon DynamoDB core components7m 32s
-
(Locked)
Amazon MemoryDB7m 10s
-
(Locked)
Amazon DocumentDB overview6m 24s
-
(Locked)
Amazon ElastiCache overview6m 7s
-
(Locked)
Amazon Neptune overview8m 21s
-
(Locked)
-
-
(Locked)
Amazon S3 overview9m 22s
-
(Locked)
Understanding Amazon S3 Storage Lens4m 14s
-
(Locked)
Amazon S3 storage class: One Zone-IA2m 31s
-
(Locked)
Amazon S3 storage class: Standard-IA2m 28s
-
(Locked)
Amazon S3 storage class: Intelligent-Tiering2m 33s
-
(Locked)
Transform data with Amazon S3 Object Lambda7m 39s
-
(Locked)
Vector management with Amazon S3 vectors10m 4s
-
(Locked)
Exploring the Amazon S3 console7m 32s
-
(Locked)
Creating an Amazon S37m 48s
-
(Locked)
Uploading and downloading objects in Amazon S35m 1s
-
(Locked)
Tabular data management in S3 with table buckets6m
-
(Locked)
Amazon FSx for Lustre4m 17s
-
(Locked)
Amazon FSx for OpenZFS6m 24s
-
(Locked)
Amazon FSx for NetApp ONTAP6m 2s
-
(Locked)
Hands-on lab: Creating an Elastic File System (EFS) storage7m 36s
-
(Locked)
-
-
(Locked)
Amazon Elastic Compute Cloud (EC2) overview5m 11s
-
(Locked)
Instance types8m 6s
-
(Locked)
Amazon Machine Image (AMI)7m 29s
-
(Locked)
Instance user data2m 31s
-
(Locked)
Instance metadata6m 13s
-
(Locked)
Amazon EC2 networking14m 20s
-
(Locked)
Amazon EC2 network security16m 12s
-
(Locked)
Hands-on lab: Vertically scaling an Amazon EC2 instance8m 13s
-
(Locked)
Hands-on lab: Using EC2 Instance Connect to connect to your instance5m 23s
-
(Locked)
Hands-on lab: Setting up a web server on an EC2 instance5m 52s
-
(Locked)
-
-
(Locked)
Amazon CloudWatch Overview7m 46s
-
(Locked)
CloudWatch metrics for EC2 instances5m 56s
-
(Locked)
CloudWatch alarms4m 18s
-
(Locked)
CloudWatch logs and metric filters3m 36s
-
(Locked)
Amazon CloudWatch events (Amazon EventBridge)4m 36s
-
(Locked)
Amazon Quick Sight7m 55s
-
(Locked)
Amazon Simple Notification Service (SNS) overview6m 56s
-
(Locked)
Amazon Simple Queue Service (SQS) overview9m 42s
-
(Locked)
AWS Step Functions overview6m 11s
-
(Locked)
-
-
(Locked)
AWS Key Management Service (KMS) overview6m 58s
-
(Locked)
AWS Secrets Manager3m 53s
-
(Locked)
AWS Network Firewall1m 56s
-
(Locked)
Amazon Macie hands-on6m 54s
-
(Locked)
Amazon Fraud Detector13m 25s
-
(Locked)
Amazon CodeGuru Security1m 38s
-
(Locked)
Amazon CodeGuru Profiler1m 30s
-
(Locked)
Amazon CodeGuru Reviewer2m 2s
-
(Locked)
-
-
(Locked)
AWS Trusted Advisor overview3m 32s
-
(Locked)
AWS Budgets overview3m 57s
-
(Locked)
AWS Cost Explorer overview4m 19s
-
(Locked)
Monitoring your AWS bill with AWS Budgets notifications5m 5s
-
(Locked)
Creating a billing alarm with Amazon CloudWatch to monitor AWS charges6m 40s
-
(Locked)
AWS Compute Optimizer overview5m 40s
-
(Locked)
-
-
(Locked)
What is the AWS Well-Architected Framework?9m 18s
-
(Locked)
The pillars of the AWS Well-Architected Framework12m 31s
-
(Locked)
Introduction to AWS Well-Architected Lenses3m 3s
-
(Locked)
AWS Well-Architected (WA) Tool step 1: Define workload5m 18s
-
(Locked)
AWS WA Tool step 2: Conduct architectural review5m 12s
-
(Locked)
AWS WA Tool step 3: Apply best practices3m 10s
-
(Locked)
AWS Well-Architected Tool for Generative AI: Your blueprint for success5m 59s
-
(Locked)
AWS Well-Architected Tool: Custom lenses for your ML workloads6m 25s
-
(Locked)
-
-
(Locked)
AWS CloudTrail Overview3m 13s
-
(Locked)
CloudFront Overview10m 45s
-
(Locked)
Amazon OpenSearch Service4m 22s
-
(Locked)
Accessing the Amazon EC2 Instance using SSH5m 34s
-
(Locked)
Connecting the domain name to the Amazon EC2 instance using Elastic IP9m 58s
-
(Locked)
AWS DataSync5m 32s
-
(Locked)
AWS Service Catalog: Governance made simple8m 10s
-
(Locked)
What is Amazon Athena?6m 39s
-
(Locked)
Querying data with Amazon Athena8m 48s
-
(Locked)
Amazon Redshift overview6m 56s
-
(Locked)
Amazon Kinesis Data Streams overview6m 56s
-
(Locked)
Amazon Data Firehose overview7m 5s
-
(Locked)
Amazon MWAA (Managed Workflows for Apache Airflow) overview6m 14s
-
(Locked)