Kubernetes Autoscaling with Karpenter

Download MP3
Bret is joined by Nirmal Mehta, a Principal Specialist Solution Architect at AWS, and a Docker Captain, to discuss Karpenter, an autoscaling solution that simplifies Kubernetes infrastructure by automating node scaling up and down.
Bret is joined by Nirmal Mehta, a Principal Specialist Solution Architect at AWS, and a Docker Captain, to discuss Karpenter, an autoscaling solution launched by AWS in 2021. Karpenter simplifies Kubernetes infrastructure by automating node scaling up and down, giving you "the right nodes at the right time."

Autoscaling, particularly for Kubernetes, can be quite a complex project when you first start. Bret and Nirmal discuss how Karpenter works, how it can help or complement your existing setup, and how autoscaling generally works.

Streamed live on YouTube on June 9, 2022.


Unedited live recording of this show on YouTube (Ep #173). Includes demos.


★Topics★
Starship Shell Prompt
Bret's favorite shell setup
Karpenter
Karpenter release blog
K8s Scheduling Concepts

Other types of autoscalers:
Horizontal Pod Autoscaler
Vertical Pod Autoscaler
Cluster Autoscaler


★Nirmal Mehta★
Nirmal on Twitter
Nirmal on LinkedIn


★Join my Community★
Best coupons for my Docker and Kubernetes courses
Chat with us on our Discord Server Vital DevOps
  • (00:00) - DDT MAIN
  • (00:04) - Intro
  • (00:51) - Custom intro
  • (02:08) - Main Show
  • (02:12) - Introductions
  • (03:12) - Nirmal's Jobs
  • (03:58) - Talking about Kubernetes cluster scaling
  • (05:04) - Who are we addressing?
  • (06:29) - What is Karpenter not addressing?
  • (06:52) - Auto-scaling at pod level
  • (07:40) - Cluster auto-scaling
  • (09:07) - Karpenter is alternate to cluser autoscaler
  • (09:21) - Question
  • (10:11) - Issues Karpenter was created to address
  • (12:29) - What is Karpenter?
  • (13:51) - Selective instance type provisioning
  • (14:47) - Matching deployment definition to instance types
  • (16:08) - Question: Is Karpenter designed only for AWS?
  • (17:13) - Question: Can you auto-scale control plane nodes?
  • (19:21) - The Kubernetes Scheduler
  • (23:14) - Question: Does Karpenter auto-scale down?
  • (25:05) - Question: EKS with Karpenter spot instances
  • (25:58) - Question: Karpenter and AWS auto-scaling groups
  • (26:10) - Question: Installation and provisioning
  • (27:20) - Only affects unschedulable pods
  • (28:49) - Demo intro
  • (29:14) - Demo
  • (29:19) - Scaling Down
  • (30:27) - Keeping your nodes fresh
  • (32:54) - If you want to learn more
  • (33:23) - Goals for 2022
  • (34:15) - Questions
  • (34:21) - Question: Cost-effective instances
  • (35:35) - Question: Instances to IoC and automatically destroyed?
  • (38:25) - Question: Features being pushed upstream into Kubernetes
  • (40:28) - Question: Rebalancing
  • (44:28) - Scaling down is hard too
  • (46:18) - Question: Horizontal pod auto-scaler trigger Karpenter
  • (47:25) - Question: Specs and Documentation
  • (48:01) - Question: How does it pick instance sizes?
  • (48:55) - Question: Karpenter respects desire to spread workloads
  • (49:29) - Question: EKSAnywhere support
  • (49:50) - Question: How do you pick AMIs?
  • (50:37) - Winding down
  • (52:25) - Wrapping up
  • (52:30) - Outro

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Creators and Guests

Bret Fisher
Host
Bret Fisher
Cloud native DevOps Dude. Course creator, YouTuber, Podcaster. Docker Captain and CNCF Ambassador. People person who spends too much time in front of a computer.
Nirmal Mehta
Host
Nirmal Mehta
Principal Specialist Solutions Architect at Amazon Web Services (AWS)
Beth Fisher
Producer
Beth Fisher
Producer of DevOps and Docker Talk podcast since 2019. Assistant producer on Bret Fisher Live show on YouTube. Business and proposal writer by trade.
Cristi Cotovan
Editor
Cristi Cotovan
Video editor and educational content producer. Descript and Camtasia coach.
Kubernetes Autoscaling with Karpenter
Broadcast by