Introduction This tutorial is meant to be a nitty gritty technical how-to that pairs with this blog post: Migrating to Kubernetes and GKE: Preemptible nodes and making space for the Chaos Monkeys.
Kubernetes will save us all. If only we could work out how to install and maintain it. For the uninitiated, Kubernetes (also known as K8s to your local neighborhood hipster developer) is an ...
We’ll walk through fine-tuning a Llama 2 7B model using GKE using 8 x L4 GPUs. L4 GPUs are suitable for many use cases beyond serving models. We will demonstrate how the L4 GPU is a great option for ...