Set up a Prefect 3 work pool backed by a Kubernetes infrastructure for scalable flow execution

Steps

1. Create a Kubernetes work pool with prefect work-pool create --type kubernetes my-k8s-pool; this registers the pool with the Prefect server
2. Deploy a Prefect worker that targets the pool using prefect worker start --pool my-k8s-pool; the worker runs inside the Kubernetes cluster and polls the server for scheduled flow runs
3. Configure the work pool's base job template in the Prefect UI to set default pod namespace, service account, image pull policy, and resource requests for all flows using this pool
4. Create a flow deployment referencing the work pool: prefect deploy --pool my-k8s-pool; the deployment stores the entrypoint command and storage location
5. Override job variables per deployment (image, CPU, memory) in the deployment YAML under the job_variables key without modifying the base pool template
6. Monitor worker health via prefect worker ls and inspect pod logs in Kubernetes to diagnose worker crashes or flow run failures