Kubernetes Bytes

Join Bhavin Shah and Ryan Wallner for a recap of announcements and news from KubeCon North America 2024.  Check out our website at https://kubernetesbytes.com/  https://www.businesswire.com/news/home/20241119538933/en/Spectro-Cloud-Closes-75m-Series-C-Led-by-Growth-Equity-at-Goldman-Sachs-Alternatives https://northflank.com/blog/northflank-raises-22m-to-make-kubernetes-work-for-your-developers-ship-workloads-not-infrastructure https://snyk.io/news/snyk-acquires-developer-first-dast-provider-probely/ https://www.nutanix.com/blog/introducing-nutanix-enterprise-ai  https://thenewstack.io/stacklok-donates-minder-security-project-to-openssf/ https://www.prnewswire.com/news-releases/akamai-launches-cloud-agnostic-ready-to-run-application-platform-302302446.html  https://www.businesswire.com/news/home/20241112064093/en/Loft-Labs-Introduces-vCluster-Cloud-a-Managed-Solution-to-Simplify-and-Reduce-Costs-of-Kubernetes https://cloud.google.com/blog/products/containers-kubernetes/gke-65k-nodes-and-counting  https://www.veeam.com/resources/wp-whats-new-veeam-kasten-for-kubernetes.html https://www.netapp.com/blog/trident-24-10-best-storage-kubernetes/ https://podman-desktop.io/blog/2024/11/14/podman-desktop-cncf  https://aws.amazon.com/blogs/aws/streamline-kubernetes-cluster-management-with-new-amazon-eks-auto-mode/ https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-eks-hybrid-nodes/ https://thenewstack.io/kueue-can-now-schedule-kubernetes-batch-jobs-across-clusters/  https://cloudnativenow.com/kubecon-cnc-na-2024/solo-io-donates-api-gateway-to-cncf-to-advance-kubernetes-connectivity/ https://blocksandfiles.com/2024/11/08/tintri-unveils-kubernetes-container-storage-interface-for-streamlined-management/  https://www.sdxcentral.com/articles/stringerai-announcements/kubiya-launches-captain-kubernetes-ai-tool-for-simplifying-kubernetes-management/ https://cloudnativenow.com/topics/cloudnativedevelopment/application-dev/cncf-automates-kubernetes-secops-with-kyverno/ https://www.cncf.io/announcements/2024/11/15/cloud-native-computing-foundation-expands-certification-to-platform-engineering-and-more/   https://training.linuxfoundation.org/platform-engineering-programs  https://cloudnativenow.com/topics/cloudnativedevelopment/cncf-kubevirt-v1-4-vms-are-now-just-another-kubernetes-resource/ https://kubevirt.io/user-guide/release_notes/ kubernetes.io/blog/2024/12/11/kubernetes-v1-32-release/ https://thehackernews.com/2024/12/296000-prometheus-instances-exposed.html?utm_source=tldrdevops

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Tobi Knaup, VP and General Manager of Cloud Native at Nutanix about all things Kubernetes and AI. The discussion focuses on how Kubernetes has evolved since the early days, and why it's architecture is a perfect fit for accelerating adoption of AI workloads inside organizations.   Check out our website at https://kubernetesbytes.com/   #kubernetes #aimodels #AIonKubernetes #machinelearning #hybridcloud #multicloud #modeltraining

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years.   Diego and Anoop share their experiences around how they drove this modernization inside Guidewire by both championing organizational change, and introducing Kubernetes and cloud technologies, while at the same time ensuring that they serve their existing customers in the insurance industry.   Check out our website at https://kubernetesbytes.com/ Show links:   https://medium.com/@guidewire-engineering https://www.youtube.com/@GuidewireSoftware https://www.youtube.com/watch?v=N-WaEneeIJs https://www.youtube.com/watch?v=bKCwMO4UeJ8 https://www.guidewire.com/about/careersTimestamps:  00:05:24 Interview with Diego and Anoop 01:02:37 Key takeaways

In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We’ll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks, such as cold starts and scaling issues. We also take a closer look at real-world examples like CleanLab, who saved 90% on GPU costs using Inferless.Whether you’re a developer, DevOps engineer, or tech enthusiast curious about the latest in AI infrastructure, this podcast offers insights into Kubernetes-based model deployment, efficient updates, and the future of serverless ML. Tune in to hear Nilesh's journey from Amazon to founding Inferless and how his platform is transforming the way companies deploy machine learning models.Subscribe now for more episodes! Show Links: OpenShift 4.17 is GA https://www.youtube.com/live/DvKHwz-c11c?si=6Zap6hk_GsQfdX2m Policy SBOM from Styra: https://www.styra.com/blog/introducing-policy-sbom/ NVIDIA GEForce NOW runs on KubeVirt https://thenewstack.io/now-nvidia-scaled-its-cloud-services-with-kubevirt/ CBT feedback https://thenewstack.io/kubernetes-advances-cloud-native-data-protection-share-feedback CNCF KUBEEDGE Grad https://www.devopsdigest.com/cncf-announces-kubeedge-graduation?utm_source=tldrdevops Palumi Operator 2.0 https://www.pulumi.com/blog/pulumi-kubernetes-operator-2-0Inferless LInks: https://www.inferless.com/blog/cleanlab-saves-90-on-gpu-costs-with-inferless-serverless-inference https://www.inferless.com/blog/how-spoofsense-scaled-their-ai-inference-with-inferless-dynamic-batching-autoscaling https://www.inferless.com/  https://docs.inferless.com/introduction/introduction  LinkedIn - https://www.linkedin.com/in/nilesh-agarwal/  X- https://x.com/nilesh_agarwal2  Medium Blog https://nilesh-agarwal.medium.com/

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Ofir Cohen, CTO of Container Security at Wiz. The discussion focuses on the challenges with the cloud native security ecosystem, how organizations can improve their security posture, how developers can do less with more, and how Wiz helps organizations avoid security incidents.Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://blog.kubecost.com/blog/2.4-release-highlights/ https://www.theregister.com/2024/09/26/critical_nvidia_bug_container_escape https://techcrunch.com/2024/09/18/edera-is-building-a-better-kubernetes-and-ai-security-solution-from-the-ground-up/ https://www.cncf.io/blog/2024/10/01/karmada-v1-11-version-released-new-cross-cluster-rolling-upgrade-capability-for-workload/ https://github.com/atlassian/escalator/?tab=readme-ov-file  https://cybenari.com/2024/08/whats-the-worst-place-to-leave-your-secrets/ https://thehackernews.com/2024/10/new-cryptojacking-attack-targets-docker.html  Show links: https://www.wiz.io/customers https://www.wiz.io/blog https://peach.wiz.io https://www.linkedin.com/in/cohen-ofir/  Timestamps: 00:01:43 Cloud Native News 00:12:56 Interview with Ofir 00:56:58 Key takeaways

In this episode, we dive into the challenges of modern CI systems and why they often hinder productivity. We explore Dagger, a programmable CI/CD pipeline engine, with insights from Sam, a former Docker engineer. Learn how Dagger addresses CI complexity, speeds up workflows, and enhances portability between local environments and CI.  Show Links Dagger.io  https://docs.dagger.io/   https://docs.dagger.io/adopting/#join-our-discord

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.   Check out our website at https://kubernetesbytes.com/  Cloud Native News: https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito https://orca.security/resources/blog/kubernetes-testing-environment/ https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available  Show links: Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) KubeRay repository: https://github.com/ray-project/kuberay Ray repository: https://github.com/ray-project/ray Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform  Timestamps:  00:02:40 Cloud Native News  00:07:20 Interview with Kai  00:49:15 Key takeaways

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Alex Lines and Vara Bonthu from AWS to talk about the Data on EKS project. The discussion dives into why AWS decided to build the Data on EKS project and provide patterns for EKS customers to use to deploy data platforms, machine learning and GenAI tools on EKS clusters. They talk about what's included and what's not included with each of these patterns and whats coming down the line.   Check out our website at https://kubernetesbytes.com/  Cloud Native News:  https://kubernetes.io/blog/2024/08/16/kubernetes-1-31-prevent-persistentvolume-leaks-when-deleting-out-of-order/ https://kubernetes.io/blog/2024/08/16/matchlabelkeys-podaffinity/ https://kubernetes.io/blog/2024/08/15/kubernetes-1-31-volume-attributes-class/ https://roadmap.vcluster.com/changelog/vcluster-v020-ga https://www.cloudbees.com/blog/cloudbees-acquires-launchable-to-enable-development-teams-to-iterate-faster?Product=Launchable&Tag=Blog%2CAI%2CLaunchable%20Update  Show links: https://awslabs.github.io/data-on-eks/ https://www.youtube.com/watch?v=G9aNXEu_a8k  https://github.com/awslabs/data-on-eks  https://www.linkedin.com/in/alex-lines-aws/  https://www.linkedin.com/in/varaprofile/  Timestamps:  00:01:45 Cloud Native News  00:12:15 Interview with Alex and Vara  00:58:21 Key takeaways

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with  Sachi Desai, Product Manager and Paul Yu, Sr. Cloud Advocate at Microsoft to talk about the open source KAITO project. KAITO is the Kubernetes AI Toolchain Operator that enables AKS users to deploy open source LLM models on their Kubernetes clusters. They discuss how KAITO helps with running AI-enabled applications alongside the LLM models, how it helps users bring their own LLM models and run them as containers, and how KAITO helps them fine-tune open source LLMs on their Kubernetes clusters.  Check out our website at https://kubernetesbytes.com/  Cloud Native News:   https://azure.github.io/AKS/2024/07/30/azure-container-storage-ga https://github.blog/news-insights/product-news/introducing-github-models/  Show links:  Azure/kaito: Kubernetes AI Toolchain Operator - https://github.com/Azure/kaito/tree/main https://www.youtube.com/watch?v=3cGmHDjR_3I&list=PLc3Ep462vVYtgN4rP1ThTJd2UlsBc2sou&index=2 https://aka.ms/cloudnative/learnlive/intelligent-apps-on-aks/episode-2 Jumpstart AI Workflows With Kubernetes AI Toolchain Operator - The New Stack - https://thenewstack.io/jumpstart-ai-workflows-with-kubernetes-ai-toolchain-operator https://paulyu.dev/article/soaring-with-kaito/ Concepts - Fine-tuning language models for AI and machine learning workflows - Azure Kubernetes Service | Microsoft Learn - https://learn.microsoft.com/en-us/azure/aks/concepts-fine-tune-language-models   Keep up to date on the most recent announcements by following some of the KAITO engineers on LinkedIn:  Fei Guo - https://www.linkedin.com/in/fei-guo-a48319a/ Ishaan Sehgal - https://www.linkedin.com/in/ishaan-sehgal/ Timestamps:  00:02:15 Cloud Native News  00:05:34 Interview with Sachi and Paul  00:42:08 Key takeaways

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Danielle Cook  -  VP of Marketing, appCD and Co-chair, CNCF Cartografos Working Group, CNCF. The discussion dives into how technical individual contributors can and should think about a business case for cloud native adoption. They talk about the cloud native maturity model and also discuss the different things business leaders care about.   Check out our website at https://kubernetesbytes.com/    Cloud Native News: https://www.chainguard.dev/unchained/chainguard-series-c https://www.cnbc.com/2024/07/23/google-wiz-deal-dead.html https://www.redhat.com/en/blog/what-you-need-to-know-red-hat-openshift-416  https://blog.kubeflow.org/kubeflow-1.9-release/ https://talks.devopsdays.org/devopsdays-boston-2024/cfp  Show links:  https://www.linkedin.com/in/danielle-cook-/ https://maturitymodel.cncf.io/ https://community.cncf.io/cncf-cartografos-working-group/ https://tag-app-delivery.cncf.io/whitepapers/platform-eng-maturity-model/ Timestamps:  00:01:36 Cloud Native News  00:12:07 Interview with Danielle 00:51:20 Key takeaways