Speakers
Description
Open source is powering the next wave of AI innovation, but the real challenge lies in making AI infrastructure accessible, secure, and scalable across environments—from cloud-native platforms to the edge devices.
In this talk, we’ll begin with a high-level perspective on the role of open source in shaping AI adoption across industries. From there, we’ll dive into practical architectures that enable AI to run efficiently in the cloud leveraging Kubernetes, exploring how virtual clusters (vCluster) provide secure multi-tenancy for teams while ensuring resource efficiency. We’ll connect this with running AI on-device, highlighting how AI can extend beyond datacenters to devices at the edge, enabling real-world applications that demand low latency and privacy-preserving computation.
We will focus on the next frontier of AI in making it personal, private and accessible. Attendees will walk away with a clearer understanding of the opportunities and challenges in running AI at scale using open source—whether in the cloud, or at the edge.
Session author's bio
Neeraj Poddar is the Co-founder and CTO at NimbleEdge where he's building the future of personal on-device AI. Prior to NimbleEdge, he was the Co-founder of Aspen Mesh, VP of Engineering at Solo.io and led the Istio open source community. He has worked on various aspects of AI, networking, security and distributed systems over the span of his career. Neeraj focuses on application of open source technologies across different industries in terms of scalability and security. When not working on AI, you can find him playing racquetball and gaining back the calories spent playing by trying out new restaurants.
| Agree to Privacy Policy and Notice | I agree |
|---|---|
| Please confirm that there are included headshots of all speakers in their profiles | Yes |
| Level of Difficulty | Beginner |
| Social Media | https://x.com/nrjpoddar |
| In Person Attendance | In-person |