Speaker
Description
AI-native applications are poised to redefine how users interact with technology — but for AI to be truly seamless, scalable, and privacy-respecting, it must move closer to the user. On-device AI is the key to unlocking adaptive, real-time experiences while eliminating the latency, cost, and privacy trade-offs of cloud-based models
In this talk, we’ll dive into how developers can harness DeliteAI, an open-source on-device AI platform, to create intelligent applications that dynamically adapt to each user.
You’ll learn how to:
- Enable real-time user context awareness using on-device data ingestion and stream processing.
- Understand user behavior and intent with lightweight, fine-tuned LLMs running securely on-device.
- Build agentic workflows that respond in-session using Python-based runtime orchestration — all without cloud dependency.
We'll walk through real-world patterns, code examples, and performance benchmarks to show how on-device AI can enable magical, responsive experiences that weren't previously possible.
By the end of this session, you'll have a practical framework for integrating on-device AI into your mobile apps — unlocking AI for everyone, everywhere.
Session author's bio
Neeraj Poddar is the Co-founder and CTO at NimbleEdge where he's building the future of personal on-device AI. Prior to NimbleEdge, he was the Co-founder of Aspen Mesh, VP of Engineering at Solo.io and led the Istio open source community. He has worked on various aspects of AI, networking, security and distributed systems over the span of his career. Neeraj focuses on application of open source technologies across different industries in terms of scalability and security. When not working on AI, you can find him playing racquetball and gaining back the calories spent playing by trying out new restaurants.
| Social Media | https://x.com/nrjpoddar |
|---|---|
| Level of Difficulty | Intermediate |
| Please confirm that there are included headshots of all speakers in their profiles | Yes |
| In Person Attendance | In-person |
| Agree to Privacy Policy and Notice | I agree |