Skip to content
← Back to all sessions

AI Without the Cloud: Building Local AI Applications with Microsoft Foundry Local

2027 Edition Applied AI & Systems Talk 45 mins

What if your application could run AI directly on the user’s device without sending prompts or sensitive data to the cloud? In modern enterprise architectures, privacy constraints, compliance mandates, zero-connectivity requirements, and latency overheads often make continuous cloud LLM inference impractical.

In this deep-dive session, we explore Microsoft Foundry Local and demonstrate how developers can build and run AI-powered applications directly on local hardware. We cover local model runtimes, quantized inference execution, memory considerations, and application integration patterns that keep sensitive data strictly on-premises.

We will evaluate the trade-offs between local and cloud AI—analyzing when edge inference delivers decisive advantages in cost, privacy, and responsiveness, versus when hybrid or cloud-hosted models remain the optimal architectural choice.

Key Takeaways

  • Local AI Architecture: Understand the core mechanics of Microsoft Foundry Local and on-device model execution.
  • Privacy & Latency Optimization: Architect offline-capable, zero-data-leakage AI workflows with minimal inference latency.
  • Hardware & Model Selection: Practical sizing considerations, quantization formats, and memory profiles for client devices.
  • Hybrid Decision Matrix: Clear criteria for choosing between local inference, cloud APIs, and tiered hybrid deployments.

Target Audience

  • Cloud architects, backend engineers, and enterprise software developers building edge, offline, or privacy-sensitive AI applications.

Prerequisites

  • Familiarity with modern application development and basic understanding of Large Language Models and API integrations.

Presenting Speakers

Senthilkumar Srinivasan
Senthilkumar Srinivasan
Azure Solutions Architect · Enterprise Cloud & AI Solutions

Senthilkumar Srinivasan is an Azure Solutions Architect with over 19 years of experience designing and …

// PRESENTED WITH COMMUNITY