local inference

Everything about local inference

1. Article · LLMs

   How to Run a Local AI Model on Windows with Windows ML and llama.cpp

   Learn how to run a GGUF language model locally on Windows with llama.cpp and call its OpenAI-style HTTP API from a C# application.

   Ananya DesaiOct 233,8511,000
2. Article · AI

   Mastering the Foundry Model Catalog, Model Router, and Foundry Local

   Learn how Microsoft Foundry Model Router selects cost-effective AI models, how structured outputs enforce JSON schemas, and how Foundry Local runs models offline.

   NithinOct 192,1201,000
3. Article · AI

   Windows Moves Toward Hybrid AI With Local Models and Cloud Routing

   Learn how Windows hybrid AI combines local models and cloud inference through intelligent routing, with practical considerations for Windows ML, NPUs, and .NET applications.

   Bhavya SinghOct 82,7931,000
4. 
   Article · Copilot

   GitHub Copilot CLI Can Now Discover Local AI Models

   Learn how GitHub Copilot CLI can discover local AI models and what local inference means for coding-agent privacy, hardware, latency, capability, and operational control.

   Aarav PatelOct 83,2481,000
5. Article · AI

   Benchmarking Local Speech-to-Text with Foundry Local and C#

   Benchmark local speech-to-text with Microsoft Foundry Local and C#, comparing transcription latency, CPU usage, memory consumption, accuracy, and offline performance.

   Riya PatelAug 142,3281,000