Loading
Topic
local LLM
10 posts about local LLM by 7 contributors.
Know local LLM? Share what you know with developers who are learning it.
+ Follow local LLMBe the first to follow this
- Articles
- 10
- Contributors
- 7
Articles about local LLM
- Article · LLMs
How to Run a Local AI Model on Windows with Windows ML and llama.cpp
Learn how to run a GGUF language model locally on Windows with llama.cpp and call its OpenAI-style HTTP API from a C# application.
- Article · NVIDIA
Benchmarking Local LLM Inference with Quantized Models on Windows
Benchmark local LLM inference on Windows using quantized models and compare CPU, GPU, and NPU performance, memory usage, latency, throughput, and model efficiency.
- Article · NVIDIA
Measuring Local AI Latency Across CPU, GPU, and NPU Hardware
Measure local AI inference performance across CPU, GPU, and NPU hardware to compare latency, throughput, power efficiency, and hardware acceleration capabilities.
- Article · LLMs
How to Build an AI Coding Assistant with ASP.NET Core and Local LLMs
Build an AI coding assistant with ASP.NET Core and local LLMs for enhanced privacy, security, and cost control in your development workflow.
- Article · LLMs
Implementing Local LLM Inference in .NET Applications Using ONNX Runtime
Unlock local LLM inference in .NET with ONNX Runtime for faster, private, and cost-effective AI applications. Learn integration & best practices.
- Article · AI
How to Use Ollama to Run Large Language Models Locally on Your System
Run LLMs locally with Ollama! This guide simplifies installation, model usage, and integration for private, cost-effective AI development. Build chatbots and more!
- Article · Langchain
How to Create AI Chatbot with Memory Using LangChain and Local Database
Build an AI chatbot with memory using LangChain, local LLMs, and databases. Create personalized, private, and cost-effective AI solutions locally. Learn how!
- Article · Langchain
Integrating Ollama with LangChain: Building Fully Local LLM Applications
Build fully local LLM applications with Ollama and LangChain! This guide covers setup, text generation, chat models, agents, and model customization for private, cost-free AI.
- Article · LLMs
Lemonade SDK: The Lightweight, Open-Source Local LLM Server for Developers
Explore Lemonade SDK — an open-source, developer-first local LLM server. Learn its architecture, compare Lemonade vs Ollama, LM Studio, and LocalAI, and discover how to deploy and optimize local AI inference
- Article · LLMs
Ollama API: A Complete Guide to Local AI with Generate, Embeddings & Model Management
This article provides a complete walkthrough of using Ollama to run LLMs like LLaMA and Mistral on your machine. Learn to generate text, create embeddings, manage models, and build private AI applications without cloud dependencies. Explore key endpoints like /api/generate, /api/embeddings, and more for total control.
