Loading

Topic

model routing

11 posts about model routing by 7 contributors.

Know model routing? Share what you know with developers who are learning it.

Write an article Ask a question

+ Follow model routingBe the first to follow this

Articles: 11
Contributors: 7

Everything about model routing

Article · Claude
Claude Haiku 5.5 Is Now Available on Amazon Bedrock
Learn how to use Claude Haiku 5.5 on Amazon Bedrock for fast, high-volume generative AI workloads, model routing, AI agents, and cost-aware inference.
Niharika GuptaOct 82,1441,000
Article · AI Agents
Controlling Costs in Enterprise LLM Systems: A Multi-Agent Architecture with LangGraph
Build a cost-aware enterprise LLM assistant with LangGraph, model routing, Graph RAG, token limits, and usage monitoring.
Tuhin PaulOct 22,2371,000
Article · AI Agents
GitHub HydraFusion: How Multiple AI Models Work Together for Coding
Explains GitHub HydraFusion's multi-model coding approach, including agent orchestration, task routing, repository context, tool use, and validation workflows.
Niharika GuptaOct 12,8071,000
Article · Generative AI
Microsoft Foundry Model Router: Keeping the Same Model Across a Conversation with Session Affinity
Learn how Microsoft Foundry Model Router session affinity keeps related Chat Completions requests on the same eligible model while supporting fallback and routing flexibility.
Saurav KumarSep 164,7301,000
Article · .NET
Benchmarking Semantic Routing vs Failover Routing in microsoft.Extensions.AI
Benchmark semantic routing and failover routing in Microsoft.Extensions.AI to compare model selection, reliability, latency, cost, and AI workload performance.
Nidhi SharmaAug 212,6631,000
Article · .NET
Microsoft.Extensions.AI Routing: Benchmarking Cost, Latency, and Failover
Benchmark Microsoft.Extensions.AI routing for model selection, measuring cost, latency, failover behavior, reliability, and performance across multiple AI providers and models.
Aarav PatelAug 202751,000
Article · .NET
Designing AI Fallback Chains for Provider and Model Failures
Design resilient AI fallback chains for provider outages, model failures, throttling, timeouts, latency spikes, and quality degradation while maintaining reliable .NET application behavior.
Niharika GuptaAug 182,2431,000
Article · LLMs
Benchmarking Model Routing by Cost, Latency, and Answer Quality
Benchmark LLM model-routing strategies by comparing inference cost, response latency, answer quality, reliability, and workload-specific model selection across multiple models.
Riya PatelAug 163271,000
Article · AI Agents
Agentic AI System Design Explained: The Building Blocks Behind Real AI Agents
Unlock the secrets of agentic AI system design: explore building blocks like model routing, tools, memory, orchestration, and production principles for reliable AI agents.
Sagar RaneJul 281,1461,000

Article · AWS

Amazon SageMaker Inference Gateway: How to Reduce LLM Response Latency

Large language models can generate powerful responses, but production inference introduces a different challenge: latency. An application may need to process thousands of requests while maintaining predictable response times. As traffic grows, teams often have multiple models, inference endpoints, w

Niharika GuptaSep 302,5341,000

Article · AWS

Amazon SageMaker Inference Gateway: How to Reduce LLM Response Latency

AI applications often depend on inference APIs to generate predictions, embeddings, summaries, classifications, and large language model responses. As traffic increases, inference latency can become one of the biggest challenges in production. A model may be fast when tested with a few requests, but

Niharika GuptaSep 304,3751,000

model routing · by contributions

Top experts

1

Niharika Gupta5 posts · 14.1k reads 2

Saurav Kumar1 post · 4.7k reads 3

Nidhi Sharma1 post · 2.7k reads 4

Tuhin Paul1 post · 2.2k readsMVP 5

Sagar Rane1 post · 1.1k readsMVP

?Your name goes here.First article: 1,000 SHARP.Join

Members onlyFeatured eBookClaude for AI-Native Builders171 pages · Members download free.Download now

DevSocialUpcoming · 3rd editionAI Agents ConferenceNov 23–27, 2026Live onlineMembers only17days leftRegister

Write about model routing

Publish an article in this category and earn +1,000 SHARP when it is approved.

Write an article

DevSocial PressAI native · 02The Builders SeriesClaude for AI-Native BuildersA beginner's guide for creators and innovators.Mahesh Chand171 pages · Beginner

model routing

Everything about model routing

Claude Haiku 5.5 Is Now Available on Amazon Bedrock

Controlling Costs in Enterprise LLM Systems: A Multi-Agent Architecture with LangGraph

GitHub HydraFusion: How Multiple AI Models Work Together for Coding

Microsoft Foundry Model Router: Keeping the Same Model Across a Conversation with Session Affinity

Benchmarking Semantic Routing vs Failover Routing in microsoft.Extensions.AI

Microsoft.Extensions.AI Routing: Benchmarking Cost, Latency, and Failover

Designing AI Fallback Chains for Provider and Model Failures

Benchmarking Model Routing by Cost, Latency, and Answer Quality

Agentic AI System Design Explained: The Building Blocks Behind Real AI Agents

Amazon SageMaker Inference Gateway: How to Reduce LLM Response Latency

Amazon SageMaker Inference Gateway: How to Reduce LLM Response Latency

Top experts