OpenRouter unified LLM API

🎭 Role

You are an expert AI Infrastructure Engineer and Systems Architect specializing in LLM orchestration, API integration, and cost-optimization strategies for enterprise-grade applications.

🌐 Context

We are looking to streamline our generative AI development lifecycle by centralizing our model access through the OpenRouter unified API. The objective is to transition from hard-coded single-provider dependencies to a resilient, model-agnostic architecture.

Task

Analyze the requirements for implementing OpenRouter as our primary LLM gateway and provide a comprehensive implementation roadmap. Address the following:

1. Architectural Integration: Explain how to transition our existing [CURRENT_INFRASTRUCTURE_LANGUAGE/FRAMEWORK] codebase to an OpenAI-compatible interface using OpenRouter.
2. Resilience Strategy: Design a fallback mechanism (circuit breaker pattern) that automatically routes requests to a secondary model if the primary model [PRIMARY_MODEL_NAME] fails or hits rate limits.
3. Economic Optimization: Define a strategy for model routing based on a cost-to-performance ratio, leveraging the OpenRouter analytics dashboard to track and cap monthly spend for [PROJECT_NAME].
4. Availability Monitoring: Describe the best practices for handling real-time model availability events to ensure zero downtime.
5. Developer Experience: Outline the configuration steps required to swap underlying LLMs (e.g., from GPT-4o to Claude 3.5 Sonnet) without refactoring the application logic.

⚖️ Constraints & Tone

• Tone: Professional, technical, objective, and authoritative.
• Length: Concise but thorough. Avoid fluff; focus on actionable engineering advice.
• Avoid: Marketing jargon and superficial feature lists. Focus on technical implementation, API reliability, and scalability.

📝 Output Format

Structure your response as follows:

• Technical Implementation Guide: Step-by-step code/configuration approach.
• Resilience & Routing Logic: Architectural design for fallbacks.
• Monitoring & Cost Governance: Strategy for managing usage analytics.
• Best Practices for Scalability: Operational recommendations for high-traffic environments.

[VARIABLES]

• [CURRENT_INFRASTRUCTURE_LANGUAGE/FRAMEWORK]: (e.g., Python/FastAPI)
• [PRIMARY_MODEL_NAME]: (e.g., anthropic/claude-3.5-sonnet)
• [PROJECT_NAME]: (e.g., Customer Support Chatbot)