• Home
  • For You
  • Create
  • Pricing
  • More
Anyken
Pricing
Settings
Language
ThemeAtelier
NSFW Video GeneratorNSFW Image GeneratorPrivacy policyTerms of serviceRefund policy
Anyken
  • Home
  • For You
  • Studio
  • My AI
  • AI Video
  • AI Image
  • Anime / Manga
  • AI Tools
  • Generate
  • Agent
  • Home
  • For You

Create & chat

  • Studio
  • AI Video
  • AI Image
  • Anime / Manga
  • Generate
  • Agent

Public discovery

  • My AI
  • AI Tools
Upgrade for more
    1. Home
    2. ›All AI tools
    3. ›AI models
    4. ›freellmapi

    freellmapi on Anyken

    freellmapi on Anyken: compare the model examples with your intended input and output. Review the capabilities documented below, then use the controls actually offered in the workspace. Available settings and credits are shown before submission.

    Read source
    Anyken editorial illustration
    Publisher identity: Anyken editorial illustration.

    In this freellmapi guide

    freellmapi: Developer Overview

    This section covers the core architecture and value proposition of freellmapi for developers who need to aggregate free-tier LLM capacity without managing multiple provider integrations.

    Aggregated Free-Tier Capacity Behind One Endpoint

    This project collapses 34 free LLM providers and 635 free model endpoints into a single local /v1 API. The combined theoretical free-tier capacity across all supported providers is roughly 7.4 billion tokens per month, though your actual total depends on which accounts you configure. Each provider on its own offers a small quota—a few million tokens a month, a few thousand requests a day—but stacked together they become a meaningful prototyping resource. The router tracks per-key RPM, RPD, TPM, and TPD counters that learn each provider's reported ceilings, so routing always stays under every cap. When a provider returns a 429 or 5xx, the router cools that key down and immediately retries the next model in your fallback chain. Provider keys are encrypted at rest using AES-256-GCM in a local SQLite database and decrypted in memory only for the duration of a request. Your applications never see the upstream keys—they only use a single unified bearer token generated by the dashboard.

    Self-Updating Model Catalog and Routing Strategies

    The router pulls a signed model catalog from freellmapi.co twice a day, applying new models, quota changes, and provider quirk fixes automatically. Free installs receive the monthly snapshot, meaning a model reaches them 30 days after it lands in the live feed; premium routers ($19/year) get same-day updates. The catalog currently tracks 474 model families across 34 providers, including 584 chat endpoints, 41 embeddings endpoints, 7 transcription endpoints, and 3 video endpoints. Six routing strategies are available: Manual, Balanced, Smartest, Fastest, Most Reliable, and Custom. The Balanced strategy (recommended default) weights reliability at 50%, speed at 25%, and intelligence at 25%. The adaptive router uses Thompson Sampling, a bandit method that balances exploiting well-performing routes with exploring alternatives that may now be better. Each response carries an X-Routed-Via header showing which provider and model actually served the request, giving full observability into routing decisions.

    freellmapi: Setup and Integration

    This section explains how to install, configure, and integrate this project with existing tools and coding agents, covering the full setup workflow from installation to API usage.

    Installation and Dashboard Configuration

    This project requires Node.js 20+ and can be installed via Docker, npm, or a desktop app. The one-liner Docker installation runs curl -fsSL https://freellmapi.co/install.sh | bash, which creates ~/this project, generates an encryption key, pulls the image, and starts the container. For manual setup, clone the repository, run npm install, generate an encryption key with openssl rand -hex 32, and start the server with npm run dev. The Web UI is served at http://localhost:3001. On the Keys page, paste your free-tier provider keys from services like Google AI Studio, Groq, Cerebras, and Mistral—each key shows a status dot and last health-check time. The dashboard generates a single unified API key (starting with this project-) that your applications use. On the Models page, drag your preferred models into priority order; that order is the routing priority, with everything below serving as automatic failover. The desktop app runs the entire router and dashboard from your system tray with no password setup required.

    Coding Agent Integration and API Surfaces

    This project exposes multiple API surfaces beyond /v1/chat/completions: /v1/responses for Codex CLI, /v1/completions for editor ghost-text autocomplete, /v1/embeddings, /v1/models, /v1/images/generations, /v1/videos/generations, /v1/audio/speech, /v1/audio/transcriptions, /v1/messages for Anthropic's wire format, and /v1beta for Gemini's native surface. Most coding agents configure themselves with one command: npx this project setup-claude --url http://localhost:3001 --api-key <unified-key> for Claude Code, with similar generators for Codex CLI, Cline, Continue, Aider, OpenCode, Goose, Qwen Code, Roo Code, and others. Each generator supports --dry-run and backs up existing config before making changes. For Python, the OpenAI SDK works with a one-line change: client = OpenAI(base_url="http://localhost:3001/v1", api_key="your-freellmapi-unified-key"). The model parameter accepts "auto" for router selection, "auto:fast" or "auto:smart" for bias, named profiles, explicit model IDs, or "fusion" for multi-model synthesis.

    freellmapi: Availability

    This section covers the current availability of this project across platforms, the free versus premium model, and the project's licensing and support status.

    Platform Support and Installation Methods

    This project runs on any system with Node.js 20+—Windows, macOS, Linux servers, and ARM SBCs including Raspberry Pi, with approximately 40 MB RSS at idle. The desktop app provides native tray-based operation for macOS (arm64 and x64, macOS 12 Monterey or later) and Windows (.exe installer), available from GitHub Releases. Docker deployment is recommended for server setups, with the official image at ghcr.io/tashfeenahmed/this project:latest. Android support via Termux is documented as experimental. The dashboard ships in 60 languages with auto-detection of browser/system language, right-to-left layout support for Arabic, Hebrew, Persian, and Urdu, and lazy loading of only the active language's dictionary. The router is local-first and single-user by design—provider keys stay in your SQLite database, encrypted at rest, and requests go from your machine directly to upstream providers.

    Free vs Premium: What You Get

    The project router itself is MIT-licensed and completely free forever—no account required, no feature gating. All routing, failover, rate tracking, dashboard, analytics, playground, and API surfaces work without payment. The inference is free because you bring your own free-tier provider keys; this project never resells tokens and never sees your prompts on a remote server. The only paid component is the live model catalog feed at $19/year or $49 once for lifetime access. Free installs receive the same signed catalog but from a monthly snapshot—a new model reaches free builds about 30 days after it hits the live feed (currently roughly 303 models behind). Nothing expires or gets crippled on free installs; updates just arrive later. One premium key covers every router you run (desktop, homelab, Raspberry Pi). The catalog server never sees your prompts, completions, or provider keys—the router stays fully self-hosted either way.

    freellmapi: Configurations

    This section details the routing strategies, model management, and advanced configuration options available in this project for optimizing request handling.

    Routing Strategies and Fallback Chains

    This project offers six routing strategies: Manual (fixed priority), Balanced (50% reliability, 25% speed, 25% intelligence), Smartest (highest intelligence score), Fastest (lowest latency), Most Reliable (highest uptime), and Custom (user-defined weighting). The router uses live per-model speed, capability, and reliability scores to rank your chain. When a provider returns a 429 or 5xx, the router puts that key on cooldown and retries the next model in your chain. Sticky sessions keep a conversation on one model for 30 minutes to maintain coherence; an optional compact handoff note keeps the thread coherent when a mid-chat switch does happen. Unified model entries collapse the same model available on several providers into one entry with strict in-group failover. Named fallback-chain profiles (e.g., a coding chain, a vision chain) can be switched from the dashboard or per request via auto:<profile>. The adaptive router uses Thompson Sampling to balance exploiting well-performing routes with exploring alternatives that may now perform better.

    Advanced Features: Fusion, Prompt Compression, and MCP

    Fusion mode fans a prompt out to a panel of diverse free models in parallel, then a judge model synthesizes one answer from the drafts—useful for comparison but consumes multiple quotas per request. Opt-in prompt compression can deduplicate prompts, filter tool output, compact repeated JSON, and trim stale context before cache lookup and routing. The router doubles as an MCP server, allowing ChatGPT and other MCP clients to call inference, list usable models, inspect provider health, usage, cache, and routing metadata, and manage the routing strategy over /mcp. A dependency-free OpenAPI viewer lives at /v1/docs. Additional operational features include an opt-in response cache, encrypted database backups, periodic key health checks, bulk key import/export, and declarative startup configuration. The router also supports custom providers—point chat, embedding, image, or audio models at any OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, local Ollama, or remote gateway) from the Keys page.

    freellmapi: Practical Notes

    This section covers important practical considerations, limitations, and security practices for using this project effectively in development workflows.

    Limitations and Production Boundaries

    This project is explicitly designed for personal experimentation and learning, not production workloads. Key limitations include: no frontier models, variable latency, no SLA, and effective intelligence dips late in the day as top models hit their daily caps (resetting at UTC midnight). Stacking free tiers has real trade-offs—requests may be routed to providers with different speeds, and failover can switch you to a less capable model. The project does not generate extra quota; it combines the free allowances you already have. The roughly 7.4 billion tokens per month figure assumes accounts with all 34 providers, so most users will have a smaller total. Your relationship with each upstream provider is governed by the terms you accepted when creating your account—those terms still apply when traffic is proxied through this project. Before building anything real on this project, swap in a paid API. The project's documentation includes a provider-by-provider terms-of-service review from May 2026.

    Security Best Practices and Key Management

    Provider keys are encrypted at rest using AES-256-GCM in SQLite and decrypted in memory only per request. The ENCRYPTION_KEY must be generated during installation, kept out of repositories, and preserved alongside the volume when upgrading—if lost, encrypted credentials may become unrecoverable. Never commit .env, the unified key, or upstream keys to version control. Use environment variables or a secrets manager. The unified key should have the smallest practical scope and must never appear in frontend code, screenshots, or shared configuration. Bind the gateway to localhost (127.0.0.1) unless remote access is explicitly secured with HTTPS, authentication, and firewall rules. Create separate, least-privilege provider keys where supported. Back up the encrypted database and its key material, then test recovery. Set spend limits even when the expected route is free. Record fallbacks so data never silently crosses an unapproved provider. For remote access, use a private network, tunnel, or reverse proxy with HTTPS—never expose the dashboard directly to the internet.

    freellmapi: FAQ

    Frequently asked questions about this project setup, usage, and limitations.

    What should I know about freellmapi?

    freellmapi is an MIT-licensed, local-first router that aggregates free-tier API keys from 34 LLM providers into a single OpenAI-compatible /v1 endpoint. It handles automatic failover, per-key rate tracking, and encrypted credential storage. The router is free and self-hosted—you bring your own provider keys. A premium tier ($19/year) provides same-day model catalog updates instead of the 30-day delay on free installs. The project is designed for personal experimentation, not production use. Key features include six routing strategies, self-updating model catalog, support for chat, embeddings, images, audio, video, and Anthropic-compatible surfaces, plus integration with coding agents like Claude Code, Codex CLI, and Cline. Provider keys are encrypted at rest with AES-256-GCM. The combined theoretical free-tier capacity across all supported providers is roughly 7.4 billion tokens per month, though actual totals depend on your configured accounts.

    Original sources

    • GitHub - tashfeenahmed/freellmapi: 7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only. · GitHub
    • FreeLLMAPI: One Endpoint for 28 Free LLM Providers | Better Stack Community
    • FreeLLMAPI: One OpenAI-Compatible Endpoint for 34 Free LLM Providers - DEV Community
    • FreeLLMAPI download | SourceForge.net
    • Build a Free AI API with FreeLLMAPI: Cloud Models and Fallbacks
    • FreeLLMAPI: Free AI Access for Coding Agents and Media

    Related reading

    AI Tools DirectoryText-to-Image GenerationImage-to-Video Generation

    Read the sources for freellmapi

    Anyken
    ContactPrivacyTermsRefund

    Anyken | AI Video & Image Generator

    support@anyken.com

    Contact Anyken at support@anyken.com with the page URL and a description of your question. Model names and trademarks belong to their owners.

    © 2026 Anyken. All rights reserved. ACKERMAN TECH SOLUTIONS LLC

    Creative tools & scenesAI models
    • grok imagine video 1.5
    • Nano Banana 2.1
    • unlucid.ai alternatives