Best Open Source TypeScript LLM Inference Tools

TypeScript LLM Inference Tools

View 168 business solutions

Browse free open source TypeScript LLM Inference Tools and projects below. Use the toggles on the left to filter open source TypeScript LLM Inference Tools by OS, license, language, programming language, and project status.

  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • Earn up to 16% annual interest with Nexo. Icon
    Earn up to 16% annual interest with Nexo.

    Access competitive interest rates on your digital assets.

    Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
    Get started with Nexo.
  • 1
    Locally Uncensored

    Locally Uncensored

    The all-in-one local AI studio for your desktop

    Locally Uncensored is a free, open-source AI desktop application that combines private chatbot conversations, image generation, video creation, and coding assistance. It enables users to run language models directly on their computers without requiring cloud services, Docker, or command-line configuration. The application supports local AI engines such as Ollama and LM Studio and simplifies model installation through a graphical manager. Users can generate and edit images, create videos, and manage creative workflows through integrated ComfyUI support. Its coding agent can inspect projects, propose changes, and execute tests. Additional capabilities include document analysis, voice conversations, persistent memory, and automated agent tasks. The software prioritizes local processing, user control, and flexible AI experimentation.
    Downloads: 61 This Week
    Last Update:
    See Project
  • 2
    Antseed

    Antseed

    An open market for AI inference. No gatekeepers

    Antseed is a free, open-source peer-to-peer network for discovering, providing, and accessing AI inference services without a centralized gateway. It connects AI service providers with consumers through a distributed hash table and encrypted peer-to-peer communications. Providers can offer services backed by local Ollama models, Anthropic, OpenAI-compatible APIs, or specialized AI workflows. Buyers discover available providers and route requests according to pricing, latency, and reputation scores. A local HTTP proxy exposes OpenAI- and Anthropic-compatible endpoints for existing applications. Its command-line interface supports configuring provider services, routing preferences, and network connections. Modular plugins allow developers to extend supported models and routing behavior. The project includes infrastructure for request metering, provider discovery, and payment coordination.
    Downloads: 6 This Week
    Last Update:
    See Project
  • 3
    BrowserAI

    BrowserAI

    Run local LLMs like llama, deepseek, kokoro etc. inside your browser

    BrowserAI is a cutting-edge platform that allows users to run large language models (LLMs) directly in their web browser without the need for a server. It leverages WebGPU for accelerated performance and supports offline functionality, making it a highly efficient and privacy-conscious solution. The platform provides a developer-friendly SDK with pre-configured popular models, and it allows for seamless switching between MLC and Transformer engines. Additionally, it supports features such as speech recognition, text-to-speech, structured output generation, and Web Worker support for non-blocking UI performance.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 4
    Eko

    Eko

    Build Production-ready Agentic Workflow with Natural Language

    Eko (Eko Keeps Operating) is a JavaScript framework designed for building production-ready agent-based workflows using natural language commands. It allows developers to create automated agents that can handle complex workflows in both computer and browser environments. With a focus on high development efficiency, Eko simplifies the creation of multi-step workflows, enabling users to integrate and automate tasks across platforms. It provides a unified interface for managing agents, offering features such as web resource access and high task complexity handling. Eko is open-source and can be used to execute tasks like browser automation, system operations, and software testing.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 5
    Prem AI

    Prem AI

    Prem provides a unified environment to develop AI applications

    An intuitive desktop application designed to effortlessly deploy and self-host Open-Source AI models without exposing sensitive data to third-party. Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure. Abstracting away all technical complexities for AI deployment and ushering in a new era of privacy-centric AI applications - users can finally retain control and ownership of their models. The AI services expose an HTTP API interface, standardized for their interface type. For example, all models of type Chat expose the OpenAI API for easy of integration of existing tools and AI app ecosystem. Each service we support it's published on the Prem Registry.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 6
    RWKV Runner

    RWKV Runner

    A RWKV management and startup tool, full automation, only 8MB

    RWKV (pronounced as RwaKuv) is an RNN with GPT-level LLM performance, which can also be directly trained like a GPT transformer (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, fast training, saves VRAM, "infinite" ctxlen, and free text embedding. Moreover it's 100% attention-free. Default configs has enabled custom CUDA kernel acceleration, which is much faster and consumes much less VRAM. If you encounter possible compatibility issues, go to the Configs page and turn off Use Custom CUDA kernel to Accelerate.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next