by Antoine Lemor · GitHub
🚀 About

High-performance inference API for transformer models trained with LLM Tool. Deploy your classification, generation, and embedding models with automatic resource management, concurrent request handling, and Ollama integration for generative AI.

📊 Text Classification
🤖 Ollama Integration
⚡ GPU Acceleration
🔒 API Key Auth
📦 LLM Tool Ecosystem
Core Package
LLM Tool
Core framework for training transformer models. Fine-tune classification, generation, and embedding models with ease.
Core
infer-client
Python SDK with Rich CLI for interactive classification and batch processing.
Python
inferclientllmtool
R package for data science workflows with DataFrame support.
R
infer-api
FastAPI server with multi-model support and resource monitoring. Contact Antoine Lemor for access.
Private
🤖 Available Models ▸ Show all deployed models
🔒
Deployed models are private
Enter your API key in the Playground below to browse models, resources, and capabilities.
██████   ██████   ██████  ██████  █████  ███    ██  ██████
██   ██ ██    ██ ██      ██      ██   ██ ████   ██ ██    ██
██   ██ ██    ██ ██      ██      ███████ ██ ██  ██ ██    ██
██   ██ ██    ██ ██      ██      ██   ██ ██  ██ ██ ██    ██
██████   ██████   ██████  ██████ ██   ██ ██   ████  ██████
— reinvented by —
██╗     ██╗     ███╗   ███╗    ████████╗ ██████╗  ██████╗ ██╗     
██║     ██║     ████╗ ████║    ╚══██╔══╝██╔═══██╗██╔═══██╗██║     
██║     ██║     ██╔████╔██║       ██║   ██║   ██║██║   ██║██║     
██║     ██║     ██║╚██╔╝██║       ██║   ██║   ██║██║   ██║██║     
███████╗███████╗██║ ╚═╝ ██║       ██║   ╚██████╔╝╚██████╔╝███████╗
╚══════╝╚══════╝╚═╝     ╚═╝       ╚═╝    ╚═════╝  ╚═════╝ ╚══════╝
Open Doccano by LLM Tool
Contact Antoine Lemor for access
🧪 Playground
🔐
Test the LLM Tool inference API
Contact Antoine Lemor to obtain an API key
API Online
Version 2.1.0 • Endpoints: /health, /models, /infer
For an inference token or Doccano access — contact Antoine Lemor
Part of the LLM Tool ecosystem