# Which AI Tool Fits Your Workflow and Data Boundary?
Canonical source: [https://isaiuseful.com/tools](https://isaiuseful.com/tools)
A replaceable stack, not a shopping list
Search practical local, hosted and agent tools by what they do, where they run, how they are licensed and the caveat most likely to change your decision—including whether a phone can be the controller.
- [Search the catalogue](#catalog)
- [Use the selection test](#how-to-choose)
- [Start with a workflow](https://isaiuseful.com/guides.html.md)
**179**
searchable entries
PRIMARY LINKS + CAVEATS
**22**
practical topics
JOB BEFORE BRAND
**0**
automatic endorsements
VERIFY THE EXACT VERSION
Vetted tool catalogue
## How do you choose the right AI tool?
These are replaceable examples, not endorsements or a required stack. Each entry names the practical fit and the caveat that most changes the decision.
**Control surface**
The browser, native app or messaging client you actually use from the phone.
**Gateway**
Authenticates the person and device, owns sessions, constrains tools and routes requests.
**Backend**
Loads the model or provides retrieval and automation. It is not a mobile interface by itself.
**Execution location**
Keep phone, home and cloud visible separately; “local model” does not describe the transport.
**Pocket-control rule:** expose the authenticated interface or gateway through a private route—not a raw inference, vector-database or agent-control port. Search **phone** or **mobile** below for current entries that describe a direct control path.
Search names, jobs, platforms, licenses and caveats. Search combines with the topic filter below.
**Filter by topic**
### Run models locally
heterogeneous LLM inference + SFT
### KTransformers
An Apache-2.0 research framework for running and fine-tuning large mixture-of-experts models across CPU and GPU memory. Its current path exposes hardware-specific kernels and LLaMA-Factory integration; follow the exact model and instruction-set tutorial, and treat project throughput figures as configuration-specific rather than a desktop promise.
CPU + GPU
MoE models
Research project
- [KTransformers repository →](https://github.com/kvcache-ai/ktransformers)
- [CUDA libraries reference →](https://docs.nvidia.com/cuda-libraries/index.html)
runtime + interface
### Ollama + Open WebUI
A straightforward local API and browser interface for trying multiple models. **Mobile role:** open the authenticated WebUI from the phone over a private route while Ollama and the model stay on the host. Audit exposed network interfaces, user access and any cloud fallback. Current Open WebUI releases use a branding-restricted license that is not OSI-approved; call it self-hostable, not strict OSS.
Phone browser
Home inference
License caveat
- [Ollama API →](https://docs.ollama.com/api)
- [Open WebUI →](https://docs.openwebui.com/)
- [License explanation →](https://docs.openwebui.com/license/)
self-hosted team interface
### LibreChat
A multi-user web interface for local and hosted models, custom OpenAI-compatible endpoints, agents, files and MCP tools. It fits in front of vLLM or several providers; treat authentication, MCP credentials and code execution as production services rather than desktop conveniences.
Self-hosted
Multi-provider
Agents + MCP
- [Documentation →](https://www.librechat.ai/docs)
- [Compatibility matrix →](https://www.librechat.ai/docs/compatibility)
power-user local LLM frontend
### SillyTavern
An AGPL-3.0, locally installed interface for switching among local and hosted text models, image generators and speech engines, with detailed prompt, character, lorebook and extension controls. It is deliberately flexible rather than beginner-simple. Keep it on a trusted network: the project warns against exposing the server directly, stores multi-user data and API keys in plain text on the server, and gives UI extensions broad access while server plugins are unsandboxed.
Local interface
Many backends
Extensions need trust
- [SillyTavern repository →](https://github.com/SillyTavern/SillyTavern)
- [Documentation →](https://docs.sillytavern.app/)
- [Plugin security boundary →](https://docs.sillytavern.app/for-contributors/server-plugins/)
runtime
### llama.cpp
A portable, low-level local inference foundation with broad quantization and hardware support. Best when you want control and can own the configuration.
Local
Technical
Portable
- [Project repository →](https://github.com/ggml-org/llama.cpp)
desktop
### LM Studio
A desktop route for downloading, comparing and serving local models without assembling a full command-line stack. **Mobile role:** backend only—enable API-token authentication, keep the server private and put a phone-friendly interface or gateway in front.
Home backend
API token available
Private route
- [Official site →](https://lmstudio.ai/)
- [API authentication →](https://lmstudio.ai/docs/developer/core/authentication)
GPU serving
### vLLM
A high-throughput, OpenAI-compatible serving engine for shared GPU inference. **Mobile role:** remote-ready backend, not the public phone endpoint; keep it behind a private network and authenticated gateway. Use it when concurrency and batching matter; for DGX Spark follow NVIDIA's ARM64/Blackwell recipe and current model matrix instead of generic x86 installation instructions.
Home/server backend
OpenAI-compatible API
Gateway required
- [vLLM docs →](https://docs.vllm.ai/en/stable/)
- [Spark recipe →](https://build.nvidia.com/spark/vllm/instructions)
distributed inference + RL rollouts
### SGLang
An Apache-2.0 serving framework for language and multimodal models, from one GPU to distributed clusters. Its runtime covers prefix caching, continuous batching, prefill-decode disaggregation, speculative decoding, structured outputs and multiple parallelism strategies, with integrations for reinforcement-learning rollout generation. Treat project performance claims as configuration-specific: pin the model, engine, kernels, hardware and traffic shape, then measure latency, throughput, correctness and recovery on your workload.
GPU service
Distributed
RL integration
- [SGLang documentation →](https://docs.sglang.io/)
- [Repository and Apache-2.0 source →](https://github.com/sgl-project/sglang)
- [Benchmarking guide →](https://docs.sglang.io/docs/developer_guide/bench_serving)
agentic GPU serving
### TokenSpeed
An MIT-licensed, OpenAI-compatible inference engine from the LightSeek Foundation, built around a compiler-backed model layer, C++ scheduler and pluggable kernels for agentic and large-MoE workloads. Current recipes cover Kimi K3, DeepSeek V4, GLM‑5.2, GPT‑OSS and other model families across selected NVIDIA and AMD systems. This is an operator-grade, fast-moving stack—not a generic desktop runtime: pin the checkpoint, container, kernel bundle and topology, then validate correctness, context capacity and throughput together.
GPU service
NVIDIA + AMD recipes
Fast-moving
- [TokenSpeed documentation →](https://lightseek.org/tokenspeed/)
- [Repository and MIT-licensed source →](https://github.com/lightseekorg/tokenspeed)
- [Model and hardware recipes →](https://lightseek.org/tokenspeed/recipes/models)
multi-model inference server + cluster
### Superlinked SIE
An Apache-2.0 self-hosted server and Kubernetes stack that puts embedding, reranking, document conversion, structured output, content screening and text generation behind one OpenAI-compatible API. It loads models on demand through task-specific CPU and NVIDIA bundles, with a local Apple-silicon route. Pin the model weights and container or chart version, validate each model’s licence and hardware fit, and account for first-call downloads and opt-out usage telemetry before production.
Apache-2.0
Local + Kubernetes
Many model tasks
- [SIE repository →](https://github.com/superlinked/sie)
- [SIE documentation →](https://superlinked.com/docs/)
model gateway
### LiteLLM Proxy
A central OpenAI-compatible gateway for multiple local and hosted endpoints, with authentication hooks, budgets, rate limits and spend tracking. **Mobile role:** it can keep one endpoint stable while a phone session routes between home and cloud models, but a public app still needs end-user identity and session handling in front. It becomes a security boundary: keep it patched, authenticated and private.
Hybrid routing
Budgets
Shared service
- [Official documentation →](https://docs.litellm.ai/)
European models + API
### Mistral
Use Vibe for an end-user assistant, Studio/API for applications, or supported open-weight models through a local runtime. Availability and licenses differ by model; “Mistral” is not one deployment or one data boundary.
Hosted + local
Open-weight options
EU company
- [Compare Mistral routes →](https://isaiuseful.com/guides.html.md#europe)
on-device app runtime + SDK
### Foundry Local
Microsoft's GA runtime embeds curated ONNX Runtime-optimized chat and speech models into Windows, Apple-silicon macOS and Linux applications. C#, JavaScript, Python and Rust SDKs manage model download, hardware-specific variants and in-process inference; an optional OpenAI-compatible server supports local integrations. It needs no Azure subscription or API key, and it is designed for single-user on-device apps—not hosted Microsoft Foundry or multi-user serving like vLLM. The SDK is MIT-licensed, the CLI uses Microsoft terms and each model keeps its own license.
On-device
C# + JS + Python + Rust
Curated models
- [Foundry Local documentation →](https://learn.microsoft.com/en-us/azure/foundry-local/get-started)
- [SDK, samples and licenses →](https://github.com/microsoft/Foundry-Local)
OpenAI-compatible extension service
### Open WebUI Pipelines
Run Python filters, provider adapters and compute-heavy pre/post-processing behind an OpenAI-compatible endpoint. The project itself recommends built-in Functions for simple filters. Pipelines execute arbitrary code and are neither a durable scheduler nor a permission boundary.
Python
Filters + adapters
Not orchestration
- [Pipelines repository →](https://github.com/open-webui/pipelines)
multi-provider LLM CLI + Python
### LLM CLI
Simon Willison's Apache-2.0 command-line tool and Python library can call hosted, OpenAI-compatible and locally installed models, extract structured data, create embeddings and invoke tools through plugins. It logs prompts and responses to a local SQLite database by default; turn logging off or set retention and access controls before processing sensitive material. Plugins are executable Python packages, so pin and review them rather than treating the directory as a trust list.
Apache-2.0
Hosted + local models
Local history by default
- [LLM documentation →](https://llm.datasette.io/en/stable/)
- [Source and releases →](https://github.com/simonw/llm)
- [Logging controls →](https://llm.datasette.io/en/stable/setup.html#turning-sqlite-logging-on-and-off)
### Operate AI infrastructure
NVIDIA application development
### NVIDIA NIM + NeMo Framework + RAPIDS
NIM packages supported model-serving APIs, NeMo supplies model-development and customization workflows, and RAPIDS accelerates GPU data science. They are complementary products rather than one required bundle; confirm the supported model, container, hardware and commercial entitlement for the exact deployment.
Model APIs
Development
GPU analytics
- [NIM →](https://docs.nvidia.com/nim/)
- [NeMo Framework →](https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html)
- [RAPIDS →](https://docs.rapids.ai/)
NVIDIA inference serving
### TensorRT-LLM + Triton Inference Server + NVIDIA Dynamo
TensorRT-LLM optimizes supported large-model inference, Triton exposes production model-server endpoints and Dynamo coordinates distributed inference. Select only the components the service needs, then pin the model, kernels, driver, container and topology used in acceptance testing.
Optimization
Serving
Distributed inference
- [TensorRT-LLM →](https://nvidia.github.io/TensorRT-LLM/)
- [Triton →](https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/)
- [Dynamo →](https://docs.nvidia.com/dynamo/)
commercial GPU operations
### NVIDIA Run:ai + Mission Control + Base Command Manager
Run:ai schedules and governs shared GPU workloads, Mission Control manages supported AI-factory configurations, and Base Command Manager provisions and operates clusters. Licensing, platform support and control-plane requirements differ; verify the exact product release and order rather than assuming hardware includes them.
Scheduling
Fleet operations
Entitlement-sensitive
- [Run:ai →](https://docs.nvidia.com/run-ai/index.html)
- [Mission Control →](https://docs.nvidia.com/nvidia-mission-control/)
- [Base Command Manager →](https://docs.nvidia.com/base-command-manager/index.html)
free NVIDIA development components
### NVIDIA Omniverse + AI Workbench
As of May 2026, Omniverse is free for development, production and redistribution without NVIDIA AI Enterprise; free use has community support, while enterprise support needs the applicable subscription. NVIDIA AI Workbench is also free for development workflows. Neither is a free-forever entitlement to the complete supported NVIDIA AI Enterprise production suite.
Development
Community support
Not the full suite
- [Omniverse license and support route →](https://docs.omniverse.nvidia.com/dev-guide/latest/common/NVIDIA_Omniverse_License_Agreement.html)
- [AI Workbench introduction →](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)
NVIDIA fabric operations
### NVIDIA UFM + NetQ
UFM manages supported InfiniBand fabrics while NetQ observes and troubleshoots supported Ethernet and network environments. They cover different fabrics and support matrices; confirm topology, device software, licensing and telemetry retention before choosing either.
InfiniBand
Network telemetry
Support matrix
- [UFM →](https://networking-docs.nvidia.com/ufmenterpriseum/6221)
- [NetQ →](https://docs.nvidia.com/networking-ethernet-software/cumulus-netq/)
NVIDIA system foundation
### DGX OS + DCGM + CUDA + NVIDIA Container Toolkit
DGX OS supplies the supported system baseline, DCGM exposes GPU health and telemetry, CUDA provides the GPU programming platform, and Container Toolkit gives containers controlled GPU access. Pin their compatibility chain; installing these components does not by itself prove an NVIDIA AI Enterprise entitlement.
System software
GPU telemetry
Containers
- [DGX OS →](https://docs.nvidia.com/dgx/dgx-os-7-user-guide/)
- [DCGM →](https://docs.nvidia.com/datacenter/dcgm/latest/index.html)
- [CUDA →](https://docs.nvidia.com/cuda/)
- [Container Toolkit →](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/)
open workload control
### Kubernetes + Kueue + Volcano + Slurm
Kubernetes is the container-orchestration baseline, Kueue adds quota-aware batch admission, Volcano adds Kubernetes batch scheduling, and Slurm supplies an established HPC workload manager. Choose one primary queue and scheduling authority; overlapping control loops make priority, recovery and capacity ownership harder to reason about.
GPU scheduling
Batch queues
Operator-owned
- [Kubernetes →](https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/)
- [Kueue →](https://kueue.sigs.k8s.io/docs/)
- [Volcano →](https://volcano.sh/docs/home/introduction/)
- [Slurm →](https://slurm.schedmd.com/gres.html)
training + model lifecycle
### PyTorch + Transformers + PEFT + TRL + MLflow
PyTorch supplies the training framework; Transformers provides model implementations; PEFT supplies parameter-efficient adapters; TRL provides supervised and preference-training loops; and MLflow records runs and artifacts. Pin the model, dataset, evaluation and environment together: this is a composable lifecycle stack, not a pre-integrated production platform.
Training
Adapters + preference
Experiment evidence
- [PyTorch →](https://pytorch.org/docs/stable/index.html)
- [Transformers →](https://huggingface.co/docs/transformers/index)
- [PEFT →](https://huggingface.co/docs/peft/index)
- [TRL →](https://huggingface.co/docs/trl/index)
- [MLflow →](https://mlflow.org/docs/latest/)
GPU enablement + AI scheduling
### NVIDIA GPU Operator + KAI Scheduler
NVIDIA GPU Operator manages the Kubernetes software components needed to run NVIDIA GPUs; KAI Scheduler adds AI-oriented scheduling, including gang scheduling, to the workload-control layer. They do not replace a clear queue owner, compatibility testing or the hardware-vendor support boundary.
Kubernetes GPUs
Gang scheduling
Operator-owned
- [NVIDIA GPU Operator →](https://docs.nvidia.com/gpu-operator/latest/)
- [KAI Scheduler →](https://github.com/kai-scheduler/KAI-Scheduler)
delivery + artifact supply chain
### Argo Workflows + Harbor
Argo Workflows runs Kubernetes-native DAG and step workflows; Harbor provides a private artifact registry. Pair them only with explicit access, signing, retention and promotion rules—an image in a registry is not a safe or approved deployment by itself.
Workflow automation
Private registry
Policy required
- [Argo Workflows →](https://argoproj.github.io/argo-workflows/)
- [Harbor →](https://goharbor.io/docs/)
bare-metal lifecycle + configuration
### MAAS + Foreman + Ansible
MAAS and Foreman are alternative routes for provisioning and host lifecycle management; Ansible applies repeatable configuration and operational automation. None removes the need for tested backups, firmware coordination, break-glass access and a documented rebuild path.
Bare metal
Configuration
Recovery ownership
- [MAAS →](https://maas.io/docs)
- [Foreman →](https://docs.theforeman.org/)
- [Ansible →](https://docs.ansible.com/)
storage + network policy + secrets
### Ceph + MinIO + Cilium + Vault
Ceph supplies distributed object, block and file storage; MinIO's current vendor route is AIStor while the former community repository is archived; Cilium provides eBPF networking and policy; and Vault manages secrets under HashiCorp's current terms. Treat this as four separately operated services, not a pre-integrated platform.
Storage
Network policy
Secrets
- [Ceph →](https://docs.ceph.com/en/latest/)
- [MinIO / AIStor →](https://docs.min.io/aistor/)
- [Cilium →](https://docs.cilium.io/en/stable/)
- [Vault →](https://developer.hashicorp.com/vault/docs)
hardware and vendor boundary
### Redfish + NVIDIA Driver + NCCL + platform firmware
Redfish standardizes server-management APIs, the NVIDIA driver connects the operating system to the accelerator, NCCL coordinates collective communication and platform firmware remains OEM-specific. CUDA is catalogued with the NVIDIA system foundation above. Validate the whole compatibility chain and support route before an upgrade.
Hardware API
GPU runtime
OEM boundary
- [Redfish →](https://www.dmtf.org/standards/redfish)
- [NVIDIA Driver →](https://docs.nvidia.com/datacenter/tesla/driver-installation-guide/)
- [NCCL →](https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/)
- [Platform firmware example →](https://docs.nvidia.com/dgx/dgxb300-fw-update-guide/)
### Choose model and embedding services
hosted models + embeddings
### Cohere + Cohere Embed
Cohere provides hosted chat, embedding and reranking APIs. Treat each endpoint as a separate design choice: record the model version, input type and data boundary, and evaluate retrieval with your own corpus before committing to an index.
Hosted API
Embed + rerank
Version explicitly
- [Cohere documentation →](https://docs.cohere.com/)
- [Cohere Embed →](https://docs.cohere.com/docs/embeddings)
open-weight local embeddings
### Nomic Embed + Sentence Transformers
Nomic Embed v2 is an Apache-2.0 multilingual embedding model that runs locally through Sentence Transformers or Transformers. Benchmark retrieval on your own languages, use the required query and document prefixes, and pin the model revision and output dimension—changing either means re-embedding the corpus.
Local weights
Multilingual retrieval
Pin the index contract
- [Nomic Embed v2 model card →](https://huggingface.co/nomic-ai/nomic-embed-text-v2-moe)
- [Sentence Transformers →](https://sbert.net/)
community model + provider metadata
### Models.dev
An MIT-licensed, community-maintained catalogue and JSON API for model identifiers, provider routes, context limits, capabilities and prices, with a type-safe SDK and offline snapshot. Use it to seed selectors, routing tests and cost comparisons—not as the final procurement source. Pin a snapshot and reconcile consequential limits, regional availability, terms and prices with each provider's current documentation.
MIT
JSON API + SDK
Verify with providers
- [Browse Models.dev →](https://models.dev/)
- [Data source and licence →](https://github.com/anomalyco/models.dev)
### Build speech and calling
open speech models
### Microsoft VibeVoice
An MIT-licensed codebase for long-form speech recognition and text to speech. The project publishes an ASR model with speaker, timestamp and transcript structure plus a real-time TTS model; model weights keep their own terms. Test language, diarization and timestamp accuracy on your audio, and require consent for cloned or synthetic voices.
ASR + TTS
Local models
Consent required
- [VibeVoice repository →](https://github.com/microsoft/VibeVoice)
local voice studio
### Voicebox
An MIT-licensed desktop stack for voice cloning, speech generation, dictation and MCP voice output across several model engines. It can keep captures and models local, but GPU support, weight licenses and quality vary by engine. Clone only voices you own or have permission to use, and keep disclosure and anti-impersonation controls around generated audio.
Local-first
STT + TTS
Voice cloning
- [Voicebox repository →](https://github.com/jamiepine/voicebox)
- [Responsible-use policy →](https://github.com/jamiepine/voicebox/blob/main/RESPONSIBLE_USE.md)
open-source desktop dictation
### OpenFlow
A free MIT-licensed voice-to-text app for macOS and Windows that can type into the active application. Speech recognition and optional AI cleanup can each run locally, through a self-hosted endpoint or through a remote provider, so confirm both settings before calling a workflow private. Current downloads are unsigned and trigger an operating-system warning; verify the release or build from source rather than treating the bypass as routine.
Local-first
macOS + Windows
Unsigned builds
- [OpenFlow →](https://openflow.computer)
- [Source and license →](https://github.com/avijeett007/openflow)
desktop + mobile AI dictation
### Superwhisper
A proprietary dictation app for macOS, Windows and iOS with custom vocabulary, task-specific modes, file transcription and meeting notes. It offers local and cloud speech and language models and can work offline, but privacy and connectivity depend on the models and mode you select; the vendor notes that offline models perform best on Apple-silicon Macs.
Local + cloud
Desktop + iOS
Free + paid tiers
- [Superwhisper →](https://superwhisper.com)
- [Product documentation →](https://superwhisper.com/docs/get-started/introduction)
OSS PBX + direct SIP
### Asterisk + FreeSWITCH
Connect a local operator's SIP trunk to an open-source PBX, then control outbound calls, DTMF, media and hangup events through Asterisk ARI or FreeSWITCH ESL. The carrier, number rights, emergency restrictions and call rates remain contractual services.
Self-operated
SIP/RTP
Call control
- [Asterisk →](https://github.com/asterisk/asterisk)
- [ARI →](https://docs.asterisk.org/Configuration/Interfaces/Asterisk-REST-Interface-ARI/)
- [FreeSWITCH ESL →](https://developer.signalwire.com/freeswitch/integration/event-socket/)
local STT + TTS service
### Speaches
An MIT-licensed, OpenAI-compatible server for streaming transcription, translation and speech generation. It combines faster-whisper for STT with Kokoro or Piper-family TTS paths and supports CPU or GPU deployment.
MIT
OpenAI-compatible
Streaming
- [Speaches →](https://github.com/speaches-ai/speaches)
- [faster-whisper →](https://github.com/SYSTRAN/faster-whisper)
- [whisper.cpp →](https://github.com/ggml-org/whisper.cpp)
local text to speech
### Kokoro-FastAPI + openedai-speech
Kokoro-FastAPI is the active Apache-licensed, OpenAI-compatible TTS wrapper to test first. openedai-speech remains a useful AGPL reference for Piper/XTTS and voice mapping, but its maintainer archived it in January 2026 and calls it mostly obsolete.
Local voices
OpenAI speech API
Archive noted
- [Kokoro-FastAPI →](https://github.com/remsky/Kokoro-FastAPI)
- [openedai-speech archive →](https://github.com/matatonic/openedai-speech)
real-time voice pipeline
### Pipecat + LiveKit Agents
Open-source frameworks for streaming transports, VAD, interruptions, STT, LLM and TTS stages. Use them for the media conversation loop; keep appointment locks and business state in PostgreSQL and a durable workflow engine.
Real-time media
Pluggable speech
Barge-in
- [Pipecat →](https://github.com/pipecat-ai/pipecat)
- [LiveKit Agents →](https://github.com/livekit/agents)
### Work with documents and media
research OCR model
### DeepSeek-OCR
A research release for turning document images into compact textual context through vLLM or Transformers. The repository is MIT-licensed and its reference environment pins CUDA 11.8, PyTorch 2.6 and FlashAttention. Treat “optical compression” as a model technique—not lossless storage—and measure transcription, reading order, tables and hallucinations against page images.
OCR
GPU-oriented
Verify against source
- [DeepSeek-OCR repository →](https://github.com/deepseek-ai/DeepSeek-OCR)
- [CUDA libraries reference →](https://docs.nvidia.com/cuda-libraries/index.html)
agent-native Office file CLI
### OfficeCLI
An Apache-2.0 command-line tool for agents to read and edit Word, Excel and PowerPoint files without an Office installation. It offers a local preview and single-binary releases. Work on copies, render the result and compare formulas, charts, fonts and pagination in a real Office-compatible viewer; ZIP-format access does not guarantee perfect application fidelity.
DOCX + XLSX + PPTX
No Office install
Render and verify
- [OfficeCLI repository →](https://github.com/iOfficeAI/OfficeCLI)
local generative-media workflows + image repair
### ComfyUI + IOPaint
ComfyUI is a GPL-3.0 node-graph engine for repeatable local image, video, audio and 3D workflows; IOPaint is an Apache-2.0, self-hosted route for erasing, replacing and extending images on CPU, GPU or Apple silicon. Model weights and outputs keep their own licences. Pin stable releases and known workflows, keep ComfyUI's optional API nodes disabled for a fully offline path, and treat third-party models and custom nodes as untrusted code and artifacts.
Local + self-hosted
Visual workflows
Audit nodes + weights
- [ComfyUI documentation →](https://docs.comfy.org/)
- [ComfyUI source and releases →](https://github.com/Comfy-Org/ComfyUI)
- [IOPaint source →](https://github.com/Sanster/IOPaint)
local video creation
### FramePack Studio
An Apache-2.0 local application based on FramePack for image-to-video and text-to-video work, with queueing, prompt timelines and blending, LoRA, upscale and post-processing paths. It requires a CUDA-compatible GPU: 8 GB VRAM is the stated minimum, while 16 GB or more and 80 GB or more of storage are recommended.
Local video
CUDA GPU
8 GB VRAM minimum
- [FramePack Studio source →](https://github.com/FP-Studio/framepack-studio)
- [FramePack Studio documentation →](https://docs.framepackstudio.com/)
local media studio
### Amuse
A local Windows studio for image, video, audio and text pipelines plus editing, upscale and interpolation. Its current reference route uses CUDA 13 and recommends RTX hardware. The software licence is personal and non-commercial; commercial use needs a separate licence, and model weights keep their own terms.
Windows
CUDA 13 + RTX
Commercial licence needed
- [AmuseAI source →](https://github.com/saddam213/AmuseAI)
- [Amuse licence →](https://github.com/saddam213/AmuseAI/blob/master/LICENSE)
local AI-app launcher
### Pinokio
An MIT-licensed local launcher and runtime for installing and running AI apps. Its scripts can execute commands and download code with your authority: review source, prefer verified or frozen scripts, and isolate credentials before running an app.
Local launcher
MIT
Scripts need review
- [Pinokio desktop →](https://desktop.pinokio.co/)
- [Pinokio documentation →](https://desktop.pinokio.co/docs/)
- [Pinokio source →](https://github.com/pinokiocomputer/pinokio)
text and image to 3D research
### threestudio
An Apache-2.0 local research framework for text, image and few-shot 3D generation across multiple methods and extensions. It is NVIDIA/CUDA-oriented, Ubuntu-tested and states a 6 GB VRAM minimum. Dependencies and model licences vary, and this is a research stack rather than a beginner desktop default.
NVIDIA + CUDA
6 GB VRAM minimum
Research stack
- [threestudio source →](https://github.com/threestudio-project/threestudio)
### Build AI applications and agents
general-purpose agent research
### OpenManus
An MIT-licensed implementation of a general tool-using agent with browser, code, retrieval, sandbox and multi-agent paths. The maintainers describe it as a simple prototype. Model endpoints, browser access and executable tools create the real data and permission boundary, so start in a disposable environment with narrow credentials and an external acceptance test.
Python
General agent
Prototype
- [OpenManus repository →](https://github.com/FoundationAgents/OpenManus)
multi-agent orchestration
### CrewAI + CAMEL
CrewAI packages agents, tasks, crews and stateful flows; CAMEL focuses on multi-agent research and composable agent societies. Use either only when separate roles improve a measured result—more agents add coordination cost, failure modes and permissions.
Python
Multi-agent
Role-based
- [CrewAI →](https://docs.crewai.com/)
- [CAMEL →](https://docs.camel-ai.org/)
experimental persona simulation
### TinyTroupe
Microsoft's MIT-licensed Python library simulates configurable personas and focus groups for research and product exploration. It runs on your machine, but OpenAI and Azure OpenAI remain the primary model routes and Ollama support is experimental. Treat synthetic responses as hypotheses, validate them against real people and data, and read the project's legal disclaimer before use.
Local library
Persona simulation
Research only
- [TinyTroupe repository →](https://github.com/microsoft/TinyTroupe)
event workflows + RAG pipelines
### LlamaIndex Workflows + Haystack
LlamaIndex Workflows provides event-driven, step-based control for retrieval and agents. Haystack composes model, retrieval and processing components into explicit pipelines. Both suit knowledge-heavy applications; keep source provenance and evaluation independent of the framework. [Plan the retrieval architecture](https://isaiuseful.com/rag.html.md#architecture) .
Python
Retrieval
Explicit pipelines
- [LlamaIndex Workflows →](https://developers.llamaindex.ai/python/llamaagents/workflows/)
- [Haystack →](https://docs.haystack.deepset.ai/docs/intro)
typed agent frameworks
### Agno + Pydantic AI
Agno supplies a broad agent stack with teams, workflows and knowledge integrations. Pydantic AI emphasizes typed dependencies, validated outputs, tools and testable Python application patterns. Choose the smaller abstraction that meets the acceptance test and keep business authorization outside the model loop.
Python
Structured output
Tools + workflows
- [Agno →](https://docs.agno.com/)
- [Pydantic AI →](https://pydantic.dev/docs/ai/overview/)
program and optimize model behavior
### DSPy
Define model programs from typed modules and signatures, then optimize prompts or weights against examples and metrics. DSPy is most useful when you have a representative dataset and a meaningful objective; optimization against a weak metric simply automates overfitting.
Code-first
Optimization
Evaluation required
- [DSPy documentation →](https://dspy.ai/)
Model Context Protocol development
### FastMCP + Official MCP Registry
FastMCP helps build MCP clients and servers; the official registry publishes discoverable server metadata. A registry listing is not a security review: pin packages, inspect requested capabilities, isolate credentials and test every tool's authorization boundary.
MCP
Python
Discovery, not trust
- [FastMCP →](https://gofastmcp.com/)
- [Official MCP Registry →](https://registry.modelcontextprotocol.io/)
local browser automation + MCP
### agent-browser
An Apache-2.0 native Rust CLI that automates a browser locally and can start a local MCP stdio server for an agent. It can inspect the accessibility tree, navigate, click, fill forms, upload files, and read cookies or network requests. The browser still opens real services under a real signed-in session: isolate the profile and credentials, allow only authorized domains and accounts, require confirmation for uploads or consequential actions, and do not mistake local execution for a local data boundary. First setup downloads Chrome for Testing unless a compatible browser is already available.
Apache-2.0
CLI + local MCP
Live-session authority
- [Source, releases and installation →](https://github.com/vercel-labs/agent-browser)
- [Apache-2.0 license →](https://github.com/vercel-labs/agent-browser/blob/main/LICENSE)
### Use agent skills and playbooks
open skill format
### Agent Skills specification
A lightweight open format in which a folder contains a required `SKILL.md` plus optional scripts, references and assets. It provides a portable packaging convention, not a trust or permission boundary: read the instructions and executable files, pin the source and test the skill with least privilege before installing it broadly.
Open format
Portable instructions
Inspect before use
- [Agent Skills overview →](https://agentskills.io/home)
skill optimization research
### Microsoft SkillOpt
An MIT-licensed optimizer that revises natural-language skills from agent trajectories and promotes an artifact only through validation gates. It changes prompts and procedures rather than model weights. Keep an untouched holdout, version every candidate and include model/API cost and data exposure in the experiment; repeated optimization can overfit a weak evaluator.
Python
Skills + evals
Holdout required
- [SkillOpt repository →](https://github.com/microsoft/SkillOpt)
Apple development skill library
### Claude Code Apple Skills
An MIT-licensed collection covering iOS, macOS, product work, testing, App Store preparation and code generation. Marketplace installs track `main` ; use the repository's era tags when reproducibility matters. Treat generated patterns and legal copy as starting points, then verify them against the target Xcode, SDK, platform guidance and counsel where needed.
Apple platforms
Prompt library
Pin for stability
- [Apple Skills repository →](https://github.com/rshankras/claude-code-apple-skills)
software-development workflow skills
### Superpowers
An MIT-licensed, cross-agent skill set that enforces discovery, specification, planning, test-driven implementation and review stages. It is an opinionated engineering method rather than evidence that autonomous coding is reliable. Adopt the parts that improve your acceptance tests and remove roles or ceremony that do not improve measured outcomes.
Planning
TDD
Cross-agent
- [Superpowers repository →](https://github.com/obra/superpowers)
specialist persona library
### Agency Agents
An MIT-licensed catalogue of role prompts spanning engineering, design, marketing, finance, healthcare and other functions. These are reusable briefs and personalities—not verified professionals or validated operating procedures. Test deliverables against primary sources and named reviewers, especially in regulated, financial, legal or health work.
Prompt library
Many domains
No credential guarantee
- [Agency Agents repository →](https://github.com/msitarzewski/agency-agents)
legal workflow references
### Claude for Legal
Anthropic's Apache-2.0 reference agents, skills and connectors for commercial, privacy, product, corporate, employment, litigation, regulatory and learning workflows. They can run as Claude plugins or behind the Managed Agents API. They are not legal advice: preserve privilege, apply the correct jurisdiction, minimize connector access and require qualified counsel to release consequential work.
Claude ecosystem
Legal workflows
Human counsel
- [Claude for Legal repository →](https://github.com/anthropics/claude-for-legal)
SEO skill + specialist agents
### Claude SEO
An MIT-licensed Claude Code plugin with technical, content, schema, local, international and AI-search audit workflows. The repository says its recommendations are grounded in primary Google guidance, while optional providers add external data collection. Recheck every recommendation, respect robots and service terms, and treat rankings or traffic as measured outcomes—not promises.
SEO audits
Claude Code
Optional data APIs
- [Claude SEO repository →](https://github.com/AgriciDaniel/claude-seo)
opinionated Claude Code workflow
### gstack
An MIT-licensed set of Claude Code skills for product, design, engineering, QA, security review and release work. Its productivity examples are the author's own measurements, not an independent benchmark. Some workflows can browse, change code or deploy, so inspect each skill, narrow credentials and keep repository review, tests and release approval outside the persona.
Claude Code
Product to release
Self-reported results
- [gstack repository →](https://github.com/garrytan/gstack)
### Build knowledge and workflows
consent-gated data-broker removal skill
### Hermes unbroker
An MIT-licensed Hermes skill that finds a consenting person's exposure on people-search sites, submits supported opt-outs and records human-only steps. It is US-first and may use browser sessions, email credentials and a dossier containing the exact personal data being removed. Encrypt state, minimize disclosure, verify consent and removals, and recheck legal and site requirements.
Privacy workflow
Hermes skill
Sensitive dossier
- [unbroker skill →](https://github.com/NousResearch/hermes-agent/tree/main/optional-skills/security/unbroker)
agent-maintained Markdown knowledge
### OpenWiki
An MIT-licensed CLI that creates and updates codebase documentation or a personal local wiki in a portable Markdown format. The configured model can receive repository or note context, and scheduled runs send anonymous reliability telemetry unless disabled. Review generated changes like code: pin the provider and prompt, require diffs and keep primary documentation canonical.
Code docs + personal wiki
Markdown
Review updates
- [OpenWiki repository →](https://github.com/langchain-ai/openwiki)
self-hosted receipt + invoice extraction
### TaxHacker
An MIT-licensed application for extracting fields from receipts, invoices and transactions into a structured accounting view. Self-hosting the app does not make a remote model local, and the documents contain financial and personal data. Keep originals and your accounting system canonical, configure the model boundary explicitly and require human review for categories, tax and filings.
Receipts + invoices
Self-hosted app
Not accounting advice
- [TaxHacker repository →](https://github.com/vas3k/TaxHacker)
self-hosted web acquisition
### Firecrawl + Scrapy
Firecrawl packages search, scrape and crawl operations behind a self-hostable API; its core is AGPL-3.0 and the hosted service includes additional features. Scrapy is a BSD-licensed Python framework for explicit spiders and extraction pipelines. Whichever route you choose, respect robots directives, site terms, privacy and rate limits, and store source URLs and retrieval times with extracted content.
Self-hosted
Web crawling
Policy required
- [Firecrawl and self-hosting guide →](https://github.com/firecrawl/firecrawl)
- [Scrapy repository →](https://github.com/scrapy/scrapy)
local knowledge workspace
### Obsidian
A free-to-use, proprietary app that stores the canonical vault locally as plain-text Markdown. Backlinks, properties and graph view help navigate relationships; they do not make the vault a neural network. Treat community plugins as executable code and audit optional Sync, Publish and AI endpoints separately.
Local files
Portable Markdown
Plugin boundary
- [Obsidian Help →](https://obsidian.md/help/)
- [License overview →](https://obsidian.md/license)
- [Second-brain guide →](https://isaiuseful.com/guides.html.md#second-brain)
continuous local activity memory
### screenpipe
A source-available desktop recorder that indexes screen text, screenshots, app and browser context, audio transcripts and user input locally, then exposes search, an API, MCP and scheduled agent workflows. That breadth creates a high-risk monitoring dataset even when storage stays on-device. For workplace use, define purpose and legal basis, consult workers where required, complete a DPIA where systematic monitoring triggers it, minimize captured apps and fields, set short retention and deletion paths, encrypt storage, disable default analytics and keep cloud transcription, sync and hosted models off unless their processors and transfers are approved.
Local by default
Source-available
DPIA likely at work
- [screenpipe documentation →](https://docs.screenpipe.com/home)
- [Source, licence and data-flow notes →](https://github.com/screenpipe/screenpipe)
RAG ingestion + chunking
### Chonkie
An MIT-licensed Python library for turning text, Markdown, tables and code into retrieval chunks. It offers token, sentence, recursive, semantic, neural and code-aware chunkers plus optional embedding and vector-store integrations. Preserve file and heading provenance, and evaluate retrieval on your documents instead of trusting a chunking benchmark. [Follow the RAG build sequence](https://isaiuseful.com/rag.html.md#build) .
MIT
Local-capable
Replaceable pipeline
- [Repository →](https://github.com/feyninc/chonkie)
- [Documentation →](https://docs.chonkie.ai/)
validated personal memory
### FaultLine
An early-stage AGPL service that exposes correctable, structured facts through MCP and OpenWebUI tools. Its repository describes a validation gate, confidence strengthening and archived corrections; treat those as project claims to test. Keep source notes canonical, secure the MCP endpoint and verify user isolation, backup and retraction behavior.
AGPL-3.0
Local service
MCP fact graph
- [Repository →](https://github.com/tkalevra/FaultLine)
- [Project limitations →](https://github.com/tkalevra/FaultLine/blob/main/HONESTY.md)
documents
### Docling + AnythingLLM
Parse complex files with provenance, then retrieve over a bounded collection with a model endpoint you can replace. [See how the stages fit together](https://isaiuseful.com/rag.html.md#model) .
Local-capable
RAG
Page provenance
- [Docling →](https://github.com/docling-project/docling)
- [AnythingLLM →](https://github.com/Mintplex-Labs/anything-llm)
end-to-end RAG applications
### RAGFlow + Embedchain
RAGFlow is a self-hostable RAG platform with document processing, retrieval and agent workflows; Embedchain is a lighter Python framework for adding data and querying an application. Use them to accelerate a prototype, but retain the original files, chunk metadata and an exportable evaluation set. [Define the acceptance test](https://isaiuseful.com/rag.html.md#evaluate) .
RAG
Application layer
Keep provenance
- [RAGFlow →](https://ragflow.io/docs/dev/)
- [Embedchain →](https://docs.embedchain.ai/)
document preparation + graph retrieval
### Unstructured + Microsoft GraphRAG
Unstructured partitions and stages documents for downstream retrieval. Microsoft GraphRAG builds graph-based indexes and query paths for relationship-heavy corpora. Neither removes the need to inspect extraction quality, preserve page-level provenance and compare the result with simpler retrieval. [Compare RAG routes](https://isaiuseful.com/rag.html.md#choose) .
Ingestion
GraphRAG
Evaluate complexity
- [Unstructured →](https://docs.unstructured.io/open-source/introduction/overview)
- [Microsoft GraphRAG →](https://microsoft.github.io/graphrag/)
vector retrieval
### Qdrant
Add Qdrant when retrieval needs explicit collections, metadata filters, hybrid search, persistence or multiple applications. A small single-user prototype may not need another service. Self-hosted Qdrant starts without authentication or encryption by default, so never expose its ports unchanged. [Apply the retrieval security checklist](https://isaiuseful.com/rag.html.md#operate) .
Vector search
Local or cloud
Secure explicitly
- [Documentation →](https://qdrant.tech/documentation/)
- [Security guide →](https://qdrant.tech/documentation/operations/security/)
local + self-hosted vector retrieval
### Chroma
Chroma offers an approachable local or self-hosted retrieval store, with a managed route available separately. Define metadata filters, tenancy, authentication, backups and an export path before relying on it—the vector index is rebuildable infrastructure, not the source of truth. [See the reference architecture](https://isaiuseful.com/rag.html.md#architecture) .
Local or self-hosted
Vector search
Export plan
- [Chroma documentation →](https://docs.trychroma.com/)
vector databases at service scale
### Weaviate + Milvus
Both support vector search, metadata filtering and production deployments across self-managed and hosted routes. They introduce a real database service: size indexes, define tenancy, secure every endpoint and test restore and re-embedding before relying on either. [Follow the production build gates](https://isaiuseful.com/rag.html.md#build) .
Vector database
Self-hosted options
Operate deliberately
- [Weaviate →](https://docs.weaviate.io/weaviate)
- [Milvus →](https://milvus.io/docs)
graph retrieval · optional
### Neo4j + FalkorDB
Add a graph only when relationships and multi-hop traversals are part of the acceptance test; PostgreSQL is enough for an appointment queue. Neo4j Community is GPL-3.0. FalkorDB targets GraphRAG but uses SSPL, so it is source-available rather than OSI open source. GraphAware is a commercial graph-services layer, not a required database component. [Use the GraphRAG decision gate](https://isaiuseful.com/rag.html.md#graph) .
Knowledge graphs
GraphRAG
License check
- [Neo4j Community →](https://github.com/neo4j/neo4j)
- [FalkorDB →](https://github.com/FalkorDB/FalkorDB)
- [GraphAware →](https://graphaware.com/)
self-hosted agent memory
### Mem0 + Graphiti
Mem0 provides an open-source memory layer; Graphiti is the self-hosted temporal context-graph engine behind hosted Zep. Neither makes extracted memories authoritative: preserve raw records and consent rules, namespace every user and agent, and test correction, deletion, provenance and stale-memory behavior before using recalled facts in decisions.
Long-term memory
Self-hosted
Retraction test
- [Mem0 →](https://docs.mem0.ai/)
- [Graphiti →](https://github.com/getzep/graphiti)
knowledge-graph memory
### Cognee
Cognee is a self-hosted memory framework that ingests supplied data into graph and vector structures and exposes add, cognify, search and memory workflows. It can use local databases and OpenAI-compatible local model endpoints; configure both generation and embeddings explicitly, keep source records outside the derived graph, and test deletion and re-indexing before production use.
Self-hosted
Graph + vector
Source records required
- [Cognee repository →](https://github.com/topoteretes/cognee)
stateful agents + fast state
### Letta + Redis
Letta builds stateful agents around persistent memory and tools. Redis can hold fast operational state and provide search primitives, but it does not define memory policy for you. Separate conversation state, durable facts and source records; give each a retention and deletion path.
Agent memory
Structured state
Retention required
- [Letta →](https://docs.letta.com/)
- [Redis for AI and search →](https://redis.io/docs/latest/develop/ai/)
visual workflow automation
### Node-RED + n8n
Both provide visual triggers, API calls and approvals. Node-RED is Apache-2.0 and fits a strict OSS stack. n8n has the larger packaged integration surface but uses a Sustainable Use fair-code license; keep that distinction visible in procurement.
Visual
Connectors
Different licenses
- [Node-RED →](https://github.com/node-red/node-red)
- [n8n →](https://github.com/n8n-io/n8n)
managed integration automation
### Zapier + Make + Pipedream
Zapier and Make emphasize visual SaaS automation; Pipedream combines hosted connectors with code steps. They are useful for bounded integrations and approvals, but credentials and payloads cross a managed control plane—review data handling, retries, run history and exportability.
Managed
Connectors
Visual + code
- [Zapier →](https://zapier.com/ai/)
- [Make →](https://www.make.com/en)
- [Pipedream →](https://pipedream.com/docs)
durable business workflows
### Temporal
Use Temporal when timers, callbacks, retries and state must survive process restarts for hours or days. Its MIT-licensed server and .NET SDK fit the appointment workflow: deterministic workflow code owns state while activities perform calendar, PBX and database I/O.
MIT
Durable state
.NET SDK
- [Temporal server →](https://github.com/temporalio/temporal)
- [.NET SDK →](https://github.com/temporalio/sdk-dotnet)
data + batch orchestration
### Prefect + Apache Airflow + Kestra
Use these for scheduled data flows, backfills and observable batch dependencies. Prefect and Airflow are Python-centered; Kestra defines workflows declaratively and spans more runtimes. They can launch preparation or reporting, but long-lived business conversations may be clearer in Temporal or application code.
Schedules
Backfills
Observable runs
- [Prefect →](https://docs.prefect.io/)
- [Apache Airflow →](https://github.com/apache/airflow)
- [Kestra →](https://kestra.io/docs)
AI workflow builders
### Dify + Flowise
Visual options for retrieval, model routing and tool-using flows. Useful for prototypes when evaluation and export remain part of the design.
Visual
Self-hostable
Prototype
- [Dify →](https://dify.ai/)
- [Flowise →](https://flowiseai.com/)
### Move, transform and serve data
OSS ingestion libraries
### Meltano + dlt
Code-first, open-source routes for moving API and database data into an analytical store without adopting a managed connector platform. Use them when the connector set is modest and versioned pipelines matter more than a large visual catalog.
OSS
ELT
Code-first
- [Meltano →](https://github.com/meltano/meltano)
- [dlt →](https://github.com/dlt-hub/dlt)
connector platforms
### Airbyte + Fivetran
Airbyte offers a broad self-hosted connector catalog but its main platform uses Elastic License 2.0, not an OSI license. Fivetran is a managed proprietary service. Compare them for connector coverage and operations—not as equivalents to a true OSS stack.
Many connectors
ELT
License boundary
- [Airbyte →](https://github.com/airbytehq/airbyte)
- [Fivetran →](https://www.fivetran.com/)
analytics transformation
### dbt Core
Version SQL transformations, tests and documentation after data lands in an analytical database. dbt is not an ingestion tool, operational scheduler or appointment transaction engine; use it for trusted reporting models.
SQL
Tests
Lineage
- [dbt Core →](https://github.com/dbt-labs/dbt-core)
lakehouse table formats
### Apache Iceberg + Delta Lake
Transactional table formats for large analytical data lakes, schema evolution and multiple compute engines. They become relevant when call/event history reaches lake scale; they do not replace PostgreSQL for live slot locks.
Apache-2.0
Data lake
Large scale
- [Apache Iceberg →](https://github.com/apache/iceberg)
- [Delta Lake →](https://github.com/delta-io/delta)
dashboards + internal apps
### Apache Superset + Dashjoin
Superset is an Apache-licensed BI and data-exploration layer for outcome dashboards. Dashjoin is an AGPL low-code platform that can put forms and actions over existing sources. Neither should become the authoritative booking state.
BI
Low-code UI
Read-mostly
- [Apache Superset →](https://github.com/apache/superset)
- [Dashjoin →](https://github.com/Dashjoin/platform)
self-hosted business intelligence
### Metabase
An AGPL-licensed, self-hostable service for queries, dashboards and self-service exploration when a simpler BI interface fits better than Superset. Run the Open Source Edition as a Java JAR or Docker container with a production application database. Self-hosting keeps Metabase the company out of your data unless you opt in to anonymized usage statistics, but it does not make connected data sources local or safe by default. Use a dedicated least-privileged, read-only database user, keep results and dashboard access behind authenticated groups, and keep transactional state in its application service. Fine-grained row and column controls require a self-hosted Pro or Enterprise plan.
AGPL-3.0
JAR or Docker
Least-privilege data access
- [Self-hosting documentation →](https://www.metabase.com/docs/latest/installation-and-operation/installing-metabase)
- [Open Source and commercial license terms →](https://www.metabase.com/license)
- [Database roles and privileges →](https://www.metabase.com/docs/latest/databases/users-roles-privileges)
### Build operational intelligence systems
property graph + traversal
### JanusGraph + TinkerPop + Cassandra
JanusGraph supplies a distributed property-graph layer, TinkerPop defines the Gremlin traversal API and Cassandra can provide the storage backend. Use this combination only when relationship-heavy queries and scale justify three moving parts; keep raw and curated records outside the graph so it remains a rebuildable serving model.
Open source
Distributed graph
Operational burden
- [JanusGraph architecture →](https://docs.janusgraph.org/getting-started/architecture/)
- [TinkerPop reference →](https://tinkerpop.apache.org/docs/current/reference/)
- [Cassandra documentation →](https://cassandra.apache.org/doc/latest/)
events + visible ingestion
### Apache Kafka + Apache NiFi
Kafka fits durable event streams and replay; NiFi fits visual routing, provenance and source-to-destination controls. A nightly file does not need either. Name which service owns retry and deduplication, retain raw inputs and test what happens when the source sends late, duplicated or malformed records.
Apache-2.0
Streaming
Provenance
- [Kafka documentation →](https://kafka.apache.org/documentation/)
- [NiFi documentation →](https://nifi.apache.org/docs.html)
versioned lakehouse + owned object storage
### Apache Iceberg + S3-compatible storage
Iceberg adds schema evolution, partition management and snapshots over object storage. Default new self-hosted builds to SeaweedFS; consider Garage for lightweight multi-site replication or Ceph RGW when Ceph already has an operations team. MinIO Community is no longer a default: its upstream repository is archived and its distribution is source-only. Pin the catalog, engine and store versions, then prove compatibility and a consistent restore.
SeaweedFS default
Garage + Ceph alternatives
MinIO migration only
- [Iceberg documentation →](https://iceberg.apache.org/docs/latest/)
- [SeaweedFS →](https://github.com/seaweedfs/seaweedfs)
- [Garage →](https://garagehq.deuxfleurs.fr/)
- [Ceph RGW →](https://docs.ceph.com/en/latest/radosgw/)
- [MinIO status →](https://github.com/minio/minio)
transform + federated query
### Apache Spark + Trino + DuckDB
Spark handles distributed transforms, Trino provides interactive SQL across services and DuckDB is often enough for the first single-machine proof. Start with DuckDB, preserve standard table formats and add distributed engines only when measured data size, concurrency or latency demands them.
SQL + compute
Scale later
Open formats
- [Spark documentation →](https://spark.apache.org/docs/latest/)
- [Trino documentation →](https://trino.io/docs/current/)
- [DuckDB documentation →](https://duckdb.org/docs/stable/)
text + faceted + geospatial index
### Apache Solr
Solr provides text search, faceting and geospatial queries and can act as a JanusGraph mixed index. Treat the index as derived and rebuildable, apply document-level authorization before results leave the service and test stale-index behavior rather than letting search become an accidental system of record.
Apache-2.0
Search
Derived index
- [Solr reference guide →](https://solr.apache.org/guide/solr/latest/)
raster processing + map clients
### GeoTrellis + CesiumJS + MapLibre
GeoTrellis handles tiled raster and terrain work on Scala/Spark; CesiumJS renders a 3D globe; MapLibre renders conventional 2D and 2.5D maps. These are processing and presentation components, not authoritative data. Keep source time, accuracy and attribution visible in the map and request only the viewport the operator may see.
Open source
2D + 3D
Geospatial
- [GeoTrellis →](https://geotrellis.io/)
- [CesiumJS →](https://cesium.com/platform/cesiumjs/)
- [MapLibre →](https://maplibre.org/)
operational UI + analytical dashboard
### LocStat + Apache Superset
LocStat is useful as a Palantir-style interface reference; verify code availability, support and licence before making it a dependency. Superset is an Apache-licensed analytical dashboard, not a transactional workflow engine. Borrow interaction patterns, but keep approvals and case state in a maintained application service.
Interface reference
BI
Verify licence
- [LocStat →](https://www.locstat.co.za/)
- [Superset documentation →](https://superset.apache.org/docs/intro)
operational data pipelines
### Apache Airflow + Prefect
Either can schedule, retry and observe batch ingestion and ontology projection. Choose one owner for each retry, make tasks idempotent and keep long-lived human cases in application state or a durable workflow engine. A scheduler succeeding does not prove that the resulting data is correct.
Python
Schedules
One retry owner
- [Airflow documentation →](https://airflow.apache.org/docs/)
- [Prefect documentation →](https://docs.prefect.io/)
data policy + application policy
### Apache Ranger + Open Policy Agent
Ranger centralizes policies and audit for supported data services; OPA evaluates policy as code in applications and infrastructure. Neither creates identities, secrets or correct object-level permissions automatically. Test denied rows, fields, actions and exports with the exact service versions in production.
Authorization
Audit
Test denies
- [Apache Ranger →](https://ranger.apache.org/)
- [OPA documentation →](https://www.openpolicyagent.org/docs/latest/)
private datacentre control plane
### vSphere Supervisor + Cloud Director CSE + vSphere CSI
Use ordinary vSphere VMs for a small stateful deployment unless the datacentre already operates Kubernetes. Supervisor and Cloud Director CSE add cluster or tenant control planes; the CSI driver maps persistent volumes to vSphere storage policies. Tenant boundaries do not replace application authorization, and VM snapshots do not replace application-consistent backup.
VMware
Private deployment
Recovery test
- [vSphere Supervisor →](https://techdocs.broadcom.com/us/en/vmware-cis/vsphere/vsphere-supervisor/8-0.html)
- [Cloud Director CSE →](https://github.com/vmware/container-service-extension)
- [vSphere CSI →](https://github.com/kubernetes-sigs/vsphere-csi-driver)
Foundry + Gotham UI references
### OpenFoundry + Osiris interface references
These repositories can make ontology, lineage, map, layer and event-card choices tangible. Treat them as workshop material until their licences, maintenance, identity model and data boundaries pass review. Reimplement only the operator journey your own services and acceptance tests require.
Prototype
Interface study
Not a platform proof
- [OpenFoundry →](https://github.com/cherishwins/OpenFoundry)
- [Osiris →](https://github.com/simplifaisoul/osiris)
- [Use the interface guide →](https://isaiuseful.com/diy-palantir.html.md#clones)
routing + constraint optimisation
### Google OR-Tools
Use established solvers for vehicle routing, assignment, scheduling and other constrained decisions before asking a language model to improvise. Define hard constraints separately from preferences, preserve the solver inputs and compare feasible solutions against the current operational baseline.
Apache-2.0
Optimisation
Deterministic baseline
- [OR-Tools documentation →](https://developers.google.com/optimization)
crowdsourced aircraft state vectors
### OpenSky Network
A research-oriented REST API for live aircraft state vectors, tracks and limited flight history. Coverage and identity are receiver-dependent, quotas apply and OpenSky now requires a written agreement for operational or commercial REST API use. Use licensed snapshots as realistic fixtures; use an approved aviation feed or your own authorized receivers when decisions depend on completeness.
Live + historical
Written licence for operations
Not authoritative
- [REST API →](https://openskynetwork.github.io/opensky-api/rest.html)
- [Terms and data licence →](https://opensky-network.org/about/terms-of-use)
crowdsourced aircraft + military filter
### ADS-B Exchange
The commercial API exposes changing aircraft positions and a military-filtered endpoint. It is useful as a supplementary or development feed, not proof of identity, intent or complete coverage. Budget for subscription and rate limits, preserve source timestamps and reconcile against the authority responsible for the air picture.
Commercial API
Live aircraft
Supplement only
- [API documentation →](https://gateway.adsbexchange.com/api/aircraft/v2/docs/index.html?url=%2Fapi%2Faircraft%2Fv2%2Fdocs%2Fopenapi.json)
- [Data products →](https://www.adsbexchange.com/data-products/)
satellite orbital elements
### CelesTrak GP data
CelesTrak publishes current general-perturbations element sets in TLE, OMM JSON, XML, KVN and CSV formats. Rendered paths are propagated estimates from an element epoch—not continuous live sensor positions. Pin dated fixtures for development and surface element age, propagation time and uncertainty in operational views.
Public data
Orbit propagation
Show data age
- [GP formats and queries →](https://celestrak.org/NORAD/documentation/gp-data-formats.php)
- [Current element sets →](https://celestrak.org/NORAD/elements/)
open road + feature data
### OpenStreetMap data
OpenStreetMap can supply roads and mapped features for routing, simulation and basemaps; it does not supply live vehicle flow. Attribute contributors and respect the ODbL. The community tile service is best-effort and forbids bulk or offline use, so production systems should self-host approved extracts and tiles or use a provider with a contract.
Open data
Attribution required
Self-host production tiles
- [Attribution and licence →](https://www.openstreetmap.org/copyright/attribution-guide/)
- [Community tile policy →](https://operations.osmfoundation.org/policies/tiles/)
public camera locations + snapshots
### City of Austin Traffic Cameras
A public-domain dataset with camera identifiers, approximate locations, status and—where publication is allowed—a link to the latest screenshot on a five-minute cadence. It is useful for a public-feed prototype and outage fixtures. The city says footage is not retained and the locations are not suitable for legal, engineering or surveying use.
Public domain
Five-minute screenshots
Approximate locations
- [Official dataset →](https://data.austintexas.gov/Transportation-and-Mobility/Traffic-Cameras/b4k4-adkb)
local NVR + object detection
### Frigate
An MIT-licensed, self-hosted NVR that performs real-time object detection locally for IP cameras, retains recordings according to detected objects and integrates with Home Assistant and MQTT. Use a supported GPU or AI accelerator as the project recommends, and keep its unauthenticated internal API off exposed networks; use the authenticated endpoint or a carefully configured reverse proxy. “Local” still leaves sensitive footage, camera credentials and retention policy for you to secure.
MIT
Local object detection
Accelerator recommended
- [Frigate NVR →](https://frigate.video/)
- [Source, releases and licence →](https://github.com/blakeblackshear/frigate)
- [Hardware guidance →](https://docs.frigate.video/frigate/hardware)
- [Authentication boundary →](https://docs.frigate.video/configuration/authentication/)
hosted photorealistic city mesh
### Google Photorealistic 3D Tiles
A high-resolution textured 3D basemap that can be rendered with CesiumJS. It requires billing, an API key and visible attribution. Google's policies restrict prefetching, storage, offline use, extraction and machine analysis, so keep every operational layer independent and retain a fallback to government terrain, imagery or 3D city models.
Hosted API
Commercial terms
Basemap only
- [3D Tiles documentation →](https://developers.google.com/maps/documentation/tile/3d-tiles)
- [Map Tiles policies →](https://developers.google.com/maps/documentation/tile/policies)
owned government-grade GIS backbone
### PostGIS + GeoServer + QGIS
PostGIS stores governed spatial records in PostgreSQL, GeoServer publishes standards-based services and QGIS supports desktop editing, analysis and review. This is the airtight fallback for an organisation that already owns authoritative GIS data: keep identity and workflow state in maintained services, issue read-only layers to the browser and test disconnected operation and restore.
Self-hosted
OGC services
Authoritative data
- [PostGIS documentation →](https://postgis.net/documentation/)
- [GeoServer documentation →](https://docs.geoserver.org/)
- [QGIS documentation →](https://docs.qgis.org/latest/en/docs/)
### Build software with agents
deterministic CLI output compression
### RTK
An Apache-2.0 Rust proxy that rewrites supported shell commands and filters, groups, deduplicates or truncates their output before it reaches a coding agent. The project estimates 60–90% token savings on common commands; measure that on your workload. Retain a route to the raw command output because compression can hide the line that matters during diagnosis.
Rust binary
Agent hooks
Keep raw output
- [RTK repository →](https://github.com/rtk-ai/rtk)
PRD-driven coding loop
### Ralph
An MIT-licensed shell loop that turns a PRD into prioritized stories, launches a fresh supported coding-agent instance per story, runs checks and commits passing work until a limit is reached. It is a useful scaffold, not proof that unattended agents finish correctly, and the selected agent keeps its own model and data boundary. Use a disposable branch, cap iterations and review every commit.
External coding agent
Fresh contexts
Bound the loop
- [Ralph repository →](https://github.com/snarktank/ralph)
response-style compression skill
### Caveman
An MIT-licensed skill that asks coding agents to answer in terse “caveman” language while preserving code and commands. Its 65% output-token claim comes from the project and does not reduce input context. Test whether terseness drops rationale, warnings or accessibility for your team; avoid it where a complete handoff matters more than output cost.
Many agents
Output only
Vendor benchmark
- [Caveman repository →](https://github.com/juliusbrussee/caveman)
open-source coding CLI + local providers
### Codex CLI
OpenAI's open-source terminal coding agent can run against Ollama or LM Studio with `--oss` ; `--local-provider` selects the provider and `oss_provider` sets a default. Local inference is not a containment boundary: the agent can still read, edit and run commands. Keep sandboxing and approvals enabled, scope files and credentials, choose a model that handles tools reliably and verify the result with tests and review.
Open source
Ollama + LM Studio
Sandbox + approvals
- [Learn the coding-agent operating method →](https://isaiuseful.com/thinking-with-ai.html.md#tools)
- [Codex CLI repository →](https://github.com/openai/codex)
- [Local-provider configuration →](https://learn.chatgpt.com/docs/config-file/config-advanced#oss-mode-local-providers)
community external-model router for Codex
### Codex Router
An independent MIT-licensed beta that adapts selected external providers to the Responses API and merges their models into the Codex App and CLI picker through a loopback service. It writes marked Codex configuration blocks, installs a per-user background service and stores provider credentials in protected local files. Review a tagged installer instead of piping the moving default branch, keep its config backup and rollback path, run the included doctor and re-test after Codex updates. Provider billing, data handling and terms still apply, and routed models do not become OpenAI-supported Codex models.
MIT
Beta
Config + credential boundary
- [Codex Router repository →](https://github.com/duolahypercho/codex-router)
- [Security model →](https://github.com/duolahypercho/codex-router/blob/main/SECURITY.md)
- [Pinned releases and checksums →](https://github.com/duolahypercho/codex-router/releases)
multi-provider coding agent + desktop
### Code Buddy
An MIT-licensed coding agent with a terminal UI, Electron-based Cowork desktop app, HTTP/WebSocket server, local Ollama support, hosted model providers, MCP and a broad tool surface. Local inference does not contain file, shell, browser or connector access: begin with narrow permissions, isolate credentials and repositories, keep optional background and self-improvement features off until tested, and review generated changes and external actions.
MIT
CLI + desktop
Local + hosted models
- [Code Buddy repository →](https://github.com/phuetz/code-buddy)
Rust coding harness + agent memory
### JCode
An MIT-licensed terminal coding agent with hosted and local model routes, MCP, semantic memory, persistent background work and coordinated swarms. The project publishes its own optimization benchmark plus Linux PSS and startup comparisons; treat those as project-run evidence and reproduce them with pinned versions. Scope files, shell, network and credentials, and set retention rules so recalled memory does not preserve stale decisions or sensitive material.
Rust
Local + hosted models
Memory + swarms
- [JCode repository →](https://github.com/1jehuang/jcode)
- [JCode Bench design →](https://jcode.sh/bench)
- [Compare published memory usage →](#harness-memory)
AI commit messages
### OpenCommit
An MIT-licensed CLI that generates commit messages from staged changes through a hosted model or local Ollama. A remote provider may receive the diff, and the default flow can stage files for you. Stage deliberately, exclude secrets, inspect the final diff and edit the message so it describes the actual change rather than the model's guess.
Git CLI
Hosted or local model
Review before commit
- [OpenCommit repository →](https://github.com/di-sukharev/opencommit)
agent-native version control
### GitButler
A Git-based desktop and CLI workflow for organizing coding-agent changes into parallel or stacked branches, selected hunks and reviewable commits in one working directory. Its agent setup can install version-control instructions, but those instructions are not access controls; keep repository permissions and release approval separate. Workspace mode also changes branch semantics, so follow GitButler's commands instead of mixing in Git index, checkout or branch operations. The source uses a Fair Source licence that converts to MIT after two years and restricts competing products during that period.
Desktop + CLI
Parallel branches
Fair Source
- [GitButler →](https://gitbutler.com)
- [Agent workflow documentation →](https://docs.gitbutler.com/ai-agents/overview)
- [Source and licence →](https://github.com/gitbutlerapp/gitbutler)
human + agent collaboration workspace
### Buzz
Block's Apache-2.0 workspace puts people and model-agnostic agents—including Codex, Claude Code and Goose harnesses—into shared channels around conversation, workflows and code. Events live on a Nostr relay that can be hosted by Block or self-hosted. Treat it as a collaboration and audit layer, not a sandbox: each underlying agent still needs narrowly scoped repositories, tools, network access and credentials. Buzz is pre-1.0, so check the current release and the project's works-now / in-progress table before standardizing a team workflow.
Apache-2.0
Hosted + self-hosted
Human + multi-agent
- [Try Buzz →](https://buzz.xyz)
- [Source, releases and current status →](https://github.com/block/buzz)
- [Block's introduction →](https://block.xyz/inside/introducing-buzz-where-humans-and-agents-work-together)
multi-agent terminal manager
### Claude Squad
An AGPL-3.0 terminal interface for running Claude Code, Codex, Gemini, Aider and other agents in separate Git worktrees. Worktrees reduce merge collisions but are not process, network or credential sandboxes; its auto-accept mode further expands authority. Review changes before applying them and isolate secrets and external accounts separately.
TUI
Git worktrees
AGPL-3.0
- [Claude Squad repository →](https://github.com/smtg-ai/claude-squad)
graphical worktree launcher
### ParallelCode
A free desktop Git worktree manager for opening Cursor, Claude Code, Copilot and other local-repository agents on separate branches. It is the focused graphical choice when parallel worktrees—not a full task platform—are the requirement. Worktrees separate files and branches, not processes, ports, networks or credentials, so coordinate shared services and review every merge.
Desktop GUI
Git worktrees
Free
- [ParallelCode overview and downloads →](https://parallelcode.dev/)
- [Worktree workflow documentation →](https://parallelcode.dev/docs)
Windows terminal workspace
### Windows Terminal
Microsoft's MIT-licensed terminal host puts PowerShell, Command Prompt, WSL and SSH profiles into configurable tabs and split panes. It is a clean baseline for watching several Windows-side agent CLIs, but it does not add agent status, task routing, worktrees or review workflow. Use scripted `wt` layouts for repeatability and pair it with Git or a session manager when branches and resumable state matter.
Windows
Tabs + panes
MIT
- [Windows Terminal guide →](https://learn.microsoft.com/en-us/windows/terminal/)
- [Source and releases →](https://github.com/microsoft/terminal)
visual multi-agent workspace
### Nimbalyst
A free, MIT-licensed desktop workspace for parallel Codex and Claude Code sessions, Kanban task management, worktrees, terminals and visual editing of documents, diagrams, mockups and code. It is the strongest fit here when non-terminal review and a mobile companion matter. Core content stays in local files, but anonymous analytics are enabled unless you opt out and mobile collaboration uses a separately operated sync service; verify both boundaries before using sensitive repositories.
Visual workspace
Codex + Claude Code
MIT
- [Parallel-session tour →](https://nimbalyst.com/features/session-management/)
- [Source, license and privacy notes →](https://github.com/nimbalyst/nimbalyst)
cross-platform agent development environment
### Orca
An MIT-licensed desktop workspace for running Codex, Claude Code, OpenCode and other CLI agents side by side in Git worktrees, with terminals, editing, per-worktree browsers, diff review and SSH. **Mobile role:** its beta iPhone and Android companion is a phone remote control for desktop-owned sessions: watch status and terminal output, browse files, reply or dictate, review changes and reconnect over LAN or Tailscale. Orca's current docs say supported agents launch with their full-autonomy flags pre-applied by default. Worktrees separate branches, not process, network or credential authority, so add real containment or change that launch policy before treating a pocket approval as a safety boundary. Packaged builds also send opt-out anonymous usage telemetry to PostHog's US region.
Phone companion beta
Desktop source of truth
MIT
- [Mobile companion and Tailscale path →](https://www.onorca.dev/docs/mobile)
- [Agent launch flags and authority →](https://www.onorca.dev/docs/agents/supported)
- [Source, releases and licence →](https://github.com/stablyai/orca)
- [Privacy and telemetry boundary →](https://www.onorca.dev/docs/telemetry)
multi-provider agent workbench
### Kandev
An AGPL-3.0, self-hostable control plane with Kanban and pipeline views, worktrees, an integrated editor, terminal and review flow. Its broad agent registry includes Claude Code, Codex, Copilot, Gemini, OpenCode, Kimi and Grok, while executors can run locally, in Docker, over SSH or in a cloud environment. That breadth brings more operational surface: pin agent adapters, scope executor secrets and treat container or remote-host policy as a separate security boundary.
Many agent vendors
Local + remote execution
AGPL-3.0
- [Supported agents and profiles →](https://kandev.ai/docs/agents-and-profiles)
- [Architecture, executors and license →](https://github.com/kdlbs/kandev)
terminal-native agent dashboard
### Agent Deck
An MIT-licensed TUI that adds agent-aware running, waiting and completed states to tmux, plus groups, search, session forking, Git worktrees, cost tracking and local or remote sessions. It is the lightweight terminal-native choice and installs through Homebrew, Go or a release script; Windows use runs through WSL. Session organization is not command isolation, so keep each underlying agent's approvals, sandbox and credential scope intact.
TUI + tmux
Homebrew
MIT
- [Install Agent Deck →](https://github.com/asheshgoplani/agent-deck#installation)
- [Features, platforms and caveats →](https://github.com/asheshgoplani/agent-deck#faq)
multi-vendor terminal session manager
### CCManager
An MIT-licensed terminal manager for parallel Claude Code, Codex, Gemini, Cursor Agent, Copilot, Cline, OpenCode and Kimi CLI sessions across projects and Git worktrees. Busy, waiting and idle indicators make it a straightforward choice when status visibility and broad CLI support matter more than a graphical workspace. Its worktree merge and delete actions change Git state, and experimental auto-approval expands agent authority; keep both deliberate and recoverable.
TUI
Kimi + major CLIs
MIT
- [CCManager repository and setup →](https://github.com/kbwo/ccmanager)
- [Supported agent commands →](https://github.com/kbwo/ccmanager#supported-ai-assistants)
persistent coding-agent terminals
### herdr
An Apache-2.0 Rust terminal runtime that keeps coding-agent panes alive in a background server, marks them working, blocked or idle and supports detach, reattach, SSH access and an agent-facing socket API. It runs existing tools such as Codex, Claude Code, Cursor and OpenCode rather than replacing them. Persistence and status tracking are not containment: each pane still inherits the filesystem, network and credentials available to its process, so keep agent approvals and sandboxing in place.
Rust binary
Persistent sessions
Apache-2.0
- [herdr repository →](https://github.com/herdrdev/herdr)
agent context compression layer
### Headroom
An Apache-2.0 local-first library, proxy and MCP server that compresses tool output, files, logs and retrieval chunks before model use. The project reports 15–20% savings for coding agents and 60–95% for JSON, with reversible paths. Benchmark answer quality as well as token count, keep raw artifacts and bypass compression for forensic or exact-text work.
Library + proxy + MCP
Local-first
Keep originals
- [Headroom repository →](https://github.com/headroomlabs-ai/headroom)
self-hosted coding-agent control center
### OpenHands Agent Canvas
A beta, MIT-licensed interface for running OpenHands, Claude Code, Codex, Gemini and ACP-compatible agents across local, remote or cloud backends. Local UI does not mean local inference or isolated execution: inspect the selected backend, mounts, network, provider credentials and automation triggers before leaving it always on.
Beta
Many agent backends
Local + remote
- [Agent Canvas repository →](https://github.com/OpenHands/agent-canvas)
mainstream IDE + BYOK
### Visual Studio Code
VS Code's built-in language-model picker can connect chat and local-agent workflows to Ollama or a custom OpenAI-compatible endpoint without a Copilot plan or GitHub sign-in. Native BYOK does not provide standard inline completions, semantic search or embedding-backed features. On DGX Spark, use NVIDIA's guide for a direct ARM64 installation or remote access through NVIDIA Sync.
Local or remote
BYOK
Chat + agents
- [VS Code BYOK guide →](https://code.visualstudio.com/docs/agent-customization/language-models)
- [VS Code on DGX Spark →](https://build.nvidia.com/spark/vscode/overview)
VS Code + JetBrains extensions
### Continue
An open-source assistant for chat, edits, agents and role-specific autocomplete. It can discover Ollama models locally or use a remote Ollama address, which fits a Spark reached through a private network or SSH tunnel. Pick models by role: a good chat model is not automatically a good fill-in-the-middle completion model.
Local-capable
IDE extension
Role-specific models
- [Ollama setup →](https://docs.continue.dev/guides/ollama-guide)
- [Autocomplete model guide →](https://docs.continue.dev/customize/model-roles/autocomplete)
VS Code coding agent
### Roo Code
A model-flexible coding agent that can use Ollama, LM Studio or another OpenAI-compatible endpoint. Local operation still depends on a model with reliable tool calling and enough context; start with approvals enabled and test file, terminal and browser boundaries before increasing autonomy.
Local-capable
Agentic
Approval controls
- [Ollama integration →](https://docs.ollama.com/integrations/roo-code)
- [OpenAI-compatible setup →](https://roocodeinc.github.io/Roo-Code/providers/openai-compatible/)
JetBrains IDEs + BYOK
### JetBrains AI Assistant
IntelliJ IDEA, Rider and the other supported JetBrains IDEs can connect AI Assistant to Ollama, LM Studio or a private OpenAI-compatible endpoint. Local models can cover chat and assigned editor tasks, but local-model MCP tools, next-edit suggestions and some proprietary completion features remain unavailable.
Local or remote
IDE-native
Feature caveats
- [Custom and local models →](https://www.jetbrains.com/help/ai-assistant/use-custom-models.html)
local-first editor
### Zed
Zed can connect its Agent and Inline Assistant directly to Ollama, LM Studio, llama.cpp or a local OpenAI-compatible server. Remote endpoint URLs are supported, while local or self-hosted edit prediction has a separate configuration path.
Native editor
Local endpoints
Agent + inline
- [Local-model guide →](https://zed.dev/docs/ai/use-a-local-model)
coding + specification
### OpenCode + OpenSpec
A provider-flexible coding agent paired with a durable, reviewable agreement about what to build and what stays out of scope.
Terminal
Provider-flexible
Spec-driven
- [OpenCode →](https://opencode.ai/docs/)
- [OpenSpec →](https://github.com/Fission-AI/openspec)
coding
### Aider
A terminal coding assistant built around repository edits and version control. Use a clean branch and keep tests as the acceptance boundary.
Terminal
Git-aware
Multiple providers
- [Official documentation →](https://aider.chat/)
IDE + CLI agent
### Cline
An open-source coding agent for IDEs and the terminal with reviewable diffs and human-in-the-loop approval. Keep its repository scope narrow and review every command or enablement choice.
IDE + CLI
Model-flexible
Reviewable diffs
- [Project repository →](https://github.com/cline/cline)
agent harness + coding CLI
### Pi Agent Harness
The MIT-licensed `earendil-works/pi` project packages a multi-provider LLM API, tool-calling agent core, terminal UI and extensible coding-agent CLI. Pi explicitly does not provide a built-in permission system, so run it with only the filesystem, process, network and credentials it should have—prefer a tested container, micro-VM or policy sandbox for consequential work.
TypeScript
Multi-provider
External sandbox required
- [Pi repository →](https://github.com/earendil-works/pi)
- [Pi documentation →](https://pi.dev/)
persistent self-improving coding agent
### Prime Agent
An MIT-licensed coding and research agent built around a persistent Python environment, programmatic subagents and durable harness state that can retain reviewed memories, prompts, skills and subagent specifications. Background sessions, goals, schedules and bounded autonomous runs suit long work. It executes model-generated Python and project commands with the user’s permissions—not inside a security sandbox—so use a disposable worktree or external containment and inspect every retained refinement.
MIT
Terminal + background daemon
External sandbox required
- [Prime Agent repository →](https://github.com/PrimeIntellect-ai/prime-agent)
community local-first coding agent
### Nanocoder
An MIT-licensed TypeScript terminal agent with Ollama and other local-server routes, cloud providers, MCP, skills, subagents, checkpoints and scheduled or event-driven runs. “Local-first” describes where the selected model can run, not a permission boundary: file and shell tools still act with the process’s authority. Begin in normal or plan mode, isolate the repository and credentials, and measure its exploration cost on your own tasks.
Terminal + VS Code
Local + cloud models
Scope tool authority
- [Nanocoder repository →](https://github.com/Nano-Collective/nanocoder)
- [Nanocoder documentation →](https://docs.nanocollective.org/nanocoder/)
- [See the repeated-run harness benchmark →](https://isaiuseful.com/benchmarks.html.md#harness-efficiency)
native local editor
### LibreCode
A .NET 10 and Avalonia code editor with Ollama integration, terminal and model browsing for Windows, Linux and macOS. Its repository is public and local-first, but the custom license restricts redistribution, forks and SaaS use—treat it as source-available, not permissively open source.
.NET + Avalonia
Ollama
Custom license
- [Repository →](https://github.com/re4/LibreCode)
- [License →](https://github.com/re4/LibreCode/blob/main/LICENSE.md)
versioned code documentation
### Context7
Feeds current, version-specific library documentation into coding agents through a CLI skill or MCP server. Pin the library ID and version, and still open the primary documentation for consequential changes; a retrieved snippet is context, not a compatibility test. Hosted use sends the documentation query to Context7.
CLI or MCP
Current docs
Coding agents
- [Documentation →](https://context7.com/docs)
- [Repository →](https://github.com/upstash/context7)
version-matched package source
### opensrc
An Apache-2.0 Rust CLI that gives coding agents searchable source for npm, PyPI and crates.io packages plus GitHub, GitLab and Bitbucket repositories. It resolves an installed or requested version, shallow-clones the matching source and caches it locally so ordinary tools such as `rg` can inspect implementation, tests and examples. Pin the dependency version and verify the resolved tag: code is the strongest evidence of implementation behavior, while official release, support and security guidance still define the supported contract.
Apache-2.0
Rust CLI
Package + repository source
- [opensrc documentation →](https://opensrc.sh/)
- [Repository and source →](https://github.com/vercel-labs/opensrc)
### Fine-tune, evaluate and reproduce
model-file architecture inspector
### Netron
An MIT-licensed desktop, browser and Python viewer for ONNX, TensorFlow, PyTorch, Core ML, OpenVINO, Safetensors and many other model formats. Use it to inspect graph structure, operators, tensor shapes and metadata before conversion or deployment. A readable graph is not proof that a checkpoint is safe, correctly licensed or numerically equivalent after export; keep provenance, hash files and run format-specific validation.
MIT
Desktop + browser + Python
Inspect, then validate
- [Netron source and downloads →](https://github.com/lutzroeder/netron)
- [Open the browser viewer →](https://netron.app/)
agent diagnostic suite
### iFixAI
An Apache-2.0 CLI and agent skill that runs 45 inspections, with 32 core checks contributing to an A–F score and optional independent model judges. The project explicitly says the result is not certification or a safety guarantee. Version fixtures and judges, inspect false positives and unsupported capabilities, budget judge calls and disable disclosed telemetry if policy requires it.
Agent evals
CI-friendly
Not certification
- [iFixAI repository →](https://github.com/ifixai-ai/iFixAI)
training libraries
### Hugging Face PEFT + TRL
PEFT provides adapters such as LoRA; TRL provides supervised and preference-training loops. This is the flexible foundation when your team wants code-level control over datasets, trainers and evaluation.
LoRA
SFT + DPO
Code-first
- [PEFT →](https://huggingface.co/docs/peft/index)
- [TRL →](https://huggingface.co/docs/trl/index)
configuration-driven training recipes
### Axolotl
Packages full, LoRA, QLoRA, preference and reinforcement-learning runs into reusable YAML configuration, with distributed and multi-GPU routes. Pin the repository revision, base model, dataset, chat template and dependency environment; a portable recipe is not a guarantee that another GPU topology will reproduce the same speed or result.
Config-driven
Distributed training
Adapters + full tuning
- [Axolotl documentation →](https://docs.axolotl.ai/)
beta desktop AI studio + training library
### Unsloth
Unsloth Desktop is a beta, cross-platform app for running and training local text, audio, image and video models, with RAG, MCP, code execution, export and OpenAI- and Anthropic-compatible endpoints that can connect Codex or Claude Code. Its Core package is Apache-2.0; the Studio UI is AGPL-3.0. Unsloth reports up to 2× faster supported LLM training with up to 70% less VRAM, but treat that as vendor evidence and reproduce it on the exact model and hardware. Support differs across CPU, NVIDIA, AMD, Intel and Apple backends. Keep it on loopback first: web search, cloud providers, MCP servers and Cloudflare remote access each change the data or authority boundary, and anyone with the tunnel link and API key can run code.
Desktop + Core
Local multimodal + training
Beta · dual license
- [Desktop downloads →](https://unsloth.ai/)
- [Desktop launch and claims →](https://github.com/unslothai/unsloth/releases/tag/v0.1.70-beta)
- [Source, requirements and licenses →](https://github.com/unslothai/unsloth)
agent optimization + training
### Microsoft Agent Lightning
Agent Lightning is an MIT-licensed training layer that turns agent trajectories into inputs for reinforcement learning, supervised fine-tuning or prompt optimization without binding the agent to one framework. The trainer, inference engine and compute remain your responsibility: version rewards and learned artifacts, retain untouched holdouts and reject gains that disappear under repeat runs.
Self-deployed
Framework-agnostic
RL + SFT
- [Agent Lightning repository →](https://github.com/microsoft/agent-lightning)
experiment evidence
### MLflow
Track run configuration, artifacts and metrics, and compare an adapter with its baseline and holdout. Keep human task judgments alongside automated scores; a model judging another model is not independent proof.
Run tracking
Artifacts
Evaluation
- [GenAI evaluation docs →](https://mlflow.org/docs/latest/genai/eval-monitor/)
open-source tracing + evaluation
### Arize Phoenix + W&B Weave
Phoenix and Weave trace model and agent calls, organize datasets and run evaluations. Instrumentation can capture prompts, retrieved documents and tool arguments, so define redaction, sampling, access and retention before sending production traces anywhere.
Tracing
Datasets
Evals
- [Arize Phoenix →](https://arize.com/phoenix/)
- [Weights & Biases Weave →](https://docs.wandb.ai/weave)
self-hosted tracing + local test suites
### Langfuse + DeepEval
Langfuse self-hosts tracing, prompt management, datasets and evaluations, but production deployment brings Postgres, ClickHouse, Redis or Valkey and object storage. DeepEval is an Apache-2.0, pytest-style evaluation framework that can run in local development and CI. Local tooling does not guarantee local judging: configure the evaluator model deliberately and redact sensitive trace fields before capture.
Self-hosted
Tracing + evals
CI tests
- [Langfuse self-hosting →](https://langfuse.com/self-hosting)
- [DeepEval repository →](https://github.com/confident-ai/deepeval)
RAG and agent evaluation
### TruLens + Ragas
TruLens combines tracing with feedback functions for agent applications; Ragas provides evaluation workflows and metrics for RAG and other LLM systems. Calibrate automated scores against human judgments and keep a stable, versioned test set—metric names are not evidence by themselves. [Use the RAG evaluation plan](https://isaiuseful.com/rag.html.md#evaluate) .
RAG evals
Agent evals
Human calibration
- [TruLens →](https://www.trulens.org/)
- [Ragas →](https://docs.ragas.io/)
test suites + request observability
### Promptfoo + Helicone
Promptfoo runs repeatable model comparisons, assertions and adversarial tests; Helicone captures and analyzes LLM requests through an observability layer. Keep golden cases in version control, block releases on meaningful thresholds and avoid treating traffic dashboards as correctness tests.
Regression tests
Red teaming
Request traces
- [Promptfoo →](https://www.promptfoo.dev/)
- [Helicone →](https://docs.helicone.ai/)
authorized generative-AI red teaming
### garak + PyRIT
Apache-2.0 garak probes models for prompt injection, jailbreaks, data leakage, misinformation, toxicity and other failure modes; MIT-licensed PyRIT orchestrates multi-turn attacks, converters, scorers and result memory for structured security exercises. Run only against systems you own or are authorized to test, cap cost and concurrency, isolate credentials, and handle prompts, responses and JSONL logs as potentially harmful security fixtures. Community attack corpora such as L1B3RT4S can broaden coverage, but they are uncurated inputs—not a safety standard or a pass/fail oracle.
Attack automation
Many model routes
Authorized targets only
- [garak repository →](https://github.com/NVIDIA/garak)
- [PyRIT repository →](https://github.com/microsoft/PyRIT)
- [L1B3RT4S attack corpus →](https://github.com/elder-plinius/L1B3RT4S)
- [Choose a jailbreak benchmark →](https://isaiuseful.com/benchmarks.html.md#jailbreakbench-harmbench)
open-weight refusal-direction research
### Heretic
An AGPL-3.0 command-line tool that automatically finds and suppresses refusal directions in supported open-weight transformer models, then offers comparison and evaluation routes. That makes it useful for interpretability and controlled robustness research—and capable of deliberately removing safety behavior. Use only in an isolated, authorized lab; preserve the original checkpoint, block deployment and sharing by default, scan generated artifacts, and compare helpfulness, over-refusal and harmful compliance rather than celebrating a lower refusal count.
Directional ablation
Dual-use
Lab isolation
- [Heretic repository →](https://github.com/p-e-w/heretic)
- [Measure attacks and defenses →](https://isaiuseful.com/benchmarks.html.md#jailbreakbench-harmbench)
prompt-injection attack + defense labs
### Tensor Trust + Gandalf
Tensor Trust is an open research game where participants write defenses and attack other prompt-protected accounts; Gandalf is a guided prompt-injection challenge that becomes harder across levels. They make failure modes tangible for awareness training, but neither simulates tool permissions, retrieval poisoning or a production incident. Tensor Trust says submitted text will be released for research, so never enter secrets, personal data or proprietary prompts.
Hands-on learning
Attack + defense
Public submissions
- [Play Tensor Trust →](https://tensortrust.ai/)
- [Research data and method →](https://tensortrust.ai/paper/)
- [Try Gandalf →](https://gandalf.lakera.ai/)
### Run durable assistants and custom systems
company agent workspace + app sandbox
### Cloudflare OS
An Apache-2.0 early-access workspace for agent chat and AI-built, shareable “Gadgets” on Cloudflare Workers. Capability-scoped Gatekeepers mediate external resources, log actions and queue side-effect approvals. The quick local route is explicitly non-production, while documented deployment on your own `workerd` server is still forthcoming; audit each OAuth connector, sandbox boundary, simulated approval result and data-residency path before organizational use.
Apache-2.0
Workers + workerd
Early access
- [Cloudflare OS repository →](https://github.com/cloudflare/cloudflare-os)
- [Deploy to Cloudflare →](https://os.cloudflare.app/deploy)
embedded agent isolation + orchestration
### Rivet agentOS
An Apache-2.0 runtime that executes supported coding agents inside lightweight isolated Linux environments with deny-by-default filesystem, network and process permissions. Its cold-start and cost comparisons are project benchmarks. Test required syscalls, process behavior and deny paths on your workload; a lightweight VM boundary still needs patched hosts, secrets brokering and resource limits.
Linux environment
Deny by default
Verify compatibility
- [agentOS repository →](https://github.com/rivet-dev/agentos)
local agent memory
### MEMANTO
An MIT-licensed local memory service with remember, recall and answer operations for several coding-agent clients, without a hosted backend or vector database. Persistent memory can preserve mistakes, secrets and stale decisions as easily as useful context. Scope what is ingested, test retrieval on a known set and keep export, deletion, backup and retention controls visible.
Local
Persistent memory
No vector database
- [MEMANTO repository →](https://github.com/moorcheh-ai/memanto)
desktop + multi-device automation
### Microsoft UFO
UFO is an MIT-licensed Microsoft research project for Windows desktop automation and cross-device orchestration. The code runs on infrastructure you control, while model endpoints are configured separately. GUI control carries broad authority: begin with non-critical accounts, isolate credentials and files, require approval for consequential actions and measure recovery from focus changes and partial execution.
Self-deployed
Windows + devices
Research project
- [Microsoft UFO repository →](https://github.com/microsoft/UFO)
general-purpose local agent
### Goose
An Apache-2.0 desktop app, CLI and API for coding, research and automation across many hosted and local model providers, with MCP extensions, reusable recipes and ACP support. It includes tool permissions, prompt-injection checks and optional adversary review, but those controls do not make arbitrary extensions or model output trustworthy. Begin with a narrow directory, an extension allowlist and approval-required tools; inspect provider, subscription and telemetry paths separately.
Desktop + CLI + API
MCP + ACP
Permission controls
- [Goose documentation →](https://goose-docs.ai/)
- [Source and Apache-2.0 license →](https://github.com/aaif-goose/goose)
- [Security guidance →](https://goose-docs.ai/docs/guides/security/)
general agent
### Hermes Agent
A persistent assistant that can learn reusable skills and run on Linux, macOS, Windows or a remote server. **Mobile role:** talk to the same home- or cloud-hosted agent through Telegram, Discord, Slack, WhatsApp or another configured channel. The messaging provider remains part of the communications path.
Phone messaging
Remote-first
Skills
- [Messaging gateway →](https://hermes-agent.nousresearch.com/docs/user-guide/messaging/)
- [Official repository →](https://github.com/NousResearch/hermes-agent)
connected assistant
### OpenClaw + companion apps
OpenClaw keeps one gateway and state store on the always-on host, while Windows, macOS, Linux, mobile and messaging clients act as operators or narrowly scoped nodes. **Mobile role:** its iPhone and Android companions connect to that gateway; the phone does not host the gateway or silently reduce its tool authority.
iPhone + Android
Always-on host
Remote gateway
- [Remote gateway →](https://docs.openclaw.ai/gateway/remote)
- [iPhone app →](https://docs.openclaw.ai/platforms/ios)
- [Android app →](https://docs.openclaw.ai/platforms/android)
local multi-agent manager
### TripleBits Apprentice
A desktop route for creating scheduled agents with chosen models, memory, budgets, channels and tools. TripleBits says Apprentice runs agents in isolated local Docker containers, offers command and website controls and keeps run logs locally; treat those as vendor claims and test filesystem mounts, network denial, credential brokering and budget stops before sensitive work.
Local-first
Schedules + channels
Verify controls
- [TripleBits Apprentice →](https://triplebits.com/)
agent containment
### NVIDIA OpenShell
A policy and sandbox runtime for autonomous agents on Linux, macOS and Windows through WSL 2. Use it to bound files, networking and execution around an agent or tool runner; still verify the selected backend and test the deny path instead of treating “sandboxed” as a blanket guarantee.
Policy
Sandbox
Cross-platform
- [Official repository →](https://github.com/NVIDIA/OpenShell)
Python + TypeScript orchestration
### LangChain + LangGraph
LangChain supplies model and tool integrations; LangGraph adds explicit stateful agent graphs, checkpointing and human-in-the-loop control. They orchestrate agent reasoning—not telecom media, distributed transactions or durable business state by themselves.
Code-first
Agent state
Python + TypeScript
- [LangChain →](https://github.com/langchain-ai/langchain)
- [LangGraph →](https://github.com/langchain-ai/langgraph)
Microsoft agent orchestration + governance
### Microsoft Agent Framework + Governance Toolkit
Use Microsoft Agent Framework for new .NET or Python agents and graph-based workflows; Microsoft describes it as the successor to AutoGen and Semantic Kernel, and its current orchestration patterns cover the Magentic route without a separate legacy Magentic-One deployment. Pair it with the framework-agnostic Agent Governance Toolkit for policy enforcement, agent identity, sandboxing and tamper-evident audit records. Pin versions and test deny paths before production.
.NET + Python
Workflows
Governance controls
- [Agent Framework →](https://github.com/microsoft/agent-framework)
- [AutoGen migration →](https://learn.microsoft.com/en-us/agent-framework/migration-guide/from-autogen/)
- [Semantic Kernel migration →](https://learn.microsoft.com/en-us/agent-framework/migration-guide/from-semantic-kernel/)
- [Governance Toolkit →](https://github.com/microsoft/agent-governance-toolkit)
### Operate the stack
telemetry + dashboards + logs
### OpenTelemetry + Prometheus + Grafana + Loki
Trace one workflow across service boundaries, record bounded metrics, build dashboards and aggregate logs. Avoid putting transcripts, phone numbers, prompts or appointment details into metric labels and unbounded log streams.
Tracing
Metrics
Logs + alerting
- [OpenTelemetry →](https://opentelemetry.io/docs/)
- [Prometheus →](https://prometheus.io/docs/introduction/overview/)
- [Grafana →](https://grafana.com/docs/grafana/latest/)
- [Loki →](https://grafana.com/docs/loki/latest/)
identity + secrets
### Keycloak + OpenBao
Use Keycloak for operator identity and roles; use OpenBao for SIP, calendar and database credentials with short leases or rotation where supported. Neither replaces host hardening or application-level authorization.
OIDC
Secrets
Rotation
- [Keycloak →](https://www.keycloak.org/documentation)
- [OpenBao →](https://openbao.org/docs/)
data governance + compliance
### Microsoft Purview
Microsoft's portfolio spans data cataloging and governance, information protection, data loss prevention, audit, lifecycle, eDiscovery and related compliance controls. In an AI teammate, use Purview to classify and govern data around the workflow; it does not replace per-tool authorization, short-lived credentials or runtime containment.
Microsoft ecosystem
Data controls
Audit + compliance
- [Purview overview →](https://learn.microsoft.com/en-us/purview/)
- [Purview developer platform →](https://learn.microsoft.com/en-us/purview/developer/)
programmable input + output rails
### NVIDIA NeMo Guardrails + Guardrails AI
NeMo Guardrails adds configurable input, dialog, retrieval, execution and output rails around LLM applications. Guardrails AI focuses on validators and structured, checked outputs. Use either as explicit policy code with tested allow and deny cases—the framework name is not a safety guarantee.
Policy checks
Validation
Test deny paths
- [NVIDIA NeMo Guardrails →](https://docs.nvidia.com/nemo/guardrails/about-nemo-guardrails-library/overview)
- [Guardrails AI →](https://guardrailsai.com/guardrails/docs)
PII detection + de-identification
### Microsoft Presidio
Presidio detects and anonymizes personally identifiable information across text, images and structured data. Detection is probabilistic and domain-dependent: add organization-specific recognizers, measure false negatives and keep access control and minimization in place even after redaction.
PII
Self-hostable
Custom recognizers
- [Microsoft Presidio →](https://data-privacy-stack.github.io/presidio/getting_started/)
AI application + supply-chain security
### Prompt Security + Protect AI
Prompt Security focuses on discovering and protecting generative-AI use and applications. Protect AI covers AI security across models, artifacts and the software supply chain. Evaluate the exact product or open-source scanner you intend to deploy; neither replaces least privilege, sandboxing or incident response.
Application security
Model supply chain
Commercial platforms
- [Prompt Security →](https://prompt.security/)
- [Protect AI →](https://protectai.com/)
prompt-injection screening
### SafePrompt + Lakera Guard + LLM Guard
SafePrompt is the low-friction hosted choice for most developers: one provider-neutral HTTP call and a free starting tier. Its own April 2026 comparison reports most checks under 100 ms and accuracy above 95%; treat those as vendor claims and validate them against your traffic and attack set. Choose Lakera Guard when current SOC 2 evidence and enterprise support are procurement gates, or MIT-licensed LLM Guard when prompts must stay inside your infrastructure and you can operate and tune Python scanners. Detection is one layer—not a replacement for least-privilege tools, policy enforcement, output validation and incident logs.
Hosted default
Enterprise option
Self-hosted option
- [Vendor comparison and methodology →](https://safeprompt.dev/blog/best-prompt-injection-detection-tools)
- [SafePrompt quick start →](https://docs.safeprompt.dev/quick-start)
- [Lakera platform and compliance →](https://docs.lakera.ai/docs/platform)
- [LLM Guard repository →](https://github.com/protectai/llm-guard)
event transport · optional
### NATS + RabbitMQ
Add a broker when independently deployed services need backpressure, fan-out or replayable delivery. A single Temporal deployment plus PostgreSQL may not need one; do not introduce a second retry system until ownership and deduplication are explicit.
Messaging
Backpressure
Optional
- [NATS →](https://docs.nats.io/)
- [RabbitMQ →](https://www.rabbitmq.com/docs)
No tool matches this topic and search. Try a broader term or choose all.
Selection test
## Trial the boundary, not only the happy path.
A useful tool survives your real files, denial cases, export needs and maintenance budget.
**Fit**
Test ten representative cases against a manual baseline and a named acceptance threshold.
**Boundary**
Write down what leaves the device, which identities and tools it can use, and where traces remain.
**Failure**
Exercise denied files, missing credentials, hostile content, bad output and recovery after interruption.
**Exit**
Export data and configuration, reproduce one result and estimate the work to replace the tool.
**Fast-moving catalogue:** the catalogue was last updated from primary project or vendor sources on 15 August 2026. Recheck the exact release, model weights, license, pricing and deployment documentation before adoption.
Coding-agent overhead
## Efficiency: wall-clock and memory
Two narrow studies expose costs hidden by capability scores. They use different methods and workloads, so read each on its own terms—not as one combined ranking.
> Visual: Independent practitioner benchmark · updated 27 July 2026. Hold DeepSeek V4 Flash fixed; measure the wrapper. The study ran the same eight focused repository bug fixes with the same local model and grading method. Pi, OpenCode and Claude Code have 24 timed runs each; Nanocoder has 54 timed runs in the published wall-clock series. Dots are individual runs and diamonds are task-weighted averages.
Independent practitioner benchmark · updated 27 July 2026
### Hold DeepSeek V4 Flash fixed; measure the wrapper.
The study ran the same eight focused repository bug fixes with the same local model and grading method. Pi, OpenCode and Claude Code have 24 timed runs each; Nanocoder has 54 timed runs in the published wall-clock series. Dots are individual runs and diamonds are task-weighted averages.
Axis range
Zoomed to ten minutes. Choose Full to reveal every run at its true position.
**Visual entries (display order):**
- **Pi** 2.1m average 24 runs · 4 tools
- **OpenCode** 3.1m average 24 runs · 10 tools
- **Claude Code** 8.0m average 24 runs · 27 tools
- **Nanocoder** 5.2m average 54 timed runs · 15 tools
**Read this narrowly.** The result describes one model, codebase and task distribution. It does not establish a universal speed or quality ranking; it does show why harness, output tokens, tool calls, timeouts and repeated runs belong in a coding-agent evaluation.
- [Read the study and methodology →](https://nqawhc.github.io/articles/harness-efficiency-not-quality/)
- [Open the benchmark database entry →](https://isaiuseful.com/benchmarks.html.md#harness-efficiency)
> Visual: JCode project benchmark · checked 28 July 2026. Add another session; measure proportional RAM. JCode's corrected Linux rerun measures the slope from one to ten active clients. Bars show approximate extra proportional set size (PSS) per added session, which accounts for shared memory proportionally. Lower is better.
JCode project benchmark · checked 28 July 2026
### Add another session; measure proportional RAM.
JCode's corrected Linux rerun measures the slope from one to ten active clients. Bars show approximate extra proportional set size (PSS) per added session, which accounts for shared memory proportionally. Lower is better.
**Visual entries (display order):**
- **JCode · embeddings off** ~9.9 MB · baseline
- **JCode** ~10.4 MB · 1.1×
- **Codex CLI** ~21.6 MB · 2.2×
- **Pi** ~76.5 MB · 7.7×
- **Antigravity CLI** ~86.4 MB · 8.7×
- **Cursor Agent** ~157.5 MB · 15.9×
- **GitHub Copilot CLI** ~158.1 MB · 16.0×
- **Claude Code** ~212.7 MB · 21.5×
- **OpenCode** ~318.4 MB · 32.2×
**Read this as project evidence.** The measurements use one Linux machine and pinned client versions. PSS varies with operating system, version, authentication state, extensions, MCP servers and workload; it does not measure answer quality or model-serving memory. Re-run the comparison before capacity planning.
- [See the live comparison and method →](https://jcode.sh/#performance-and-resource-efficiency)
- [Inspect JCode source and tested versions →](https://github.com/1jehuang/jcode)
Next step
## Choose a workflow before assembling a stack.
The smallest tool set that passes a real acceptance test is usually the easiest one to secure, explain and replace.
- [Choose a guide](https://isaiuseful.com/guides.html.md#chooser)
- [Choose a local model](https://isaiuseful.com/local-models.html.md)