AI Engineering Tools · Reproducible Tests

Build, test, evaluate, and improve AI applications.

Practical engineering tools and reproducible research for AI agents, RAG pipelines, prompt evaluation, and MCP security.

Explore all tools → Browse research Failure Test Library
Client-Side Execution
Interactive tool computations and scanning heuristics execute locally in your client browser.
Diagnostic Tools
Real, deterministic algorithms for security scans, token economics, and semantic grounding.
Documented Tests
Formalized boundary tests and pass/fail criteria covering real-world LLM failure modes.
Open Engineering
100% free with no registration, no token paywalls, and fully transparent methodology.

Featured Engineering Tools

Core diagnostic and evaluation utilities for modern AI stacks.

View all tools →
Security Protocol Audit

MCP Security Scanner

Audit Model Context Protocol configuration files for shell injections, unpinned packages, and excessive filesystem permissions.

Security Defensive Filter

Prompt Injection Scanner

Scan user prompts and untrusted RAG chunks for direct instruction overrides, jailbreak personas, and markdown exfiltration.

RAG Citation Grounding

RAG Retrieval Debugger

Analyze token overlap and sentence-level attribution between retrieved document passages and generated answers to catch hallucinations.

RAG Vector Ingestion

RAG Chunking Playground

Experiment with document splitting strategies, target token chunk sizes, and boundary overlaps for vector databases.

Evaluation Regression Testing

LLM Response Diff

Compare baseline model outputs against candidate prompts to detect token drift, formatting changes, and semantic regressions.

Agents Execution Trace

Agent Loop Detector

Detect infinite execution loops, cyclical tool calls, and runaway retry patterns in multi-step autonomous agent traces.

Cost & Context Unit Economics

AI API Cost Calculator

Calculate token pricing, prompt caching discounts, and monthly operational costs across OpenAI, Anthropic, and Gemini models.

Cost & Context Attention Saturation

Context Window Calculator

Model token consumption and attention saturation across system prompts, retrieved passages, conversation history, and completion limits.

Engineering Tools Directory

All utilities are grouped into structured technical disciplines to help you diagnose and optimize every layer of your AI stack.

Empirical Research & Failure Modes

Reproducible test case specifications for production AI failure modes.

All research →
Open Research Dataset 6 Seeded Specifications

AI Failure Test Library

A catalog of structured test specifications designed to stress-test AI applications before deployment. Includes test procedures for unbounded agent loops, multi-hop context compression loss, schema hallucinations, and prompt injection vectors.

Explore Test Library → Read AI Engineering Methodology →

Engineering Guides & Architecture

In-depth technical writeups on tokenization, latent geometry, and conditioning math.

View all guides →
Analysis

Text-to-Image Prompt Architecture

How cross-attention layers process token order, why comma-separated tag soup fails, and how to structure descriptive clauses.

Read guide →
VAE Alignment

Latent Aspect Ratios & Training Buckets

Understanding SDXL and Flux bucket resolutions, divisible-by-64 geometry, and preventing multiple torso/limb hallucinations.

Read guide →
Guidance Math

CFG Mechanics & Negative Guidance

Examining Classifier-Free Guidance vector math, when negative prompting strips desirable detail, and modern alternatives.

Read guide →

Start Testing Your AI Systems

Deterministic utilities, zero account sign-up, and 100% free access. Browser-based tools are designed to process supported inputs locally in your browser, minimizing application-controlled transmission of tool content.

Browse All Tools Review Free & Open Access Model