# I am speed. (iamspeed.dev)

> A network-speed-test-style benchmarking tool for LLM APIs (Fast.com for LLMs). Pick a provider and model, and see live streaming output with real-time throughput metrics.

## Key Features
- **Live Streaming & Real-Time Metrics**: Track throughput in tokens/second, Time-to-First-Token (TTFT), and Time-to-Last-Token (TTLT) dynamically.
- **Race Mode**: Run 2–3 providers in parallel on the same prompt and watch them race side-by-side on a live race track with cars, live TPS, and a Piston Cup podium. Winner is decided by TTLT (time-to-last-token) with TPS as tiebreaker; a "Fastest Start" award highlights the lowest TTFT.
- **Dynamic Model Discovery**: Fetches active models dynamically from models.dev with robust offline fallback.
- **Local & Cloud Provider Support**: Native support for cloud APIs (OpenAI, Anthropic, Groq, Cerebras, Fireworks AI, Mistral, OpenRouter, Google Gemini) and local developer endpoints (Ollama, LM Studio).
- **Sci-Fi Sound Synthesis**: Dynamic additive audio synthesis (Web Audio API) playing metallic "calculation chimes" as numbers roll, with a top-bar mute toggle.
- **Secure Local Storage**: API keys are securely stored client-side using AES-GCM encryption via the Web Crypto API.
- **Run History**: Persistent local history of recent runs with sparkline visualizations.
- **Minimal, Static Architecture**: Fully client-side web application built with Astro and Preact.

## Technical Details
- **Architecture**: Fully static site generation (SSG) with interactive Preact components (islands).
- **Security**: Zero API keys are sent to external servers other than direct requests to the respective AI providers' endpoints. Encryption uses Web Crypto API.
- **Metrics Tracking**:
  - **TTFT (Time-to-First-Token)**: Measured from request initiation to the first chunk received.
  - **Throughput**: Calculated continuously as tokens per second.
  - **TTLT (Time-to-Last-Token)**: Total time elapsed.

## Workspace Structure
- `/src/components/`: Preact UI Islands (BenchmarkPanel, SettingsPanel, TopBarActions, RecentRuns, MetricsDisplay, StreamOutput, RawResponsePanel).
- `/src/components/race/`: Race Mode UI (RacePanel, RaceTrack, RaceTrackLane, RacePodium, RaceSetupBar).
- `/src/lib/`: Core libraries (metrics tracker, cryptographic adapter, local model discovery, sound synthesizer).
- `/src/lib/race/`: Race orchestration, ranking, persistence, and sound effects.
- `/src/lib/providers/`: Endpoints and response parser adapters for Anthropic, OpenAI, Groq, Cerebras, Fireworks AI, Mistral, OpenRouter, Google Gemini, and local endpoints.

## Disclaimer
"Cars", "Piston Cup", McQueen, Sally, Chick Hicks, and related character names are trademarks of Disney/Pixar. This is an unofficial fan project and is not affiliated with or endorsed by Disney.

## Author 

- **Name**: NaveenKumar Namachivayam
- **Website**: [QAInsights.com](https://qainsights.com)
- **Projects**:
  - [JMeter.ai](https://jmeter.ai)
  - [Dosa](https://dosa.dev) 
  - [Awesome AI Tools](https://ai.dosa.dev)
  - [Achu](https://achu.app)
  - [YouTube](https://www.youtube.com/@qainsights)
  - [X](https://x.com/qainsights)