# DuckDB - Analytics & Dashboards

DuckDB for in-browser analytics, large-scale dashboards, CSV/Parquet processing. Sub-second queries on hundreds of millions of rows.

## Apps (4)

### BRIQ - In-Browser DuckDB Analytics
- App: https://briq.tigzig.com
- Docs: https://tigzig.com/app-documentation/briq.html
- GitHub: https://github.com/amararun/shared-sql-rooms-tigzig-new
- AI Docs: https://tigzig.com/ai/apps/briq.md
- Natural language to SQL with DuckDB running entirely in the browser. Data stays local - nothing uploaded to servers. Supports CSV, Parquet, JSON, TSV, pipe-delimited, and DuckDB database files.

### Process Cricsheet.org zipped CSV files to pipe-delimited TXT
- App: https://cricket-flask-only.tigzig.com
- Docs: https://tigzig.com/app-documentation/csv-processor.html
- AI Docs: https://tigzig.com/ai/apps/csv-processor.md
- Process Cricsheet.org zipped CSV files to pipe-delimited TXT

### DuckIt - CSV to DuckDB Converter
- App: https://duckit.tigzig.com
- Docs: https://tigzig.com/app-documentation/duckit-xlwings.html
- AI Docs: https://tigzig.com/ai/apps/duckit-xlwings.md
- Browser-based tool for converting CSV/TSV files to DuckDB databases and Parquet files with shareable download links. Conversion happens in-browser using DuckDB-WASM. Integrates with xlwings Lite Data Importer for Excel-based SQL analytics.

### CinePro - IMDb Analytics Dashboard
- App: https://imdb-dashboards.tigzig.com
- Docs: https://tigzig.com/app-documentation/movie-explorer.html
- AI Docs: https://tigzig.com/ai/apps/movie-explorer.md
- Interactive movie and TV analytics dashboard exploring 12M+ titles from the IMDb dataset. 230M+ rows across pre-computed optimization tables in a 10GB DuckDB database. Sub-second query responses.

## Blog Posts (14)

- [Rolling Returns: Why CAGR Alone Can Mislead You (And What To Use Instead)](https://tigzig.com/post/rolling-returns-why-cagr-alone-can-mislead-you.html) — Tags: mutual-funds, portfolio-analytics, duckdb
  Explains why point-to-point CAGR is fragile and how rolling returns provide a more reliable picture of fund performance. Covers the difference between rolling window and evaluation period, the ASOF JOIN computation in DuckDB SQL, minimum gap thresholds, CAGR vs absolute return for sub-1-year windows, and how to read each column (average, median, min, max, % negative, observations). Includes validation results across 7,485 data points within 0.50 bps of Excel. Live on MFPRO with 95 funds and 9 indices.
  AI-readable: https://tigzig.com/ai/posts/rolling-returns-why-cagr-alone-can-mislead-you.md
- [Talk to Your Database from Excel - Postgres, DuckDB - via Claude in Excel with MCP](https://tigzig.com/post/talk-to-your-database-from-excel-postgres-duckdb-claude-mcp.html) — Tags: claude-in-excel, mcp, duckdb, database-ai
  Public MCP server enabling SQL queries against live Postgres (Supabase, ODI cricket) and DuckDB (T20 cricket) databases from Claude in Excel. Covers 2 million rows of ball-by-ball data from 2013-2025. Built with FastAPI, asyncpg, and fastapi-mcp. Includes detailed tool docstrings for schema context, 1000-row response cap, read-only security, rate limiting, and SQL validation. Open source, single-file Python backend.
  AI-readable: https://tigzig.com/ai/posts/talk-to-your-database-from-excel-postgres-duckdb-claude-mcp.md
- [How I Built a Sub-Second Movie Similarity Engine With a 10-Line SQL Query](https://tigzig.com/post/movie-similarity-engine-sql-jaccard-duckdb.html) — Tags: duckdb, database-ai
  Movie similarity engine using weighted Jaccard similarity in pure SQL on DuckDB. Pre-computes token lists from 97M person-to-title records, filtering to 12,000 movies with 10,000+ votes. Tokens encode genre, directors, actors (weighted by billing), writers, decade, runtime, and rating band via token duplication. A single 10-line SQL query compares one movie against all others in under 1 second. Returns matching factors for explainability. Open source.
  AI-readable: https://tigzig.com/ai/posts/movie-similarity-engine-sql-jaccard-duckdb.md
- [From 12 second queries to under 1s: Optimizing a 230 Million Row Dashboard - 14 Bottlenecks I Had to Fix](https://tigzig.com/post/from-12-second-queries-to-under-1s-optimizing-230-million-row-dashboard.html) — Tags: duckdb, fastapi, infrastructure
  Documents 14 optimization techniques that reduced query times from 9-12 seconds to under 1 second on a 230M-row DuckDB dashboard (16GB). Covers pre-computed denormalized tables, single-blob dashboard cache, in-memory query caching, ORDER BY index conflicts, adaptive queries, EXISTS vs CTE (15x gap), client-side computation from loaded data, Docker container memory mismatch with DuckDB, and autocomplete race condition fixes. Open source with dual Hetzner/Oracle backends.
  AI-readable: https://tigzig.com/ai/posts/from-12-second-queries-to-under-1s-optimizing-230-million-row-dashboard.md
- [Architecture & Setup for a Dashboard with Hundreds of Millions of Records - Powered by DuckDB](https://tigzig.com/post/custom-dashboard-duckdb-fastapi-230-million-rows.html) — Tags: duckdb, fastapi, infrastructure, react
  Architecture guide for building a custom dashboard with 230M rows on DuckDB (16GB). Covers FastAPI backend with read-only and admin endpoints, React frontend on Vercel, serverless proxy for API security, dual backend setup (Hetzner/Oracle), data pipeline with pre-computed denormalized tables, Clerk auth toggle, query timer, and smart search. Addresses Docker container memory mismatch with DuckDB. Open source, runs on 8 EUR/month Hetzner VPS.
  AI-readable: https://tigzig.com/ai/posts/custom-dashboard-duckdb-fastapi-230-million-rows.md
- [CinePro - 230M Rows, 16GB Database, Instant Queries with DuckDB](https://tigzig.com/post/cinepro-movie-explorer-duckdb.html) — Tags: duckdb, fastapi, react
  CinePro movie analytics dashboard built on 230M rows (16GB) of IMDb data in a single DuckDB file. Features type-as-you-search across 15M people, multi-filter discovery, Jaccard similarity for finding similar movies, career timeline analysis, side-by-side comparisons, and live query timer. Runs on $7/month Hetzner VPS alongside 40 other backends. Dual backend (Hetzner/Oracle) with UI toggle. Fully open source.
  AI-readable: https://tigzig.com/ai/posts/cinepro-movie-explorer-duckdb.md
- [BRIQ App: DuckDB AI in Browser - 500MB Files, 4M+ Records, No Database Setup](https://tigzig.com/post/briq-duckdb-ai-browser-no-database-setup.html) — Tags: duckdb, database-ai
  BRIQ is a browser-based DuckDB AI tool for querying flat files up to 1.5GB using natural language. No database setup or credentials needed. Upload CSV/TSV files, auto-converts to DuckDB in-browser, query with plain English. Data stays in browser except for LLM API calls. Built on SQL Rooms AI. Also available as single-file HTML for offline use. Supports merging, appending, and transforming multiple files. Open source.
  AI-readable: https://tigzig.com/ai/posts/briq-duckdb-ai-browser-no-database-setup.md
- [xlwings Lite Data Importer v2 Released](https://tigzig.com/post/xlwings-lite-data-importer-v2-released.html) — Tags: xlwings-lite, python-in-excel, duckdb
  xlwings Lite Data Importer v2 adds support for any file type (PDFs, images, ZIPs, data files), files up to 1.2GB tested, and token-based private access (Dropbox, Google Drive, GitHub) alongside shareable links. Auto-converts data files to DuckDB or imports as-is. Uses token access pattern from xlwings_utils package. Includes CORS proxy and token setup guides with AI coder instructions.
  AI-readable: https://tigzig.com/ai/posts/xlwings-lite-data-importer-v2-released.md
- [DuckDB Meets Excel: xlwings Lite Data Tools](https://tigzig.com/post/duckdb-meets-excel-xlwings-lite-data-tools.html) — Tags: duckdb, xlwings-lite, python-in-excel
  Two tools for getting large datasets into xlwings Lite. DuckIt: browser-based file converter that turns CSVs into DuckDB or Parquet with shareable links (tested up to 1.5GB, 10M+ records). xlwings Lite Data Importer: pulls files from URLs into Excel, supports DuckDB, SQLite, CSV, Parquet, JSON (tested up to 1.2GB, 20M+ records). Uses Cloudflare Worker for CORS bypass. Both open source.
  AI-readable: https://tigzig.com/ai/posts/duckdb-meets-excel-xlwings-lite-data-tools.md
- [DuckDB isn't just fast SQL. It's Python, SQL and compression all in one box.](https://tigzig.com/post/duckdb-isn-t-just-fast-sql-it-s-python-sql-and-compression-all-in-one-box.html) — Tags: duckdb
  Highlights lesser-known DuckDB SQL features discovered through Jasja De Vries's 30-day series. Includes SELECT EXCLUDE, prefix aliasing, reusable aliases across clauses, LIMIT with percentages, QUALIFY for window function filtering, GROUP BY ALL, LIST comprehensions with Python-like syntax, lambda functions in SQL, dot operator chaining, glob patterns for multi-file queries, and direct file queries without CREATE TABLE.
  AI-readable: https://tigzig.com/ai/posts/duckdb-isn-t-just-fast-sql-it-s-python-sql-and-compression-all-in-one-box.md
- [Try Text-to-SQL on Real Data - Multi-Million Rows & GB+ Sizes](https://tigzig.com/post/try-text-to-sql-on-real-data-gb-files-multi-million-rows.html) — Tags: text-to-sql, database-ai, duckdb
  DATS-4 text-to-SQL app with sample datasets from 64 rows (14KB) to 11.8M rows (1.6GB). Two-click setup creates temporary Postgres database via Neon API, uploads data, and connects AI agent. Nine LLM options from Gemini 2.0 Flash to Claude 4.5 Sonnet. Features dual agents (general and advanced), file uploads, working tables, CSV export, interactive table viewer, Python charts via E2B, and PDF output. Open source with seven GitHub repos.
  AI-readable: https://tigzig.com/ai/posts/try-text-to-sql-on-real-data-gb-files-multi-million-rows.md
- [Segment 1M customers from 10M transactions (640MB CSV) with natural language queries / Text-to-SQL - entirely in your browser. No server. No remote database. No IT approvals.](https://tigzig.com/post/run-advanced-analytics-locally-in-your-browser-no-server-no-remote-database-no-it-approvals.html) — Tags: duckdb, text-to-sql
  Browser-based analytics tool (DABX-1) using DuckDB-WASM and text-to-SQL AI for processing multi-GB files locally. Demonstrated segmenting 1M customers from 10M transactions (640MB CSV) entirely in-browser. Built on SQL Rooms framework. Available as a 3.5MB single HTML file. Supports CSV, TSV, Parquet. Data never leaves the machine.
  AI-readable: https://tigzig.com/ai/posts/run-advanced-analytics-locally-in-your-browser-no-server-no-remote-database-no-it-approvals.md
- [Run a Full AI Database App as a Single HTML File. No Server. No Remote DB.](https://tigzig.com/post/run-a-full-ai-database-app-as-a-single-html-file-no-server-no-remote-db.html) — Tags: database-ai, duckdb
  Single-file deployment of a full AI database app based on SQL Rooms and DuckDB-WASM. The entire React application compiles into a portable 3.5MB HTML file. Demonstrated importing 1.6GB / 11M-row files for in-browser analysis. Built using vite-plugin-singlefile. Supports Gemini API for natural language querying. No backend or server required.
  AI-readable: https://tigzig.com/ai/posts/run-a-full-ai-database-app-as-a-single-html-file-no-server-no-remote-db.md
- [Chat, Query, and Transform Multi-GB Files - In Natural Language, Right in Your Browser with DuckDB.](https://tigzig.com/post/chat-query-and-transform-multi-gb-files-in-natural-language-right-in-your-browser-with-duckdb.html) — Tags: duckdb, text-to-sql
  In-browser analytics tool using DuckDB-WASM and SQL Rooms for querying multi-GB files via natural language. Demonstrated analyzing a 1.6GB, 11M-row CSV file entirely locally. Supports CSV, TSV, pipe-delimited, and Parquet files. Data stays in browser; only schema and sample rows sent to LLM. Supports Gemini, OpenAI, and Claude APIs. Open source.
  AI-readable: https://tigzig.com/ai/posts/chat-query-and-transform-multi-gb-files-in-natural-language-right-in-your-browser-with-duckdb.md

## Related Topics

- [Database AI & Text-to-SQL](https://tigzig.com/ai/tags/database-ai.md)
- [Python in Excel (xlwings Lite)](https://tigzig.com/ai/tags/python-in-excel.md)
- [Claude in Excel](https://tigzig.com/ai/tags/claude-in-excel.md)
- [MCP Servers & Agents](https://tigzig.com/ai/tags/mcp-servers.md)
- [Portfolio & Quantitative Analysis](https://tigzig.com/ai/tags/portfolio-quants.md)
