Data engineering & information design.

Applications that make data useful. Analytics platforms, interactive dashboards, and data products for professional services — everything from raw ingestion to the final visualization, custom-built from scratch.

660M

RECORDS / MONTH

9.6B

DATA POINTS

37+

SIGNAL TYPES

§ 01 — SCOPE OF WORK

What we actually do.

Raw data — messy, scattered, high-volume, arriving from dozens of sources — gets turned into something a business can actually use. Not a spreadsheet. Not a static report. A living system that updates itself, catches what matters, and presents it in a way that makes the next decision obvious. Every layer built in-house. No outsourcing, no drag-and-drop tools, no templates.

Analytics

DATA ENGINEERING & ETL

Collection at scale. Data pulled from APIs, web crawls, databases, and public records — hundreds of millions of records a month — cleaned, normalized, deduplicated, and moved reliably into warehouses where it becomes queryable intelligence.

Applications

INFORMATION DESIGN · DASHBOARDS

Interactive, numbers-heavy frontends with real depth — charts, heatmaps, ranking tables, competitive grids. Organized and presented so the data actually communicates: dense, navigable, and designed around the questions its audience needs answered.

Automation

SYSTEMS ARCHITECTURE

Pipelines that run themselves. The interconnect — scheduling, dependency management, error recovery, monitoring — so a system of pipelines shares state and triggers downstream work the moment upstream data changes.

Agentics

AI CLASSIFICATION & INTELLIGENCE

AI working inside the pipeline — classification models that analyze content quality, detect competitive shifts, and score relevance. What lands in the warehouse isn’t raw data; it’s structured intelligence, ready to be queried and visualized.

§ 02 — METHOD

How we build.

The cloud platforms — Google Cloud, BigQuery — provide effectively unlimited compute and storage. Everything on top of them is custom software: the extraction logic, the transformation rules, the orchestration, the APIs, the dashboards. Written from scratch, because the edge cases matter and generic tools don’t know about anyone’s edge cases.

EXTRACTION

APIs have rate limits, websites have anti-scraping measures, databases have schemas designed in 2009. Getting data out cleanly and reliably is its own discipline.

TRANSFORMATION

Where the real work happens. The rules that turn a messy API response into a structured, queryable record that means something specific — written by hand.

Incremental, deduplicated, properly partitioned. At 660 million records a month, the loading strategy matters as much as the transformation logic.

THE INTERCONNECT

Pipelines aware of each other — shared state, dependency management, downstream triggers. The intelligence layer that orchestrates everything.

CLOUD

Google Cloud / BigQuery

LANGUAGES

Python / TypeScript / SQL

FRONTEND

Astro / React / Tailwind / D3

PUBLISHING

Dashboards / Data Products

§ 03 — PRINCIPAL

I’m Douglas Mallett.

Data engineer, analyst, and developer. Amicus Data came out of a problem that kept coming up: interesting data trapped in systems that couldn’t do anything useful with it. Raw APIs returning millions of records with no structure. Organizations sitting on gold mines of information with no way to see it.

Amicus Data is a one-person operation, and that’s intentional. Every pipeline, every dashboard, every line of code comes from the same person who understood the problem. No handoff. No interpretation layer. No game of telephone.

The focus is professional services — legal, accounting, medical — because those are industries where the data is rich, the competition is real, and the existing tools consistently fall short of what’s actually needed.

DOUGLAS MALLETT — DATA ENGINEER & ANALYST
AMICUS DATA · SEATTLE, WA

§ 04 — IN PRACTICE

What this looks like in practice.

The primary platform currently running ingests 660 million records per month from dozens of sources, processes them through custom transformation pipelines, and surfaces the results in interactive dashboards built for specific industries.

Collection at Scale

Search APIs, mapping platforms, website crawlers, business directories, public records. Pipelines that run on schedule, handle failures gracefully, and scale without architectural changes.

Transformation & Intelligence

Cleaned, normalized, deduplicated, enriched. AI classification models analyze content quality, detect competitive shifts, and score relevance before anything lands in the warehouse.

Applications & Dashboards

Interactive web applications, competitive analysis tools, market monitoring dashboards — each designed around the specific questions its audience needs answered.