Skip to content

SYSTEM Cited by 1 source

Instacart Cost Tracker

Cost Tracker is Instacart's internal system for recording detailed LLM usage and spend, attributed per job and per team. Integrated into Instacart's AI Gateway; every LLM call routed through the Gateway is logged there.

Referenced in the 2025-08-27 Maple post:

"The AI Gateway is also responsible for integrating with the Cost Tracker, logging detailed usage and spend per job and team." (Source: sources/2025-08-27-instacart-simplifying-large-scale-llm-processing-with-maple)

Stub page — post does not disclose Cost Tracker architecture (storage substrate, query interface, reporting cadence, chargeback policy, integration with Instacart's financial systems). Expand on future sources that describe it.

Role

Cost Tracker enables Instacart's platform teams to attribute LLM spend back to the consuming internal team — the per-team cost-attribution primitive. In the Maple post's framing: "ensures teams don't need to worry about how to call various LLMs and prompt jobs are fully traceable, cost-monitored, and fault-tolerant." Cost-monitoring + traceability are the Cost-Tracker-shaped half of that claim.

Seen in

Last updated · 319 distilled / 1,201 read