Skip to content

CONCEPT Cited by 1 source

Quota auto-rightsizing

Quota auto-rightsizing is the periodic, automated adjustment of a quota's numeric value based on that subject's historical usage pattern — so the quota tracks what the subject actually needs rather than what the original operator guessed at provisioning time.

Distinct from autoscaling

Autoscaling adjusts how much resource is currently allocated in response to real-time load. Auto-rightsizing adjusts the upper bound (quota) that allocation can grow into; the autoscaler still does the moment-to-moment work, but the rightsizing loop sets the envelope. The two operate on different timescales — autoscaling in seconds, rightsizing in hours or days.

Canonical loop (per Piqama)

  1. Data-plane telemetry. Piqama clients (or storage-based feedback for non-client integrations) transparently collect enforcement and usage stats.
  2. Pre-aggregated persistence. Stats land in Apache Iceberg on S3 with a predefined schema. Pre-aggregation at write time keeps storage bounded.
  3. Separate rightsizing service. Consumes historical data from various sources — Presto, Iceberg directly, or user-defined sources.
  4. Rightsizing strategies. Predict needs based on:
  5. Organic usage growth — trend extrapolation.
  6. Traffic bursts — peak accommodation with headroom.
  7. Underutilization detection — reclaim over-allocated quota.
  8. Write-back to control plane. New quota value flows through Piqama's authoring + authorization + validation surfaces back out to the data plane via the normal update dispatch path.

"This service applies rightsizing strategies designed to predict needs based on organic usage growth, traffic bursts, and underutilization detection. Currently, a rightsizing strategy has been developed for capacity-based quotas, aiming to allocate maximum resources without saturating the system for a Big Data Processing Platform within an organization." (Source: sources/2026-02-24-pinterest-piqama-pinterest-quota-management-ecosystem)

Manual escape hatch is mandatory

Even with auto-rightsizing, operators need a manual path. "Piqama provides a mechanism for development teams to manually adjust quota values. This flexibility is particularly vital in critical situations such as 'firefighting' emergencies or for accommodating urgent, high-priority requests that necessitate immediate resource rebalancing." Operator response time during an incident is shorter than any automation's feedback loop.

Relationship to chargeback

Auto-rightsizing reads usage but doesn't enforce budget. The chargeback + budget enforcement loop (see chargeback cost attribution and budget-enforced quota throttling) writes quota down when budget is exceeded. Both loops consume the same telemetry stream; they are different actions on the same observation.

Seen in

  • sources/2026-02-24-pinterest-piqama-pinterest-quota-management-ecosystem — canonical wiki introduction. Rightsizing service is a separate process from Piqama's control plane; consumes Iceberg + Presto + user-defined sources; deployed for capacity-based quotas on the Big Data Processing Platform; rate-limit rightsizing is listed under "continuous rate limits management will be done centrally via Piqama right-sizing service, by periodically aggregating the request usage stats, forming the feedback loop."
Last updated · 319 distilled / 1,201 read