What are the built-in limits of Data Fix and why do they exist?
Data Fix enforces several hard limits to keep corrections safe, targeted, and performant. These limits exist because the engine is designed for minor data quality patches — not large-scale data manipulation.
Time range limit — 90 days maximum
Each Data Fix operation can cover at most 90 days of meter readings. This prevents accidentally analyzing and modifying an entire year of data in one pass. If you need to fix a longer period, run multiple passes in 90-day windows. Start with the most recent window and work backward.
Reading count limit — 100,000 readings per run
The engine processes a maximum of 100,000 readings per operation. For meters reporting every 15 minutes, 100,000 readings covers roughly 1,040 days — well above the 90-day time limit. This guard protects against memory exhaustion on meters with very high-frequency reporting (e.g., every second).
Gap fill limit — 7 days default
Gaps longer than 7 days (168 hours) are skipped by default. A gap that large usually indicates a real outage, not a minor data hiccup. You can increase this to 720 hours (30 days) in Advanced options, but the engine warns you that longer interpolations are less accurate.
Recent data protection — last 24 hours untouched
Data Fix does not modify readings from the last 24 hours. Late-arriving readings are common in real-time data pipelines — a reading might arrive minutes or hours after its timestamp. Protecting the last day prevents Data Fix from "filling" gaps that would naturally resolve as delayed readings arrive.
Bulk operation limit — 50 meters for preview only
You can preview up to 50 meters at once using the bulk preview feature, but there is no bulk apply. Every apply operation targets a single meter and requires its own confirmation token. This ensures you review and confirm each meter's fixes individually.
Excessive fixes warning — 10% threshold
If more than 10% of readings in the selected range need correction, a warning appears. This signals that the data source itself may need attention — Data Fix is not the right tool for wholesale data repair.
Where to adjust limits: Analytics → Data Fix → Advanced options for gap fill hours. Time range and reading limits are server-enforced and cannot be overridden.