Carrier overview
Two-strategy extraction
1
Strategy A — passthrough proxy
The primary path sends an httpx GET to ABF’s public fuel surcharge page through a residential proxy with
keep_headers=True, which preserves browser-like headers across the proxy hop. When ABF’s origin cooperates, this returns AngularJS HTML that NexusFeed parses directly.2
Strategy B — ScraperAPI full render fallback
When the primary path fails (timeout, 403, empty response, or confidence below threshold), the router automatically re-runs the extraction through ScraperAPI’s full-render mode, which executes the AngularJS client-side and returns the hydrated HTML. The response reports
extraction_method: scraper_api_fallback so you know the fallback ran.Example request
Example response
ABF’s confidence ratio is calculated against
effective_date and fuel_surcharge_pct only. doe_diesel_price_usd is not a required field because the upstream source does not publish it.