Price monitoring · Energy tariffs
Energy tariff monitoring: public electricity and gas prices by region and postcode
A retail energy tariff is a unit rate and a standing charge for one region, meter type and payment method, published through a supplier's public quote calculator. Query those calculators with representative postcodes and standard consumption profiles from an exit in the country, and you have a regional tariff panel without touching anyone's personal data.
Pay per GB · No subscription · Prices in EUR, excl. VAT
- €0.75
- per GB on ARC Basic, excl. VAT
- −21%
- at 1 TB (€0.59 / GB)
- 185+
- countries, city targeting
- Never
- expires — no subscription
Written for
- Energy comparison sites
- Energy market analysts
- Regulatory and policy researchers
- Supplier pricing teams
The short answer
- Energy tariffs are regional: in Great Britain, Ofgem says the price cap and standing charges vary with where you live, how you pay and your meter type. The postcode you enter decides the region, not the exit IP.
- Use representative postcodes and published standard consumption profiles. Never enter a real person's address, name, meter number or account.
- Store unit rate and standing charge separately, plus contract length, exit fees and tariff type. A single annual-cost figure hides the structure.
- Calculator pages are small and the panel is finite, so ARC Basic carries almost all of it.
The problem
What goes wrong without the right IPs
One postcode reported as the country
Standing charges and unit rates differ by region. A tracker that quotes one postcode reports one network area's tariffs and calls them national.
Annual cost without its parts
Calculators often lead with an estimated annual cost. Two tariffs with the same estimate can have very different standing charges and unit rates, and they diverge as soon as consumption differs from the profile.
Calculators that drift into personal data
Some supplier journeys ask for a full address, meter details or contact data after the first quote. Continuing down that path turns a price study into the collection of personal data, which this kind of monitoring should never do.
Quote flows lose state
A calculator is several steps: postcode, meter type, consumption, results. If the exit IP changes between steps, some sites restart the flow or return a generic result.
Missed tariff changes
Regulated caps change on a fixed calendar and fixed deals come and go weekly. A monthly sweep sees the cap but misses most of the fixed-deal market.
What to collect
What you can collect
- Postcode and region
- The representative postcode used and the distribution region it maps to. Every price hangs off it.
- Fuel, meter and payment type
- Electricity or gas, standard or time-of-use meter, direct debit or other. Each changes the tariff.
- Consumption profile
- The annual kWh you entered, from a published standard profile, so estimates are reproducible.
- Unit rate(s)
- Per kWh, per time band where the tariff has more than one.
- Standing charge
- Per day. In Great Britain the price cap limits unit rate and standing charge together, not the total bill.
- Tariff type and contract length
- Variable, fixed, time-of-use or dynamic, and the term of a fixed deal.
- Exit fees and conditions
- Early-exit fees and eligibility conditions, as stated on the public quote page.
- Estimated annual cost
- As the calculator shows it, kept beside the parts it was computed from.
How it runs
How a collection run works
- 01
Build a postcode panel per region
Pick one or more representative postcodes for each distribution or network region in the market, using public lists of regions. A postcode should stand for an area, never for a household.
- 02
Fix your consumption profiles
Use the standard consumption values the regulator or comparison tools in that market publish, for example low, medium and high usage. Keeping profiles fixed makes estimates comparable from week to week.
- 03
Run each quote flow on one exit
Open a sticky session per postcode and profile so the steps of the calculator share one IP. Stop at the results page; if a flow requires an address, name or account before showing prices, skip it.
One sticky exit per quote flow15 linesimport requestsGATEWAY = "proxy.arcproxies.io:8000"PASSWORD = "PASSWORD"def quote_session(country: str, handle: str) -> requests.Session: # Postcode, meter type and consumption are separate steps: keep one exit. user = f"USERNAME_pool-arc_country-{country}_session-{handle}_sesstime-5" proxy = f"http://{user}:{PASSWORD}@{GATEWAY}" s = requests.Session() s.proxies = {"http": proxy, "https": proxy} return ss = quote_session("gb", "ls1medium")# 1) postcode 2) fuel and meter 3) standard kWh profile 4) read results, stop - 04
Parse rates, not just totals
Extract unit rates per band, standing charge, tariff type, term and exit fees from the results page or the public JSON it loads. Keep the estimated annual cost alongside, not instead.
- 05
Schedule around the tariff calendar
Run a full panel weekly, plus a run on the day a regulated cap or reference price changes. Dynamic tariffs that publish prices per day or half-hour need their own, lighter feed.
Setup
Recommended setup
Tariff calculators are small, the panel is a few hundred quote flows, and each flow needs one IP for a few minutes, so the cheapest pool with sticky sessions fits.
| Plan | Role | Session | Targeting | Price |
|---|---|---|---|---|
ARC Basic Rotating ISP | Default for supplier and comparison calculators Rotating ISP exits at our lowest price per GB, held for each multi-step quote. Calculators are light pages and JSON calls. | Sticky, 5 minutes per quote flow | Country | €0.75 / GB €0.59 at 1 TB (−21%) |
ARC Fast Rotating residential | For calculators that fail on ISP exits Residential exits for the supplier sites where ISP addresses keep getting a challenge or an empty result. Move those sites alone. | Sticky per quote flow | Country | €2.00 / GB €1.12 at 1 TB (−44%) |
Prices are list prices in EUR, excl. VAT. Volume discounts apply automatically at checkout — full ladder on the pricing page.
Connect
One connection string per market
The country, city and sticky session are tokens in the username. Change the token, change the market; keep the session handle, keep the IP.
http://USERNAME_pool-arcfast_country-de_session-k3f9a1x2_sesstime-10:PASSWORD@proxy.arcproxies.io:8000Swap _country-de for any market you quote. The full grammar is on the residential proxies page.
Illustration
What a weekly tariff panel in three markets costs
An illustration with round numbers — your pages, payloads and retry rate will differ. The arithmetic is the real price ladder.
Assumptions
- Postcodes across all regions
- 60
- Suppliers and comparison tools
- 25
- Profiles (fuel, meter, usage)
- 4
- Requests per quote flow
- 5 at 80 KB
- Cadence
- weekly, about 4.3 runs a month
- Bandwidth per month
- ≈ 11 GB
On ARC Basic
€8.25per month, excl. VAT
11 GB bought in one purchase at €0.75 / GB (list price).
The same 11 GB on ARC Fast: €22.00 at €2.00 / GB. Route only the jobs that need it through the pricier pool.
A small, steady line: bandwidth does not expire, so one purchase can cover several months of weekly panels. A full browser with images loaded can make each flow several times heavier.
Bandwidth never expires, so a bigger single purchase is only ever cheaper per GB. See the ladder.
In depth
Energy tariffs, in depth
How retail energy tariffs vary by region
A retail electricity or gas tariff has two parts: a price per kWh and a fixed charge per day. Both depend on the network region the meter is in, the meter type and often the payment method, because network costs and settlement differ by area.
Great Britain makes the structure explicit. Ofgem sets the default tariff price cap every three months; it is the maximum a supplier can charge for a unit of energy and the standing charge together, it does not limit the total bill, and both cap and standing charge vary with where you live and how you pay. Customers on fixed deals are not covered by the cap. Other markets have different regulation but the same principle: a tariff is a regional price.
| What decides the tariff | How a calculator sets it | What the exit IP contributes |
|---|---|---|
| Region or network area | The postcode you enter | Nothing — the postcode decides |
| Meter and payment type | Selection in the flow | Nothing |
| Consumption | kWh you enter or a profile | Nothing |
| Which country site and offers load | Domain and visitor location | Decisive: some suppliers serve only domestic visitors |
So the proxy's job here is narrow: put the request in the right country, keep each multi-step quote on one IP, and spread a panel of quotes across addresses. The geo-targeting entry explains the country token.
Public pages only: what not to collect
Tariff monitoring works entirely on public quote pages with sample inputs. A representative postcode for a region is not a household; a standard consumption profile is not anyone's usage.
The line is crossed the moment a flow asks for something about a real person. Stop there, and do not work around it.
- Do use region-representative postcodes and published standard consumption values.
- Do stop at the first results page that shows tariffs.
- Do not enter real names, full addresses, meter numbers, email addresses or phone numbers.
- Do not create accounts or start a switch to reach prices; if prices sit behind that, they are out of scope. See the acceptable use policy.
Comparison tools and dynamic tariffs in EU law
The EU Electricity Directive (EU) 2019/944 gives household customers, and microenterprises below 100,000 kWh a year, the right to access free of charge at least one tool comparing suppliers' offers. Its Article 14 lists requirements for such tools, including independence from market participants, disclosure of who runs and funds them, clear comparison criteria, accurate and up-to-date information with the time of the last update, and asking only for the personal data strictly necessary for the comparison.
Article 11 of the same directive requires that a final customer with a smart meter can conclude a dynamic electricity price contract with at least one supplier and with every supplier that has more than 200,000 final customers. Dynamic tariffs publish prices per hour or shorter period, which is a different collection shape: a small daily price file per tariff, rather than a quote flow.
For a comparison site or a researcher, these provisions describe what the market is supposed to make visible. Whether a given tool meets them is a regulatory question, not something this page answers.
Turning quotes into a tariff time series
Store one row per postcode, profile, supplier, tariff and run, with unit rates, standing charge, term and exit fees. From that, the useful series follow: the cheapest fixed deal per region, the spread between default and fixed tariffs, how quickly suppliers re-price after a cap change, and how standing charges differ between regions.
Keep the estimated annual cost the calculator shows, but recompute your own from rates and profile. A mismatch between the two usually means an assumption you have not captured, such as a discount, a time-of-use split or a different consumption default. The guide on storing price time series covers the table design.
Works with anything that takes a proxy URL
- Python requests / httpx
Playwright
- Scrapy
- n8n
- Docker
FAQ
Questions
Something not covered? Write to contact@arcproxies.io.
Does the proxy location decide which regional tariff I see?
No. Energy calculators set the region from the postcode you enter, and the meter, payment type and consumption from the next steps. The exit IP decides the country and keeps the quote flow on one address. Use country targeting and let the postcode do the rest.
Is it acceptable to collect energy tariffs automatically?
Collecting public tariff information with representative postcodes and standard consumption profiles, at a polite pace, is what comparison sites and researchers do. Never enter a real person's details, never create accounts, and read each site's terms. This is not legal advice.
Which consumption values should I enter?
The standard consumption profiles published in each market, for example by the energy regulator or used by comparison tools, in low, medium and high bands. Keep them fixed across runs so estimates stay comparable.
How often do energy tariffs change?
Regulated default tariffs change on the regulator's calendar; in Great Britain Ofgem sets the price cap every three months. Fixed deals are launched and withdrawn far more often, so a weekly panel plus a run on cap-change days covers most needs.
How much bandwidth does a tariff panel use?
Very little. 6,000 quote flows a week at five 80 KB requests each come to about 10 GB a month. Rendering calculators in a full browser with images on can make that several times larger.
Can I monitor dynamic or time-of-use tariffs?
Yes, where suppliers publish the rates publicly. Time-of-use tariffs show several unit rates per band; dynamic tariffs publish prices per hour or shorter. Both are best stored as separate rate rows per band or interval rather than one blended price.
Sources & review
Last reviewed by the ARC Proxies team. Prices are read from the live catalog at build time.
Price monitoring
More on price monitoring
Get started
Buy a gigabyte and try it on your own targets.
No subscription, no sales call. Code WELCOME15 takes 15% off your first purchase, and whatever you do not use is still there next quarter.