Most companies don’t fire their cold email agency because the emails stopped working. They fire the agency because nobody asked the right questions before signing the contract. By the time open rates crater and the domain lands on a blocklist, the damage is already done, and rebuilding sender reputation takes longer than the campaign that broke it.
If you’re evaluating vendors right now, this is the checklist we wish more buyers used. It’s built from the questions that separate an agency that treats your inbox like a rented apartment from one that treats it like something they actually have to maintain.
What a cold email agency is actually responsible for
A cold email agency isn’t just a copywriting service that happens to send emails. At minimum, the job covers four things: building and warming sending infrastructure, sourcing and verifying a prospect list that matches your ideal customer profile, writing sequences that get replies instead of just opens, and reporting on results in a way you can actually act on. Some agencies stop at the copywriting and hand you a spreadsheet of leads bought from a third-party tool. Others own the entire stack, from domain registration to the calendar link a prospect clicks. Figure out which one you’re hiring before you sign anything.
In practice, the full-stack version looks like this: a strategist maps your ICP and messaging angle in week 1, infrastructure gets registered and warmed over the following month, and by week 5 or 6 you’re seeing sequences go out to a verified list with someone checking deliverability metrics daily. The version where an agency skips straight to sending is the version where you find out about a domain problem 3 weeks in, after the damage is already done.
The checklist: what to verify before you sign
Domain setup and warmup
This is the single biggest predictor of whether a campaign survives past month one. A competent agency never sends cold email from your primary business domain. They register secondary domains built specifically for outbound, so a deliverability problem never touches the domain your invoices and support emails come from. You’ll want to know how many domains they set up, how many mailboxes per domain, and what the warmup ramp looks like week by week. If the answer is vague, or if they say they’ll start sending at full volume right away, that tells you how this engagement ends.
SPF, DKIM, and DMARC configuration
You don’t need to become an email infrastructure expert to hire well, but the agency does. A good test is asking them to walk you through how they’ll configure authentication records for your domains and what DMARC policy they’ll set and why. Gmail and Yahoo now enforce bulk sender requirements that make this non-negotiable: authentication failures get mail rejected outright, not filtered to spam. An agency that can’t explain this in plain language probably isn’t configuring it correctly either. We’ve written a more technical breakdown of SPF, DKIM, DMARC, and domain warmup if you want to check their answers against a reference.
List sourcing and verification
A list of 10,000 loosely matched contacts will always underperform a list of 800 that actually fit your ideal customer profile. It’s worth pinning down where the data comes from, whether it’s verified before it ever touches a sequence, and how the agency defines your ICP in the first place. Bounce rates above 2% start damaging your sender reputation, and above 5% most sending platforms will throttle or suspend the account outright. If an agency can’t tell you their typical bounce rate on past campaigns, they either don’t track it or don’t want to share it.
What counts as a result
Open rate is the easiest metric to report and the least useful one to optimize for, especially now that Apple Mail Privacy Protection and similar features inflate opens artificially. The agency should be able to tell you what it actually measures and reports weekly: reply rate, positive reply rate, meetings booked, and where those meetings land in your pipeline. A serious agency will tell you upfront what a realistic reply rate looks like for your industry and won’t promise a number before it has seen your offer and ICP.
Who’s actually doing the work
Some agencies staff every account with the same two people who close the sales calls. Others subcontract execution to whoever’s available that week. It’s worth asking directly whether the team that pitched you is the team running your campaign, and how many other accounts that person is juggling. This matters more than it sounds like it should. Infrastructure problems get caught early by someone paying close attention, and missed by someone spread across 15 accounts.
Pricing model and what’s included
Cold email agency pricing generally falls into three bands. Smaller or boutique operators run somewhere around $1,900 to $3,500 a month. Mid-market agencies with more infrastructure and a dedicated strategist tend to land between $4,000 and $8,000. Premium retainers with multi-channel add-ons or larger teams run higher still. On top of the retainer, budget separately for infrastructure costs: domains, mailboxes, verification tools, and sending software typically add another $500 to $2,000 a month depending on scale. Ask what’s bundled into the retainer and what shows up as a separate line item later.
Compliance and unsubscribe handling
Cold email operates under CAN-SPAM in the US, and GDPR or similar regional rules apply if you’re prospecting into the EU or UK. A compliant setup includes a real return address, an honest subject line, and a working one-click unsubscribe link on every message, not a mailto request buried in a footer. Gmail and Yahoo both require RFC 8058 one-click unsubscribe headers for bulk senders, and unsubscribe requests need to be honored within a couple of days, not weeks. Ask how the agency handles suppression lists across campaigns. A prospect who opts out of one sequence should never end up in a different sequence 3 months later because the suppression list didn’t carry over. It sounds like a small detail until a prospect complains and it turns into a spam report that follows your domain.
Questions worth asking on the first call
A short list you can bring into any discovery call:
- How many dedicated sending domains will you register for us, and how are they separated from our main domain?
- What does the warmup schedule look like in week 1, week 4, and week 12?
- What’s your average bounce rate and positive reply rate across the last 5 campaigns in a similar industry?
- Who verifies the list before it enters a sequence, and what tool do you use?
- What happens if deliverability drops mid-campaign? Walk me through the actual remediation steps.
- Can we see a redacted reporting dashboard from an existing client?
- What’s included in the retainer, and what costs extra?
Red flags that should end the conversation
- They want to send from your existing company domain instead of setting up dedicated sending domains.
- They can’t produce a straight answer about bounce rates or reply rates from past work.
- The pricing pitch leads with lead volume promises instead of a plan for your specific ICP.
- Reporting is limited to open rate and emails sent, with no visibility into replies or meetings.
- List verification isn’t mentioned, or it’s treated as an optional add-on.
- They guarantee a specific number of meetings before seeing your offer, pricing, or target market.
- The contract locks you in for 12 months with no early termination clause.
Where Advazon fits into this
We built this checklist from the questions we get asked on discovery calls, and honestly, from watching what happens when companies come to us after a bad experience with a previous vendor. We see the same pattern repeatedly: domains that were never warmed properly, lists pulled once and never re-verified, reporting that stopped at emails sent and nothing beyond that. Fixing that damage usually takes longer than setting things up correctly would have taken in the first place.
Our approach is to own the full stack: infrastructure setup and domain warmup, verified list building tied to your actual ICP, and reporting that tracks replies and pipeline, not just opens. If your current setup needs a second opinion before you commit to a renewal, an email deliverability audit is a reasonable first step, whether or not you end up working with us.
Frequently asked questions
How long does it take to see results from a cold email agency?
Expect 4 to 6 weeks before a new domain is fully warmed and sending at volume, and most agencies won’t call a campaign statistically meaningful until it’s run for 8 to 12 weeks. Anyone promising booked meetings in the first 2 weeks is either sending from an already-warm domain you should ask about, or skipping steps that will cost you later.
Is it worth hiring an agency instead of running cold email in-house?
It depends on whether you have someone who can own infrastructure, list building, and copywriting at the same time, and keep doing it as deliverability rules change. Teams with a dedicated SDR who has time to learn the technical side can run it in-house successfully. Teams stretching a marketer or founder across 5 other priorities tend to get better and faster results from a specialist.
What’s a realistic reply rate to expect?
This varies heavily by industry, list quality, and offer, but a healthy B2B campaign with a well-matched ICP typically lands somewhere between 3% and 8% for total replies, with a smaller slice of those being positive. Any agency quoting a specific number before reviewing your market and offer is guessing.
Do I need to provide my own list, or does the agency build it?
Most full-service agencies build the list as part of the engagement, using your ICP criteria and a verification step to remove invalid or risky addresses. If an agency asks you to supply the list yourself with no input on targeting, ask what happens to deliverability if that list is outdated or poorly matched.
What happens to the domains and infrastructure if I end the contract?
This should be spelled out in writing before you sign. Reputable agencies transfer ownership of domains and mailboxes registered under your name, since they were purchased for your campaign in the first place. Pin this down before you sign, not during an offboarding dispute.
Should I sign a long-term contract or go month-to-month?
Domain warmup and list building take real time, so most reputable agencies ask for at least a 3-month commitment to give the campaign room to work. Anything beyond that should come with a clear early termination clause and defined terms on what happens to your infrastructure if you leave. Be cautious of a 12-month contract with no exit option, especially from an agency you have not worked with before.
The question that matters most
Choosing a cold email agency comes down to one question more than any other: can they explain, in specific and verifiable terms, how they protect your domain while getting you replies? Vague answers about proven systems and proprietary processes usually mean there isn’t much substance underneath. Specific answers about warmup schedules, bounce rates, and reporting mean you’re talking to people who’ve actually done this before and know what breaks when it’s done wrong. If an agency cannot answer these questions clearly on a first call, that is useful information too. Move on to the next one.