To choose a lead generation agency, score every candidate on the same weighted criteria before you look at price, then test their answers on a sales call. The checklist below gives you 25 criteria across 5 categories, weighted to 100 points, plus the exact questions to ask and what good answers sound like.
Use it to compare two or three agencies side by side, so you choose on a written score instead of an impression.
How to use this scorecard
Score each criterion from 1 to 5 based on what the agency shows you, not what it promises. Then multiply by the criterion weight and divide by 5. Add everything up for a score out of 100.
| Score | Meaning |
|---|---|
| 5 | Shown with evidence (documents, screenshots, a sample, written terms) |
| 4 | Explained clearly and specifically, but not yet shown |
| 3 | Answered in general terms, plausible but vague |
| 2 | Deflected, or the answer depends on "our proprietary process" |
| 1 | Not offered, or the answer is a clear problem |
A quick example: an agency scores 4 on a criterion worth 5 points. That criterion contributes 4 points (4 x 5 / 5). A 3 on a 4-point criterion contributes 2.4 points.
Two rules sit above the math. Any score of 1 in Category 1 (infrastructure) or on data and domain ownership is a deal breaker, whatever the total. And score right after the call, before you look at price.
The five categories and their weights
| Category | Weight | Why it carries this weight |
|---|---|---|
| 1. Infrastructure and deliverability | 25 | If emails land in spam, nothing else on this list matters |
| 2. Data and targeting | 20 | The wrong list wastes good copy and good infrastructure |
| 3. Messaging and campaign process | 15 | Copy matters, but it is the easiest part to fix later |
| 4. Transparency, reporting and ownership | 20 | Decides whether you can see problems and leave cleanly |
| 5. Commercial terms and fit | 20 | Decides how much risk you carry if it does not work |
These weights reflect an outbound, email-first engagement. If you are hiring a paid ads or inbound agency, lower Category 1 and raise Category 3. If you are not sure which kind of agency you need, start with our lead generation services overview.
Category 1: Infrastructure and deliverability (25 points)
Each criterion is worth 5 points.
1.1 Separate sending domains (5)
Cold email should go out from domains that are not your main company domain. If a campaign hurts sender reputation, your invoices, support replies and internal mail should not pay for it.
Good answer: "We register lookalike domains for outreach, point them to your site, and never send from your primary domain."
1.2 Who owns and runs the sending setup (5)
Some agencies operate their own mailboxes and domains. Others rent from resellers. You want to know who fixes things when a domain gets flagged.
Good answer: a specific description of the providers, how many mailboxes per domain, and who monitors them.
1.3 Warmup and ramp plan (5)
New mailboxes need time before they send at volume. Ask how long warmup lasts and how volume increases after launch.
Good answer: a week-by-week plan with numbers, for example "about three weeks of warmup, then a gradual increase per mailbox," and a reason for each step.
1.4 Authentication and compliance with mailbox provider rules (5)
Google's sender guidelines require all senders to set up SPF or DKIM and keep the spam rate reported in Postmaster Tools below 0.3%. Bulk senders (over 5,000 messages a day to Gmail) also need DMARC and one-click unsubscribe for marketing messages.
Good answer: "We set SPF, DKIM and DMARC on every domain, monitor spam and bounce rates, and pause mailboxes that cross our thresholds." Bonus points if they name the thresholds.
1.5 Monitoring and recovery (5)
Domains get listed and mailboxes get suspended. The question is how fast the agency notices.
Good answer: daily or automated checks on bounce rate, inbox placement and blocklists, plus a clear process for rotating out a damaged mailbox.
Category 2: Data and targeting (20 points)
Each criterion is worth 4 points.
2.1 ICP definition process (4)
A good agency pushes back on a vague target. "Companies that need our product" is not an ideal customer profile.
Good answer: they ask about your best current customers, deal sizes, sales cycle, and the accounts you lost, then write the ICP down for your approval.
2.2 Data sources (4)
Ask where contacts come from. Most agencies use a mix of databases such as Apollo, enrichment tools and manual research.
Good answer: named sources and a reason for the mix. "Proprietary database" with no detail scores a 2.
2.3 Email verification before sending (4)
Unverified lists drive bounces, and bounces damage sender reputation. Even Apollo's help center puts its verified-email accuracy at 91%, not 100%, so a second verification pass before high-volume sending is cheap insurance.
Good answer: "Every list goes through a separate verification step, and we remove catch-all and risky addresses or send to them separately."
2.4 Sample list before launch (4)
You should see real rows from your list before a single email goes out. This is the cheapest quality check in the whole process.
Good answer: "You approve a sample, and then the full list, before launch."
2.5 Exclusions and do-not-contact handling (4)
Your customers, open opportunities, partners and competitors should never get a cold email from your agency.
Good answer: they ask for your CRM exports or a block list during onboarding and keep a running suppression list that includes every unsubscribe.
Category 3: Messaging and campaign process (15 points)
Each criterion is worth 3 points.
3.1 Offer work before copy (3)
The offer (what you ask the prospect to do and why it is worth their time) moves results more than clever wording. Strong agencies spend time here first.
Good answer: they propose two or three offer angles and explain who each is for.
3.2 Copy approval (3)
You should approve every sequence before it sends. Your brand is on those emails, even from a separate domain.
Good answer: "Nothing launches without your written approval, and changes go through you."
3.3 Testing plan (3)
Ask what they test, in what order, and how much volume they need before calling a winner.
Good answer: a short plan that tests one variable at a time, starting with the offer and the target segment, not button colors.
3.4 Sequence structure (3)
Ask how many emails are in a sequence and how they space follow-ups, and why that structure fits your buyers.
Good answer: a specific structure with a reason, plus a willingness to change it based on your sales cycle.
3.5 Reply handling (3)
Who reads replies, how fast, and who answers? Some agencies hand every reply to you; others book meetings for you. Know which one you are buying.
Good answer: a clear handoff rule, for example "every positive reply goes to your inbox or CRM the same day, and you take it from there."
Category 4: Transparency, reporting and ownership (20 points)
Each criterion is worth 4 points.
4.1 Reporting on the right metrics (4)
Opens are unreliable as a metric because of privacy features in mail clients. Replies, positive replies, meetings and pipeline are what matter.
Good answer: a sample report showing sends, bounce rate, reply rate, positive replies and meetings per campaign.
4.2 Access to raw activity (4)
You should be able to see what was sent to whom and what came back, not only a summary slide.
Good answer: read access to the sending platform or a regular export of every reply.
4.3 Data ownership (4)
If you leave, the lists built for you and the replies you received should leave with you.
Good answer: "The data is yours, in writing, and we hand over a full export when the engagement ends."
4.4 Domain ownership and exit plan (4)
Ask what happens to the sending domains when you stop. Some setups lock domains inside a provider account, so the answer matters.
Good answer: a written answer about who owns the domains and whether they can be transferred, plus a simple offboarding process.
4.5 Named people and a communication rhythm (4)
Know who runs your account day to day and how often you will talk.
Good answer: a named point of contact, a weekly or biweekly check-in, and a shared channel for quick questions.
Category 5: Commercial terms and fit (20 points)
Each criterion is worth 4 points.
5.1 Contract length and exit (4)
Cold email results usually take a few weeks to show because of warmup. A long lock-in on top of that slow start shifts most of the risk to you.
Good answer: month-to-month, or a short initial term with a clear exit.
5.2 Pricing clarity (4)
You should know what the fee covers and what costs extra: data, domains, mailboxes, tools, setup. For real price points and what drives them, see our breakdown of cold email agency pricing.
Good answer: a written quote that lists every line item and every possible extra.
5.3 Honest expectations (4)
An agency that promises fixed results before seeing your offer, market and list is guessing. A good one gives ranges and explains what they depend on.
Good answer: "Here is what similar clients saw, here is why yours may differ, and here is what we will know by week six."
5.4 Relevant proof (4)
Ask for case studies with numbers, ideally in a market close to yours, and ask to speak with a current client.
Good answer: specific results with a time frame, plus a reference you can actually call.
5.5 Legal compliance (4)
In the US, the FTC's CAN-SPAM guidance says you "can't contract away your legal responsibility to comply with the law," which means both you and the agency can be held responsible for violations. Opt-outs must be honored within 10 business days, and each violating email can carry penalties of up to $53,088. If you sell into Canada or the EU, the rules are stricter.
Good answer: a working unsubscribe process, a physical address in every email, a suppression list, and a clear view on which countries they will and will not target for you.
Want a second opinion? If you already have proposals in hand and want someone to pressure-test them against this scorecard, book a 30-minute call with David at Koldify. He will tell you which answers look solid and which need follow-up, even if you hire someone else.
Questions to ask on the sales call
Ask every agency these questions in the same order and write down the answers. The right column is what a strong answer usually sounds like.
| Question | What a strong answer sounds like |
|---|---|
| Where will our emails be sent from? | Separate domains you register for us, never our main domain |
| Who owns and runs the mailboxes and domains? | We do (or a named provider), and here is who monitors them |
| How long before the first campaign sends? | A specific timeline with warmup built in, not "next week" |
| Where does the contact data come from? | Named sources, plus a separate verification step |
| Can we see a sample of our list before launch? | Yes, and you approve it before anything sends |
| Who writes and approves the copy? | We draft it, you approve every email in writing |
| What happens when someone replies? | A clear handoff rule with a time frame |
| What do your reports show? | Replies, positive replies, meetings, bounce rate, by campaign |
| Who owns the data and domains if we leave? | You own the data; here is exactly what happens to the domains |
| What is the minimum term, and how do we cancel? | Month-to-month or a short term, with notice in writing |
| What costs are not in this quote? | A complete list, or "none" in writing |
| Can I talk to a current client? | Yes, here are two |
Pay attention to how they answer as much as what they say. A team that runs its own infrastructure tends to answer infrastructure questions with numbers. A reseller tends to answer with adjectives.
If you want the shorter, conversation-style version of this list, our post on how to hire a cold email agency covers ten questions in more depth.
Printable checklist
Print this table or copy it into a spreadsheet. Fill in one column per agency. Weighted points = score x weight / 5.
| # | Criterion | Weight | Agency A (1 to 5) | Agency B (1 to 5) | Agency C (1 to 5) |
|---|---|---|---|---|---|
| 1.1 | Separate sending domains | 5 | |||
| 1.2 | Owns and runs the sending setup | 5 | |||
| 1.3 | Warmup and ramp plan | 5 | |||
| 1.4 | SPF, DKIM, DMARC and spam rate control | 5 | |||
| 1.5 | Monitoring and recovery | 5 | |||
| 2.1 | ICP definition process | 4 | |||
| 2.2 | Named data sources | 4 | |||
| 2.3 | Verification before sending | 4 | |||
| 2.4 | Sample list approval | 4 | |||
| 2.5 | Exclusions and suppression | 4 | |||
| 3.1 | Offer work before copy | 3 | |||
| 3.2 | Copy approval | 3 | |||
| 3.3 | Testing plan | 3 | |||
| 3.4 | Sequence structure | 3 | |||
| 3.5 | Reply handling | 3 | |||
| 4.1 | Reports on replies and meetings | 4 | |||
| 4.2 | Access to raw activity | 4 | |||
| 4.3 | Data ownership in writing | 4 | |||
| 4.4 | Domain ownership and exit plan | 4 | |||
| 4.5 | Named contact and rhythm | 4 | |||
| 5.1 | Contract length and exit | 4 | |||
| 5.2 | Pricing clarity | 4 | |||
| 5.3 | Honest expectations | 4 | |||
| 5.4 | Relevant proof and references | 4 | |||
| 5.5 | Legal compliance | 4 | |||
| Total | 100 |
Reading the total
| Total | What it means |
|---|---|
| 75 to 100 | Strong candidate. Compare price and chemistry from here |
| 60 to 74 | Workable if the gaps are in areas you can cover yourself |
| Under 60 | Pass, or ask them to come back with evidence |
Remember the override: a 1 on any infrastructure item, or on data or domain ownership, rules the agency out. For the warning signs that should end a conversation early, see our guide to lead generation agency red flags.
Where Koldify fits (and where it does not)
Koldify is a done-for-you cold email agency run by David Tile. Nerdy Joe is its content site, so weigh this section knowing who wrote it, and run Koldify through the same scorecard as everyone else.
Here is how Koldify answers the questions above:
- Infrastructure: Koldify owns and operates its sending infrastructure, with no middlemen. Campaigns go out from separate sending domains, never your main domain.
- Timeline: about three weeks of inbox warmup before anything sends. Campaigns typically launch around week four.
- Lists and copy: built with you and approved by you before launch.
- Replies: routed to you. Your team handles the conversation, the booking and the close.
- Terms: month-to-month, no long-term contract.
- Proof: Koldify reports 10M+ cold emails sent, 50K+ leads generated, $10M+ in pipeline and $2M+ in revenue generated for clients. Vidsec got 160+ ready-to-buy leads in 2 months and closed $12,000+. Black Stone Funding Group got 120+ leads in 60 days. Skrapper got 140+ interested leads.
Koldify is probably not the right fit if you want someone to run your sales calls and close deals for you, since replies come back to your team. It is also not the right fit if you need meetings next week, because warmup comes first, or if you want LinkedIn, calling and paid ads bundled into one retainer. For those, look at an appointment setting agency or a broader SDR provider.
If the answers above match what you scored highly, book a 30-minute call with David at Koldify and bring your scorecard. You can also read more about the service on our cold email services page.
If you would rather run it yourself: the DIY stack
Some teams score every agency, then decide to build in-house. That is reasonable if someone on your team has time to learn deliverability. Some tool links here are affiliate links (disclosure).
A typical DIY stack has three layers:
| Layer | Tool option | Price as of October 2026 |
|---|---|---|
| Data | Apollo | Free plan; paid plans from about $49 per user per month billed annually |
| Sending | Instantly | Outreach plans from $47 per month (Growth), unlimited email accounts and warmup |
| Sending | Smartlead | Plans from $39 per month (Base), unlimited email accounts |
| Sending | PlusVibe | Plans from $37 per month (Personal) |
You will also need separate domains and mailboxes, a verification step, and time every week to watch bounce rates and replies. Use the Category 1 and Category 2 criteria above as your own internal checklist: if you cannot score yourself a 4 on each, budget time to learn before you send at volume.
For a full cost and time comparison, see our guide to hiring a cold email agency vs doing it yourself. Nerdy Joe is a certified Apollo.io Managed Services Partner and a PlusVibe Certified Silver Partner, so we use these tools every week.
The short version
Score before you compare prices, and weight infrastructure and data heavily, because better copy cannot fix those failures. Walk away from anyone who will not show you a sample list, explain where emails come from, or put ownership and exit terms in writing.
If you want help reading the proposals on your desk, book a 30-minute call with David at Koldify.
Sources
- Google, Gmail Help, "Email sender guidelines": https://support.google.com/mail/answer/81126?hl=en
- Federal Trade Commission, "CAN-SPAM Act: A Compliance Guide for Business": https://www.ftc.gov/business-guidance/resources/can-spam-act-compliance-guide-business
- Apollo Knowledge Base, "How Apollo Verifies Emails": https://knowledge.apollo.io/hc/en-us/articles/10826699994381-How-Apollo-Verifies-Emails
- Apollo pricing (plan prices cross-checked with 2026 third-party reviews): https://www.apollo.io/pricing and https://www.saleshandy.com/blog/apolloio-pricing/
- Instantly pricing: https://instantly.ai/pricing
- Smartlead pricing: https://www.smartlead.ai/pricing
- PlusVibe pricing: https://plusvibe.ai/pricing
- Koldify results and service details: https://koldify.io
Frequently asked questions
How do I choose a lead generation agency?
Score each agency on the same criteria before you compare prices: deliverability and infrastructure, data quality, messaging process, transparency and ownership, and commercial terms. Ask every agency the same questions on the sales call and write down their answers so you compare evidence, not impressions.
How many lead generation agencies should I talk to before deciding?
Three is a practical number. It gives you enough contrast to see what a strong answer sounds like without turning the search into a project that delays your pipeline by months.
What should a lead generation agency show me before I sign?
At minimum, a sample of the list they would build for you, an example sequence for a similar client, a written description of their sending setup, and the contract terms in writing. If they will not show any of this before you pay, treat it as a warning sign.
Is it a red flag if a lead generation agency guarantees meetings?
Not automatically, but read the fine print. A guarantee is only useful if it defines what counts as a qualified meeting, what happens when the number is missed, and whether you can leave. A vague guarantee paired with a long contract protects the agency, not you.
Should a lead generation agency send emails from my main domain?
No. Cold outreach should run from separate sending domains so that any reputation damage stays away from the domain your team uses for customer and internal email. Ask every agency where the emails will come from before you sign.
What score should an agency get on the checklist before I hire it?
On the 100-point scorecard in this guide, treat 75 or higher as a strong candidate, 60 to 74 as workable if the gaps are in areas you can cover yourself, and anything under 60 as a pass. Any score of 1 on an infrastructure or ownership item should rule an agency out regardless of the total.