You're drowning in operational work. Your sales pipeline is weak. And you know cold email works - you've seen it work for competitors - but you don't have the time, infrastructure, or expertise to run it yourself.
So you Google "cold email agency" and get 47 results. All of them claim they'll book you 15-20 meetings a month. All of them have testimonials. All of them cost between $2k and $10k a month.
How do you actually pick one?
Most people make this decision on vibes and case studies. That's how you end up paying $5k a month for an agency that sends 500 emails to your target market and gets 3 replies.
Here's how to actually evaluate a cold email agency so you know exactly what you're paying for.
Understand the Three Types of Cold Email Agencies
There's no standardized agency model, which is why they all sound the same. But they're actually very different. The confusion starts here.
Type 1: Outsourced SDR Model
The agency acts like an internal sales team. They build your list, write copy, send campaigns, handle replies, and try to qualify deals. You get a dedicated account manager who works on your account most of the time.
Type 2: Platform + Done-For-You Model
The agency uses a platform (lemlist, Apollo, etc.) and does the strategic work - list building, copy, campaign setup. Then you handle the mechanics - sending, reply management, scheduling follow-ups.
Type 3: Hybrid Model
The agency owns list-building, copy, and campaign setup. They also handle initial reply collection and organization. You close the deals, but the agency manages the email side completely.
Each model has different costs, different time commitments from you, and different results. Most agencies don't clearly say which model they use. That's your first red flag.
Ask These 5 Questions Before Talking to Anyone
You need specifics, not promises. These questions will give you numbers to compare.
1. How many emails do you actually send per month on my behalf?
This is the foundation of everything. If an agency sends you 200 emails a month to your target market, the math is brutal. At a typical 5-8% reply rate, that's 10-16 replies. Even if half are qualified, you're looking at 5-8 meetings. That's not enough to scale a business.
Good agencies send between 800-2000 emails per month per client. Ask them for this number outright. If they hedge, move on.
2. What's your typical reply rate and qualified meeting rate?
Reply rate is email replies divided by emails sent. If they sent 1000 emails and got 40 replies, that's a 4% reply rate. Qualified meeting rate is how many of those replies turned into actual meetings with decision-makers.
Realistic benchmarks: 5-12% reply rate depending on industry and list quality. 40-70% of replies turning into meetings. If an agency claims 20% reply rates across all clients, they're either lying or working with incredibly warm lists and won't do that for you.
3. Who builds the list, and how do they find prospects?
This determines everything. If they use a scraper tool and LinkedIn, you'll get high volume but lower quality. If they use a combination of tools (Apollo, LinkedIn Sales Navigator, ZoomInfo, manual research), you get better targeting.
Ask specifically: Do you use LinkedIn Sales Navigator for targeting? Do you manually research accounts? Do you use intent data? The more specific their process, the better.
4. What happens with replies?
This is where most agencies fall apart. Getting a reply is only half the battle. Then someone has to actually respond to it within 2-4 hours or the prospect loses interest.
Ask: Do you handle all replies, or do I manage them? If you manage them, what's the response template you use? If they handle it, who's checking the inbox and how fast is turnaround?
5. How much of my time will this actually require?
Some agencies claim "fully done for you" but still require you to hop on 15 discovery calls a week to answer questions about your service. That's not done for you.
Ask directly: How many hours per week will I need to spend on this? If they say "less than 5 hours," ask them to walk you through what those 5 hours are.
Evaluate Their Copy Quality with a Real Test
The agency's copy is their core product. But most agencies won't show you real examples. They'll show you best-case examples or examples from industries that aren't yours.
Ask for 3 cold email sequences they've run for clients in your industry (or adjacent). Look for these specific things:
Does the opening line reference something specific?
Bad copy opens with a generic compliment. Good copy opens with a specific observation about the company or person.
Compare these:
Hey [name], I found your LinkedIn profile and was impressed by your background in marketing.
versus
Quick question - noticed you guys switched from HubSpot to Marketo last quarter. How's the data migration going on your end?
The second one gets responses. The first one gets deleted.
Does the email have a clear reason to respond?
The worst cold emails make the prospect do the work. They say "I help people with X" and wait. Good emails give a specific reason to reply - a data point, a question, a concrete offer.
Is it short?
The best cold emails are 3-5 sentences. If their examples are a paragraph, they don't understand cold email in 2026.
Look at Their Case Studies the Right Way
Every agency has case studies. Most of them are useless because they don't show process, just results.
A good case study answers these questions:
- How many emails per month?
- What was the reply rate?
- How many qualified meetings booked?
- Over what timeframe (month 1 vs. month 3)?
- What industry was this?
If a case study just says "We booked 20 meetings in 60 days" with no context on list size or email volume, it doesn't mean anything.
The best case studies show progression. Month 1: 5 meetings. Month 2: 8 meetings. Month 3: 12 meetings. That tells you they're optimizing and learning, not just running the same campaign over and over.
Price Isn't Just the Monthly Fee
An agency that costs $3k/month but gets you 8 meetings is more expensive than an agency that costs $7k/month and gets you 16 meetings.
Calculate cost per qualified meeting. If an agency charges $4k and gets you 10 qualified meetings, that's $400 per meeting. If another charges $2k but gets you 2 meetings, that's $1000 per meeting.
Also ask about ramp time. Most agencies need 4-6 weeks to ramp up (list building, copy testing, optimization). If they promise results in week 1, that's a bad sign.
The Real Gap Between Knowing This and Actually Running It
You now know what to look for. But understanding what to look for and actually evaluating 5-10 agencies, getting answers to all these questions, comparing their metrics, and making the right call takes time. Real time - probably 15-20 hours.
And even after you pick one, there's the integration cost. You need to make sure their process meshes with yours, that they understand your customer, that you're giving them feedback fast enough to optimize. That's another 10+ hours of onboarding and management.
Most agencies don't make this easy because they haven't systematized it. That's the actual gap - not between knowing what good cold email is and having it run. It's between picking the right partner and having that partnership actually execute at the level it should.
Related Guides
- Hire an SDR vs. Use a Cold Email Agency - Which Actually Works?
- How to Book 20 Meetings a Month with Cold Email (Without Losing Your Mind)
- How to Scale a B2B Agency Using Cold Email (Without Losing Your Mind)
- How to Track Cold Email Campaigns (So You Actually Know What's Working)
- How to Build a Cold Email List From Scratch (Without Losing Your Mind)