If you've looked at cold email agencies, you've probably seen their dashboards. Lots of green numbers. "500 emails sent." "47 replies." "9.4% reply rate." "3 meetings booked."
The problem: those numbers don't tell you whether the agency is actually working, or just moving activity around.
Most cold email agencies report vanity metrics - things that look impressive but don't mean anything for your business. They report what's easy to count, not what matters.
Here's what actually matters, and how you should be reading those reports.
Emails sent: This is noise. Anyone can send 500 cold emails. That's not an achievement. Skip this number entirely.
Reply rate: This matters, but only in context. A 12% reply rate from 500 emails means 60 replies. But if only 3 of those turn into meetings, the reply rate is irrelevant. You care about meetings and clients, not replies.
Cost per meeting: Now we're getting somewhere. If your agency is spending $2,000 to book one qualified meeting, you need to know that. The calculation is simple: (total spend for the month) / (qualified meetings booked) = cost per meeting. For most service businesses, anything under $500 per meeting is solid.
Cost per client: This is the only number that actually matters. If the agency booked 3 meetings and closed 1 client, that's a 33% close rate. Multiply that by cost per meeting ($500 x 3 meetings = $1,500 to close 1 client). That's your real acquisition cost. If your average client is worth $15,000, that's a 10:1 return. If your average client is worth $1,500, you're losing money.
Lead quality: An agency can book 10 meetings with unqualified leads in a week. Don't let them hide behind high meeting numbers. Ask: "Of the 10 meetings, how many were decision-makers at companies that fit our ICP?" If it's 4 out of 10, your real conversion rate is half what they're claiming.
Good agencies give you three pieces of information each week or every two weeks:
1. The activity breakdown
Emails sent: 500
Replies: 53 (10.6% reply rate)
Qualified replies: 22
Meetings booked: 5
The jump from 53 total replies to 22 qualified replies tells you they're filtering. They're not counting every "unsubscribe" or "not interested" as a win. That's good. The jump from 22 qualified replies to 5 meetings tells you their follow-up game. That ratio (qualified replies to meetings) should sit around 20-30%. If it's lower, they're not following up well.
2. The outcome metrics
Meetings this month: 12
Clients signed this month: 2
Close rate: 16.7%
Revenue attributed to cold email: $48,000
This is what you actually care about. Not all meetings are created equal. If they booked 12 but closed 2, that's a real close rate. If they booked 4 and closed 2, that's 50% - which is different. Ask which number is accurate.
3. The quality indicators
Average deal size: $12,000
Average sales cycle: 18 days
Meeting attendance rate: 78%
These matter because they tell you if the agency is booking the right people. An 18-day sales cycle is fast. A 90-day cycle means something's wrong - either the leads are cold prospects who need education, or the agency's follow-up is weak. A 78% meeting attendance rate is good. Below 60% means they're booking people who don't actually want to meet.
If an agency only shows you reply rates and email volume, they're hiding something. These metrics don't connect to revenue. Push for actual meeting and client numbers.
If they show you 15 meetings booked but can't tell you how many turned into actual business, they don't know what's working. They're just executing.
If they claim high close rates (50%+) on all meetings, they're either lying or the "meetings" aren't actually with real prospects. Real B2B close rates sit between 10-35% depending on industry and deal size.
If they don't segment meetings by quality or decision-maker level, you can't tell if they're booking the right people. Ask them to break down meetings into: decision-makers, influencers, and wrong-fit meetings. Good agencies do this naturally.
Here's an example from a real campaign:
Week 1-2 Report
This tells you everything. They're hitting the right ICP. Their quality filter is working (59% of replies are qualified). Their follow-up is landing meetings. Their meetings are actually happening. And there's a real deal in the pipeline.
Compare that to:
"1,200 emails sent. 89 replies. 12 meetings booked."
The second report could mean anything. Maybe all 12 meetings are with unqualified people. Maybe only 2 will show up. Maybe none will buy. You have no idea.
At the end of each report, ask one thing: "What's the revenue impact this month?" If the agency can't answer that, they're not connecting their work to your actual business. They should be able to say: "We booked 12 meetings. 2 closed. That's $24,000 in new revenue from cold email." If they can't, you don't know if they're actually working.
Most agencies don't track this because it requires them to stay connected to your sales process. They send emails and hand off meetings, then disappear. The good ones ask "Did that meeting convert?" every time.
When you're trying to book consistent meetings with cold email, you need agencies that understand this distinction. They should obsess over which metrics actually predict revenue, not just which ones look good on a dashboard.
Before you hire an agency, agree on these four things:
1. What counts as a qualified meeting? Define it: "Decision-maker at a company with 50+ employees in our target market." Use this definition every time.
2. How will we track close rate? The agency should check back with you on meetings they booked. You tell them: "That one closed." Or "That one's still in talks." Or "That one didn't convert." This gives you real close rate data.
3. What's the reporting frequency? Weekly is better than monthly for early-stage campaigns. Monthly is fine once things are running steady.
4. What does success look like? Not "high reply rate." Not "lots of meetings." Define it: "5 qualified meetings per week" or "2 signed clients per month." Then measure against that.
This takes 15 minutes to set up and saves months of confusion later.
If an agency shows you 20 meetings booked in a month but your sales team only has data on 8 of them, something's wrong. Either the meetings didn't happen, they didn't actually book them (they just handed over warm leads), or there's a communication gap.
Most of the time it's the last one - the agency and your team aren't synced on what "booking" means. The agency thinks they booked a meeting if they sent a calendar link. You think they booked it if someone actually accepted and showed up.
Align on this early. It saves a lot of frustration.
Understanding what metrics matter is one thing. Actually setting up reporting infrastructure, tracking which leads convert, filtering for quality, and connecting each meeting back to revenue - that's another level of work entirely.
Most cold email agencies don't do this. They send emails, track opens and replies in their platform, and call it a day. The ones that do - that actually stay connected to your sales process and report real revenue impact - are rare. That's why a solid cold email process includes built-in tracking from the beginning. BEC Growth handles this by staying embedded in your pipeline from first contact through closed deal - you get weekly reports on what actually converted, not just what opened an email. That accountability is what separates agencies that book meetings from ones that actually move revenue.
Ready to Sign Clients On-Demand?
BEC Growth builds and manages your entire cold email system from infrastructure to reply handling.
Book a Call →