Is Your Marketing Agency Working? How to Measure Without a Math Degree

Somewhere around month six, every owner paying for marketing has the same private thought: is this actually doing anything? The report says impressions are up. The invoice says the same thing it always says. The phone rings about as much as it rang before, or maybe more, or maybe that’s the season. You genuinely cannot tell, and the uncertainty itself is exhausting.

Here’s the liberating truth: you do not need to become a marketer to judge marketing. You need five numbers, a fair time window, and the nerve to ignore everything else in the report. This guide gives you all three, plus the vanity metrics designed to fog the question, and the honest complications, because some genuinely good marketing looks bad in month three and some genuinely bad marketing looks great forever if you’re staring at the wrong chart.

Start here: what did you hire them to do?

You can’t grade work without a job description. Before touching any dashboard, write one sentence: “I am paying this agency so that ______.” More calls from people needing a roof. Tables filled on weeknights. Online orders. Fewer dead weeks in winter. That sentence is the exam; everything else is homework shown. If you can’t write the sentence, that’s finding number one, and it’s about the engagement, not the agency. The scope conversation in our guide to what’s inside a retainer is where that sentence gets written; it’s never too late to write it.

The five numbers that answer the question

1. Qualified leads per month

Not traffic, not clicks: humans who contacted your business with real intent. Calls, forms, chats, walk-ins who mention finding you online. The word “qualified” carries weight: fifty inquiries from people outside your service area count for nothing. Every measurement system for a service business starts here, and if your agency can’t tell you this number, nothing else in the report matters. Tracking it requires unglamorous plumbing, call tracking, form tracking, a “how did you hear about us” habit at the counter, which a competent agency installs in month one. Ours does it through Jacko AI, which logs every call, text, form, and booking in one place precisely so this number is never a matter of opinion.

2. Cost per lead

Total marketing cost for the month, agency fee plus ad spend, divided by qualified leads. This is the number that turns “marketing is expensive” into an actual sentence with actual meaning: expensive compared to what? A lead that costs eighty dollars and becomes a nine-thousand-dollar install is the cheapest employee you have. What’s normal varies enormously by trade and market, which is why we publish honest benchmarks by industry in what’s a good cost per lead for HVAC and for restaurants; that same math is the backbone of our HVAC marketing work, where cost per booked job is the only scoreboard anyone respects. Track your own month over month; the trend matters more than anyone’s benchmark.

3. Lead-to-customer rate, and whose problem it is

What fraction of leads become paying customers? This number matters for a diagnostic reason: it separates the agency’s job from yours. If leads doubled but bookings didn’t, the leak might be marketing sending junk, or it might be your voicemail eating calls, your quotes going out slow, your front desk. An honest agency helps you find out, because a documented pattern in this industry is the opposite: agencies pointing at lead counts while the owner points at the empty calendar, forever. Missed-call data is usually the smoking gun, and fixing that leak is often worth more than any campaign.

4. Revenue you can trace to marketing

The number the whole exercise exists for. It doesn’t need to be perfect; attribution never is, and anyone promising perfect attribution is selling something. It needs to be honest: booked jobs, orders, or sales that plausibly trace to marketing activity, compared against the total cost of that marketing. When traceable revenue comfortably exceeds total marketing cost, with room for your margins, the machine works. One caution: give slow channels their honest window, covered below, before running this verdict.

5. The asset line: what do you own now that you didn’t?

The number nobody reports: rankings that didn’t exist last year, an email list that grew, reviews accumulated, content that keeps pulling visitors. This is equity, and it’s the difference between marketing as an expense and marketing as an investment. An agency can deliver mediocre lead numbers while building you real equity, or decent lead numbers while renting everything, and only this line tells you which. Ask for it explicitly: what do we own now that we didn’t own in January?

The fog machine: metrics that sound like results

None of the following numbers are meaningless, but none of them are results, and reports built around them are usually hiding the absence of results. Impressions: how many screens your ad crossed; you cannot deposit an impression. Reach and followers: audience, not customers. Click-through rate: interest, not intent. “Engagement”: the vaguest of all, a stew of likes and scroll-pauses. Rankings for keywords nobody searches: the oldest trick in SEO reporting, page one for a phrase with no traffic. When a report leads with these and buries leads and revenue, that’s not a style choice. What a report should lead with is covered in what to expect from agency reporting; the short version is that page one of any honest report answers “what did this money make happen?”

The fair time windows, channel by channel

Judging all marketing on one clock is how owners fire good agencies and keep bad ones. The honest windows:

• Paid ads: signal within four to eight weeks. Ads are the fastest feedback in marketing; if paid campaigns show nothing by month two or three, something specific is wrong and the agency should be naming it, not counseling patience.
• SEO: three to six months to meaningful movement, longer in competitive markets, and we say the same thing in how long until SEO works. Judging SEO at month two is unfair; accepting nothing at month nine is gullible.
• Email and reviews: visible within a quarter, compounding after.
• Brand and social presence: the slowest burn, real but hardest to trace; it should never be the only thing a retainer produces.

The universal rule underneath the windows: you should always see leading indicators before results. Rankings climbing before leads arrive, cheaper clicks before cheaper customers, work visibly shipping every month regardless. “Trust the process” is a legitimate sentence only when the process is visible.

If you’re starting from zero: the one-week measurement setup

Plenty of owners reading this have no tracking at all, which means even a great agency’s results are invisible. The good news: a usable measurement foundation takes about a week to stand up, and most of it is free or cheap.

• Day one: the counter question. Train whoever answers the phone or works the counter to ask “how did you hear about us?” and tally the answers anywhere, a notepad counts. Imperfect, immediate, and more honest than most dashboards.
• Day two: call tracking. A tracking number on your website and ads tells you which calls came from marketing, records the missed ones, and turns “the phone seems busier” into a number. This is standard plumbing any agency can install in an afternoon.
• Day three: forms and analytics. Confirm every contact form actually delivers, then make sure basic analytics is installed on the site under an account you own, with form submissions counted as conversions.
• Day four: the revenue link. Start tagging new customers in whatever you use, a job system, a spreadsheet, with their source. Even rough tagging lets you compute the only division problem that matters: revenue traced to marketing over money spent on marketing.
• Day five: the baseline. Write down this month’s numbers before anything changes: leads, calls, jobs, revenue. Every future argument about whether marketing worked gets settled by comparison to this piece of paper.

One habit completes the system: compare months to the same month last year, not to last month. Seasonal businesses especially get fooled in both directions by month-over-month reading; year over year is the honest lens.

The quarterly verdict: a working system

Once a quarter, sit down with the five numbers and sort the situation into one of three buckets:

Working: qualified leads trending up, cost per lead stable or falling, traceable revenue exceeding cost, assets accumulating. Renew happily, and say so; good agencies run on knowing what’s valued.

Unproven: results thin but leading indicators genuinely moving inside honest windows, and work visibly shipping. Renew with a named checkpoint: “by month six we want X.” An agency confident in its trajectory welcomes the checkpoint; one that resists defining any measurable expectation ever is telling you something.

Failing: flat leads past the honest windows, reports leading with fog, questions answered with jargon or silence. One direct conversation with a deadline, then leave. The mechanics of leaving well, without losing your website, data, or momentum, are covered in switching agencies without losing everything, and the silence pattern specifically in why did my agency stop answering.

What honest measurement looks like from the agency side

Since this whole guide coaches you to grade us and our competitors, here’s the standard we think you should hold everyone to, stated as the practices of the agencies worth keeping: tracking installed before campaigns launch, so the count is never reconstructed from memory. Reports that lead with leads and revenue, include the disappointing number, and arrive in plain English on schedule. A same-week answer to “what did we get for this?” at any moment, not just report day. And a genuine willingness to be fired if the numbers stay flat, because month-to-month terms mean the client’s continued yes is the business model. That last one is the whole architecture of Twin Shores: no long contracts, everything client-owned, the owner’s cell in every client’s phone. Ninety percent of our clients stay, and the number is only meaningful because leaving is easy.

The full context on fees, and what level of results justifies them, lives in the pillar guide to what a marketing agency costs. Measurement is how you find out whether yours is worth it; the five numbers are how you find out without needing anyone to translate.

And a final permission slip, since owners sometimes need one: you are allowed to ask these questions without being a difficult client. You’re not micromanaging by wanting to know what your money did; you’re doing the same diligence you’d apply to a supplier, a hire, or a truck purchase. The agencies that bristle at measurement are telling you why. The ones that hand you the five numbers before you ask are the ones this industry should have more of.