I run a marketing agency, which means I have an inherent bias when writing about how to evaluate marketing agencies. I’ll name that upfront. But I also think the bias cuts the other direction — I’ve seen the industry from the inside, I know how agencies actually operate, and I know exactly what separates the ones that deliver from the ones that perform.
Because that’s the core problem with evaluating agencies: the performance of competence and the reality of competence are often miles apart. A beautiful pitch deck, a confident sales process, impressive client logos on the website — none of these tell you whether an agency will actually move your numbers.
Here’s what does.
Start With Their Questions, Not Their Answers
The single most reliable indicator of agency quality is what they ask you before they pitch you. A good agency wants to understand your business before they propose solutions. A bad agency already knows what they’re going to sell you before the first call ends.
When we onboard a new client at PipelineRoad, the first conversation is almost entirely questions. Who’s your buyer? How do they find you today? What’s your sales cycle? What have you tried that didn’t work? What does your team look like? Where’s the revenue coming from?
We need to ask these questions because the answers determine the strategy. A company with a forty-five-day sales cycle needs a fundamentally different approach than one with a same-day purchase. A company selling to CFOs needs different content than one selling to DevOps engineers. These aren’t subtle distinctions — they’re the entire game.
If an agency pitches you a solution in the first meeting without deeply understanding your context, they’re not selling you strategy. They’re selling you their playbook. And their playbook was built for a different company.
Look at Retention, Not Testimonials
Testimonials are curated. Every agency — including ours — puts their best quotes on their website. The client who had a great experience says something generous, and it gets immortalized on the homepage. The client who left after six months of mediocre results says nothing publicly, and their absence tells you nothing.
The question to ask instead is: how long do your clients stay? What’s your average retention? Can you walk me through a client relationship that didn’t work out, and what happened?
Long retention is earned, not engineered. If an agency’s clients stay for two or three years on average, something real is happening — results are being delivered, the relationship is working, the value is clear enough that renewal is automatic.
Short retention can mean many things, but it rarely means the agency was excellent. Agencies that churn through clients quickly are either overselling in the pitch, underdelivering in execution, or both.
We’ve had clients leave. Every honest agency has. The question is whether the agency can discuss those departures without defensiveness, and whether they learned something from the experience.
Understand Who Does the Work
This is the question most buyers forget to ask, and it’s the one that matters most.
In the agency pitch, you’re usually talking to the most senior, most polished people in the organization. The founder. The VP of Client Services. The strategist who built their best case study. These are the people who understand your business, speak your language, and make you feel understood.
Then you sign the contract, and the work is done by a junior team you’ve never met.
This isn’t inherently bad — junior people do great work, and leverage is how agencies scale. But if the strategic thinking you bought in the pitch is not present in the day-to-day execution, you have a problem. The content won’t match the voice. The campaigns won’t reflect the nuance. The work will be competent but generic.
Ask explicitly: who will I be working with day-to-day? What’s their experience level? Will the people in this room be involved in the ongoing work, or just the pitch?
At PipelineRoad, our team is small enough that the people in the pitch are the people doing the work. That’s a deliberate choice. It limits our scale, but it means the quality of the conversation before the contract matches the quality of the work after it.
Evaluate Their Process, Not Just Their Portfolio
A strong portfolio is necessary but not sufficient. Good work in a portfolio tells you the agency has produced good work at least once. It doesn’t tell you whether they can produce good work consistently, under your constraints, with your budget, on your timeline.
What tells you that is their process. How do they plan work? How do they handle revisions? What’s the feedback loop? How do they measure results? How often do they report? What happens when something isn’t working?
These are boring questions. They don’t have the sizzle of looking at a beautiful campaign or a impressive traffic graph. But they’re the questions that predict the quality of the relationship at month six, when the honeymoon is over and the real work is happening.
An agency that can walk you through their process in detail — not a generic “we do strategy, then creative, then execution” but a specific, concrete description of how work moves from brief to deliverable — is an agency that has thought carefully about operations. And operational rigor is the difference between an agency that has one great case study and an agency that delivers great work consistently.
The Red Flags
I’ve been in the industry long enough to recognize the patterns that predict problems.
Guaranteed results. No honest agency guarantees specific outcomes. Marketing is probabilistic. An agency that guarantees first-page rankings or a specific number of leads in a specific timeframe is either lying or planning to use tactics that will hurt you in the long run. A good agency will tell you what they expect to achieve and why, with caveats and contingencies.
No discussion of what’s not working. If the agency’s reporting is all green and all positive, someone is either cherry-picking data or not looking closely enough. Good agencies flag problems proactively. They tell you when a campaign underperformed, what they learned, and what they’re changing. This is a sign of intellectual honesty, and it’s rare enough to be a genuine differentiator.
Scope that’s too broad for the price. If an agency is offering you SEO, content, paid media, social management, email marketing, and web design for a price that seems too good to be true, it is. Each of those disciplines requires real expertise and real time. An agency that claims to do everything well at a low price is either using templates, outsourcing to low-quality providers, or planning to cut corners.
Inability to explain their strategy. If you ask an agency why they’re recommending a particular approach and the answer is vague or circular — “it’s best practice,” “it’s what we do for all our clients,” “trust the process” — they don’t have a strategy. They have a routine. A strategy is specific to your business, your market, and your goals. If it could apply to any company in any industry, it’s not a strategy.
The Relationship Test
Ultimately, the decision of whether to hire an agency comes down to a relationship judgment. Do you trust these people? Do they understand your business? Do they communicate clearly? Do they ask hard questions and give honest answers?
The best agency relationships I’ve seen — and the ones we strive to build — are partnerships in the genuine sense. The agency pushes back when the client’s idea won’t work. The client gives honest feedback when the agency’s output misses the mark. Both sides are invested in the outcome, not just the deliverable.
That kind of relationship can’t be evaluated in a pitch. But you can get close by paying attention to how the agency behaves before you’ve signed anything. Do they challenge your assumptions? Do they ask for information that’s inconvenient to gather? Do they tell you things you don’t want to hear?
If the answer is yes, you’ve probably found a good one.