Featured · Agencies
How to assess reviews of any large legal marketing vendor
Let us be straightforward about what this page is. Scorpion is a well-known supplier in the legal marketing market, and a great many firms search its name alongside the word reviews before deciding whether to approach it. We have no basis on which to review that company's service, so we are not going to pretend to.
What is genuinely useful is the method — because reviews of large marketing vendors are among the least reliable material online, and the same is true whichever supplier's name you searched. This is how to reach a defensible view yourself.
Why vendor reviews are so unreliable
This applies to any large supplier, including ours. Understanding the mechanics tells you how much weight to put on what you find.
Selection. Happy clients are asked and unhappy ones are not, so a review set is a sample chosen by the party being reviewed.
Timing. Reviews are usually collected early in a relationship, when optimism is highest and results have not yet arrived.
Survivorship. Firms that left rarely write anything, so the people best placed to describe the failure modes are systematically absent.
Incentive. Directory listings and comparison sites frequently carry commercial relationships with the companies they rank.
Attribution. A negative review often describes a firm that could not approve work or answer enquiries, which the supplier could not have fixed.
And scale. A large vendor with thousands of clients will have hundreds of genuinely delighted ones and hundreds of genuinely furious ones simultaneously, both accurately reported.
That last point is the one that matters most for any big supplier. At sufficient scale, both the glowing and the damning reviews are true — of different engagements, different account teams and different years.
So the aggregate rating tells you very little. What tells you something is the pattern of specifics, and whether the complaints describe things that would happen to you.
What to read instead of the rating
These are the signals that carry information, in roughly descending order of usefulness.
The specific complaints, repeated. One person describing an account manager change is noise; forty describing it is a staffing model.
Whether negative reviews describe the supplier's work or the client's own capacity. The second tells you about the client.
Responses to criticism, which reveal more about how a company behaves than any praise does.
The date range. A company that improved or declined three years ago will have reviews describing an organisation that no longer exists.
Whether reviewers say what they bought. A review of a website build tells you nothing about a search retainer.
And whether anybody describes leaving — the exit is where contractual and ownership problems surface, and it is the least reviewed part of any engagement.
Evidence you can gather yourself
All of this is verifiable, none of it is stage-managed, and it applies to any supplier you are considering.
Look at the current search performance of firms the supplier names as clients. It is public and it is not curated.
Check whether those clients are still clients, which is often visible from the site footer or from asking.
Look at staff tenure on a professional network. High turnover in delivery roles predicts the account-team complaints you will read about.
Ask two firms in your jurisdiction who they use and what they would say privately.
Ask the supplier directly for a reference from an engagement that ended, not only current clients.
Read the contract terms — notice, ownership, deliverable definitions — because most serious complaints about any vendor trace back to those rather than to the work.
And weigh their own marketing: a company selling search that does not rank, or web design on a slow site, has told you something no review can.
Then judge on fit for your firm's size and decision speed, which is what most mismatches actually come down to.
None of this requires a verdict on any particular company, which is fortunate, because no honest one is available from a competitor. It requires about an afternoon and it produces a view you can defend to your partners.
FAQs
Is this a review of Scorpion?
No. We have no basis on which to assess that company's service, and a competitor's opinion would be worth little in any case. This is a method for assessing reviews of any large legal marketing vendor, which is the useful part of the question.
Why are marketing vendor reviews unreliable?
Selection, timing, survivorship and incentive. Happy clients are asked and unhappy ones are not, reviews are collected early when optimism is highest, firms that left rarely write anything, and comparison sites often carry commercial relationships with those they rank.
Why do large vendors have both glowing and terrible reviews?
Because at scale both are true — of different engagements, different account teams and different years. The aggregate rating tells you very little; the pattern of repeated specifics tells you a great deal.
What should we read in a review set?
Repeated specific complaints rather than the score, whether criticisms describe the supplier's work or the client's own capacity, how the company responds to criticism, the date range, and whether anybody describes leaving — the exit is where real problems surface.
What evidence can we gather ourselves?
The current search performance of named client firms, whether those clients are still clients, staff tenure in delivery roles, private opinions from two peer firms, a reference from an engagement that ended, and the contract terms — where most serious complaints originate.
End Note
Searching a supplier's name with the word reviews is a reasonable instinct and an unreliable method, whichever name you typed. The material is selected, early, incentivised and — at scale — genuinely contradictory.
Spend the afternoon on evidence instead: named clients' current performance, staff tenure, a reference from an engagement that ended, and the contract. That produces a view you can defend, about any supplier.
Key Takeaways
At scale, the glowing and the damning reviews are both true.
The rating carries almost no information; repeated specifics do.
Many negative reviews describe the client's capacity, not the supplier's work.
Check named clients' current performance — public and uncurated.
Most serious complaints trace back to contract terms, not to the work.
