CRM & sales process
Keeping Up With the Competition: How to Mystery Shop a Powersports Dealership
How to mystery shop your own powersports store and your competitors by phone, web lead, chat and walk-in, with a 100-point scorecard and honest ground rules.
Quick answer
To mystery shop a powersports dealership, pose as a real buyer by phone, web lead, chat and walk-in, score each contact on a fixed scorecard, and compare your store with competitors. Shop your own store monthly and competitors a few times a year, never record without consent, and fix one finding at a time.
When we first published this post in 2021, the advice was to step back, look at where you stand and decide where you want to go. That is still right. The question it left open is how you find out where you stand, honestly, from the customer's side of the counter.
The most direct answer is a mystery shop: contacting your own store and your competitors the way a real buyer would, then scoring what happens. This guide is for the dealer principal, sales manager or BDC lead who wants to run shops in house, including the ethics and recording rules most guides skip.
What a mystery shop tells you, and what it cannot
A mystery shop shows what one customer experienced on one day. It exposes process gaps: the phone that rings out at lunch, the web lead that gets only an auto-reply. It is poor at judging an individual salesperson, because one contact is a small sample.
Industry data shows why the web-lead shop matters. In the 2026 Pied Piper PSI Internet Lead Effectiveness study, shoppers submitted questions about a specific motorcycle or side-by-side in inventory through 2,133 powersports dealership websites, using a new name, email address and local phone number each time, and measured responses over the next 24 hours. Only 47% of dealers answered the customer's question by email or text, dealers phoned the customer 50% of the time, and appointments were offered 13% of the time. "More than half of powersports customers still receive no personal response to their web inquiry," said Pied Piper's Cameron O'Hagan.
The four kinds of shop
Run all four, because customers use all four, and a store can be strong on one and weak on another.
| Shop | What it tests | How to run it | What to note |
|---|---|---|---|
| Phone | How a sales call is answered, whether the caller's name and number are captured, whether an appointment is set | Call during business hours and again at lunch or near closing, asking about a specific in-stock unit | Rings to answer, who answered, questions asked, whether a specific appointment was offered |
| Web lead | Speed and quality of the response to a website inquiry | Submit a form asking one specific question about one unit, with a working email and phone number | Time to first personal reply, whether the question was answered, calls and texts received, appointment offered |
| Chat | Whether chat reaches a person or a useful answer, and whether contact details are captured | Open chat on a unit page, ask the same specific question | Time to a real answer, hand-off to a person, next step set |
| Walk-in | Greeting, needs discovery, walk-around, demo offer, trade and financing conversation, follow-up | Visit as a genuine shopper for a unit you could plausibly buy, keep it to a normal browsing visit | Time to greeting, questions asked, whether a demo and a next step were offered, follow-up afterward |
Use the same scenario across stores in a round, such as a question about an in-stock side-by-side, so you compare like with like.
The mystery shop scorecard
Score every shop on the same 100 points. The weights are our recommendation, not an industry standard; adjust them to your process, but not mid-round. Professional services score more items: Pied Piper says its web-lead evaluations use over 20 weighted measurements, and its in-store shops analyze "more than 50 critical factors".
| Channel | Item | What good looks like | Points |
|---|---|---|---|
| Phone | Answered live | A person answers with the store name and their own name | 5 |
| Phone | Contact captured | Caller's name and number asked for early in the call | 5 |
| Phone | Question answered | Exact unit confirmed and the question actually answered | 5 |
| Phone | Needs asked | At least one question about how and where the caller rides | 5 |
| Phone | Appointment | A specific day and time offered | 5 |
| Web lead | Speed | First personal reply (not an auto-reply) within 15 minutes in business hours | 7 |
| Web lead | Answer | The question asked is answered in the first reply | 6 |
| Web lead | More than one channel | Email or text plus a phone call | 6 |
| Web lead | Appointment | A specific day and time offered | 6 |
| Chat | Real answer | A useful answer or a hand-off to a named person | 5 |
| Chat | Next step | Contact details captured and a next step agreed | 5 |
| Walk-in | Greeting | Greeted within a couple of minutes, without pressure | 5 |
| Walk-in | Discovery | Asked how the customer rides before showing units | 5 |
| Walk-in | Presentation | A walk-around of the unit and an offer of a demo ride where available | 5 |
| Walk-in | Trade and finance | Offered to appraise a trade and explained how financing works | 5 |
| Walk-in | Ask | Gave a price or clear next step and asked for the sale | 5 |
| Walk-in | Contact | Took contact details and agreed when they would follow up | 5 |
| Follow-up | First touch | A personal follow-up within 24 hours, with a reason to reply | 5 |
| Follow-up | Second touch | A second, different touch within three days | 5 |
| Total | 100 |
Add a free-text box to every shop: "What would have made me buy here?" The score tells you where you stand; the comments tell you what to fix.
How to run a mystery shop, step by step
- Decide what you want to learn, such as "how fast do we answer web leads compared with the two stores nearest us?"
- Write the scenario: a unit, a plausible buyer and one specific question, the same for every store in the round.
- Choose a shopper your staff will not recognize: a friend of the business, a hired shopper or a professional service.
- Set up a shop-only email address and phone number, so responses can be counted and nobody's personal details are exposed.
- Tell your own staff that shops will happen, but not when. It is fair, and it makes results a coaching tool rather than a trap.
- Run the shops in the same week, at different times of day, and fill in the scorecard straight after each contact while memory is fresh.
- Wait for follow-up. Score responses over the next three days before closing the shop.
- Compare by item, not just total. Your store and a competitor can both score 60 for very different reasons.
- Pick one change and test it (see the last section), then reshop the same channel.
How often to shop
- Your own store: once a month per channel. Pied Piper's O'Hagan says dealers are twice as likely to be top performers if they commit to responding to web customers at least once each day "and receive monthly web-response measurement as a reminder of what's really happening." A monthly self-shop does the same job for phone, chat and the floor.
- Competitors: two to four times a year, for example before and during your busy season. More often adds cost to their staff without telling you much more.
- After any change: reshop that channel about 30 days later to see whether it held.
Shopping honestly: what most guides skip
Most mystery shop pages explain how to get paid as a shopper or sell a shopping service. Almost none say where the line is when a dealer shops a competitor.
Do not cost a competitor real money
A competitor shop should cost the other store no more than a normal browsing customer would. The UK Market Research Society's mystery shopping guidelines say time with a competitor's staff "should be kept as short as possible and should not be seen to waste the competitor's resources in any way other than a normal customer enquiry might do," and that particular individuals must not be targeted in a way that disrupts normal business. The same guidelines note that when staff are paid on commission, as in automotive retail, the time a shopper takes from them deserves extra thought.
In practice, for competitor shops:
- No credit applications, and no false information given to a lender.
- No deposits, holds on units or special orders you do not intend to complete.
- No trade appraisals for a vehicle you are not willing to sell.
- No demo rides. They cost fuel, staff time and risk.
- Report results by store, not by named salesperson, and never publish or share them outside your management team.
Do not record without consent
Federal law is one-party consent. Under 18 U.S.C. § 2511(2)(d), it is generally not unlawful for a person to record a call they are a party to, or where one party has consented, unless the recording is made to commit a crime or tort. Many states go further. The Reporters Committee for Freedom of the Press lists about 11 states that primarily require all parties to consent, including California, Florida, Illinois, Maryland, Massachusetts, Pennsylvania and Washington, and notes that Connecticut and Nevada require all-party consent for phone calls. For calls between states, it advises assuming the stricter state law applies.
The research industry sets a higher bar still. The Market Research Society's guidelines say that because competitors' employees cannot be told they may be shopped, they must not be recorded by audio, photographic or video equipment at all. Our advice is the same: do not record competitor shops, in any state. Take notes immediately afterward instead.
Your own store is different: you can tell staff that calls are recorded and shops happen, and play a recording announcement on your lines. Then a self-shop call can be reviewed from your own phone system instead of being recorded by the shopper.
This is general information, not legal advice. Check your state's law with your dealership's attorney before you record any call.
Do not use real customers' identities
Never borrow a real customer's name, number or trade, or use CRM details to make a shop look real.
Turn findings into one change at a time
The usual mistake after a shop is a long list of fixes announced at one meeting. Nothing sticks. Work through findings one at a time.
- Rank the gaps by lost customers, not by points. A web lead that never gets a phone call costs more than a missing name badge.
- Write one change as a behavior: "every web lead gets a personal reply that answers the question, then a call, within 15 minutes in business hours."
- Give it an owner and a date to start.
- Train on it with a real example, ideally your own recorded call or the actual reply your shopper received.
- Reshop the same channel in about 30 days. If the score moved, keep the change and pick the next gap. If it did not, find out why before adding anything new.
- Keep a one-page log of each round: the date, the scores by item, the change made and the result.
When shops show salespeople fumbling the same objection or sending nothing useful after a visit, the fix is often content, not training. Our guide to sales enablement content for dealership salespeople covers what marketing should build for each stage. For phone gaps, see our guide to inbound sales call handling; for web-lead gaps, the powersports lead follow-up cadence. If the shops point to a wider problem, a full sales process audit is the next step.
Where PSX Ascend fits
A shop is a sample; your own records show every customer. PSX Ascend records and tags every inbound call, and every outbound call where state law permits. Recordings sit in the customer record and in a dashboard view where managers can do quick and detailed reviews, so the phone gaps a shop reveals can be checked against the rest of the week's calls. That is a tool for reviewing your own store's calls, not for shopping competitors, and the consent rules above still apply. Our guide to call tracking for powersports dealerships covers the weekly review.
The PSX Ascend powersports CRM keeps phone, text and email history on one record with a next action, which makes the follow-up items on the scorecard visible for every lead, not just the shopped ones. One dealer describes their lead response this way (dealer-reported, from our testimonials page): "The PSXAscend website, combined with their CRM, has allowed us to connect in a two-way conversation via phone, text, or email 99% of the time in less than 1 minute from the time a lead is submitted." Chuck Scott, GM, Edge Performance Sports.
You can also see the same AI-powered powersports CRM on our sister site, PSXDigital's AI-powered powersports CRM page.
Sources
- Pied Piper Management Company, Indian Motorcycle Ranked Highest in 2026 Web Lead Response Study (press release, March 2026)
- Pied Piper PSI, Power Equipment, Powersports, RV and Marine Mystery Shopping
- Legal Information Institute, Cornell Law School, 18 U.S. Code § 2511 (one-party consent exception, subsection (2)(d))
- Reporters Committee for Freedom of the Press, Introduction to the Reporter's Recording Guide (all-party consent states, calls between states)
- Market Research Society, Guidelines for Mystery Shopping Research (October 2011, PDF) (competitor shopping: time, recording, reporting)