The Problem With ‘Best’ Lists That Aren’t Independently Tested

The Uncomfortable Truth About ‘Best’ Lists

I’ve spent the last five years testing products for a living, and I can tell you with absolute certainty: most “best” lists you encounter online are not actually based on independent testing. They’re marketing documents dressed up as journalism. This is the core of the best lists problem: many lists claim objectivity while serving commercial incentives.

This isn’t a casual observation. It’s a systemic problem that affects how millions of people spend their money. When you search for “best wireless headphones” or “best skincare routine,” you’re likely to find a carefully curated list that prioritizes affiliate commissions, brand partnerships, and SEO optimization over actual performance data. Understanding the best lists problem helps explain why top-ranked items may not actually perform best for users. The products ranked at the top aren’t necessarily the best—they’re often the ones that generate the highest revenue for the website publishing the list.

I want to be direct about my bias here: I believe this is broken. And I want to explain why, how it happens, and what consumers should actually look for when making purchasing decisions. Addressing the best lists problem is part of why I write and test.

How ‘Best’ Lists Actually Get Built

Let’s start with how these lists are typically constructed. Most popular “best” lists follow a predictable formula that has nothing to do with rigorous testing:

The Affiliate Model: A website identifies products with strong affiliate commission structures. These are the products that will make them the most money if someone clicks through and buys. They then build a list around these products, working backward to justify why they’re “best.” The testing, if it happens at all, is superficial and designed to confirm what was already decided. This is one of the clearest examples of the best lists problem in action.

The Brand Partnership Model: Brands pay websites directly for placement in “best” lists. Sometimes this is disclosed in fine print; often it isn’t. The list becomes a paid advertisement masquerading as editorial content. Research from academic studies examining popular web top lists shows how these curated lists are frequently misused and misrepresented as objective rankings when they serve specific commercial interests. Brand deals amplify the best lists problem because placement can be bought rather than earned.

The SEO Optimization Model: A website identifies high-search-volume keywords like “best budget laptop” or “best hair dryer under $100.” They then create a list designed to rank for that keyword, filling it with products that match the search intent but not necessarily products they’ve actually tested thoroughly. The list is built for search engines first, consumers second. SEO-focused content creation exacerbates the best lists problem by prioritizing search rankings over rigorous testing.

The Aggregation Model: Someone reads five other “best” lists, combines them, and publishes their own version without doing any independent testing. These lists become increasingly diluted as they’re copied and recopied across the internet. Aggregation without testing is a classic symptom of the best lists problem—copied lists that never see the products.

None of these approaches require actually using the products for extended periods. None of them require transparent testing methodology. None of them prioritize what’s genuinely best for the consumer—they prioritize what’s best for the website’s bottom line.

Why Independent Testing Actually Matters

Here’s what happens when you actually test products independently: reality gets in the way of the narrative. Solving the best lists problem requires independent labs, repeatable methods, and transparency.

When we tested the best vitamin C serum we’ve evaluated this year, we didn’t start with a predetermined winner. We tested multiple serums under identical conditions, measured stability, assessed absorption rates, and tracked results over weeks of consistent use. The winner wasn’t the most expensive option. It wasn’t the one with the biggest marketing budget. It was the one that actually performed best in our testing conditions.

The same principle applies across every category. When we evaluated the best robot vacuum for most homes in 2026, we didn’t just read manufacturer specifications. We tested navigation accuracy, suction power on different floor types, noise levels, and real-world performance in homes with pets, stairs, and furniture obstacles. We measured how long the battery actually lasted, not what the marketing materials claimed.

This matters because products rarely perform as advertised. A hair dryer that claims “ionic technology for frizz reduction” needs to be tested against competitors to see if that claim holds up. A web host that promises “99.9% uptime” needs to be monitored over months, not weeks. A VPN that advertises “military-grade encryption” needs actual security analysis, not just marketing language.

When we tested which streaming bundle is actually worth it in 2026, we looked at actual content libraries, interface usability, streaming quality, and price-per-value. We didn’t just list the options—we compared them head-to-head under conditions that matter to real users.

Independent testing reveals these truths. Non-independent lists hide them. Confronting the best lists problem means demanding the kind of evidence that only independent testing can provide.

The Cost of Misinformation

Let me be specific about what happens when consumers rely on non-independent “best” lists.

You buy a product that’s ranked #1 on a popular list, assuming it’s the best available. In reality, it’s the best for the website’s affiliate commission structure. You spend $200 on something that doesn’t meet your needs, or you buy a product that performs worse than alternatives that weren’t mentioned because they don’t have affiliate programs.

Multiply this across millions of purchasing decisions, and you’re looking at billions of dollars being spent inefficiently. Consumers are literally paying premium prices for products that aren’t actually the best options for them. The scale of the best lists problem means entire product categories can be skewed by a few monetized pages.

This isn’t just about wasted money. It’s about wasted time. When you buy something based on a fraudulent “best” list and it doesn’t work as expected, you’ve lost the time you spent researching, the time you spent purchasing, the time you spent using it, and the time you spend returning it or dealing with disappointment.

It’s also about eroded trust. When consumers figure out that “best” lists aren’t trustworthy—and most of them do eventually—they become skeptical of all product reviews, including genuinely independent ones. The ecosystem of consumer information becomes poisoned.

What Transparent Testing Actually Looks Like

If you want to understand the difference between a real review and a fake “best” list, look for these markers:

Disclosed Methodology: A legitimate review explains exactly how the product was tested, under what conditions, for how long, and with what measurements. We explain our testing approach for products like the LG C5 OLED TV, detailing the specific tests we ran, the comparison products we used, and the criteria that mattered most.

Transparent Affiliate Disclosure: If a review includes affiliate links, it should be clearly labeled. More importantly, the review should be honest about whether the product actually deserves its ranking, regardless of commission structure. Some of our highest-performing reviews recommend products with lower affiliate commissions because they genuinely outperform alternatives.

Reproducible Results: The testing should be designed so that someone else could theoretically replicate it and get similar results. This requires detailed documentation of test conditions, sample sizes, and measurement methods. When we tested six VPNs for 30 days, we documented the specific tests, the conditions, and the measurements so readers could understand why we reached our conclusion.

Honest Limitations: Real testing acknowledges its constraints. We might test a product for 30 days, but we’ll be transparent about the fact that long-term durability wasn’t fully evaluated. We might test in a specific climate, and we’ll note that results might differ in other environments. This honesty is what separates legitimate reviews from marketing material.

Comparison Fairness: Products should be compared under identical conditions using the same measurement criteria. When we compared CeraVe versus La Roche Posay cleansers, we tested both under the same conditions, with the same skin types, over the same time period. We didn’t cherry-pick favorable conditions for one product over the other.

Willingness to Recommend Against: The most trustworthy reviews are willing to say when something isn’t worth buying. A “best” list that recommends everything is worthless. A real review acknowledges that some products don’t meet the threshold for recommendation, regardless of their marketing claims or affiliate potential.

Addressing the best lists problem also means being willing to publish negative findings even when those findings reduce traffic or revenue. That kind of integrity is rare because the economics of online publishing often reward the opposite behavior.

The Counterargument—And Why It Doesn’t Hold

Someone will inevitably argue that “all reviews are biased” or “there’s no such thing as truly unbiased testing.” They’re partially right about the bias part. Everyone has perspectives that shape their evaluation. But this argument is often used to excuse the complete absence of integrity in product reviewing.

Yes, bias exists. But there’s a massive difference between acknowledging bias while maintaining standards and deliberately ignoring standards because bias exists. It’s like saying “everyone makes mistakes, so let’s stop trying to be accurate.” The solution to bias isn’t to abandon standards—it’s to be transparent about methodology and to let results be reproducible and verifiable.

Another counterargument is that “independent testing is expensive and time-consuming.” This is true. It’s also why most websites don’t do it. But that’s precisely the point. If you want reliable information, you need to seek out sources that have actually invested in the testing process. That’s what separates legitimate product evaluation from marketing content. The existence of the best lists problem is largely a function of those cost and incentive imbalances.

Some will also argue that “best” lists are just meant to be starting points, not definitive guides. Fair enough. But if that’s the case, they should be labeled as such. They shouldn’t be presented with authority and confidence when the underlying research doesn’t support that confidence.

How to Identify Trustworthy Reviews

If you’re looking for genuinely useful product information, here’s what to look for:

Check the Source’s Transparency: Visit the About page of any review site. Do they explain their testing methodology? Do they disclose how they make money? Do they explain their editorial standards? Trustworthy sources are transparent about these things.

Evaluate the Depth of Content: Real reviews are detailed. They explain not just what’s good about a product, but what’s mediocre or disappointing. They include specific measurements and observations. When we reviewed the hair dryer that beats Dyson for half the price, we didn’t just say it was better—we showed the testing that proved it, with specific performance metrics.

Look for Specific Test Conditions: If a review mentions testing but doesn’t explain the conditions, be skeptical. Real testing includes details like room temperature, humidity levels, sample size, duration, and measurement methods. These specifics matter because they affect reproducibility.

Cross-Reference Multiple Sources: Don’t rely on a single “best” list. Read multiple independent reviews. If they consistently recommend the same product across different sources with different methodologies, that’s a stronger signal than a single recommendation. Cross-referencing is one way to spot the best lists problem—if only one site touts a product as “best” while others do not, that’s a red flag.

Check for Negative Reviews: A review source that only publishes positive reviews is suspect. Every product has tradeoffs. A trustworthy source will acknowledge them. When we tested the adjustable dumbbells worth the counter space, we were honest about the limitations alongside the benefits.

Verify Affiliate Relationships: Many legitimate sources use affiliate links. The key is transparency. They should clearly label affiliate links and be honest about whether affiliate relationships influenced their recommendations. A source that hides affiliate relationships is untrustworthy.

Look for Long-Term Testing: Products often fail or underperform after initial use. Trustworthy sources test over extended periods. We don’t review a laptop after one week. We use it for months, testing battery life, thermal performance, and durability over time.

If you apply these checks, you’ll be better equipped to spot and avoid the worst effects of the best lists problem.

The Role of Transparency Standards

One of the most important things consumers can do is demand transparency. When you see a “best” list without disclosed testing methodology, ask questions in the comments. Email the site and ask how they tested the products. If they can’t or won’t answer, that’s your signal to look elsewhere.

This is why we’re committed to standards that go beyond what most review sites do. When we recommend the best mechanical keyboard under a specific price point, we explain exactly what we tested, how we measured performance, and what tradeoffs exist. We acknowledge that “best” depends on individual preferences, but we explain our criteria so readers can decide if our priorities match theirs.

The same applies to our coverage across different categories. Whether we’re evaluating the best web host for a small business site or testing skincare products like La Roche Posay Cicaplast B5, we maintain the same standards: transparent methodology, honest assessment, and detailed explanation of our findings.

Guides like how to evaluate health information on the internet from authoritative sources like the NIH provide frameworks for assessing credibility that apply to product reviews as well. These resources emphasize the importance of identifying who created the content, whether they have expertise, and whether they’re transparent about their methods and conflicts of interest.

Insisting on transparency is one of the most effective ways to reduce the influence of the best lists problem on consumer behavior.

Why This Matters Beyond Individual Purchases

The problem with non-independent “best” lists extends beyond individual purchasing decisions. It affects market dynamics.

When fake “best” lists drive sales toward specific products regardless of actual quality, manufacturers have less incentive to improve. Why invest in better performance if you can just invest in better affiliate partnerships? This creates a perverse incentive structure where marketing effectiveness becomes more important than product quality. Over time, this dynamic is a core driver of the best lists problem.

It also creates barriers to entry for smaller brands. A startup company with a genuinely superior product might never gain traction because they can’t afford the affiliate commissions or brand partnerships that get them onto the major “best” lists. Consumers never discover them because they’re not being recommended by sites with large audiences.

This is why independent testing matters at a systemic level. It’s not just about helping individual consumers make better decisions—though that’s important. It’s about maintaining a marketplace where quality actually matters. Tackling the best lists problem helps ensure innovation and meritocracy in product development.

The Path Forward

I don’t expect the problem of fake “best” lists to disappear. The incentive structure is too strong, and the barrier to creating a convincing-looking fake list is too low. Any website can publish a “best” list and claim authority.

But I do think consumers can push back. You can demand better from the sources you trust. You can ask questions about methodology. You can seek out sources that invest in actual testing. You can support review sites that prioritize accuracy over affiliate commissions.

When you’re considering a major purchase, don’t just read the top Google result for “best [product category].” Read multiple sources. Look for detailed methodology. Check whether the reviewer has actually used the product. See if they’re transparent about how they make money. Cross-reference their recommendations against other independent sources.

And if you find a review source that consistently provides honest, detailed, independently-tested product information—even if it’s not the most convenient or popular source—support them. Share their reviews. Recommend them to others. The market for trustworthy product information exists, but it requires consumer demand to sustain. That consumer pressure is one practical antidote to the best lists problem.

We’ve built Unbias Review on the principle that consumers deserve better than marketing disguised as journalism. When you read our review of the Sony WH-1000XM6 headphones, or our comparison of noise-cancelling options like the Bose QuietComfort Ultra, you’re getting the results of actual testing by people who care about accuracy more than affiliate commissions.

That’s not because we’re inherently more virtuous than other sites. It’s because we’ve structured our business model to align our incentives with consumer interests. We’re reader-funded, which means our success depends on providing value to you, not on maximizing affiliate clicks.

This is possible. Other independent review sources do it too. The market for trustworthy product information exists. It’s just smaller and less visible than the market for marketing-disguised-as-reviews, because marketing has much larger budgets. Recognizing and acting on the best lists problem is how consumers can help change that balance.

The Real Measure of a ‘Best’ List

Here’s my final thought: the best “best” list isn’t the one with the most polished design or the highest Google ranking. It’s the one where the reviewer would actually buy the recommended product with their own money and would be willing to stand behind that recommendation if they had to defend it in court.

Would the author of a typical “best” list actually use their top recommendation? Or would they buy something completely different for themselves? That’s the question that separates legitimate reviews from marketing content. Asking this question is a quick way to spot whether a review is part of the best lists problem or part of the solution.

When we recommend products like the Ninja Creami ice cream maker or suggest insulated bottles that actually keep ice for 24 hours, we’re recommending products we would buy ourselves. That’s the standard we hold ourselves to.

I hope you’ll hold other sources to the same standard. Ask them the hard questions. Demand transparency. Seek out independent testing. And support the review sources that actually deserve your trust.

The truth is the only side worth taking. When it comes to “best” lists, make sure you’re getting the truth, not just the marketing. If you keep the best lists problem in mind as you read recommendations, you’ll be far less likely to fall for lists that are optimized for ad revenue rather than accuracy.