How We Rate Products
In the product ratings game, there is a ton of ambiguity. What does 5 stars really mean? Just because something has 5 stars doesn’t mean that you know how it got to 5 stars and how the author decided to give it that number. Ever notice how on ratings sites the 5 star reviews often happens to be the most expensive item?
At Dirt Bike Gear Guide, we strive for complete transparency, so here is how our ratings work for each type of item.
We try and make this as fair as possible, so please pay special attention to how this works.
Price and Accessibility
Every one of our ratings scales has a component of price and accessibility. Price is how the items price compares to others in the same category. We also have an Accessibility metric. The Accessibility metric is a function of how accessible this item is to the average Joe. The reason we do it this way is to not penalize an item that has a premium price, but penalize that item if it is not accessible. A perfect example of this is with motocross boots.
Lets say that you have an ultra premium motocross boot ($600 dollars and up). If all the other boots in this category are 600 to 700 dollars and the price of the item on review is 610 dollars, then it would get a high Price score. It may also have 5 stars for comfort, features, etc. However, not everyone is going to have 600 bucks to spend on a new pair of motocross boots, so the accessibility score will be low. This helps balance out the reviews because a mid price range motocross boot may have less features, less comfort, a high price score, and a higher accessibility score (because most people can afford it).
So which is the best boot? I would argue the mid price one, because it is actually attainable.
This category also exists on all of our reviews and is the most heavily weighted. This is an estimation of the actual user experience using this product. We feel that actual user experience is the best indicator as to the quality of the product. This does not just come from Amazon, we research forums, other retailers reviews, and our own experiences (if we own the product).
Other factors are going to vary depending on what type of item you are looking at. For things that you wear, they will have a feature and comfort category. A part would not have a comfort category, etc.
Rating System for Protection Gear and Apparel
As you can see, each section has a weight that comes up with the complete score. Below is a sample of how this looks in practice.
Using the weights for our rating system for Protection Gear and Apparel, this fictional product gets an overall score of 3.9 out of 5. This 3.9 is used to compare with the other products in this category to give a fair and unbiased view of which product is the best overall.