I subscribe to Consumer Reports. I enjoy the magazine. Every once in a while, it does seem that a recommendation for or against a particular product comes out of thin air. That’s true of all media reviews, CarseatBlog being no exception, of course. Unfortunately, it seems that their carseat reviews have had more than their share of mistakes and questionable advice. The biggest gaffe was in 2007, when they failed to catch a mistake and published the results about carseats that failed a side impact test. Heather has an article about this. By the time they admitted their error, a lot of damage had already been done. Google still indexes numerous headlines and stories from the original flawed test and consumers may well find those articles without learning about the retraction. Maybe larger companies can absorb the backlash from a rating of “Don’t Buy: Safety Risk”. For smaller companies, something like that can do a lot of damage to the company and its employees. For this reason, scientific method really must be closely followed and any results that could indicate a risk to consumers (and damage to a company’s reputation) must be checked, rechecked and triple checked for any possible error.
In August of 2009, Consumer Reports struck again. This time, it was a single model, the Orbit Baby Infant seat. Kecia has a great summary of this report. Consumer Reports may be right this time. Or they may be wrong. They simply haven’t developed a trustworthy reputation in the child passenger safety area, so it’s difficult to give them the benefit of the doubt. Their test results can create a lot of hype, a lot of panic and a lot of publicity for their magazine and website. The disturbing part is that their press release seems to eschew scientific method, leaving too many variables and conditions ignored. After their flawed test and subsequent apology in 2007, I would have expected every “i” dotted and every “t” crossed before they released another test result. From what I have read on their website, they have left too many questions for me to believe their results without further testing. Specifically:
1) After the failures, they tested the seat 4 more times without a failure. No results for other models were issued. Were other models tested 6 or more times? Did any fail? It’s hard to determine if there is a problem with the product or the testing without that information.
2) They admitted that the manufacturers instructions were not followed in the failed crash tests. The Orbit Infant Seat is a unique product and has unique installation requirements. Were any tests done with the seats installed according to the instruction manual? What were the results?
3) Could the laboratory or test parameters be at fault? They didn’t name the lab or personnel who did the testing. Were the results confirmed by an independent laboratory or agency?
4) Could a defect be involved that affected only some product? Were the units that failed from a different date range or batch? Have they been examined for defects?
5) Given the issues with the 2007 crash testing, have the details of the testing and the complete results been published and peer reviewed by independent experts?
These types of questions should be considered as part of any testing that follows established principles of scientific method. I certainly hope they were asked before this warning was published. Certainly, they should have been both asked and answered, given what happened in 2007 and the subsequent apology by their president, Jim Guest, where he said, “I apologize on behalf of Consumers Union and I promise you we’re working hard to ensure that such an error does not happen again.”
It may turn out that Consumer Reports is right. Hopefully, an independent review of this issue will prove or disprove their findings. In the mean time, Orbit Baby has already conducted such tests, using the same laboratory and conditions and released a new statement:
Dear Orbit Baby parent,
As I mentioned in my last letter to you in regards to the Consumer Reports testing of the Orbit Baby Infant Car Seat, we referred this matter to NHTSA, the government agency responsible for car seat safety. I am pleased to share the following information:
Update September 1, 2009: The National Highway Traffic Safety Administration (NHTSA) tested the Orbit Baby Infant Car Seat for compliance with all crash testing requirements of Federal Motor Vehicle Safety Standard (FMVSS) 213. NHTSA confirmed that the Infant Car Seat passes these tests.NHTSA also independently verified:
- The middle shoulder harness slot is the appropriate slot for the size of the official CRABI 12 test dummy.
- The knob on the car seat Base should be turned to engage the StrongArm™ tightening mechanism to achieve the regulated seat belt tension for compliance testing.
Therefore, our Infant Car Seat not only passes our own tests in independent labs, it also passes tests conducted by NHTSA, the government agency that regulates traffic safety.
Orbit Baby maintains that Consumer Reports did not properly follow the Infant Car Seat instructions when they conducted their tests. (Our full response can be found here.) As an Orbit Baby parent, I believe that this issue highlights the importance of following car seat instructions, as well as the need for parents to educate grandparents, babysitters, and other caregivers on proper car seat usage.
Please be sure to take advantage of these helpful resources on our website:
- View Car Seat installation videos
- Read the Orbit Baby article on “The Correct Harness Position for Rear-Facing Car Seats”
- Download Orbit Baby product manuals
- Orbit Baby’s position on car seat safety can always be found here
- Email us with any further questions at [email protected]
Thank you for your support of Orbit Baby.
Sincerely,
Joseph Hei
CEO and Co-founder of Orbit Baby
Consumer Reports has the resources to do a great service to parents in regard to additional testing of child restraints. It’s too bad this test seems seems akin to “Crying wolf.” Even if they are right, a third party verification is now needed to prove it. If it is eventually shown that they have made another mistake, I sure hope their board of directors takes a very close look at how their testing is done and the serious impact their press releases can have on businesses and people.
As for our part, we plan to have a full review of the Orbit Baby Infant and Toddler system later this month. We won’t be able to tell you about crash test results, but we will be able to tell you a lot about this innovative child restraint!
My problem with many of their ratings is that they don’t provide enough information about their methods or results for you to tell if they are accurate or not. For example, the secrecy behind how they produce their “Crash Protection” ratings for child seats is mind boggling. If you are using that rating to protect your child, the least they could do is tell you how they derived the rating. For example, did they correlate it to a real world risk of injury, like the NHTSA “5-star” crash test ratings? Instead, you get these vague and mysterious red, empty or black circles and don’t even know how much better a full red one is compared to an empty one.
My BIL is an engineer and he hates CR system of ratings. He says most of them are inaccurate.
After the issues they’ve had in the past, I too can’t believe that CR didn’t follow the manual and testing protocal to an absolute “T” this time. It really hurts their credibility, in my opinion. (Unfortunately, for the hordes of parents who just see that it’s CR, the only thing they really know or care about are the CR results/recommendations.)
Well stated. I am furious with Consumer Reports. I have been a proud Orbit Baby parent for over two and a half years. I knew the minute I felt the carseat and hefty base that this was what i was going to entrust to keep my most precious cargo safe. I knew instantly that the reports had to be flawed…but I’m not the one that this erroneous statement is going to effect. Consumer Reports has put doubt along side the Orbit Baby name. The damage is done. They can retract their findings, but what if those new parents don’t hear about the retraction. I hope that the retailers that sell Orbit can instill confidence back in the consumers. Orbit Baby does not deserve this. I would much rather have them putting their energy into designing a booster seat so i can continue to support them when my two and a half year old eventually (it will be a while…the limit is 50 lbs…and there is quite a bit of height left before her ears peak out over the top).
Shame. Shame. On Consumer Reports. I cancelled my subscription yesterday. I know I am only one little consumer, but if they feel backlash that effect their bottom line as well maybe they will take more care in how they test and report important safety products…all products for that matter.