If it was a prototype - or new product, then yeah, that's great. In this case the claim has been in their materials and on the web for 5 or so years. That's plenty of time for Jack to get some data together.
But yes, in this case, things were exacerbated by other circumstances. CockerPunk already had some previous history with Jack. Their conversations of a few months ago were what prompted this test. The internet is a great place for things to get out of hand. CockerPunk and Jack were both a bit on the edge - which, in turn led to fanboys on both sides taking things to really inappropriate places.
Neither Jack nor CockerPunk ever stepped over the line, but the overall tone of the conversation was poor because of the other participants. CockerPunk and I have both had extensive phone conversations with Jack - before, during and after the test. They were all very cordial and professional. The thing that we didn't and won't to - is hold results because they don't agree with what the manufacturer claims. Which, in effect, is what Jack wanted us to do. That would simply be dishonest work on our part - if we chose to withhold data because it was going to make someone mad. If we are confident in our procedures (which we are), open about our methods (which we are) and trust our results (we do), then the onus has to be on the other person to step forward and produce better data and a better test to refute ours.
Now, if someone asks us to help in product development, that's something else and we would have to make some decisions about whether we even want to get into that. The moment we are tied to a product competing in the market - our credibility when talking about competing products has gone down the shitter.
We want people to call us on stuff if they see a problem - that's how we'll improve our testing. Smart people like you should be watching us like hawks - jumping on us for any problems you see in what we do. The criticism leveled at us about not documenting our tests is simply a smoke screen for people who don't like our results. And that's fine. I'll continue to use the gear that we find to be best though our work - and in the end, I'll have an advantage over people who don't. Which is what this is all about.
I'm not saying withhold....you know me I try to look at both sides before leaping (I still get schooled sometimes) But if a result from a claim, this instance the Bolt didn't pan out...I would hit pause for a day or two and say Jack...the results of the bolt wasn't that good....Could the bolt be defective? Could you send another bolt or is there something in the set up we missed?.......I know this is playing armchair quaterback after the game is over....but just trying to smooth future tests...
Hell look at my sig....My main sponsor knows me well...too well...I have more documentation on them then anyone else....I was not a fanboy for years because of claims, stories and my opinion subpar materials...They listened to the players and they will be one if not the best companies for quality equipment and service to the player for years to come...Credit this to people like Sean who came aboard and are working for the better of paintball as well as the company...
just my two cents....according to inflation my half cents worth