Just looked at the analysis of price elasticity and I have to say that this is one of the sneakiest reports I have ever seen.
They base their findings on two other reports, both of which are meta-analysis reports, which means that they themselves base their findings on the findings on a bunch of other reports.
I have a problem with meta-analysis reports, because they can be put together in such a way as to come to whatever conclusion you like, simply by picking and choosing the reports you use in your analysis.
From a post by myself on boards.ie:
[quote:3qs5vgry]
you could take a bunch of other reports from other countries or decades ago, pick out the bit's and pieces that you like and use them the "prove" what you want. If a report doesn't say what you want, ignore it and use another report. If a report has a bit that you like but other bits you don't, only refer to the bits you like. You don't have to print the rest of the data, just the good bits and a list of sources.[/quote:3qs5vgry]
It makes it very difficult for anyone to check your figures, because the figures you use are actually from a bunch of other reports, the quality of which is unknown and which you got to choose. There is nothing that says you have to include a report so if you find one that doesn't say what you want, you can leave it out of your meta-analysis. Handy.
If you have to make your report by examining statistics, you have to use the statistics that are available and relevant to the study. This means that any Joe soap can come along, look at the figures and go "Hang on, how did you work that out? You're ignoring all these figures over here."
Gallet's report examines 132 studies from all over space and time, while Wagenaar examines over 1000. While these figures sound impressive and are used to make the reports seem authoritative, what it actually means is that we have no effective way of checking whether the report is worth anything.
TheRegister.co.uk tear this report apart here: Junk science and booze tax - a study in spin[/url:3qs5vgry]