Opinions ___________________________________________
The UN climate change numbers hoax
Thursday, 10 July 2008
By Tom Harris and John McLean

It’s an assertion repeated by politicians and climate campaigners the world over: “2500 scientists of the United Nation’s Intergovernmental Panel on Climate Change (IPCC) agree that humans are causing a climate crisis.”

But it’s not true. And, for the first time ever, the public can now see the extent to which they have been misled. As lies go, it’s a whopper. Here’s the real situation.

Like the three IPCC “assessment reports” before it, the Fourth Assessment Report (AR4) released during 2007 (upon which the UN climate conference in Bali was based) includes the reports of the IPCC’s three working groups.

Working Group I (WG I) is assigned to report on the extent and possible causes of past climate change as well as future “projections”. Its report is titled “The Physical Science Basis”.

The reports from working groups II and III are titled “Impacts, Adaptation and Vulnerability” and “Mitigation of Climate Change” respectively, and since these are based on the results of WG I, it is crucially important that the WG I report stands up to close scrutiny.

There is, of course serious debate among scientists about the actual technical content of the roughly 1000-page WG I report, especially its politically motivated Summary for Policymakers which is often the only part read by politicians and non-scientists. The technical content can be difficult for non-scientists to follow and so most people simply assume that if large numbers of scientists agree, they must be right.

Consensus never proves the truth of a scientific claim, but is somehow widely believed to do so for the IPCC reports, so we need to ask how many scientists really did agree with the most important IPCC conclusion, namely that humans are causing significant climate change - in other words the key parts of WG I?

The numbers of scientist reviewers involved in WG I is actually less than a quarter of the whole, a little more than 600 in total. The other 1900 reviewers assessed the other working group reports. They had nothing to say about the causes of climate change or its future trajectory. Still, 600 “scientific expert reviewers” sounds pretty impressive. After all, they submitted their comments to the IPCC editors who assure us that “all substantive government and expert review comments received appropriate consideration”. And since these experts reviewers are all listed in Annex III of the report, they must have endorsed it, right?

Wrong.

For the first time ever, the UN has released on the Web the comments of reviewers who assessed the drafts of the WG I report and the IPCC editors’ responses. This release was almost certainly a result of intense pressure applied by “hockey-stick” co-debunker Steve McIntyre of Toronto and his allies. Unlike the other IPCC working groups, WG I is based in the US and McIntyre had used the robust Freedom of Information legislation to request certain details when the full comments were released.

An examination of reviewers’ comments on the last draft of the WG I report before final report assembly (i.e. the “Second Order Revision” or SOR) completely debunks the illusion of hundreds of experts diligently poring over all the chapters of the report and providing extensive feedback to the editing teams. Here’s the reality.

A total of 308 reviewers commented on the SOR, but only 32 reviewers commented on more than three chapters and only five reviewers commented on all 11 chapters of the report. Only about half the reviewers commented on more than one chapter. It is logical that reviewers would generally limit their comments to their areas of expertise but it’s a far cry from the idea of thousands of scientists agreeing to anything.

Compounding this is the fact that IPCC editors could, and often did, ignore reviewers’ comments. Some editor responses were banal and others showed inconsistencies with other comments. Reviewers had to justify their requested changes but the responding editors appear to have been under no such obligation. Reviewers were sometimes flatly told they were wrong but no reasons or reliable references were provided.

In other cases reviewers tried to dilute the certainty being expressed and they often provided supporting evidence, but their comments were often flatly rejected. Some comments were rejected on the basis of a lack of space - an incredible assertion in such an important document.

The attitude of the editors seemed to be that simple corrections were accepted, requests for improved clarity tolerated but the assertions and interpretations that appear in the text were to be defended against any challenge.

An example of rampant misrepresentation of IPCC reports is the frequent assertion that “hundreds of IPCC scientists” are known to support the following statement, arguably the most important of the WG I report, namely “Greenhouse gas forcing has very likely caused most of the observed global warming over the last 50 years”.

In total, only 62 scientists reviewed the chapter in which this statement appears, the critical chapter 9, “Understanding and Attributing Climate Change”. Of the comments received from the 62 reviewers of this critical chapter, almost 60 per cent of them were rejected by IPCC editors. And of the 62 expert reviewers of this chapter, 55 had serious vested interest, leaving only seven expert reviewers who appear impartial.

Two of these seven were contacted by NRSP for the purposes of this article - Dr Vincent Gray of New Zealand and Dr Ross McKitrick of the University of Guelph, Canada. Concerning the “Greenhouse gas forcing …” statement above, Professor McKitrick explained “A categorical summary statement like this is not supported by the evidence in the IPCC WG I report. Evidence shown in the report suggests that other factors play a major role in climate change, and the specific effects expected from greenhouse gases have not been observed.”

Dr Gray labeled the WG I statement as “Typical IPCC doubletalk” asserting “The text of the IPCC report shows that this is decided by a guess from persons with a conflict of interest, not from a tested model”.

Determining the level of support expressed by reviewers’ comments is subjective but a slightly generous evaluation indicates that just five reviewers endorsed the crucial ninth chapter. Four had vested interests and the other made only a single comment for the entire 11-chapter report. The claim that 2500 independent scientist reviewers agreed with this, the most important statement of the UN climate reports released this year, or any other statement in the UN climate reports, is nonsense.

“The IPCC owe it to the world to explain who among their expert reviewers actually agree with their conclusions and who don’t,” says Natural Resources Stewardship Project Chair climatologist Dr Timothy Ball. “Otherwise, their credibility, and the public’s trust of science in general, will be even further eroded.”

That the IPCC have let this deception continue for so long is a disgrace. Secretary General Ban Kai-Moon must instruct the UN climate body to either completely revise their operating procedures, welcoming dissenting input from scientist reviewers and indicating if reviewers have vested interests, or close the agency down completely.

Until then, their conclusions, and any reached at the Bali conference based on IPCC conclusions, should be ignored entirely as politically skewed and dishonest. 

Tom Harris is an Ottawa-based mechanical engineer and Executive Director of the International Climate Science Coalition.

John McLean is climate data analyst based in Melbourne, Australia.


An opinion provided by OnlineOpinion.com.au - Australia's e-journal of social and political debate
Comments
Add New
posted by: A.J.H. Viirlaid 10-Jul-08 17:39:03
Thanks to many researchers like Steve McIntyre, the work of the IPCC is -- ever so slowly -- being debunked. But at the present time, it doesn't really matter that the "jig is up."

Just as you "cannot fight city hall" you also cannot fight political movements and the mass media. There are just too many other agendas involved in the intrigue by now. This is not about the science. This is no longer your grandfather's logical and simple world. There are back-stabbers and political animals lurking in “climate science” today that would normally have been exposed as charlatans a long time ago in any other age or any other field.

The 'science' of astrology has a more firm undergirding than does the IPCC's 'scientific' stance.

The new message in your piece above would have to be so dumbed down for the media to absorb and accept and then distribute, it most likely won't happen for a long time.

Just witness the G8 meeting in Japan. While the leaders know that climate science’s predictions are hopelessly flawed, they have no choice but to pander to the AGW disciples.

I predict that the way this will unfold that slowly, VERY slowly, as our Earth cools in relative terms over the next 2 decades, prevailing views will begin to shift. There won't be any stopping the increase in atmospheric CO2, unless Earth cools sufficiently for more rapid oceanic absorption to occur.

Sadly it will not be real science that leads the way in the inevitable reassessment, but reality. This will leave a bad taste in people’s mouths regarding how much they can ever trust any scientist or science again.

That is the long-term cost of a science that was brought ‘out of the lab’ so prematurely.
posted by: Mr Gumby 11-Jul-08 03:12:31
Often in these type of opionion pieces, the comments rapidly go down the path of

a. Opinion by someone (typically a climate "skeptic", typically on the UN/IPCC)
b. Comment by a critic of the opinion piece on the motives, qualification and/or ideology of the opinion stater
c. Response from those who agree with the opinion stater that to question the motives, qualification and/or ideology of the opinion stater is nothing but a personal attack, that the motives etc are irrelevant, etc.
d. Depending on the opion piece the critic will often reply that given that the original piece questioned the motives, qualification and/or ideology of the UN/IPCC etc, that such comment is valid.

With that base and to avoid confusion, can I ask if the Tom Harris of this piece the same Tom Harris who is/was executive director of the "Natural Resources Stewardship Project" and a global warming skeptic/denier/contrarian and who was until September 2006, the Ottawa operations director of the High Park Group, a public relations and lobbying firm active in the debate over global warming, whose clients include the Canadian Electricity Association and the Canadian Gas Association, and which has been accused of being an "astroturfing" organisation set up by High Park Group to promote the interests of its clients?

Secondly, is the John McLean the same John McLean mentioned in the Nexus6 Blogspot (http://n3xus6.blogspot.com/2007/12/show-me-credentials.html) which refers to a website where that a John McLean is referred to himself as a "Computer consultant and occasional travel photographer"? and details an exchnage on the "climate change analyst" credentials of that Mr McLean?

posted by: Tom Harris 12-Jul-08 00:44:10
Answers to Mr. Gumby's questions:

1 - I, Tom Harris, was the Executive Director of "Natural Resources Stewardship Project" until the end of February 2008.

2 - I have never been "a global warming skeptic/denier/contrarian". Climate always changes and always will. At times it warms and at times it cools. It never stays the same.

3 - Until September 2006 (from May 2006 to September 2006, a long career indeed), I was the Ottawa operations director of the High Park Group. Despite HPG's other activities, I was never a lobbyist or involved in lobbying. You will have to ask HPG about what their other staff do or did as I can only speak for myself. I do know however that HPG clients include solar and wind companies as well as biofuels, not that it makes any difference to me.

Do you have anything of substance about the piece to ask, or comment, about?

Tom
posted by: John M Reid 12-Jul-08 01:35:57
It is reasonable to raise the issue of the extent of scientific support for particular assertions and forecasts/predictions in IPCC reports. If the information contained in the opinion piece by Harris & McLean is correct then someone seems to have been rather over-egging the pudding. However, of even more concern are the questions, is the climate warming and if so, by how much and what will be the effects on the biosphere. Given the climate is warming, and that the result of a 4°C increase in the global average temperature would be catastrophic, the precautionary principle tells us even if the effect is not mainly due to human activity we should do everything possible to restrain the increase. Everything possible short of climate engineering. In other words we should take drastic steps, however economically painful, to reduce our input of heat into the system.
Of even more concern are the data contained in The Global Footprint Network's Living Planet Report 2006. If the data are correct (and I know of no scientific analysis that disputes the approximate accuracy of the data) with a present world population of 6.7 billions we are consuming about one and one-third times the biocapacity of the Planet. When the population reaches its forecast peak of about 9.1 billions in 2050, and each person in the (present) poor countries has, or aspires to, a footprint of at least 1.9 global hectares (and the 3.4 billions in China and India will probably demand 4.8 global hectares/person, the present EU average) the demand will represent the biocapacity of 2.75 Planet Earths. If global warming reduces the biocapacity of Earth, the demand will be for even more than 2.75 planets.
Climate change requires urgent action, overpopulation is an even more pressing concern.
posted by: Mr Gumby 12-Jul-08 02:19:45
Dear Tom,

I thought I posed a question on an issue that too frequently permiates commentary on such opinion pieces. In the world of the internet it is too easy to "google" and find information of questionable lineage and integrity. I think you have quite succinctly stated your position on the veracity of information readily obtainable from various internet sources.

I am sorry you didn't find my question be be "of substance". I would have thought that the author of a piece that challeneges the integrity, honesty and ethics of the people involved with the IPCC, would consider the chance to counter claims regarding their own integrity, honesty and ethics as being "of substance" and appropriate.
posted by: Damir Ibrisimovic 12-Jul-08 11:57:36
Sad!

This debate is becoming an ad hominem debate. Science? You must be joking!

Opinions are legitimate as long they stick to the facts. This article, however, does not speak about climate facts. It speaks about how “other side” is illegitimate about stating it’s facts. I would expect better from a science related site.

This is not a question to irresponsibly throw stones at each other. This is the question of being a scientist or wishing to be one. And what is scientific method is (or should be) well known.

I’m still waiting to be enlightened why we have such debates exported from US. I’m still waiting to be enlightened why we do not have them in other parts of world. I’m still waiting to be enlightened why we have these desperate attempts to reignite such debates in non-US countries.

US and Big Oil policies aligned are trying to fight for status quo although it is clear that they are simply buying time; at whose expense? Until I’m enlightened about my questions, I reserve the right to be sceptical.

This is science no more. This is politics that may run all of us into ruin.

Kind regards,
posted by: A.J.H. Viirlaid 12-Jul-08 17:31:50
Hi Damir,

The authors also reserve THEIR OWN right to be skeptical of the IPCC and its findings — especially since they don’t trust the PROCESS of compiling the final document.

I am responding to possibly correct an incorrect impression you seem to have in your entry above.

This particular article was NOT ever INTENDED to address the actual 'science'.

It simply and very specifically tries to show why the so-called IPCC-described 'consensus' is a mirage.

It does this by addressing the PROCESS of compiling the final document.

The process is ALSO a legitimate issue to address ALONG WITH the science that you are primarily concerned about.

Even if the underlying science has no problems, if the actual findings are SUMMARIZED in a manner that distorts the underlying detailed scientific findings — through a faulty process that the IPCC apparently uses — then there is a very real PROBLEM. Would you not agree?

That is the only thing the authors above have attempted to do — and if they have succeeded, then indeed they have added real value to the whole debate. Please try to address this, and whether, in your mind, that attempt has failed or succeeded.

I humbly suggest that you re-read the article. If you don’t think that there is a legitimate problem in the IPCC document-compilation PROCESS, then you should respond to THAT issue only. Also focusing on only one thing at a time will prove to be more productive for all of us.

When you are reading the article, ask yourself if it is legitimate for the IPCC editors to reject suggestions from leading climate scientists when these scientists suggest that the level of confidence should be reduced in the final document’s phrasing.

Ask yourself if it is possible that the IPCC ‘editors’ might be biased and might be selectively rejecting suggestions for improvements in wording that they receive from the qualified climate scientists — scientists who were ASKED to review certain chapters in the IPCC document.

Ask yourself if it is possible that ‘vested interests’ are possibly controlling a hidden agenda and possibly skewing the final document’s wording in a predetermined direction.

Please read the section that says “only 32 reviewers commented on more than three chapters and only five reviewers commented on all 11 chapters of the report”. Also please read the section that BEGINS “An example of rampant misrepresentation of IPCC reports is the frequent assertion that ‘hundreds of IPCC scientists’ are known to support the following statement, arguably the most important of the WG I report, namely ‘Greenhouse gas forcing has very likely caused most of the observed global warming over the last 50 years’.”

Then ask yourself whether it is ultimately FAIR to describe the final IPCC document as something that really represents a ‘consensus’ of 2500 leading climate scientists “of the United Nation’s Intergovernmental Panel on Climate Change (IPCC) [who] agree that humans are causing a climate crisis.”

Once you have done all that, please respond again. Cheers!
posted by: Christian-Adam Ribeiraud 18-Jul-08 20:24:25
Sad, indeed that a discussion on a scientific conclusion, such as the IPCC Report seems to be, cannot be disputed by anyone without being attacked.

Every scientific theory emitted is usually presented to the Scientific community, just so that very community, can engage in any possible debunking, by reviewing the data and the results advanced. Skepticism is as much a part of the scientific process as is extrapolation and facts. You can't discover anything with all of it. The scientific method however can only be based on factual observation and those facts have to be verifiable by anyone, otherwise they are just opinion or theory, not facts.

I think the only consensus there is, at this point, and apparently rapidly eroding, is that there is a general warming of the planet. The disagreement stems from the cause of that global warming. The "Church of Global Warming" (as the opponents have been calling it), claim that Man is mostly responsible for it. Others, acknowledge the warming trend but do not accept the conclusion that it is Man made as opposed to a normal cycle of Climatic conditions influenced by any number of natural occurrences (the least of which is not Solar activity cycles).

If the past is any indication, there has been a quite a large number of warming and cooling cycles, as evidenced, in the micro gas bubbles trapped in the Ice Core Samples at the poles.

This article is not disputing the Warming trend, but the claim that it is unanimously supported and confirmed by "thousands" of scientists, as advanced by the UN report. It further unveils that besides the misleading numbers of scientists reaching a "consensus" on the issue, quite a large portion have a conflict of interest in supporting a conclusion versus another.

After all, we were told in the 70's that there will be an ice age coming, "Global Cooling" was the idea then. According to the research then, I should be seeing 2 to 3 feet snow falls in Winter in Miami for the past few years already.

It has been advanced lately that the oceans have in fact cooled by about 1oC since 1998. Is that a fact? If it is, what does it say about Global Warming?

What I would like to hear is if Global Warming is bad? The crop cycle will be naturally extended, possibly even doubled, so that should be good, unless I am missing something. What about the length of that warming period, do we have any clue as to how long it might last in Human Years? If Global Warming is "Bad" what can be effectively done to counter it? We can't stop breathing and if the population projections for 2050 are correct, what are 9 billion Humans to do to counter the warming effect?

No Gentlemen, the sad part of all of this is that Politicians have gotten involved to further agendas, and sadder still is that Scientists may have lost their scientific objectivity by tilting their report one way or the other. That, is what is wrong with the entire picture. The debate should be between scientists, particularly between Climatologists. Let both side be heard and both sides should issue their reports.

Debate on any issue is healthy, particularly on one such as the alleged catastrophic Global Warming.

I am not a scientist and have no expertise in climatology, but I like to stay informed as much as possible and attempt to think for myself. As an individual, I formulate opinions, I try however to see as many facets of a problem as I can before I do so. Just because it is being advanced, by "Most" Politicians and medial outlets, that Global Warming is Man Made doesn't necessarily make it a fact. If there's another side to this story, I'd like to have the same access to it as what is being made public willingly. We should have to have someone "digging" for the other side of the story. Both sides should be equally available to anyone who wishes to be informed.
posted by: A.J.H. Viirlaid 19-Jul-08 23:05:18
Tom Harris and John McLean conclude their article with words that I agree with:

"That the IPCC have let this deception continue for so long is a disgrace. Secretary General Ban Kai-Moon must instruct the UN climate body to either completely revise their operating procedures, welcoming dissenting input from scientist reviewers and indicating if reviewers have vested interests, or close the agency down completely.

"Until then, their conclusions, and any reached at the Bali conference based on IPCC conclusions, should be ignored entirely as politically skewed and dishonest."

In no other field of science is there a 'body' sanctioned by the UN that so corrodes the process of doing good science. It will eventually also corrode the public’s broader trust of science.

Even when multitudes of scientists speak out against the so-called ‘consensus’, the status quo does not change. The media have their marching orders. The politicians — who very recently have so imbecilely created the tragedy of biofuels — also cannot get off the bandwagon without completely losing face. What to do?

Christian-Adam Ribeiraud is correct. The whole field is now so politicized that there seems to be little hope of quick improvement.

For example, even if Al Gore, James Hansen, David Suzuki, and Shintaro Ishihara (the three-term governor of Tokyo) were to all suddenly realize and acknowledge (to themselves) that the certainty with which they had accepted the premises of Anthropogenic Global Warming was unraveling, how could they ever present such bafflement to the public without risking looking like complete idiots. Not easily. Only a scientist of great moral fibre could admit personal mistakes of such gravity.

What is harder to explain is why any of these intelligent people felt compelled to put themselves in such a foolhardy intellectual position in the first place. The science was never, ever, all THAT certain —— other than to a few revisionists, perhaps, at the ‘editorial’ desks of the IPCC.

But we hardly have to worry about any of them quickly changing their current public stance. There has been too much committed at great personal cost to those positions. Climbing off such a high horse is virtually impossible for any human given the high cost to be incurred as measured in psychological terms.

Perhaps they should not feel so isolated and abandoned. Once the time does come to revisit their beliefs, they should feel somewhat assured that the rest of us (who were never as sure as they were) would very likely forgive them —— after all, their motivations were for the GOOD as far as Earth’s health was concerned —— weren’t they?
posted by: Damir Ibrisimovic 20-Jul-08 02:19:25
Dear A.J.H. Viirlaid,

Everybody is entitled to his own opinion. And every fact can have more than one interpretation. This is the reason why scientists often disagree. And this is the reason behind what we call scientific method.

Peer review will always produce disaccording comments that will not appear in the final document. This is especially evident when we have two and a half thousands reviewers involved. It is really hard to achieve full agreement of two and a half thousands voices.

However hard it was, they did put their names on the final document, even though many of their comments were not included. This is called consensus. And they did so twice and will again. This is another dimension in the scientific method - the test of time.

By attacking what appears to be quite normal scientific process, you and authors only demonstrated total ignorance about it and receptiveness to US driven attempts to export debates. And we all know who funds them.

Personally, I prefer science and scientific method. Voting about issues is domain of politicians. In this context, however, ideologies clashed and the science is pushed into background. This is sad!

I would like to see science here. Ideological wars should be waged elsewhere. And they should not be disguised as science.

Kind regards,
posted by: Michael Smith 21-Jul-08 14:04:14
I invite any of you interested in the scientific credibility of the IPCC to read Ross McKitrick's article detailing his experience as an IPCC reviewer. You may read it here:

http://ross.mckitrick.googlepages.com/McKitrick.final.pdf

Read that, then explain to me why the IPCC has any credibility at all.
posted by: Francois Ouellette 21-Jul-08 22:11:53
Dear Damir,

If you think that the redaction of the IPCC report is "the scientific method", think again. The IPCC does not do any science. The report is really a (very) long review article about the status of climate science. The science itself comes from peer reviewed papers that are cited (or not...) by the report. Each chapter is written by a rather small number of authors (about 20) who each contribute a section or a paragraph on their own sub-field, and in fact, it appears that an even smaller number is responsible for the final text.

What I have found by reading some chapters, as well as the reviewers comments, and comparing with my own review of the literature, is that many researchers who had published a lot in a given field were neither authors, nor reviewers of the chapter covering their area of expertise. The reviewers often were... the authors themselves! So many experts have never been asked if they agreed or not with the relevant chapters, in fact a much larger number than were asked to comment.

Another thing to remember is that the IPCC reports cover a lot of ground that has little or no relevance to the central question of how much temperature increase we can expect from green house gases increase. Such logorrhea hides the fact that that central question has no easy answer, if any. And in the end, only a handful of climate researchers are really involved in solving that precise question. Most of the others are experts in areas that have nothing to do with it. They may agree that the IPCC report accurately reflects the status of their own field, and have little or no opinion on the central question.

In (Latourian) sociological terms, the IPCC report is an attempt at "blackboxing" the facts surrounding climate change. The proponents of a scientific theory use all sorts of rhetorical devices to ensure that the facts that they claim to support their theory are not questioned any more, ie. they become a "black box". A lot of energy is spent preventing the opening of the black box, by creating netorks of converging interests. This process has nothing to do with the "scientific method", but much to do with the way scientists "really" do science. Read Bruno Latour's "Science in Action" if you want to know more.
posted by: A.J.H. Viirlaid 23-Jul-08 00:38:18
Hi again Damir,

I am not against the Scientific Method.

But what you describe as “difficulty” in reaching FULL agreement over 2,500 voices is a little bit disingenuous. Again if you read the article carefully you can see that the agreement or so-called “consensus” was far less than that which you suggest.

And “putting their names on the final document” is also a bit of a stretch. Some have tried to REMOVE their names and have not succeeded.

If that is what you accept as “consensus” then no effort by the authors above to explain the situation to you will make a difference to the opinion you seem to hold.

As to comments like “we all know who funds them” I can only say that disparaging other contributors does not raise the quality of the debate nor does it help to move the debate forward.

“Voting about issues is the domain of politicians.”

Is that not the point of the article? It is the IPCC which touts the phantom “consensus” by implying that 2,500 leading climate scientists have voted and they have voted overwhelmingly in favour of AGW. Are you then also against the IPCC’s own “vote”?

This is what the authors are criticizing. So you agree with the authors?

I would also dispute your point about “ideological wars”. This is not a war over ideologies. It is a disagreement about representation — the authors maintain that the IPCC has misrepresented the science. That hardly constitutes an “ideological war” IMHO.

Nor does the authors’ position in any way contradict or diminish The Scientific Method — on the contrary IMHO their contribution ties in well as a valid part of the search for Scientific Truth.

If you have time and would like to see how difficult it can be for scientists to REMOVE their names from the IPCC report please go to

http://www.garagetv.be/video-galerij/blancostemrecht/The_Great_Global_Warming_Swindle_Documentary_Film.aspx

or to

http://www.garagetv.be/video-galerij/blancostemrecht/CBC_Global_Warming_Doomsday_Called_Off_mp4.aspx
Write comment
Name:

3.26 Copyright (C) 2008 Compojoom.com / Copyright (C) 2007 Alain Georgette / Copyright (C) 2006 Frantisek Hliva. All rights reserved."

 
Email this
Related Stories ____________________________________________