What Counts as Credible Evidence in Applied Research and Evaluation Practice? by Stewart I. Donaldson
My rating: 5 of 5 stars

The evaluation field continues to engage in paradigm wars that involve heated debates over which approaches and methodologies produce the most reliable results to support evidence-based policy-making. Somewhat regretfully, the commendable goal of enhanced rigour in evaluation research has been hijacked by a focus on a narrow set of experimental methods—randomized controlled trials or RCTs—which have been proclaimed as the ‘gold standard’ by their proponents. This trend has been boosted by calls for unambiguous measurements of results and impacts, and cost-efficiency, by policy-makers and bureaucrats struggling with making policy choices and undertaking programs under increasing resource constraints. On the other side, the reaction from the proponents of more qualitative methodologies and participatory approaches to evaluation has been strong, even emotional at times. As a professional evaluator, I’ve witnessed these brawls first hand.

This book makes an excellent contribution to the debate through a balanced presentation of the issues and by letting the different sides to make their respective cases. The authors in the book include a number of leading scholars and practitioners in the field. The perspective is North American (all authors work in the US or Canada) and draws heavily on experiences from education and social services. Although my own work pertains to evaluating international development programs, I found the discussion in the book on what constitutes credible evidence very valuable.

In the two introductory chapters the editors frame the debate in the context of a search for evidence-based society and how this has played out in the use of experimental and non-experimental designs for collecting evidence. Quite didactically, they place the debate within the broader scientific paradigms of social inquiry, including logical positivism, post-positivism, constructivism and related thinking, and pragmatism. They also tentatively place the chapter authors along these paradigmatic axes. The following eight chapters are divided into two sections arguing, respectively, for experimental and non-experimental routes to credible evidence. The trajectory of the chapters moves from the most hard-core case for experimental designs to an argument for the credibility of image-based research in evaluation. The chapters in between tend to take a conciliatory approach to the extent that the last of the chapters in the experimental section could have been moved to the non-experimental section.

Part II entitled ‘Experimental Approaches as a Route to Credible Evidence’ contains four chapters. In the first, Gary Henry argues for high-quality policy and program impact evaluations as a necessity for providing solid evidence for policy choices, linking the matter to democratic theory and the need to detect and debunk bad policies. His view assumes that there actually are ways to objectively define what produces desirable outcomes—and what such outcomes are. He acknowledges types of bias in evaluation research, but sees them in technical, rather than political terms. In the chapter that follows, Leonard Bickman and Stephanie Reich assess the credibility, reliability and validity of RCTs, concluding that while there are threats to the validity (especially external validity) of RCTs, they still can be seen to be amongst the most credible designs available to evaluators. Despite this overall conclusion, Bickman and Reich acknowledge that there are other, non-experimental approaches to establish causality (many natural science disciplines—geology, astronomy, engineering, and subfields of medicine—base their research on non-experimental designs). In social sciences, they particular highlight the program theory, theory-driven or pattern-matching method, recognizing that such other approaches are needed to supplement RCTs that can only answer a very limited number of questions.

The last chapter in this part of the book, by George Julnes and Debra Rog, introduces the concept of actionable evidence. The authors assert that for evidence to be useful, it should not only be credible but also actionable, defined as adequate and appropriate for guiding actions in targeted real-world contexts. The lengthy chapter takes as its starting point the question of relating the choice of methods to the questions that stakeholders want addressed. They proceed to outline a multitude of evaluation tasks (borrowing from Carol      Weiss) and then consider the implications of the tasks for methodology. Another way of framing the evaluation questions relates to the level of conclusion and the different levels of causal questions in impact evaluation, including whether the evaluation seeks to provide an aggregate description, disaggregation for causal analysis, or an inferential analysis of the underlying constructs and causal mechanisms. They state that, “experimental methods are argued as appropriate for strengthening impact-evaluation conclusions, but the value of these methods is dependent on the level of conclusions being addressed” (p. 104). Summarizing the discussion on the relationships between questions and methods, Julnes and Rog express their view that, while particular questions call for quantitative designs, there is substantial territory open to other designs. This summary leads the authors to consider the contextual factors that affect the adequateness and appropriateness of alternative methods, including policy context and the nature of the phenomena studied. They then discuss how to judge the adequacy of methods for providing the evidence that is needed to address the stakeholder questions identified, and when is it appropriate to use particular methods for causal analysis, taking into account constraints posed by factors internal to the program, evaluation capacity and political constraints, as well as ethical considerations. The discussion is nuanced and fair. Julnes and Rog conclude by affirming the primacy of the evaluation stakeholder questions in influencing the types of evidence needed. They caution against “simple frameworks that drive method choice in a somewhat automatic fashion” and instead wish to support “more informed judgments on method choice in political public policy environments” (p. 128). To me, this is one of the strongest, most thoughtful and balanced chapters in the book. Therefore, it also deserves its place in the middle, bridging the quantitative and qualitative parts.

Another chapter in this section of the book, preceding the chapter discussed above, by Russell Gersten and John Hitchcock focuses on the role of the What Works Clearinghouse, established in 2002 by the U.S. Department of Education. The chapter is descriptive and possibly useful to education researchers and evaluators, but did not raise my own somewhat biased interest.

Part III on ‘Nonexperimental Approaches for Building Credible Evidence’ consists of another five chapters, starting with one of the grand old men of evaluation, Michael Scriven. His chapter, ‘Demythologizing Causation and Evidence,’ is written with flair in lively language. Like Julnes and Rog before him, Scriven enlists other sciences—from mathematical physics and geology to anthropology, ethnography and epidemiology—to demonstrate how experimental methods are but one of the many approaches to analyse causation. He writes, “much of the world of science, suffused with causal claims, runs along very well with the usual high standards of evidence, but without RCTs” (p. 136). Breezing through the origins of causal concepts, the cognitive process of causal inference vs. observation, and the level of evidential certainty required for scientific, legal and practical purposes, he then addresses the alleged supremacy of RCTs as well as “other contenders.”  His myth-busting position is that “(i) the attempted takeover of the terms evidence and cause is partly inspired by the false dichotomy between experiment and quasi-experiment, and (ii) the whole effort is closely analogous to the attempted annexation of the concept of significance by statistically significant” (p. 151).

The following chapter by Jennifer Greene discusses evidence as ‘proof’ vs. evidence as ‘inkling.’ Her premise is that evaluation is both influenced by the political, organizational and sociocultural contexts, as well as it serves to shape that context. Consequently, “evaluation is not a bystander or neutral player in the debates that often surround it, but rather an active contributor to those debates and to the institutions that house them” (p. 153). Her chapter attempts to demonstrate how the present discourse assumes that ‘evidence’ can make social systems ‘efficient and effective’ and how these assumptions convey a particular view of human phenomena and responsibilities of government in democratic societies. The argument is a useful antidote to the positivistic view presented by Henry earlier in the book. Her vision of evidence is not providing the truth, or neat and tidy small answers to small questions. Rather, in Greene’s view evidence must provide a “window into the messy complexity of human experience; evidence that accounts for history, culture, and context; evidence that respects difference in perspective and values; evidence about experiences in addition to consequences; evidence about the responsibilities of government, not just the responsibilities of its citizens; evidence with the potential for democratic inclusion and legitimization of multiple voices—evidence not as proof but as inkling” (p. 166).

Sharon Rallis starts her chapter by telling the story of how she first encountered evaluation when she was teaching a federally funded summer program that was subject to an evaluation. The evaluators insisted on holding on to their plan to assess the program against a single outcome, with no regard to the important associated benefits that the program had bolstering the self-esteem of the participating students. Furthermore, the evaluation based on a quasi-experimental design deprived half of the students from participating in an important part of the program, which Rallis and other program colleagues felt was unfair. While the evaluators claimed that their work was scientific and rigorous, Rallis pondered about the missing piece and came to the conclusion that it was ‘probity’—goodness and moral soundness. Consequently, she began to study evaluation with a commitment to make evaluations useful for the program personnel and participants. This chapter elaborates on her vision of evaluation with probity and moral reasoning, grounded in nonconsequentialist theories. She explains: “The evidence we collect looks quite different from that of our colleagues who measure outcomes. Our aim is not to cast judgment … but to discover what happened and what the experience meant to the program participants. We hope that our discoveries can lead to improving the program and thus the well-being of the participants” (pp. 174-175). Rather than RCTs, evaluation done with these principles borrows tools from fields such as ethnography, phenomenology and sociolinguistics/semiotics. She presents a case from an evaluation and needs assessment of an HIV/AIDS education and prevention program that provides some unexpected insights into the participants’ experiences. She asserts that this work is rigorous because “it is grounded in theory and previous research and in moral principles of justice and caring” (p. 178).

Sandra Mathison in her chapter ‘Seeing Is Believing’ explores the credibility of image-based research and evaluation, as one form of evidence to establish and represent truth and value. Like the part III authors before her, she emphasizes how the credibility of evidence and the knowledge thus created is contingent on experiences, perception and social conventions. Image-based research uses images in three ways: (i) as data or evidence; (ii) as an elicitation device to collect other data, and (iii) as a representation of knowledge (p. 184). Mathison posits four considerations for establishing the credibility of image-based research: (1) quality of the research design, (2) attention to context, (3) adequacy of the image from multiple perspectives, and (4) the contribution images make to new knowledge (p. 188).

The last chapter in part III, by Thomas Schwandt, is entitled ‘Toward a Practical Theory of Evidence for Evaluation’ and it functions as a kind of recap of what has come before; as such, it could have equally well been placed in part IV on conclusions. This is another rich chapter that goes to the heart of the debate of what we mean by evidence: “…information helpful in forming a conclusion or judgment. Framed in a more rigorous epistemological perspective, evidence means information bearing on whether a belief or proposition is true or false, valid or invalid, warranted or unsupported. At present, we face some difficulty and confusion with understanding the term evidence in evaluation because it is often taken to be synonymous with the term evidence-based” (p. 199). He then proceeds to problematize the term evidence-based, as being narrowly interpreted to mean only a specific kind of finding regarding causal efficacy. Secondly, Schwandt argues why evidence cannot serve as a secure and infallible base or foundation for action. Furthermore, he emphasizes that, as an aspect of policy making, evaluation must consider ethics. Schwandt concludes that “deciding the question of what constitutes credible evidence is not the same as deciding the question of what constitutes credible evaluation … However necessary, developing credible evidence in evaluation is not sufficient for establishing the credibility of an evaluation” (p. 209). He further asserts that method choice alone does not determine what is credible and convincing evidence. He calls for framing evidence in a practical-theoretical way that that is concerned with the character and ethics of evidence and the contexts in which evidence is used.

In the final part of the book, Melvin Mark summarizes the different perspectives of the book with an aim of changing the terms of the debate. He concludes: “Extensive and continued discussion of the relative merits and credibility of RCTs versus other methods would have limited capacity to move forward our understanding and our practice. … by changing the terms of the debate, we may be able to improve understandings of deeply entrenched disagreements; move toward a common ground where such can be found; better understand the disagreements that remain; allow, at least in select places, credible evidence as part of the conversation; and enhance the capacity of stakeholders to make sensible decisions rather than be bewildered by our disagreement or draw allegiances based on superficial considerations” (pp. 237-8). Certainly a deserving goal.  The book ends with an epilogue by Stewart Donaldson that attempts to provide a practitioners guide for gathering credible evidence in the evidence-based global society.

I thoroughly enjoyed reading this book and although much of the debate around epistemology, approaches and methods is familiar to someone educated and working in evaluation and applied social science research, the way it is framed in this book is truly enlightening. For a thoughtful reader, it becomes evident that the truth—as almost always in such debates—is somewhere in the middle. All of the approaches and methodologies have merit when used appropriately and in appropriate contexts. Both experimental and non-experimental methods can be rigorous, but both can also have serious flaws with regard to internal and external validity, relevance and appropriateness. The old saw about everything looking like a nail when you have only a hammer in your tool box is true here as well. The take-home lesson is that, instead of allowing methods to dictate one’s evaluation questions and designs, one should choose one’s methods according to the questions one wants answered.


View all my reviews

Shooting America

On Friday, 14th of December 2012, a young gunman walked into Sandy Hook elementary school in Newtown, Connecticut, and proceeded to shoot and kill 26 people, including 20 children in the ages of 6 and 7 years. This horrific incident was one of the worst mass murders even in the violent history of America. Unfortunately, however, it wasn’t entirely isolated. In fact, this was the third incident of a similar kind to take place in the United States just in 2012. These recent cases include the movie theatre shooting in Aurora, Colorado, on the 20th of July 2012, in which twelve people were killed and 58 injured; and the shooting at a Sikh Temple in Oak Creek, Wisconsin, on August 5, in which a white supremacist killed six people, possibly mistaking the Sikhs for Muslims. Six of the worst mass shootings in America have taken place since 2007.

Could this finally be a turning point—the straw that broke the camel’s back, in the words of Sen. Dianne Feinstein of California—in the American attitude towards gun violence? There are signs of outrage that seem unprecedented; after all, the horror of the slaughter of these little children is just too painful, too hard even to imagine. But don’t hold your breath.

There is much focus on the mental health of the shooter and on providing increased security in schools. This is understandable. However, I do not see this primarily as a mental health issue. This is not meant to belittle the importance of psychological factors or to deny the importance of mental illness as an explanatory factor. America’s mental health care system is clearly broken and there seem to be extraordinarily many sick people who turn to violence. However, there are crazy people everywhere, but in most other places they can be stopped before they are able to commit mass murder. Just recently, a Chinese nutcase attacked a school in his own country. Armed only with a knife, he was able to injure a number of people but not to kill anyone before he was apprehended.

In this latest case in Connecticut, the assailant was in the possession of three advanced pieces of weaponry: Glock and Sig Sauer handguns and an AR-15 Bushmaster semi-automatic rifle. He used this firepower to enter the school and then to kill the kids and their teachers. It is worth noting that apparently he had acquired access to these guns from his mother (who was the first victim of his killing spree), a gun enthusiast.

What surprises me is that so relatively few Americans have arrived at the inevitable conclusion that access to high-powered firearms itself is a threat. While a few people like Feinstein and Dan Gross of the anti-gun violence Brady Campaign have systematically brought the issue of stronger gun control up, the debate still seems to be up in the air. Although most pro-gun politicians have had the sense of laying low since Friday’s tragedy, a number of gun activists, sensing a threat to their God-given right to carry any weapon, have again decided that attack is the best defense. People like John Lott, author of More Guns, Less Crime, has been seen on a number of TV talk shows peddling his claim that everywhere where stricter gun controls have been effected, murder rates have gone up (would someone please look at the statistics behind this implausible claim). Citing the Aurora example, Lott asserts that the shooter actually chose that particular movie theatre because it didn’t allow guns. There were other theatres closer to the murderer’s home but, Lott implies, there might have been armed people there who would have returned the fire, so the shooter was afraid of attacking them. Just imagine a gunfight in a crowded and dark movie theatre.

Another creep, Philip Van Cleave, president of the sinister sounding Virginia Citizens Defense League, actually had the temerity to tell Washington Post on Sunday after the Newtown massacre that guns are fun. Defending the people’s wish to own semi-automatic weapons like the AR-15 (implicated in the three latest massacres mentioned above), he was quoted by the newspaper as saying: “I could ask you why should anyone want a Ferrari? [Bushmasters] are absolutely a blast to shoot with. They’re fast. They’re accurate. … Guns are fun, and some of them are much more cool than others.” Apart from the stunning insensitivity, Van Cleave’s views may not be that rare amongst Americans.

Who exactly Lott, Van Cleave and their ilk envision could have been better armed to fight back in the Sandy Hook elementary school in Newtown is not clear to me. The young teachers who died with their students? Or perhaps the children themselves? Employing armed guards and arming teachers or movie goers or citizens in general so that they can return fire when a deranged person starts shooting at them is such a dystopian vision that few of us I imagine would cherish. And would all of us really want to be trained in handling guns?

Maybe I’m wrong. Maybe many Americans do see this as a desirable way of protecting oneself and one’s liberties. After all, this is a country where large groups of people arm themselves in preparation against a takeover by the socialists in the Federal Government (or even—gasp!—the United Nations) . It would seem inevitable that an even larger number of people walking and driving around with concealed weapons would result in those guns being used when things heat up in, say, a traffic jam or a supermarket line. And the risk of innocent bystanders getting hurt in these altercations seems high.

This happened on Friday, August 24, 2012, when a man shot his former co-worker near Empire State Building in Manhattan. The police killed the assailant immediately following the incident, in the process injuring eight innocent bystanders with ricocheting bullets—and remember, these were highly trained law enforcement officers who are experts in handling firearms.

“Guns don’t kill people; people kill people,” has long been the rallying call of the supporters of the National Rifle Association (NRA), a powerful pro-gun lobby. Regretfully, that’s just not true. There will always be nuts who want to kill people. However, their ability to do so is significantly increased by the availability of guns. Later the same evening, the brother of the Empire State Building victim was interviewed by CNN. His opinion: Don’t turn this into a referendum on firearms; if the killer hadn’t had a gun, he could have used a “baseball bat or whatever.” Perhaps so. People who are inclined to commit premeditated murder do find a way to do so. A baseball bat would do the trick, but it just might be more difficult to carry it concealed to the spot, then un-shield it rapidly when the intended victim is in sight, and to wield it to his head—all on a crowded city street. The intended victim might have a higher chance of escape, too, when he sees the batter approaching. In this particular case, the victim was also physically larger than the assailant, which might have made a difference in a fight without guns.

A more important point is that premeditated murder is, by definition, usually targeted towards a specific individual against whom the would-be murderer bears a grudge. Such murders occur in all countries.

There are two very obvious cases where the availability of guns does create a much larger hazard. One, as we have seen, is indiscriminate mass murder by a lunatic. An individual’s ability to massacre a large number of people is directly correlated with the availability of guns, especially powerful assault weapons. In this year’s cases, the madmen’s ability to kill was multiplied by the availability of such automatic weapons, with clips holding more than 100 rounds of ammunition reducing the need to reload. Such weapons and clips have no legitimate use in private hands, as they are by no stretch of imagination needed for hunting or target practice. Their only purpose is to enable the killing of as many people as possible in close combat.

The other case, which so obviously speaks against having guns around is that the majority of killings in the US happen between family members and people who know each other. Only a small fraction of these are premeditated murders. Most are either accidents (every year many people shoot themselves or their dear ones accidentally when fondling their beloved guns) or happen when arguments—between spouses, friends or colleagues—heat up and a loaded gun happens to be handy. Guns kill people, even when people don’t intend to do so.

In the December 2012 issue of The Atlantic, that appeared on newsstands just before the Connecticut massacre, Jeffrey Goldberg argues that it is too late to install any further gun controls in America. There are already some 280-300 million guns owned by private citizens in America and each year this number is increased by more than 4 million. These are of course stupendous figures, given that the total population of the USA is just around 311 million. I have recently heard that slightly less than half of American adults own a gun. Simple arithmetic thus implies that these people have multiple guns at home. Goldberg draws the conclusions that it would be impossible anymore to regulate the situation through democratic means and, therefore, it would be better to give more guns to law-abiding citizens so that they can defend themselves. This is a saddening view, although it does have a certain logic. Yet, by the same logic it would be futile to attempt to address any similar issue that involves an advanced situation, including nuclear disarmament. His solution would also bring back the Wild West in which disputes were settled with six-shooters.

Except that in the Wild West, guns were quite strictly controlled in towns where the sheriff made sure that gunslingers would check their weapons at the gate. Joe Klein in Time magazine (August 6, 2012) outlined how this free-for-all guns-galore is not an American tradition or what the Founding Fathers expected. Rather it’s a result of a concerted advocacy effort by all kinds of right-wing groups since the 1970s to overturn gun control legislation. In 1993, during Bill Clinton’s presidency, legislation was passed to ban assault weapons, but that too was let expire a decade later.

Of all industrialized countries, the United States has by far the largest amount of guns per capita: 88.8 firearms per 100 people. This is far more than the 54.8 in the second most gun-heavy country in the world, Yemen. America has some 5% of the world’s population but, depending on the estimate, up to half of the world’s firearms in the hands of private citizens. Topping the list with Yemen, which many consider en route to becoming a failed state and which now is the principal host of Al-Qaeda on the Arabian Peninsula, should not be an accolade most Americans would want. Still a large number of Americans seem to be perfectly content with it.

Unfortunately, my own country of origin, Finland, is number 4 on the list (the third place goes to Switzerland, where most men who have served in the army have a rifle in their closet). Why Finland, the seemingly tranquil Nordic country known for its peace-making efforts on the world scene? I suppose the reasons are something similar to those that would be applicable to America, too: a macho culture of rugged individualists. There, too, men go on rampage shooting people.

Another factor that militates against gun control in America is (you guessed it) money. There is a lot of money involved in gun sales and they are not limited to domestic sales, as if the 4 million guns sold in the US annually wouldn’t be enough. Mexico’s drug war is largely fought with American guns: it is estimated that 80% of the guns confiscated from Mexican gangs have been bought legally in the US.

In the American political system, lobbyists for special interest groups play a central role. Politicians find it hard to go against the lobbyist if they want to stay in power. According to the Time article by Joe Klein, NRA has funded a total of US$18.9 million to political parties and candidates running for federal office since 1990. Of this amount, 82% has gone to the Republicans. The New York Times columnist Charles Blow has calculated that the NRA’s financial contributions to politicians in Washington are 4,100 times larger than those by the largest anti-gun organization, the Brady Campaign.

When culture, tradition, corporate interests and money come together, it will be a tough job to go against them and change things when it comes to the prevalence of guns and the ensuing gun violence. This is the reason for my pessimism, but I do hope that I am proven wrong. Perhaps, in the unspeakable tragedy of the Sandy Hook elementary school, there lies a seed of hope for some modest reform. If nothing more, it would seem reasonable to start by banning semi-automatic assault weapons and clips containing tens or hundreds of rounds of ammunition.

Sandy farewell

Monday, 29 October 2012

On Monday morning New York City is closed down. I’m staying at home as my office, like most others, has been forced shut. Without transportation it would anyway be impossible to get to Manhattan. It doesn’t look too bad outside, though. It’s grey and the rain is falling, but it all looks rather calm. The wind comes in gusts that violently shake the trees outside. Some leaves have already turned yellow and are flying off like wet rags.

By noon the situation is starting to look more serious. According to the reports, the storm has been moving faster than anticipated and therefore has arrived earlier than expected. Its power has intensified. There’s by now no doubt this’ll be the worst storm to hit New York since the 1938 hurricane. The TV shows images from Atlantic City, NJ. The famous boardwalk and the casinos are being pounded by heavy winds and the waves from the open ocean are splashing forcefully onto the shore. I remember my brother has a vacation property on the Brigantine Island not far from Atlantic City. I also remember it faces the ocean. There’s only the sandy beach and a narrow street between the building and the Atlantic. In good weather, the location is lovely.

I correspond with my colleague Chona who lives in New Jersey. She is lamenting the pictures of her beloved Jersey Shore being eaten up by the waves. The TV meteorologist explains how New York City is squeezed in between New Jersey and Long Island, which means that in an Atlantic storm situation like today, the water has only one way to go: inland towards the city via the inlets. Therefore, the storm surge forecast for New York harbour is grim.

The most threatening situation starts unfolding in mid-afternoon on the west side of Manhattan. A crane on a high-rise construction site on the 7^th Avenue at 57^th Street has collapsed and is hanging upside-down at the height of the 90^th floor above the city. There is no way to stabilize it, so it’ll be pure luck if it stays up and doesn’t fly smashing into neighbouring buildings and onto the street.

Around 4 pm Governor Andrew Cuomo holds another press conference flanked by NYFD and other emergency personnel. A troop of National Guardsmen dressed in camouflage uniforms stands guard behind them. There is a life-threatening situation on Fire Island, a thin barrier island off Long Island. Fourteen people who refused to obey the mandatory evacuation order last night had to be rescued today. Having spent some good summer vacation time on the island, I can’t even imagine anyone wanting to face a hurricane on that thin sliver of sand in the Atlantic. In the process a rescue vehicle has been lost. Luckily there were no personnel losses. Cuomo quotes Mayor Michael Bloomberg, who accused people who refused to leave of being selfish, putting others at peril. The emergency chief tells in no uncertain terms that the window to evacuate is rapidly closing. Sandy is now expected to make landfall around 18:00, which will coincide with the peak of the tide coming in. When that happens, it won’t be possible to get out of the islands that surround New York City.

I also correspond with my other colleague Indran who lives high up in one of the high-rises on the East River waterfront in Manhattan. It is Zone A, but the building complex is very solid and the water would anyway never reach that high up, so he had chosen not to evacuate. He and his family moved here from South Africa only earlier this year. They are awed by the storm which they can observe through rattling windows from a vantage point tens of stories above sea level.

Our building is faring well, too. We stay in our warm apartment and enjoy the food we stocked up on before the storm: steaks and asparagus for lunch, followed by coffee ice cream; grilled chicken and salad for dinner. Do we normally eat this well? Nowa sleeps through much of her first hurricane. I go down to the basement, which looks dry—so far. 

Around the time of the landfall, I venture out briefly to snap these photographs. From the balcony the southwestern sky looks menacing. On the street side, the large trees are bending with the gale force winds. Luckily, the rain remains surprisingly moderate.

In early evening, the communications start to falter. The cable network on which our building depends on for the Internet, TV and telephone landline goes dark. The elevator also becomes unsafe to use. We’re cut off from information and communications. Well almost, as Yoko’s iPhone can still send and receive messages (my older model went blank). Some neighbours in the building report water leaking from their a/c vents. Apparently, water is also starting to gather in the basement.

Around 21:30, Yoko reads on the iPhone that Sandy is no longer a hurricane. The National Hurricane Centre has reclassified it because it “has continued to lose tropical characteristics”—no wonder at these latitudes. It doesn’t mean that its power is waning. Sustained winds of more than 120 km per hour remain. The wind and rain continue late into the night.

Tuesday, 30 October

We survived the storm with minor personal inconvenience. In the morning the winds are still high and there are heavy showers. At the JFK airport, top wind speeds recorded were 127 kph. Our cable service is restored and we never experienced a power outage. Not everyone was equally lucky. The storm left some 7 million people in 11 states and the District of Columbia without power. In New York, power outages are widespread and currently 1.8 million people are without power. In the New York University Langone Medical Centre even the back-up generator system failed. Some 260 patients, including four newborn babies, had to be evacuated.

ConEdison, the power utility, made a statement that this is the biggest storm-related problem in the company’s history. A representative couldn’t give a timetable for fixing the problems but suggested it may take a week to fully restore the service. It's going to be a cold and dark week for those affected. 

The initial reports by the police talk about seven Sandy-related deaths in the city, but there is no information about how these happened. The national death toll from Sandy is currently put at 16. According to news reports, more than 80 homes have burned down to the ground in a fire in Breezy Point, Queens, due to electric fires. One can imagine insurance companies studying the hurricane causes in the policies for loopholes to avoid payment to the home owners. A building in Chelsea collapsed partially because of the wind. The crane in Midtown West is still hanging there, but the situation remains dangerous and the police have evacuated buildings in the neighbourhood.

There is massive flooding around the city. The National Hurricane Centre recorded storm surges of up to 3.8 metres in Kings Point. The storm surge in southern Manhattan’s Battery at 4.3 metres, was the highest ever on record, beating that caused by Hurricane Dana in 1960. In the South Street Seaport waves with a height of 9 metres were measured. Residents on Staten Island report that they have never seen anything like this. Coney Island waterfront is still inaccessible even to eager reporters. Streets look like rivers with cars floating on them. Cars have been crushed under felled trees. One car spontaneously combusted in a fireball, possibly caused by salt water getting into its battery. A huge tanker has washed ashore on Staten Island.

Reports are coming in and are being updated as more information becomes available. The economic impact has not yet been assessed.

The system-wide shutdown of mass transit—both local and long distance trains, subways, buses, ferries—continues. Seven subway tunnels are severely flooded. One can only imagine the hordes of rats sprinting across the debris in the deluge. Apparently MTA had managed to get all subway cars on higher ground in anticipation of the storm, so the trains have been spared damage. MTA calculates it’ll take four days to pump out the water from the tunnels. The rain continues to fall.

It seems that we’ll spend some more time indoors.

Waiting for Sandy

Sunday evening, October 28^th

Sandy is again a hurricane. Having already once been downgraded into a tropical storm, Sandy is back as Category 1 hurricane—and it’s heading north along the Atlantic coast. The storm system is slow-moving and massive, ranging some 1,200 km across. The eye is still far out on the Atlantic off the Carolina coast some 800 km from New York, but despite the distance, the winds are picking up even here in Brooklyn. The rain is starting to fall and the Rockaway shore is already getting soaked. The hurricane is calculated to make landfall well south of New York tomorrow night and is expected to pass the metropolitan area south-southwest from here across the garden state of New Jersey.

Although New York will likely not be hit directly, the expectation is that the city will receive its share of rain and wind. In fact, the biggest threats would appear to stem from wind and the associated storm surge. The rainfall on Monday-Tuesday is expected to be just 50-120 mm—enough to give us a good washing, but not huge in historical terms. However, by noon tomorrow, the winds are expected to blow at 80 km per hour, with gusts going up to 112 km per hour. That’s strong enough to fell trees and power lines and to throw leisure boats off the East River on the banks.

This afternoon we walked down from our house to Bedford Avenue and the main shopping area of Williamsburg to get supplies so that our daughter Nowa would be able to ride out her first hurricane in comfort. It should have been no surprise, but we were still taken aback at seeing how many others had had the same idea. There were crowds of people in all shops and at least three dozen people were queuing on the pavement outside our favourite supermarket. Two bouncers were admitting people in an orderly manner, so that inside the store things didn’t get too chaotic. After a brief wait we were able to stock up with enough of bottled water and cooking ingredients should we be unable to shop for a few days.  It is interesting to note the types of items that people buy in these kinds of situations. Apart from bottled water, the first things to go seem to include canned tuna. This I noticed 14 months ago when we were bracing for Hurricane Irene, and could reconfirm today. As we headed back home, we could feel the humidity condensing in the cool wind.

New York Governor Andrew Cuomo has been visible in the media today assuring people of the state of preparedness. All public transportation—subway, local trains, buses, ferries—will be shutting down tonight. The area airports—JFK, La Guardia and Newark—have also instructed flights to be directed elsewhere and  Amtrak trains will be avoiding New York’s Penn Station. The bridges and tunnels connecting the five Boroughs may be closed up to avoid accidents caused by heavy winds or flooding. New York will be cut off from the world.

The decisive Mayor Michael Bloomberg ordered mandatory evacuation of all vulnerable low-lying areas on the coastline by 7 pm tonight. Zone A—which includes most of the shores of Manhattan, Brooklyn, Queens and Long Island—may be facing huge storm surges. The forecast at this time is mostly 1-2 m above normal—high in its own right—but some areas around East and Hudson Rivers—and especially Long Island Sound—may face a storm surge of up to 1.8-3.3 metres. It’s almost full moon, which worsens the effects as the tides are naturally high at this time.

While the city hurricane shelters are slowly filling up, many citizens are also planning on challenging the evacuation orders and riding out the storm. The local TV station NY1 sometime ago broadcast a report from the Rockaways where some of the 130,000 people living there were gathering for hurricane parties. A somewhat wobbly gentleman declared firmly through a nearly toothless grin that he would not leave his home of 35 years: “The captain must go down with his ship!” True to his style, Mayor Bloomberg justifies the mandatory evacuations, not because of his concern for the stubborn residents, but because their intransigence may eventually put rescue personnel at risk if they need to go out to salvage foolhardy partyers from storm hit areas. He also made a decision to shut down elevators and hot water in public housing—many tall high-rises—to prevent people from getting stuck in elevators and other mishaps if and when there are power failures.

This is not the first time New York City will experience a hurricane, although they certainly are not regular events. By definition, hurricanes are tropical storms, and New York is far from tropical, as anyone having spent a winter here would attest. However, just last year, in August 2011, the city was hit by another hurricane, Irene. It was the first since Hurricane Floyd in 1999. The one before that had been Agnes in 1972. Whether this repeat just a year later would be any indication of intensified storm activity linked with climate change is of course impossible to tell. Two events in a row don’t provide any statistically significant trend. The most destructive hurricane that New York has had to deal with in modern times took place in 1938 when the eye of a Category 3 storm passed straight through Long Island killing ten people. Damage from Irene last year stayed quite limited, although much of Lower Manhattan—the Financial District and the Battery—were severely flooded. Even then, the Far Rockaways took the brunt of the storm that damaged the piers and boardwalks there. Here in Williamsburg, the visible damage was limited to some flooded basements and a few felled trees (see the photos from the aftermath of Irene).

 

Sandy is different, though. It’s been termed ‘storm of a generation’ to reach this far up on the East Coast. Last week, it already killed at least 60 people and caused large-scale homelessness in the Caribbean. President Barack Obama has just signed an emergency declaration for New York State in anticipation of Sandy’s arrival.

For now, we are tucked in comfortably in our apartment in Williamsburg. We are close to East River, but just outside of Zone A by virtue of our building standing on a small knoll. It will not prevent the winds from rocking the windows here on the 4^th floor or preventing flooding in the basement storage areas. But all the plants have been moved inside from the balconies. We expect to stay safe and dry, although the thick clouds hide the full moon and the wind is increasingly throwing raindrops our way..

The Soul of the Rhino: A Nepali Adventure with Kings and Elephant Drivers, Billionaires and Bureaucrats, Shamans and Scientists, and the Indian Rhinoceros by Hemanta Mishra
My rating: 5 of 5 stars

This is a delightful and important book. Hemanta Mishra, the acclaimed conservationist who in 1973 established Nepal’s first national park, the Royal Chitwan National Park, tells the more than three decades long story of his—and his native country’s—efforts to protect the Indian rhinoceros. The rhino, a majestic and sacred animal in Nepal, was in the 1960s and 1970s facing extinction due to poaching and habitat destruction. As we know and as Mishra shows, conservation is only for a small part about biology and ecology. The success of conservation efforts is mostly determined by economic and political factors. At the heart of the threats to the rhino lie poverty and the growth of human population. Over the decades, Misha, a Western educated conservation biologist, became adept at navigating the rapidly shifting political landscape of Nepal, with its rampant corruption, and using the traditional culture to protect the rhino.

This is a very passionate book. Its value doesn’t rest in its literary aspects. Hemanta Mishra, with the assistance of his friend Jim Ottaway Jr, tells the story in a straightforward and largely chronological manner relying on illustrative anecdotes and retelling specific events that were significant. While the conversational and personal style is pleasant, the only gripe I have about this book is about some of the literary choices, as illustrated by the fact that a third of the 21 chapters start with a sentence describing the scene and the weather of the day or night in question (“It was a cool and typical Terai evening with a clear sky and a big bright December moon…” or “It was a sunny but pleasant morning…”). The value of the book is ample in many other respects. It includes valuable scientific and historical information about the rhino and its place in Nepal—however, this information is sprinkled throughout the book and in a couple of specific short chapters, so it doesn’t make the book heavy reading on the scientific front. It also provides a wealth of information about Nepali culture and society, which is essential for understanding the conservation trajectory. But most of all, it’s a highly personal account of Hemanta Mishra’s own journey from a well-off Kathmandu city boy to a passionate conservationist and a leading light in the national parks movement. I can attest to the genuineness of his feelings, as I had the pleasure and privilege of working together with and befriending Hemanta a decade ago when we both were employed by the Global Environment Facility (GEF) in Washington, DC. Hemanta is truly committed to the welfare of wildlife and has little patience with foolish bureaucracy, although he now understands what makes it tick.

There are a number of highly emotional episodes in the book. One such is when Mishra has been charged with capturing and delivering two rhinos to Forth Worth Zoo in Texas as a present from the King of Nepal. He describes his feelings of guilt kidnapping the baby rhinos from their mothers and how he becomes attached to them over the three months he and his crew must raise them prior to shipment to the zoo. When he finally has to see the rhinos off following a ceremony at Kathmandu airport—flying first to Germany on a Lufthansa flight, then on to Texas—a teary-eyed Hemanta Mishra reflects on the workings of fate: “Fate had forced me to snatch the baby rhinos from their mothers, only to nurture and love them before finally putting them on a German aircraft for a journey of no return, across two continents to America” (p. 135).

While zoos often get a bad rap, good zoos actually play an important role in species conservation through research and captive breeding programs. Hemanta Mishra frequently recognizes the support he and the conservation movement in Nepal received from America through both agencies like USAID and the Smithsonian Institution, as well as individuals like the Texas billionaire Edward B. Bass and Ramona Bass, the chairperson of the Fort Worth Zoological Society. Early on, Hemanta also sought inspiration and good practices from Yellowstone, the world’s oldest national park.

A key segment of the book pertains to the Tarpan or traditional rhino hunt ceremony by the King of Nepal that Mishra again has to arrange. He is deeply torn by his role in organizing the killing of one rhino. He carefully chooses an old male to be sacrificed for the purposes of the ritual. The young King Birendra, highly committed to nature conservation himself (as had been his father King Mahendra), had been postponing the ritual required from all Nepali kings, but had to finally cave in to the demands from the traditionalists in his government and country. The Tarpan presents a dramatic episode in the book with genuine tension, starting with the palace intrigue around the arrangements and culminating in the hunt and the following mystical religious ceremony. In the process Hemanta comes to understand the importance of tradition in conservation and that sacrificing one rhino to the king may be very valuable in maintaining the animal’s status as sacred in the Nepali culture. He often ponders in the book about his own mind has become divided between the traditional Nepalese culture and values and those adopted from the West where he was educated as a scientist. At the end of the Tarpan, he declares: “I had found my soul in the body of a rhino” (p. 185).

In general, Hemanta Mishra gives much credit to Kings Mahendra and Birendra for their commitment to environmental protection. The reverence towards the King and the royal family in Nepal has been extremely beneficial to conservation in the country. Similarly, what Mishra realized was that he had to win the local population support for managing the national park and protecting the rhinos if the project had any chance of succeeding.

There are also many interesting and outright funny occurrences described in the book. A particularly satisfying anecdote pertains to a corrupt local politician, with private interests in illegal logging, who tried to raise the local villagers against the Royal Chitwan National Park and organized an attack against the conservation staff and their camp. When Mishra and his staff finally caught up with the man after some serious vandalism and violence, they let him taste his own medicine by first leaving the politician tied up in the forest for three hours, then dunking his head covered with a jute bag repeatedly in Rapti River, thereafter transporting him to the other side of the river and letting the man walk back to the village with his hands still tied behind his back.

Throughout the book, Mishra talks warmly about his staff, including the elephant drivers, many of whom are uneducated tribesmen from the Terai or the southern plains. He acknowledges their superior knowledge of the forest and the animals. Their humanity comes through warmly in many segments, not least those describing evenings around the campfire.

Eventually, a crowning glory and major achievement of Hemanta Mishra was the transplantation of rhinos from the Chitwan National Park to the Bardia National Park to provide them a second home. The idea had been put into his head twenty years earlier by his first chief elephant driver, Tapsi, who had proposed it in order “not to put all eggs in the same basket.” If something were to happen to the rhinos in Chitwan, at least there would be another population in Bardia where the last rhino had been shot by a “coldhearted colonial officer of the British Empire” in 1878 (p. 203).

The efforts by Mishra and his colleagues and successors were largely successful. In 1968, a rhino census (Hemanta Mishra was already then part of it) counted 90-108 animals. At the peak, around 2000, the number of rhinos had risen to about 550. On June 1, 2001, the crazed Crown Prince Dipendra shot and killed his parents, including King Birendra, and other members of the royal family. This tragic event contributed to the growing political chaos in Nepal and, consequently, to renewed bad fortunes for the rhinos.

I can imagine many Americans (and others) chuckling at the irrelevance of the topic of the book. Conservation of the rhinoceros in Nepal, a country many people here wouldn’t even have heard of, could sound as esoteric as anything. Yet, the issues raised in the book—and the lessons learned in Nepal—are very relevant indeed to environmental management and the future of our world everywhere.

The epilogue, ‘Hope or Uncertainty on a Himalayan Scale,’ outlines the situation for Nepal’s rhinos in 2008 when the book went to print. Many of the advances of the past decades had been reversed and rhinos were again poached at alarming rates. Of the 38 original rhinos moved to Bardia, only three had survived. The main reason for this sad state of affairs was the unstable situation in the country following the regicide. The insurgency by Maoist guerrillas who had terrorized the countryside and killed many of the national park guards in their fight against the government also created general conditions of lawlessness in the parks and the rest of the countryside (there have also been suspicions that the Maoists collaborated with the poachers to finance their struggle). In an additional blow, in September 2006, a helicopter accident decimated the environmental leadership in Nepal, killing three key figures—Tirtha Man Maskey, Chandra Prasad Gurung and Mingma Norbu Sherpa (Hemanta Mishra had been invited to join the trip but was unable to do so)—as well as several international supporters from WWF and partner governments (including my good acquaintance Pauli Mustonen from the Ministry of Foreign Affairs of Finland).

Hemanta Mishra ends with a cautiously optimistic note. The Maoists had entered into a truce and were sharing power in government. Some high-level poachers had been arrested and prosecuted. Much was at stake for conservation in Nepal and much depended on whether the fragile peace and stability would hold and the country would find new resolve in appreciating its natural patrimony. When I last visited Nepal in November 2011, the peace was holding but the law and order situation was still weak, especially in some areas of the Terai.


View all my reviews