Volume 9.2 & 10.1

NCEHR Comuniqué CNÉRH

Summer/Fall 1999

Table of contents

THE ANALYSIS OF RISKS AND POTENTIAL BENEFITS IN RESEARCH 

by Charles Weijer, MD, PhD
Bioethicist and Assistant Professor of Medicine, Dalhousie University

Based on a talk at the NCEHR-York University Regional Workshop, March 13, 1999.

Prof. Weijer is a member of Council and Chair of NCEHR’s Committee on Ethics of Research Design. His research is supported by an MRC Scholar Award and Operating Grant, as well as a Dalhousie University Clinical Scholar Award.

The research ethics board (REB) is a social-oversight mechanism charged with protecting research subjects. Performing this task competently requires that the REB scrutinize informed consent, confidentiality, the balance of risks and potential benefits, and subject selection procedures in research protocols. One review of the research ethics literature suggests that too much time and energy are devoted to the review of informed consent, and too little spent in analyzing of the risks and potential benefits posed by studies.1 Canada’s new research ethics document, the Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans, clearly emphasizes the central importance of risk-potential benefit analysis.2 In my opinion, ensuring that a study has a favorable ratio of potential benefits to risks is the single most important determination made by the REB. It ensures that potential research subjects — be they sick or well, young or old, competent or incompetent — are presented with the option of entering a research study only when agreeing to participation in a study would be a reasonable choice.

The conduct of clinical research is guided by three ethical principles set forth in the Belmont Report: respect for persons, beneficence, and justice.3 Articulated more than 20 years ago, the Belmont principles remain the paradigm for ethical problems in research. Accordingly, they are mirrored in the U.S. federal Common Rule,4 the Council for International Organization of Medical Sciences (CIOMS) international research guide-lines,5 and, in a somewhat expanded form, the Tri-Council Policy Statement. The principle of respect for persons requires that the wishes of autonomous persons be taken seriously, and those who are not autonomous are protected. The principle finds expression in requirements for informed consent and confidentiality. The principle of beneficence is typically expressed in terms of two complementary rules: (1) do no harm, and (2) maximize potential benefits while minimizing the risks to subjects. The principle is applied in the demand that a study present an acceptable balance of potential benefits and risks. The principle of justice entails that the benefits and burdens of research participation be distributed equitably. Accordingly, the REB must ensure that procedures for the selection of subjects are equitable.

Defining risk
The concept of risk is pivotal to the weighing of potential benefits and risks required by the principle of beneficence. Risk, properly understood, is a multi-dimensional concept embracing both the probability and magnitude of harms to research participants. Benefit, on the other hand, refers only to the magnitude of a positive outcome, without reference to its probability. One often reads the phrase "risk-benefit ratio," but this is not a parallel construction and, hence, it is, strictly speaking, incorrect. One speaks properly of "harms and benefits" or "risks and potential benefits."

Some Canadian researchers have commented recently that risk is an inherently biomedical concept that does not apply across the spectrum of research now captured in the Policy Statement. Undoubtedly, this is at least in part a reflection of the fact that, for the first time in Canada, a single ethics document governs biomedical, social sciences, and humanities research. But is there more to it than this? Let us consider three diverse examples of research studies.

Study A: placebo controlled trial of a drug for people with acutely-symptomatic schizophrenia. Chouinard reports a study on schizophrenic patients who are newly hospitalized with acute symptoms of their disease.6 Despite the existence of effective treatment for such symptoms, patients are randomized to a new antipsychotic drug (remoxipride), a standard drug (chlorpromazine), or placebo. Patients are treated in hospital for four weeks and a variety of psychometric scales are measured. A number of risks are presented by this study to research subjects: the new medication may have serious adverse effects, some may be irreversible; patients assigned to placebo (or the new drug if it proves to be ineffective) will be deprived of needed treatment for a month; patients may suffer from hallucinations or paranoia; they may be at increased risk of suicide; and, finally, they may pose a risk to others. The ethics of placebo controlled trials in schizophrenia is discussed in detail elsewhere.7

Study B: hypnotic induction of partial deafness to see whether paranoid symptoms result. Zimbardo and colleagues report a study in which a group of hypnotically-suggestible and otherwise healthy college students were randomized to three different hypnotic suggestions: partial deafness without awareness of the cause; partial deafness with awareness of the cause; and itchiness of an ear.8 The hypothesis was that persons in the first group would demonstrate symptoms of paranoia. Subjects were assessed by a variety of measures, including psycho-metric scales and scoring of observed behavior. Subjects were rehypnotized, debriefed at the end of the study, and reassessed at one month. The study posed a variety of risks to participants, including distress associated with paranoia and hearing loss, risk of suicide, the possibility of harm to others, and uncertain sequelae from hypnosis. Some of the ethical issues raised by this study are discussed elsewhere.9

Study C: questionnaire examining adolescent sexual practices. Phillips describes a study involving 400 Minneapolis high-school students who were administered a pencil and paper questionnaire during their regularly scheduled health classes.10 The survey sought to document attitudes and behaviours related to HIV prevention. Accordingly, these adolescent participants were asked whether they were sexually active, what types of sexual activity they had experienced (e.g., oral, vaginal, or anal intercourse), and the gender or genders of their partners. A variety of risks are presented by this study to participants: teachers or parents may become aware of undisclosed sexual activity; others may become aware of same-sex relationships; and, participants might become aware that they are at risk of developing HIV. Phillips discusses thoroughly the ethical issues raised by her study.10

As illustrated by these three examples, research participation may expose the study participant to a wide spectrum of risks. Risks are classified by Levine into four categories: physical, psychological, social, and economic.11 Let us consider each briefly:

  • Physical risks: the research subject may suffer bodily harm — minor or serious, temporary or permanent, immediate or delayed as a result of the study.
  • Psychological risks: study participation may impact upon the research subject’s perception of self, cause emotional suffering, e.g., anxiety or shame, or may induce aberrations in thought or behavior.
  • Social risks: research findings, or even study participation itself, may expose subjects to the possibility of insurance or employment discrimination, or other forms of social stigmatization.
  • Economic risks: research subjects may directly or indirectly bear financial costs related to research participation.

So defined, risk is an inherently inclusive concept. As demonstrated by the above examples, a given study may present a variety of types of risk. For example, Study C (sex questionnaire) posed both psychological and social risks. Furthermore, no category of risk is exclusive to medical or non-medical research: Study B (deafness and paranoia) presented physical risks and Study A (schizophrenia trial) generated psychological risks. Finally, it is worth noting that despite the various disciplinary backgrounds involved, all three of the study examples posed non-trivial risk to research subjects.

Ethical analysis of risk
The ethical analysis of risks and potential benefits is a difficult task. The REB’s job is often described metaphorically as ensuring that there is an ‘acceptable ratio of potential benefits to risks’ or that there is a ‘balance of harms and benefits.’ But what is an ‘acceptable ratio’ and how do we know when a state of ‘balance’ exists? Research studies often involve a variety of procedures.12 Some of these procedures — be it a new psychotherapeutic maneuver, surgical technique, medical device, or drug — may benefit the patient and are administered with therapeutic warrant. Other procedures — questionnaires, psychological indices, extra blood tests or x-rays — are done purely to answer the scientific question and are given without therapeutic intent. Returning to our examples: Study A involves both therapeutic (antipsychotic drugs) and non-therapeutic procedures (psychometric scales); Study B involves only non-therapeutic procedures (hypnosis, psychometric scales, observation); and Study C also only involves only a non-therapeutic procedure (questionnaire). The Tri-Council Policy Statement requires that the risks of therapeutic procedures be evaluated separately from the risks of non- therapeutic procedures (page 1.5).

When a study involves therapeutic procedures, the REB must ascertain that a state of clinical equipoise exists (TCPS page 7.1). Clinical equipoise exists when there is a state of uncertainty in the expert clinical community as to the comparative merits of the study treatments.13 In other words, there must be genuine uncertainty as to the preferred treatment. A trial is initiated to resolve this uncertainty. Clinical equipoise does not require that treatments present equal risk. Indeed, an experimental treatment may pose greater risk than standard treatment, so long as it also offers a greater prospect of benefit. In short, the ethical analysis of therapeutic procedures involves a risk-benefit calculus.

Non-therapeutic procedures, by definition, do not offer any prospect of benefit to the research subject and, thus a risk-benefit calculus is inappropriate. Two ethical requirements must obtain if non-therapeutic procedures are to be deemed acceptable (TCPS page 1.5). First, the risks associated with such procedures must be minimized. If the information can be obtained in a less risky way, through ‘piggy backing’ on other procedures or using available information, then this must be done. Second, the risks posed by such procedures must be proportionate to the knowledge that may reasonably be expected to be gained from the study. Thus, the ethical analysis of non-therapeutic procedures does not involve a risk-benefit calculus, rather a risk-knowledge calculus.

Many studies in the social sciences and humanities will not involve therapeutic procedures, and in these cases, the REB’s attention should focus on the analysis of non-therapeutic risks. When a research protocol involves both therapeutic and non-therapeutic procedures, the results of both the risk-benefit calculus and the risk-knowledge calculus must be favorable. A study may not counter-balance experimental therapy that is ab initio known to be inferior to standard treatment with claims that important knowledge may result.

Minimal risk
The concept of ‘minimal risk’ is novel to Canadian guidelines and pervades the Tri-Council Policy Statement. Indeed, the phrase is used 19 times in the body of the document and it appears in the text of or commentary on 8 articles. What does minimal risk mean? When is a study minimally risky? Who makes this determination? Fortunately, ‘minimal risk’ has been a prominent feature of U.S. federal regulations for the last quarter century and, as a result, there is a substantial body of experience and literature from which to draw.

Minimal risk "means that the risks of harm anticipated in the proposed research are not greater, considering probability and magnitude, than those ordinarily encountered in daily life or during the performance of routine physical or psychological examinations or tests" (TCPS page 1.5).14 The definition has two parts: the first defines minimal risk as risks comparable to those "encountered in daily life;" the second gives an example of such risks, namely, risks encountered in "routine physical or psychological examinations or tests." Importantly, minimal risk only applies to the risks posed by non-therapeutic procedures.

The risks of daily life are familiar to us all. While it may be true that it is difficult to quantify the precise risk of disabling injury or mortality associated with, for example, driving to the grocery store or playing catch, we can nonetheless identify them as risks encountered in daily life. Properly understood, minimal risk is a categorical or qualitative determination made by the REB. As Freedman and colleagues observe: "We are, by definition, each acquainted with them; and, almost by definition, if we are unsure whether they belong within the set of common risks, then they don’t."15 The reasoning process to be used by the REB in the minimal risk determination is analogical. Research interventions may be determined to be minimally risky because either the procedure is in fact encountered in daily life or it is sufficiently similar to those routinely encountered.

It would be very useful to have lists of procedures that clearly present only minimal risk. A note of caution must be introduced here, however. Minimal risk refers to the sum total of risk posed by all the non-therapeutic procedures in a research study. Thus, a given procedure in isolation may be minimally risky, but in combination with other procedures, it may present more than minimal risk. Furthermore, the concept of risks of daily life is inherently flexible; its determination depends whose daily life we are talking about. The life experience of a diabetic is different from that of a cancer patient, and the life experience of a cancer patient is different from that of a healthy person. Certain procedures may be commensurate with the experience of one group of people but not others.

With these provisos in mind, at least one list of prima facie minimally risky procedures is available in the U.S. regulations. 4 Some of the procedures that may present minimal risk are as follows:

  • Collection of hair and nail clippings;
  • Collection of excreta and external secretions;
  • Recording of data using non-invasive procedures routinely employed in clinical practice, e.g., ECG, EEG, and echocardiography;
  • Venipuncture (not more than 450 ml in eight weeks and not more than two times per week);
  • Collection of supra-and sub-gingival dental plaque and calculus;
  • Voice recordings for research purposes such as investigation of speech defect;
  • Moderate exercise by healthy volunteers; and,
  • Research on individual or group behavior or characteristics of individuals, such as studies of perception, cognition, game theory, or test development, where the investigator does not manipulate subjects’ behavior and the research will not involve stress to subjects.

It is worth noting that none of the three studies we discussed obviously present only minimal risk to research subjects. Thus, the REB should avoid the erroneous presupposition that all social science and humanities research involves only minimal risk.

As suggested, the implications of minimal risk in the Tri-Council Policy Statement are numerous. Minimal risk serves at least two roles in the Policy Statement. It is used as a mechanism to focus the REB’s attention on studies that present more non-therapeutic risk:

  • social science and humanities research that presents minimal risk need not be peer-reviewed (article 1.5);
  • minimal risk is identified as the foundation of proportionate review and eligible protocols may be reviewed in an expedited fashion by the REB (article 1.6);
  • research that poses minimal risk requires only a "minimal [continuing] review process" (article 1.13);
  • naturalistic observation should usually be regarded as minimally risky (article 2.3);
  • REBs should consider having a person independent of the research team obtain consent when more than minimal risk is present (article 2.8); and
  • secondary use of data presenting more than minimal risk may require informed consent or community consultation (article 3.4) .

Minimal risk is also used to set a threshold for risk to which vulnerable populations may be exposed:

  • some or all of the elements of consent may be waived for an eligible study (article 2.1c); and
  • persons incapable of giving consent, including children and incompetent adults, may not be enrolled in studies that involve more than minimal risk (article 2.5).

Clearly, the challenges presented to the REB by risk analysis are substantial. In addition to NCEHR’s regional REB education workshops, individual institutions will need to undertake considerable educational efforts to ensure that REB members are fluent with the concept of risk and associated analytic techniques. As REBs face this challenge, it is imperative that they communicate their successes and failures with one another through forums such as NCEHR’s e-mail discussion group. Challenges are far better faced together than in isolation.

References

1. Freedman B, Shapiro SH. "Ethics and statistics in clinical research: towards a more comprehensive examination." Journal of Statistical Planning and Inference 1994; 42: 223-240.
2. Medical Research Council of Canada, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council of Canada. Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. Ottawa: Public Works and Government Services Canada, 1998.
3. National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. "The Belmont Report: ethical principles and guidelines for the protection of human subjects of research." OPRR Reports April 18, 1979: 1-8.
4. 45 CFR 46.
5. Council for International Organization of Medical Sciences (CIOMS). International Ethical Guidelines for Biomedical Research Involving Human Subjects. Geneva: CIOMS, 1993.
6. Chouinard G. "A placebo-controlled clinical trial of remoxipride and chlorpromazine in newly admitted schizophrenia patients with acute exacerbation." Acta Psychiatrica Scandinavica 1990; 358: 111-119.
7. Weijer C. "Placebo-controlled trials in schizophrenia: Are they ethical? Are they necessary?" Schizophrenia Research 1999: 35: 211-218.
8. Zimbardo PG, Anderson SM, Kabat LG. "Inducing hearing deficit generates experimental paranoia." Science 1981; 212: 1529-1531.
9. Lewis M, Zimbardo PG. "The ethics of inducing paranoia in an experimental setting " [letter and response]. IRB: A Review of Human Subjects Research 1981; December: 9-11.
10. Phillips SR. "Asking the sensitive question: the ethics of survey research and teen sex." IRB: A Review of Human Subjects Research 1994; 16(6): 1-7.
11. Levine RJ. Ethics and Regulation of Clinical Research. 2 nd ed. New Haven: Yale University Press, 1988: 37-65.
12. Freedman B, Fuks A, Weijer C. "Demarcating research and treatment: a systematic approach for the analysis of the ethics of clinical research." Clinical Research 1992; 40: 653-660.
13. Freedman B. "Equipoise and the ethics of clinical research." New England Journal of Medicine 1987; 317: 141-145.
14. 45 CFR 46.102(g).
15. Freedman B, Fuks A, Weijer C. "In loco parentis: minimal risk as an ethical threshold for research upon children." Hastings Center Report 1993; 23(2): 13-19.end.gif (970 bytes)

Top of page | Next | Table of Contents