 |
RETURN TO TABLE OF
CONTENTS Spring 2002
CFS Research: The Need for Better Standards
By
Nancy Klimas, MD, University of Miami
The scientific literature on chronic fatigue syndrome as an entity begins
in 1988 with the first case definition that coined the controversial term “CFS”
and established a set of criteria for researchers to use in selecting study
subjects. Over the past 14 years, the field has grown in both the number of
researchers and disciplines represented. Yet for all that’s been learned since
1988, much remains unknown about this enigmatic illness. Each research finding
seems to raise more questions than it answers.
The bulk of the blame, of course, lies with the vagaries of CFS itself.
But the research effort also is hampered by poorly conceived, constantly
changing — even non-existent — standards. Tighter research methodology could
improve individual studies and enable greater comparability of research findings
across studies. What follows is an overview of the areas most in need of
clarification and consensus, and a summary of the efforts to achieve overarching
agreement among CFS researchers.
Case definition Authors of the 1988 case definition
set out to identify a group of patients sharing similar symptoms and clinical
signs, but problems using the definition quickly became apparent. A revision in
1994 by an international consensus group (see back cover) attempted to address
some of the difficulties, but the resulting guidelines are rife with ambiguity
and vagueness. Symptoms are counted either as present or absent, without regard
to severity or frequency. Terms such as “substantial reduction” and “not
lifelong” are subject to varied interpretation. The use by some groups of
outdated case criteria developed in England and Australia obscures comparability
as well.
Thus, the case definition itself contributes to the heterogeneity of the
patient population, creating a shaky foundation for CFS research. The U.S.
Centers for Disease Control and Prevention (CDC) has convened an international
group of CFS investigators to develop a new case definition. The group has a
paper in press that outlines ways in which the case definition could be
strengthened.
Subgrouping Another weakness in CFS research stems
from the lack of information about illness course and long-term effects.
Patients are often enrolled in studies solely on the basis of currently meeting
CFS criteria, without regard to the length of their illness, which could account
for differences in biological markers (e.g., cell subsets, viral titers) and
functional status. Researchers have discussed the need for “staging criteria” as
a means of grouping patients by length and severity of illness, but none have
been established. Variations among study participants in age at onset, present
age, co-morbid conditions, menstrual cycle, body weight, medication use,
deconditioning, diurnal rhythms and other factors may also limit study
conclusions.
Control groups The selection of controls is a
particularly tricky element of study design. If the study hypothesis calls for
“healthy” or “normal” controls, recruitment techniques can present unintended
biases. For instance, healthy controls recruited from a health club near the
investigator’s site would probably differ from control subjects obtained from an
urban hospital clinic or patients’ families. Unrecognized medical issues in
“healthy controls” may taint study results. In some studies, the researcher may
seek to compare CFS subjects with people with other illnesses — if so, defining
appropriate disease groups can be problematic, in part because the symptoms of
CFS overlap with so many conditions. Selecting disease control subjects who have
fibromyalgia, multiple sclerosis, migraine, orthostatic intolerance or
depression may make scientific sense, but investigators must consider the
potential for overlap, as individual CFS study subjects may meet criteria for
one or more of the comparison conditions. Although the study hypothesis may
dictate the type of control subjects to use, it is important that recruitment
methods and selection criteria be thoroughly described, so that reviewers fully
understand group definition, and investigators hoping to duplicate the study
conditions are capable of performing confirmatory studies.
Lab methods Laboratory studies of cell subsets,
cytokines, immune activation, hormones, etc. often suffer from the lack of
agreed-upon protocols for sample collection, handling and storage. At a recent
CFS research conference, one reviewer noted that clinical samples are often
“treated more carelessly than last night’s leftovers.” Variability in lab
processing standards can also contribute to differences in test results.
Academic research laboratories are typically held to a high standard in
establishing methodologies and quality control measures not necessarily seen in
lower cost send-out laboratories. Yet published papers in CFS that have been
peer reviewed often neglect to disclose the site of the laboratory or quality
control measures used in determining the results of the study. Similarly,
differing procedures and conditions for tilt table tests, sleep studies and
exercise tolerance may account for discrepancies in the literature.
Standardization of procedures is a lofty goal that has evaded most disciplines,
but better documentation of protocols in research reports is an important first
step.
Outcome measures In 1992, the federal Food and Drug
Administration convened an advisory meeting on outcome measures used in CFS
research. Participants tried to agree on standard measures of improvement in
treatment studies. No consensus was reached, and the field still lacks a widely
endorsed instrument by which to judge clinical improvement. This leaves the
decision to individual investigators, some of who rely on simplistic self-report
questionnaires (e.g., “Do you feel better than you did before the study
began?”), while others conduct exhaustive batteries that evaluate progress
across numerous domains (e.g., sleep, pain, fatigue, memory, self-care, leisure
activity). As part of its effort to revise the case definition, CDC is
evaluating numerous instruments and piloting use of a panel developed for CFS
studies.
Funding
considerations Investigators are attracted to new areas of
investigation by two draws: scientific curiosity and availability of research
funding. Funding levels drive the rigor of scientific studies; pilot efforts
squeezed from funds for ongoing research activities generally suffer from small
subject numbers, few formal measures and cursory data analysis. Well-funded
projects more often ascribe to standards for study design and evaluation.
Multiple well-characterized patient and control groups, stratification on
several different symptomatic and demographic measures, careful assessment of
domains pre- and post-study, optimized handling of clinical samples and thorough
statistical analysis of data all add strength to research findings and
conclusions. Ironically, it’s often the presence of these design standards that
attracts funding in the first place. Developing greater funding for pilot
projects and more multidisciplinary studies is essential to building a critical
mass of research on CFS.
Federal health officials
are
increasingly working with CFS researchers in academic centers to attract more
senior investigators from related fields and to spur novel, yet testable,
hypotheses. A stronger research effort will enhance credibility for the illness,
and will propel advocacy efforts to increase CFS research funding at the
National Institutes of Health (NIH) and the CDC. Overcoming the methodological
challenges of studying CFIDS is essential to making progress in understanding
this complex illness and to uncovering more direct means of diagnosis and
effective treatments.
Nancy Klimas, MD, is
the
director of an NIH-sponsored Center for CFS Research and Professor of Medicine
at the University of Miami School of Medicine. She has chaired three methodology
workshops held in conjunction with The CFIDS Association of America’s research
symposia series (see below).
Initiatives to Strengthen CFS
Research
The CFIDS Association
of
America Symposia Series (2000–2002): Three research
meetings on specialized topics have brought together multi-disciplinary groups
of scientists studying chronic fatigue syndrome and conditions that share
important features. Each of the three symposia featured a day-long methodology
session.
Pilot Studies Funding
Program: Since its inception in 1987, the Association
has funded $3.4 million in CFIDS research, and now solicits annually for pilot
project applications, supporting those most likely to compete well for larger
grants from the National Institutes of Health (NIH) and other major funding
sources.
National Institutes
of
Health Program Announcement: On Dec. 11, 2001, NIH
published its first CFS research solicitation since 1996. Eleven divisions of
NIH made this joint announcement of research priorities and opportunities (see
notice on p. 11). On-Campus Collaboration: A working group of NIH staff from
various institutes meets regularly to discuss CFS research and mechanisms to
stir interest and recruit talent to the field.
Centers for Disease
Control & Prevention (CDC) Case Definition
Revision: The CFS program has led a group of
international CFS researchers working to refine the CFS case definition. Much of
this effort has been devoted to improving the comparability of studies through
standardized methodology.
Expanded Research
Partnerships: CDC has greatly increased the number
of, and funding for, collaborative research efforts with top-notch research
groups in the U.S. and abroad.
|