CA
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVECOVER ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


CA Cancer J Clin 2003; 53:356
doi: 10.3322/canjclin.53.6.356
© 2003 American Cancer Society
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF) Freely available
Right arrow Freely available CME: Take the course for this article:
The Impact of the Internet on Cancer Outcomes
Right arrow Submit a letter to the editor
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Eysenbach, G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Eysenbach, G.

The Impact of the Internet on Cancer Outcomes

Gunther Eysenbach, MD, MPH


Dr. Eysenbach is Associate Professor, Department of Health Policy, Management and Evaluation, University of Toronto, and Senior Scientist, Centre for Global eHealth Innovation, Division of Medical Decision Making and Health Care Research, Toronto General Research Institute of the UHN, Toronto General Hospital, Toronto, Canada.


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
Each day, more than 12.5 million health-related computer searches are conducted on the World Wide Web. Based on a meta-analysis of 24 published surveys, the author estimates that in the developed world, about 39% of persons with cancer are using the Internet, and approximately 2.3 million persons living with cancer worldwide are online. In addition, 15% to 20% of persons with cancer use the Internet "indirectly" through family and friends. Based on a comprehensive review of the literature, the available evidence on how persons with cancer are using the Internet and the effect of Internet use on persons with cancer is summarized. The author distinguishes four areas of Internet use: communication (electronic mail), community (virtual support groups), content (health information on the World Wide Web), and e-commerce. A conceptual framework summarizing the factors involved in a possible link between Internet use and cancer outcomes is presented, and future areas for research are highlighted.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
The recent "First International Conference on Cancer and the Internet," organized by the European School of Oncology and held in New York, had the subtitle "What Is the Impact of the Internet on Cancer Outcomes?" A similar question was posed in a recent news article in this journal.1

The current article, an expanded version of the opening keynote speech of that conference, is an attempt to synthesize the available literature published in the realm of "cancer and the Internet" and to put available evidence into a larger context. It is based on a comprehensive review of studies published in the field (for my search strategy, see the Appendix). The aim of this article is to summarize how persons living with cancer are using the Internet, to describe the possible effect on cancer outcomes, and to provide a framework for current and future research in this area.


    WHO USES THE INTERNET?
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
As of September 2002, one meta-analysis of different global surveys estimates that 606 million persons are online worldwide,2 which represents approximately 10% of the world population. Although in the past the Internet was used predominantly by North Americans, this has recently changed in terms of absolute numbers: Europeans now constitute the largest user group (191 million), followed by Asian/Pacific (187 million), and Canadian and U.S. (183 million) users. Latin America (33 million), Africa (6 million), and the Middle East (5 million) constitute the developing world when it comes to both the number of absolute users and Internet penetration.

    Persons Living With Cancer
    How Many Are Online?
How many of these millions of Internet users are persons with cancer? One crude way to estimate this number is to multiply the number of persons with cancer worldwide, which is, according to the World Cancer Report, approximately 22 million,3 by the global proportion of persons using the Internet (which is, as noted previously, approximately 10%), which would lead to an estimate of about 2.2 million persons with cancer online. However, we know that persons living with cancer are older than the general population, and in this age group Internet use is less common than in a younger population, so this might lead to an overestimate. On the other hand, cancer is more prevalent in the developed world, where people generally have better Internet access, so that taking the global proportion of Internet users of 10% might lead to an underestimate.

A more accurate way may be to focus our discussion on the industrialized world. We can estimate the proportion of persons with cancer who are using the Internet in the industrialized world based on published surveys among persons with cancer, and multiply this by the number of persons with cancer in the developed world. I conducted a systematic review of all studies containing data on the proportion of persons with cancer who are using the Internet (see the appendix for the search strategy).

The TableGo is a compilation of the 24 identified surveys that contain data on the proportion of persons with cancer who are Internet users.4–27 Taken together, these studies surveyed 8,697 persons with cancer. The average proportion of Internet users is 39%. Interestingly, this figure corresponds well with what oncologists estimate when asked what proportion of their patients use the Internet: 30%.11 If we assume that the developed world contains approximately 6 million persons living with cancer, and if we further believe that about 39% of them are online, this would translate into approximately 2.3 million persons with cancer online, an estimate that is not far from our first figure.


View this table:
[in this window]
[in a new window]

 
TABLE 1 Published Survey Data About the Proportions of Internet Users Among Persons With Cancer
 

View this table:
[in this window]
[in a new window]

 
TABLE 1 (Continued) Published Survey Data About the Proportions of Internet Users Among Persons With Cancer
 

The TableGo also shows that the proportions across studies vary considerably, ranging from 4% to 58%. This partly reflects that these surveys were conducted in different countries over different periods in time. Another reason for the variability is that no standard operational definition of an "Internet user" exists, and different studies may have measured different things. Some surveys frame their question as "Do you have access to the Internet," others ask "Do you use the Internet," "Do you use the Internet regularly," "Do you use the Internet for cancer information," or "Which of the following information sources are your primary source of information." How different questions may lead to different answers can be seen in one study, in which 35% of patients said they had access to the Internet, but only 6% said that they had sought cancer information on the Internet.13

A further reason for the heterogeneity of results across surveys is that "cancer is not cancer," and significant differences in Internet use according to diagnosis exist. In one study, in which different groups of persons with cancer were surveyed using the same instrument, highly significant differences in utilization of the Internet by diagnosis were observed: 16% of lung patients, 18% of head-and-neck patients, 27% of prostate patients, 34% of breast patients, and 45% of gynecologic patients reported using the Internet to obtain cancer-related information.20 This partly reflects demographic differences between the cancer types: We know from many studies that women are more active health seekers than men,28,29 and that younger age7,9,10,12,14,16,20,21,24 is also associated with greater Internet use. Therefore, age and sex are confounders when comparing Internet use, and it is unclear whether differences between diagnostic groups are mainly a result of demographic differences or whether they remain significant when adjusted for patient age and sex.

In addition, well-known socioeconomic predictors for Internet use or nonuse, that is, factors contributing to the "digital divide,"30,31 also cut across the population of persons with cancer: those using the Internet are mostly better educated6,7,14,19,21,24 and have a higher income6,14,19 than nonusers, and they are more likely white.6,16 Metz, et al.20 and Smith, et al.16 found very large differences in Internet use between a cancer patient population from an academic center (48%) and a VA hospital (8%), which again might be due to differences in socioeconomic status between the hospital populations.

    What Is the Role of the Internet as an Information Source for Patients Compared With Other Media?
Although in some studies the Internet is cited as the second most important source for cancer information after health professionals,14,19 it may play a somewhat less important role when it comes to making important treatment decisions in cancer: When asked for the most important factor influencing their treatment decision, men with prostate cancer indicated that physician recommendation (51%), advice from friends and family (19%), and information obtained from books and journals (18%) were more often the most important source, with the Internet cited by only 7%.15

Still, for those who use the Internet, information found there certainly influences their decisions, and patients are highly satisfied with the Internet as an information source compared with other media. Raupach and Hiller18 report that persons with breast cancer were mostly satisfied with information from the Internet (89%), with lower proportions of patients satisfied with that from television (46%), newspapers (52%), magazines (58%), and radio (60%).

It is also interesting to note that, according to one longitudinal study of persons with breast cancer, the Internet remains an important source of information years after diagnosis, whereas other sources of information such as health professionals or books quickly become less important after the initial phase of diagnosis.14 It is likely that the ongoing social support provided by Internet communities and the ability to keep up-to-date with recent medical news accounts for this.

    What About Internet Access of Family Members?
In addition to the estimated 2.3 million persons with cancer online, an unknown number of friends and relatives of these patients use the Web. Yakren, et al.21 report that 60% of patient companions used the Internet. An often-neglected phenomenon is that many persons with cancer may not actually use the Internet themselves ("direct users"), but rather use their companions (eg, husband or wife, children, or friends) to search and retrieve information or to communicate through e-mail ("indirect users"). It can be estimated that 15%22 to 20%25 of persons living with cancer are indirect users. With time, indirect users often become direct users.25

    What Do These Statistics Not Tell Us?
Approximately 39% of persons with cancer use the Internet directly, and an additional 15% to 20% use it indirectly. However, we realize that this statement may be insufficient to describe the reality, as Internet access or use is not a dichotomous variable, but in fact a quantitative and qualitative continuum.32 For direct users, conditions of access (physical accessibility at home or in a library, costs, convenience, and filters), computer literacy and search skills, as well as health literacy are factors that influence Internet use quantitatively and qualitatively. If the Internet access is indirect through proxy persons such as family and friends, the degree to which the proxy persons become active and supply information to the patient varies widely, as does the degree to which the information is preselected and filtered through the proxy. Surveys asking dichotomous questions do not capture and reflect these qualitative differences sufficiently. As Internet use becomes more and more common, new measures will have to be found to describe Internet use on meaningful ordinal or continuous scales.


    HOW ARE PERSONS WITH CANCER USING THE INTERNET?
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
To determine what patients and their families are doing on the Internet and what the effect on cancer outcomes might be, it is helpful to distinguish four broad application areas of the Internet.

Figure 1 shows a conceptual framework of how these areas are related to each other and depicts hypothesized intermediary steps and factors involved in influencing cancer outcomes (e-commerce was left out).


Figure 1
View larger version (30K):
[in this window]
[in a new window]
[PowerPoint slide for Educational Purposes]
 
FIGURE 1 A proposed conceptual framework for the possible links between Internet use and its effect on cancer outcomes.

 

    Communication
It is e-mail, and not the millions of Web pages on the World Wide Web, that Internet users rank as the number one reason for being online.33 An astounding 31 billion e-mail messages are exchanged daily world wide,34 with no data available on what proportion is health related (however, we know that 40% of all e-mail messages exchanged are spam,34 and most spam messages actually refer to health-related issues such as vitamins, breast augmentation, penis enlargement, weight loss, Viagra, and so forth). For persons with cancer, e-mail communication is important for staying in touch with friends and family, forming new social networks (virtual communities, see below), and communicating with health professionals. Although the former two areas are heavily used, there is a huge gap between demand and supply in electronic physician–patient communication. Survey after survey shows that although patients desperately wish to communicate by e-mail with physicians, in the United States only 6% to 9% of patients have done so.28,29,35,36 It would, however, be an oversimplification to portray physicians simply as technophobes unwilling or incapable of using e-mail. In fact, most physicians use e-mail to communicate with their colleagues and privately,37 and one survey shows that as many as 75% of physicians have in fact used e-mail with patients, although only with a very select subset (1% to 5%) of their patients.38 The reasons why physicians have not yet adopted e-mail on a wider scale to communicate with their patients are more complex than technophobia, and include fear of increased demand on physician time (particularly with overuse of e-mail by patients), difficulty incorporating e-mail into daily office work flow, concerns over generating timely responses, concerns over inappropriate or urgent content in the messages, confidentiality issues, and lack of reimbursement for this service.39,40 Another study adds liability concerns and "preferring face-to-face interaction" to the list, the latter cited by 82% of physicians surveyed.37

Conversely, there is a significant potential for e-mail to improve communication between physicians and patients. Electronic communication may help patients to ask questions, facilitate understanding and shared decision making, and reduce unnecessary appointments.41 Still, as with any other technology in medicine, these promises must be evaluated carefully, and e-mail must be critically compared against other modes of communication, most notably the telephone. Although one advantage of e-mail over the telephone is that communication can occur in an asynchronous manner (patients can send an e-mail whenever they want, and physicians are flexible to schedule the reply whenever they have time), it is presently not clear whether these benefits outweigh the disadvantages, especially as it might be much more time consuming to write an e-mail message even for very simple questions that could be answered on the telephone in 10 seconds. The fact that e-mail is a written, documented communication increases liability concerns and further increases the time needed to formulate a response. Even if it takes only 4 minutes to read and reply to a patient e-mail,42 100 patient e-mails per day would easily require an additional staff member who does nothing but reply to e-mails. Would money spent for this additional time be better invested in face-to-face communication, or, for example, in a telephone triage system? As Patt, et al.39 have noted, the only controlled trial implementing e-mail communication between physicians and patients revealed no significant reduction in the volume of telephone communication,43 indicating that e-mail is used in addition to existing services, not as a replacement, which may not be cost-effective. Other studies have come to more favorable conclusions about e-mail communication.44 Much research to evaluate e-mail as a tool for clinical communication remains to be conducted.

    Communication With Physicians in the Absence of a Patient–Physician Relationship
In the absence of any formal e-mail communication channels offered by the traditional health care system, patients have found other ways to satisfy their need to communicate electronically with health professionals. One avenue is to use "cyberdocs," health professionals or other persons offering e-mail advice for money on the Web.45 Another, perhaps more widely used avenue are unsolicited e-mails sent to physicians.46 In one study, 50% of physicians were in fact tempted to respond to such an e-mail inquiry from an unknown patient,47 despite possible liability consequences.48,49 Guidelines for this so-called "type A" communication (in the absence of a pre-existing patient–physician relationship) have been proposed,50,51 but this kind of "cybermedicine" remains a gray area. Recently, a woman filed a lawsuit against a radiologist, whose e-mail address she found on a hospital Web site and whom she asked a seemingly casual question via e-mail. The radiologist responded with a quick e-mail trying to help. The woman later turned out to have cancer and claimed to have been harmed by the advice she received, and she sued the radiologist.52

In summary, physician–patient e-mail communication is a challenging area in health communication, with many unresolved questions, most significantly the cost-effectiveness of introducing electronic physician–patient communication into routine clinical practice. E-mail is likely to be useful and cost-effective only for a quite narrow set of scenarios and conditions, which could be covered by health and social insurance plans. For the remaining situations, e-mail is going to be offered by physicians as an additional service for which patients may have to pay or co-pay for out of their own pockets. Electronic communication might also become an integral part of the "e-end" of health services, with a hospital providing Web-based medical records online and patients having the chance to review them, supply additional information, or enter the communication module to ask questions.

    Community
    What Are Virtual Communities?
Virtual communities are "social aggregations that emerge from the Net when enough people carry on ... public discussions long enough, with sufficient human feeling, to form webs of personal relationships in cyberspace."53 Virtual communities are therefore social networks formed or facilitated through electronic media.54 In the health context, they may also be referred to as electronic support groups (ESGs). As of August 2003, Yahoo!Groups lists 22,000 support groups in the Health & Wellness section, among them at least 280 cancer groups. Although most ESGs are actually mailing lists, other synchronous (real-time) community venues exist. For example, on Web sites such as cancerpage.com, online support groups meet on designated days and at designated times in chat rooms. Although most ESGs are unmoderated, some are facilitated by trained professionals, either oncology nurses, counselors, or cancer survivors involved in offline support.

Among the most comprehensive online resource for electronic cancer support groups is the Association of Cancer Online Resources (ACOR), founded by Gilles Frydman. After his wife was diagnosed with breast cancer, Frydman used a breast cancer mailing list, which eventually led him to the conclusion that his wife’s physician was recommending a far too radical course of treatment, and he sought a second opinion. He was so impressed with the information he found on mailing lists that he tried to create a clearinghouse for mailing lists.55 As of March 2003, the Web site (http://www.acor.org) hosts 235 cancer mailing lists, with 115,000 messages exchanged per day.

    What Kinds of Messages Are Exchanged in These Virtual Communities?
According to a content analysis study of an electronic cancer support group, 80% of messages contain information giving or seeking personal opinions, encouragement and support, and personal experiences, whereas the remaining 20% contained thanks, humor, and prayers.56 An emphasis on the two pillars "information" and "support" was also found in other content analysis studies,57,58 mirroring findings from the literature on face-to-face self-help support groups.59 Klemm notes interesting gender differences in the content of the messages, with women engaging in supportive messages more frequently than men, who used the electronic community primarily for information exchange,60 which again is similar to findings from face-to-face groups.59

It has been suggested that virtual communities present an excellent opportunity for researchers to learn about preferences and experiences of patients, provided that the material it is obtained in an ethical manner.61 Content analysis of these messages can be a rich source for researchers interested in understanding the experiences and views of interested persons and patients, and it is a largely untapped opportunity for health researchers to analyze where and why gaps exist between evidence-based medicine and consumer behavior and expectations. Such research may elicit a wealth of valuable data that may inform priorities for research, health communication, and education.61

    What Are the Advantages and Disadvantages of ESGs Over Face-to-Face Groups?
The advantages of virtual communities over face-to-face groups include absence of geographic and transport barriers; anonymity for stigmatizing, embarrassing, or sensitive issues; increasing self-disclosure; encouraging honesty and intimacy; and that even patients with rare diseases can find peers online. Electronic support groups seem to attract more men than traditional face-to-face support groups, where women outnumber men four to one.59 The anonymity of virtual communities may facilitate the participation of men, who may be culturally and socially conditioned not to ask for help and support.

The disadvantages of virtual communities include a large volume of mail with a considerable amount of "noise," negative emotions ("flaming"), and lack of physical contact and proximity.62 As with content on the Web, there have been concerns over inaccurate or "non–evidence-based" information exchanged in virtual communities.63,64 A recent topic analysis of messages from a mailing list for brain tumor patients found that alternative treatments were the most frequently discussed topics (15%), followed by debates about therapeutic strategy and symptoms.65

    What Is the Effect of Virtual Communities on Well-being and Health Outcomes?
I believe virtual communities are probably the one Internet application area with the greatest effect on persons with cancer. Anecdotal reports from patients support the notion that they can benefit enormously from these interactions.55,66,67

There is an ongoing debate on whether electronic communities in fact lead to social isolation and reduced well-being rather than a strengthening of social support. These concerns are based mainly on the controversial "Internet paradox" publication reporting results from a longitudinal study of the effect of the HomeNet project at Carnegie Mellon University, where 169 persons were provided free computers and Internet access and followed for a period of 1 to 2 years. The study provided alarming evidence of the possible harmful effects of Internet use.68 The paradox was that a "social technology" (e-mail, newsgroups, and chatrooms) used primarily for interpersonal interaction apparently increased social isolation and decreased mental health and psychological well being among its users. Heavy Internet use was associated with increases in loneliness and depression and tended to increase stress. To explain the paradox, the researchers reasoned that superficial relationships (weak ties) formed online displaced meaningful relationships (strong ties) in the real world.

It should be noted that the HomeNet study was conducted with healthy participants and not with persons with cancer. However, in a cross-sectional study looking at persons living with cancer in an ESG (14 men with prostate cancer, 2 of whom were receiving active treatment) and a face-to-face group (26 men and women with "different cancer diagnoses," 14 of whom were undergoing active treatment), Klemm and Hardie69 noted a significant higher proportion of depressed persons with cancer in ESGs (92%) compared with no depressed participants in face-to-face cancer support groups. Does this mean that ESG participation causes depression? Or that face-to-face groups reduce depression, whereas ESGs do not? Or only that depressed persons are turning primarily to electronic groups while staying away from face-to-face groups? Obviously, an association does not tell us anything about the causation sequence, and the latter explanation (selection bias of the study participants) might be the most plausible explanation for this finding. Longitudinal studies or randomized trials are needed to investigate this question further.

Conversely, there are many patient narratives55,66,67 and studies reporting benefits for persons with cancer that are incompatible with the notion that Internet use leads to depression. Fogel, et al.70,71 reports that Internet use in persons with breast cancer is associated with increased perceived social support and decreased loneliness. The most impressive study to date, a randomized controlled trial with recipients of a breast cancer mailing list, suggests that a Web-based support group can be useful in reducing depression and cancer-related trauma as well as perceived stress.72

In summary, the overall "net benefits" of virtual communities, in particular in the health context and even more specifically for persons with cancer, are unclear, and there is a lack of high-quality controlled trials addressing these questions.59 It is likely that most persons with cancer benefit from virtual communities, whereas a minority may prefer local face-to-face support and might not feel comfortable using computers to build social relationships. In fact, when the authors of the original Internet paradox publication recently revisited their HomeNet study population after three years, which is now more experienced with Internet and computers, higher Internet use was associated with lower depression, and no significant association with loneliness was observed. The authors speculate that the negative findings from the early study phase might have been only a result of the novelty of the Internet and due to the fact that the nature of the Internet in these early years of the Web was different. The authors have also expanded their analysis and now argue that Internet use has positive effects on well-being for extraverted, highly sociable persons, who have existing social support in "real life," whereas the opposite is true for introverted persons, where the Web might interfere in real life relationships.73 Persons living with cancer participate more in online communities when they perceive that support received from a face-to-face partner is low.74 In this situation, it is unlikely that time spent to build a virtual support network compromises local support, in particular as some ESGs actually lead to face-to-face meetings and "virtual" interactions can turn into strong and long-lasting social and emotional support relationships.

    Content
The third pillar of the Internet is provision of information ("content"), most notably on the Web, but, as noted before, also through communities.

    Why Are Patients Turning to Web Information?
Most patients seek explanatory information about their cancer or treatment, especially just after their diagnosis and before starting treatment.75 However, health professionals frequently fail to meet their patients’ information needs fully. In one study, 48% of persons with cancer reported that they had insufficient information;76 in another survey, 20% were not satisfied with the information given.77 Two surveys reported that 87% of patients stated that they want as much information as possible,4,78 and almost 54% of these patients did not feel that their physicians and other health care workers provided them with adequate information.4 In another study, 39% of persons with breast cancer indicated that they "wished that they had help with knowing what questions to ask."79

Is it this degree of dissatisfaction with insufficient information received from health care professionals that makes patients turn to the Web? Indeed, persons with breast cancer who had used the Internet were less satisfied with the amount of treatment-related information they received from caregivers than were those patients who had not used the Internet.7 Although this could indicate that dissatisfied patients are more likely to turn to the Internet, it may also mean that the expectations of Internet patients have changed in a sense that they become more dissatisfied than non–Internet users when they realize how much information is out there that they should have received.

Dissatisfaction with information is not the only reason why patients turn to the Web: Searching for information has also been described as a coping strategy.80 Persons living with cancer may be completely happy with the amount of information they received but still wish to reassure themselves that they have every bit of information available.

    What Is the Prevalence of Health-Related Searches on the Web?
This enormous thirst for information translates into millions of Web searches conducted every day on the Internet. Based on my research with Kohler, we estimate that approximately 4.5% of all searches on the Web might be health related.81 Although this appears to be a relatively small proportion, the absolute numbers are still impressive: Google, a search engine with a usage share of 54%,82 reports 150 million searches per day on all regional partner sites combined. Based on this, we estimate that on a global level, 278 million Internet searches are being conducted every day, of which approximately 12.5 million searches are health related. No data are available on how many of these are cancer related.

    What Is the Effect of Information on Persons With Cancer?
Provision of information to persons with cancer has been shown to help patients gain control, reduce anxiety, improve compliance, create realistic expectations, promote self-care and participation, and generate feelings of safety and security.83,84 Satisfaction with information has been shown to correlate with quality of life,85 and patients who feel satisfied with the adequacy of information given are more likely to feel happy with their level of participation in the overall process of decision making.76

Although more than 15 randomized trials have evaluated interventions to provide information to persons with cancer,86 most focus on evaluating the effect of providing printed patient education pamphlets or computer-based personalized87 information to patients. Relatively little is known about the effects of general undirected "chaotic" Internet information on persons with cancer.

Fleisher25 reports a strong relationship between Internet use and both self-efficacy (confidence in remaining independent and being able to make treatment decisions) and patient task behavior. Most persons (92%) believed that getting Internet health information made them feel empowered to make decisions about their health. Most (91%) also believed that the information helped them talk to their physicians about their health. Having access to Internet health information has a direct relation to having the confidence to ask questions to a physician and to a perceived "partnership" relation with a physician. Despite these perceived positive aspects of using Internet health information, some users also felt that getting the information could be overwhelming (31%), that information on the Web made them aware of conflicting medical information about their cancer (76%), and that getting Internet health information made them confused about the right course of cancer treatment (27%).

Although most oncologists agree that in general Internet information increases the level of understanding of patients,11 they also warn that patients’ understanding of information is only "sometimes" or even "rarely" correct,4 and that Internet information also increases the patients’ level of confusion and anxiety.11

Most physicians embrace the accessibility of health information on the Web as a positive development,4,11,88 but an important minority (9%, in one study) felt that it has, in fact, worsened the patient–physician relationship because patients challenge their physicians’ authority, patients’ requests are not always appropriate for their health, and patients bring information to consultations and interfere with the physicians’ time efficiency.89 Nearly all (95%) oncologists agree that time spent discussing Internet information has increased in the past 5 years; almost one half admit that they sometimes (38%), most of the time (5%), or always (1%) had difficulty discussing Internet information, with 9% of oncologists sometimes or always feeling threatened when patients brought Internet information for discussion.11

    What Is the Quality of Cancer Information on the Web?
Most persons with cancer who use the Web have a positive subjective quality experience, especially younger patients.12 Most consider information on the Web either very reliable (22%) or somewhat reliable (70%).20 In another survey, 52% from a general (healthy) population who have visited health sites think that "almost all" or "most" health information they see on the Internet is credible.29 Physicians view the quality of health information on the Web slightly more critically: They report that the last time a patient brought Internet information it was very (8%) or somewhat (66%) accurate, whereas 26% said it was not very or not at all accurate.88

A systematic review of 79 published studies on the quality of health information on the Web revealed that the view of most medical experts who systematically evaluated information on the Web is even more unfavorable.90 However, as noted in the review, most study authors did so mainly on grounds of criticizing insufficient disclosure/disclaimer information or other technical criteria (which has little to do with information accuracy), or lack of completeness of information (which is a different concept than "accuracy" and of questionable relevance on the Web). Measuring completeness might make sense for a printed pamphlet, but it is not an appropriate evaluation criterion for Web-based information, because Web sites may deliberately and with good reason focus on a single topic in-depth rather than aim for comprehensiveness, and consumers will usually search across different Web sites when looking for specific health information.90

It is also a noteworthy finding from this review that the quality of cancer information on the Web, compared with other topic areas, is not so bad after all. Studies evaluating the accuracy of cancer sites have found inaccuracy rates on the order of 5%: 4% for prostate cancer,23 5.1% for breast cancer,91 9% English or 4% Spanish breast cancer documents,92 6% for testicular cancer,23 and 6.2% for Ewing sarcoma.93 Compared with other areas such as diet and nutrition for which authors have found 45.5%94 or 88.9%95 inaccurate information, such prevalence figures seem low (Figure 2). Published rates of inaccurate or incomplete information in other media are not less disturbing,90,96 and little evidence supports the notion that information found on the Web is worse than in other media. For example, two of four inaccuracies found on the Web by Biermann, et al.93 are in fact inaccuracies that exist in a printed publication as well.90


Figure 2
View larger version (49K):
[in this window]
[in a new window]
[PowerPoint slide for Educational Purposes]
 
FIGURE 2 Prevalence figures of inaccurate information on the Web, based on data from a recent systematic review.90 The size of the dot represents the number of Web sites or Web pages authors evaluated. The four highlighted studies looking at cancer information found comparably low prevalence values of approximately 5%.

 

Comparisons of the proportions of inaccurate information across different topic areas, such as presented in Figure 2, must be interpreted carefully, because the search strategy is a major confounder influencing the quality of the retrieved information (for example, entering the key words "rapid and guaranteed cure for cancer" would elicit qualitatively different results than entering "cancer therapy"). For this reason, it is virtually impossible to get a "representative" estimate of the prevalence of inaccurate cancer information, because it also depends on the search skills and filtering abilities of the user. In other words, the proportion of low-quality information on the Web is only one factor in the equation that describes the risk for a consumer to encounter low-quality information. The other factor is the search and appraisal skill of the user.90 Both factors can be influenced by health professionals, the first by publishing high-quality information themselves (CancerNet is a prime example), the second by educating and training patients how to "filter" information. One of the first studies that evaluated how consumers search for and appraise health information on the Web strongly suggests that there is a role for user education and training. For example, none of the Internet users who were given the task to find reliable answers to health questions on the Web were observed to try to find out who the authors or owners of a Web site were (eg, by checking the "about us" sections).97 Some institutions have begun to offer Internet training classes to consumers and patients,98–100 and at Princess Margaret Hospital in Toronto, Canada, we are developing and evaluating an "Internet school" for persons with prostate cancer. In these face-to-face courses, advanced search skills and simple strategies to evaluate health information are taught. For example, we are using the CREDIBLE mnemonic to remind patients what they should look for at a trustworthy Web site,101 namely:

Another strategy, particularly for cancer information, is to tell patients to watch out for "red flags" indicating questionable information.102 For example,

    E-Commerce
Much of the negative findings from quality evaluation studies can be attributed to the fact that the Web is, in fact, a gigantic marketplace, with most information (83%) being commercial information designed to advertise and sell products and services, with less than 3% nonprofit health information.103 Limited information is available as to what degree persons with cancer use the Web to purchase health services and products, but at least two studies suggest that about 50%7,20 of online persons with cancer use the Web to find information about complementary and alternative medicine (CAM), and 12% of persons with cancer who use the Internet actually purchased unconventional medical therapies over the Internet.20 These numbers are hardly surprising, because we know that the proportion of persons living with cancer using CAM is of the same order,104,105 and the Internet is just one of many channels through which CAM information and products can be obtained. There has been one reported case of a person with cancer who was severely harmed as a result of ordering CAM on the Web,106 but to blame the Internet for this would be like blaming telephone books or libraries for similar events that have occurred before. There are no qualitative or quantitative data on whether Internet users are taking more CAM than non-Internet users, and whether this has any effect on outcomes.

In contrast to CAM, the Internet is a less well-established medium to purchase prescription medicines. In a recent U.S. survey, only 5% of those taking prescriptions drugs reported to have ordered them on the Internet, and fewer than 2% have obtained their prescriptions on the Web.28


    RECOMMENDATIONS FOR RESEARCH
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
Much of the discussion around the "quality of information" or the effect of the Internet on persons with cancer1 has been a debate on whether the glass is half full or half empty. Based on a comprehensive review of the literature, I am convinced that the glass is filled almost to the top with unprecedented opportunities and it would be a mistake to leave them untapped by focusing our attention on the small area that is empty.

One important example that illustrates the degree to which we have been distracted by focusing on the negative aspects of the Internet is the flood of hundreds of publications on the quality of health information on the Web. The time and energy investigators spent on "descriptive infodemiology" (eg, attempting to describe the prevalence of "low quality" health information on the Web101) could have been invested in answering more significant questions. Rather, future studies should focus on "analytic infodemiology" and address issues such as the relation of different quality criteria to each other (including which markers of a Web site can be used by a consumer to judge whether the site is trustworthy), or the relation between quality criteria or presentation formats on the one hand and outcomes such as knowledge transfer or satisfaction on the other. One recent example is a usability study conducted by researchers at the National Cancer Institute that considered which Internet presentation format is most effective for knowledge transfer.107

Much work also remains to be done to evaluate the opportunities and pitfalls of electronic communication between patients and health professionals, and to integrate these tools into clinical practice if they prove to be effective, without disadvantaging those who have different preferences or those who benefit from more traditional modes of communication.

In addition, we have a long way to go to fully understand the effects and opportunities of virtual communities on the Web and to devise strategies to maximize their use.

Today the effect of the Internet on cancer outcomes is unknowable and perhaps will never be fully understood. Although we can hypothesize and test that there are associations between Internet use and variables such as self-efficacy, empowerment, coping, decisional conflict, CAM use, anxiety, or depression, questions of causality are more difficult to answer. A myriad of potential confounders, such as education and socioeconomic status, which are both associated with exposure (Internet use) and the outcome variables, may explain the observed associations and must be adjusted for. To do a "clean" randomized trial with "the Internet" as intervention is hardly feasible. Longitudinal studies may help us to understand the interplay and timing of different outcome variables and help us to refine the conceptual framework depicted in Figure 1.

Perhaps the question of whether the Internet affects cancer outcomes should be rephrased. The question of the "Net effect" is largely academic, because the Internet is a permanent fixture in society that is here to stay. The greater task is to develop and evaluate interventions that can maximize the positive effect of the Internet; harness the power of information and communication technology for patients who want it, without disadvantaging those who have different preferences; and to evaluate these innovations. In any case, there is an urgent need for research that goes beyond pure descriptive studies.


    APPENDIX
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 
    Search Strategy Used
This review is data driven in a sense that I searched (on July 18, 2003) all publications in PubMed using the search terms ["neoplasms" (MeSH term) OR "cancer" (text word)] AND "Internet" (MeSH term) and screened all 489 resulting abstracts.

I conducted further searches to answer specific questions, and I used a personal literature database on Internet literature.


    Acknowledgments
 
Acknowledgments

The "Internet school for prostate cancer patients" project is supported by the Change Foundation, Toronto. Further work of the author is supported by the European Union, Canadian Institutes for Health Research, and the Centre for Global eHealth Innovation.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 WHO USES THE INTERNET?
 HOW ARE PERSONS WITH...
 RECOMMENDATIONS FOR RESEARCH
 APPENDIX
 REFERENCES
 

  1. Oncologists disagree on impact of patient internet use. CA Cancer J Clin 2003; 53: 135–137.[Free Full Text]
  2. NUA. How many online? Available at http://www.nua.ie/surveys/how_many_online/. 2003.
  3. Stewart BW, Kleihues P. World Cancer Report. Geneva: World Health Organisation, 2003.
  4. Chen X, Siu LL. Impact of the media and the Internet on oncology: survey of cancer patients and oncologists in Canada. J Clin Oncol 2001; 19: 4291–4297.[Abstract/Free Full Text]
  5. Jadad AR, Sigouin C, Cocking L, et al. Internet use among physicians, nurses, and their patients. JAMA 2001; 286: 1451–1452.[Free Full Text]
  6. Fogel J, Albert SM, Schnabel F, et al. Use of the Internet by women with breast cancer. J Med Internet Res 2002; 4: e9.
  7. Pereira JL, Koski S, Hanson J, et al. Internet usage among women with breast cancer: an exploratory study. Clin Breast Cancer 2000; 1: 148–153.[Medline]
  8. Ranson S, Morrow GR, Dakhil S, et al. Internet use among 1020 cancer patients assessed in community practices: a URCC CCOP Study [abstract]. Proc Am Soc Clin Oncol 2003; 22: 534.
  9. Norum J. Evaluation of Norwegian cancer hospitals Web sites and explorative survey among cancer patients on their use of the Internet. J Med Internet Res 2001; 3: e30.
  10. Norum J, Grev A, Moen MA, et al. Information and communication technology (ICT) in oncology. Patients’ and relatives’ experiences and suggestions. Support Care Cancer 2003; 11: 286–293.[Medline]
  11. Helft PR, Hlubocky F, Daugherty CK. American oncologists’ views of internet use by cancer patients: a mail survey of American Society of Clinical Oncology members. J Clin Oncol 2003; 21: 942–947.[Abstract/Free Full Text]
  12. Mills ME, Davidson R. Cancer patients’ sources of information: use and quality issues. Psychooncology 2002; 11: 371–378.[Medline]
  13. Carlsson M. Cancer patients seeking information from sources outside the health care system. Support Care Cancer 2000; 8: 453–457.[Medline]
  14. Satterlund MJ, McCaul KD, Sandgren AK. Information gathering over time by breast cancer patients. J Med Internet Res 2003; 5: e15.[Medline]
  15. Diefenbach MA, Dorsey J, Uzzo RG, et al. Decision-making strategies for patients with localized prostate cancer. Semin Urol Oncol 2002; 20: 55–62.[Medline]
  16. Smith RP, Devine P, Jones H, et al. Internet use by patients with prostate cancer undergoing radiotherapy. Urology 2003; 62: 273–277.[Medline]
  17. Brotherton JM, Clarke SJ, Quine S. Use of the Internet by oncology patients: its effect on the doctor-patient relationship. Med J Aust 2002; 177: 395.
  18. Raupach JC, Hiller JE. Information and support for women following the primary treatment of breast cancer. Health Expect 2002; 5: 289–301.[Medline]
  19. Peterson MW, Fretz PC. Patient use of the Internet for information in a lung cancer clinic. Chest 2003; 123: 452–457.[Abstract/Free Full Text]
  20. Metz JM, Devine P, DeNittis A, et al. A multi-institutional study of Internet utilization by radiation oncology patients. Int J Radiat Oncol Biol Phys 2003; 56: 1201–1205.[Medline]
  21. Yakren S, Shi W, Thaler H, et al. Use of the Internet and other information resources among adult cancer patients and their companions [Abstract]. Proc Am Soc Clin Oncol 2001; 20: 398a.
  22. Vordermark D, Kolbl O, Flentje M. The Internet as a source of medical information. Investigation in a mixed cohort of radiotherapy patients. Strahlenther Onkol 2000; 176: 532–535.
  23. Hellawell GO, Turner KJ, Le Monnier KJ, Brewster SF. Urology and the Internet: an evaluation of Internet use by urology patients and of information available on urological topics. BJU Int 2000; 86: 191–194.[Medline]
  24. Pautler SE, Tan JK, Dugas GR, et al. Use of the Internet for self-education by patients with prostate cancer. Urology 2001; 57: 230–233.
  25. Fleisher J. Relationships among Internet health information use, patient behavior and self efficacy in newly diagnosed cancer patients who contact the National Cancer Institute’s Atlantic Region Cancer Information Service. Proceedings of the AMIA Annual Fall Symposium, 2002, pp 260–264.
  26. Monnier J, Laken M, Carter CL. Patient and caregiver interest in internet-based cancer services. Cancer Pract 2002; 10: 305–310.[Medline]
  27. Duffy CC, McLernon NF, D’Orsogna LJ, et al. Internet use by radiation oncology patients: a pilot study. Med J Aust 2000; 172: 350–351.
  28. Baker L, Wagner TH, Singer S, Bundorf MK. Use of the Internet and e-mail for health care information: results from a national survey. JAMA 2003; 289: 2400–2406.[Abstract/Free Full Text]
  29. Fox S, Rainee L. The Online health care revolution: how the Web helps Americans take better care of themselves. The Pew Internet and American Life Project. Washington, DC: Pew Charitable Trusts, 2000.
  30. Irving L, Klegar-Levy K, Everette DW, et al. Falling through the Net: Defining the digital divide. A Report on the Telecommunications and Information Technology Gap in America. Washington, DC: National Telecommunications and Information Administration, U.S. Department of Commerce, 1999.
  31. Brodie M, Flournoy RE, Altman DE, et al. Health information, the Internet, and the digital divide. Health Aff (Millwood) 2000; 19: 255–265.[Abstract]
  32. Skinner H, Biscope S, Poland B. Quality of internet access: barrier behind internet use statistics. Soc Sci Med 2003; 57: 875–880.
  33. Katz JE, Aspden P. A nation of strangers? Communications of the ACM 1997; 40: 81–86.
  34. IDC Research. Worldwide Email Usage Forecast, 2002–2006. Framingham, MA: IDC, 2002.
  35. Mold JW, Cacy JR, Barton ED. Patient-physician e-mail communication. J Okla State Med Assoc 1998; 91: 331–334.[Medline]
  36. Sittig DF, King S, Hazlehurst BL. A survey of patient-provider e-mail communication: What do patients think? Int J Med Inf 2001; 61: 71–80.[Medline]
  37. Deloitte Research and Cyber Dialogue. Taking the Pulse: Physicians and the Internet. New York: Deloitte Research, 2001.
  38. Hobbs J, Wald J, Jagannath YS, et al. Opportunities to enhance patient and physician e-mail contact. Int J Med Inf 2003; 70: 1–9.[Medline]
  39. Patt MR, Houston TK, Jenckes MW, et al. Doctors who are using e-mail with their patients: a qualitative exploration. J Med Internet Res 2003; 5: e9.[Medline]
  40. Moyer CA, Stern DT, Dobias KS, et al. Bridging the electronic divide: patient and provider perspectives on e-mail communication in primary care. Am J Manag Care 2002; 8: 427–433.[Medline]
  41. Mechanic D. How should hamsters run? Some observations about sufficient patient time in primary care. BMJ 2001; 323: 266–268.[Free Full Text]
  42. Borowitz SM, Wyatt JC. The origin, content, and workload of e-mail consultations. JAMA 1998; 280: 1321–1324.[Abstract/Free Full Text]
  43. Katz SJ, Stern DT, Dobias K, Moyer CA, Cox D. Effect of a triage-based email system on clinic resource use in primary care [Abstract]. J Gen Intern Med 2002; 17( Suppl 1): 199.
  44. Solovy A. E-mail minus ‘e-mail’. California study shows that online communication can benefit patients, physicians and payers. Hosp Health Netw 2002; 76: 26.[Medline]
  45. Eysenbach G, Diepgen TL. Evaluation of cyberdocs. Lancet 1998; 352: 1526.[Medline]
  46. Eysenbach G, Diepgen TL. Patients looking for information on the Internet and seeking teleadvice: motivation, expectations, and misconceptions as expressed in e-mails sent to physicians. Arch Dermatol 1999; 135: 151–156.[Abstract/Free Full Text]
  47. Eysenbach G, Diepgen TL. Responses to unsolicited patient e-mail requests for medical advice on the World Wide Web. JAMA 1998; 280: 1333–1335.[Abstract/Free Full Text]
  48. Kuszler PC. A question of duty: common law legal issues resulting from physician response to unsolicited patient email inquiries. J Med Internet Res 2000; 2: e17.
  49. Terry NP. Cyber-malpractice: legal exposure for cybermedicine. Am J Law Med 1999; 25: 327–366.[Medline]
  50. Eysenbach G, Diepgen TL. Doctor, you’ve got e-mail [letter-reply]. JAMA 1999; 282: 730–731.
  51. Eysenbach G. Towards ethical guidelines for dealing with unsolicited patient emails and giving teleadvice in the absence of a pre-existing patient-physician relationship: systematic review and expert survey. J Med Internet Res 2000; 2: e1.
  52. Smith JJ, Berlin L. E-mail consultation. AJR Am J Roentgenol 2002; 179: 1133–1136.[Free Full Text]
  53. Rheingold H. The Virtual Community. New York: Harper Perennial Library, 1993.
  54. Wellman B. An electronic group is virtually a social network, in Kiesler S (ed). Cultures of the Internet. Mahwah, NJ: Lawrence Erlbaum, 1997; 179–205.
  55. Landro L. Alone together. Cancer patients and survivors find treatment–and support–online. It can make all the difference. Oncologist 1999; 4: 59–63.[Free Full Text]
  56. Klemm P, Reppert K, Visich L. A nontraditional cancer support group. The Internet. Comput Nurs 1998; 16: 31–36.[Medline]
  57. Sharf BF. Communicating breast cancer on-line: support and empowerment on the Internet. Women Health 1997; 26: 65–84.[Medline]
  58. Weinberg N, Schmale J, Uken J, Wessel K. Online help: cancer patients participate in a computer-mediated support group. Health Soc Work 1996; 21: 24–29.[Medline]
  59. Klemm P, Bunnell D, Cullen M, et al. Online cancer support groups: a review of the research literature. Comput Inform Nurs 2003; 21: 136–142.[Medline]
  60. Klemm P, Hurst M, Dearholt SL, Trone SR. Gender differences on Internet cancer support groups. Comput Nurs 1999; 17: 65–72.[Medline]
  61. Eysenbach G, Till JE. Ethical issues in qualitative research on internet communities. BMJ 2001; 323: 1103–1105.[Free Full Text]
  62. Han HR, Belcher AE. Computer-mediated support group use among parents of children with cancer–an exploratory study. Comput Nurs 2001; 19: 27–33.[Medline]
  63. White MH, Dorman SM. Online support for caregivers. Analysis of an Internet Alzheimer mailgroup. Comput Nurs 2000; 18: 168–176.[Medline]
  64. Culver JD, Gerr F, Frumkin H. Medical information on the Internet: a study of an electronic bulletin board. J Gen Intern Med 1997; 12: 466–470.[Medline]
  65. Mursch K, Behnke-Mursch J. Internet-based interaction among brain tumour patients. Analysis of a medical mailing list. Zentralbl Neurochir 2003; 64: 71–75.[Medline]
  66. Penson RT, Benson RC, Parles K, et al. Virtual connections: Internet health care. Oncologist 2002; 7: 555–568.[Abstract/Free Full Text]
  67. Forbriger A. Leben ist, wenn man trotzdem lacht. Diagnose Krebs - Wie ich im Internet Hilfe und Hoffnung fand. München: Heyne, 2001.
  68. Kraut R, Lundmark V, Patterson M, et al. Internet paradox: a social technology that reduces social involvement and psychological well-being? Am Psychol 1998; 53: 1017–1031.[Medline]
  69. Klemm P, Hardie T. Depression in Internet and face-to-face cancer support groups: a pilot study. Oncol Nurs Forum 2002; 29: E45–E51.[Medline]
  70. Fogel J, Albert SM, Schnabel F, et al. Internet use and social support in women with breast cancer. Health Psychol 2002; 21: 398–404.[Medline]
  71. Fogel J, Albert SM, Schnabel F, et al. Racial/ethnic differences and potential psychological benefits in use of the Internet by women with breast cancer. Psychooncology 2003; 12: 107–117.[Medline]
  72. Winzelberg AJ, Classen C, Alpers GW, et al. Evaluation of an Internet support group for women with primary breast cancer. Cancer 2003; 97: 1164–1173.[Medline]
  73. Kraut R, Kiesler S, Boneva B, et al. Internet paradox revisited. J Soc Issues 2002; 58: 49–74.
  74. Turner JW, Grube JA, Meyers J. Developing an optimal match within online communities: an exploration of CMC support communities and traditional communities. J Communic 2001; 51: 231–251.
  75. Manfredi C, Czaja R, Price J, et al. Cancer patients’ search for information. J Natl Cancer Inst Monogr 1993; 93–104.
  76. Turner S, Maher EJ, Young T, et al. What are the information priorities for cancer patients involved in treatment decisions? An experienced surrogate study in Hodgkin’s disease. Br J Cancer 1996; 73: 222–227.[Medline]
  77. Jones R, Pearson J, McGregor S, et al. Cross sectional survey of patients’ satisfaction with information about cancer. BMJ 1999; 319: 1247–1248.[Free Full Text]
  78. Jenkins V, Fallowfield L, Saul J. Information needs of patients with cancer: results from a large study in UK cancer centres. Br J Cancer 2001; 84: 48–51.[Medline]
  79. Silliman RA, Dukes KA, Sullivan LM, Kaplan SH. Breast cancer care in older women: sources of information, social support, and emotional health outcomes. Cancer 1998; 83: 706–711.[Medline]
  80. Derdiarian AK. Informational needs of recently diagnosed cancer patients. Nurs Res 1986; 35: 276–281.[Medline]
  81. Eysenbach G, Kohler C. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the Internet. Proceedings of the AMIA Annual Fall Symposium, 2003. In press.
  82. Search engine war: Yahoo is back according to OneStat.com. Available at http://www.onestat.com/html/aboutus_pressbox17.html. 2003. One Stat.com. Accessed September 3, 2003.
  83. Mills ME, Sullivan K. The importance of information giving for patients newly diagnosed with cancer: a review of the literature. J Clin Nurs 1999; 8: 631–642.[Medline]
  84. Mossman J, Boudioni M, Slevin ML. Cancer information: a cost-effective intervention. Eur J Cancer 1999; 35: 1587–1591.
  85. Annunziata MA, Foladore S, Magri MD, et al. Does the information level of cancer patients correlate with quality of life? A prospective study. Tumori 1998; 84: 619–623.[Medline]
  86. Mohide EA, Whelan TJ, Rath D, et al. A randomised trial of two information packages distributed to new cancer patients before their initial appointment at a regional cancer centre. Br J Cancer 1996; 73: 1588–1593.[Medline]
  87. Jones R, Pearson J, McGregor S, et al. Randomised trial of personalised computer based information for cancer patients. BMJ 1999; 319: 1241–1247.[Abstract/Free Full Text]
  88. Murray E, Lo B, Pollack L, et al. The impact of health information on the Internet on health care and the physician-patient relationship: National U. S. survey among 1,050 U. S. physicians. J Med Internet Res 2003; 5: e17.[Medline]
  89. McClung HJ, Murray RD, Heitlinger LA. The Internet as a source for current patient information. Pediatrics 1998; 101: E2.
  90. Eysenbach G, Powell J, Kuss O, Sa ER. Empirical studies assessing the quality of health information for consumers on the World Wide Web: a systematic review. JAMA 2002; 287: 2691–2700.[Abstract/Free Full Text]
  91. Shon J, Musen MA. The low availability of metadata elements for evaluating the quality of medical information on the World Wide Web. Proceedings of the AMIA Symposium, 1999, pp 945–949.
  92. Berland GK, Elliott MN, Morales LS, et al. Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA 2001; 285: 2612–2621.[Abstract/Free Full Text]
  93. Biermann JS, Golladay GJ, Greenfield ML, Baker LH. Evaluation of cancer information on the Internet. Cancer 1999; 86: 381–390.[Medline]
  94. Davison K. The quality of dietary information on the World Wide Web. Clin Perform Qual Health Care 1997; 5: 64.[Medline]
  95. Miles J, Petrie C, Steel M. Slimming on the Internet. J R Soc Med 2000; 93: 254–257.[Abstract/Free Full Text]
  96. Canto MT, Kawaguchi Y, Horowitz AM. Coverage and quality of oral cancer information in the popular press: 1987–98. J Public Health Dent 1998; 58: 241–247.[Medline]
  97. Eysenbach G, Köhler C. How do consumers search for and appraise health information on the World-Wide-Web? Qualitative study using focus groups, usability tests and in-depth interviews. BMJ 2002; 324: 573–577.[Abstract/Free Full Text]
  98. Edgar L, Greenberg A, Remmer J. Providing Internet lessons to oncology patients and family members: a shared project. Psychooncology 2002; 11: 439–446.[Medline]
  99. Campbell RJ, Harris KD, Wabby J. The Internet and locus of control in older adults. Proceedings of the AMIA Annual Fall Symposium, 2002, pp 96–100.
  100. White H, McConnell E, Clipp E, et al. A randomized controlled trial of the psychosocial impact of providing Internet training and access to older adults. Aging Ment Health 2002; 6: 213–221.[Medline]
  101. Eysenbach G. Infodemiology: the epidemiology of (mis)information. Am J Med 2002; 113: 763–765.[Medline]
  102. Matthews SC, Camacho A, Mills PJ, Dimsdale JE. The Internet for medical information about cancer: help or hindrance? Psychosomatics 2003; 44: 100–103.[Abstract/Free Full Text]
  103. Lawrence S, Giles CL. Accessibility of information on the Web. Nature 1999; 400: 107–109.[Medline]
  104. Cheetham PJ, Le Monnier KJ, Brewster SF. Attitudes and use of alternative therapies in UK prostate cancer patients–isn’t it time we were in the know? Prostate Cancer Prostatic Dis 2001; 4: 235–241.[Medline]
  105. Wilkinson S, Gomella LG, Smith JA, et al. Attitudes and use of complementary medicine in men with prostate cancer. J Urol 2002; 168: 2505–2509.[Medline]
  106. Hainer MI, Tsai N, Komura ST, Chiu CL. Fatal hepatorenal failure associated with hydrazine sulfate. Ann Intern Med 2000; 133: 877–880.[Abstract/Free Full Text]
  107. Bader JL, Strickman-Stein N. Evaluation of new multimedia formats for cancer communications. J Med Internet Res 2003; 5: e16.[Medline]