|Year : 2016 | Volume
| Issue : 5 | Page : 465-473
|Comparison of views on the need for continuing education on oral cancer between general dentists and oral medicine experts: A Delphi survey
S Leuci1, M Aria2, M Nicolo1, G Spagnuolo1, K Warnakulasuriya3, MD Mignogna1
1 Department of Neurosciences, Reproductive and Odontostomatological Sciences, University of Naples Federico II, Naples, Italy
2 Department of Economics and Statistics, University of Naples Federico II, Naples, Italy
3 Department of Oral Medicine, King's College, London Dental Institute, London, UK
|Date of Submission||27-Jul-2016|
|Date of Acceptance||07-Sep-2016|
|Date of Web Publication||24-Oct-2016|
Department of Neurosciences, Reproductive and Odontostomatological Sciences, Federico II University of Naples, Via Pansini 5, 80131 Naples
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Objectives: The role of dental professionals in screening for oral cancer has been limited. The purpose of this study was to investigate and compare the educational priorities of oral medicine specialists, general dental practitioners, and doctors of dental surgery with regards to the diagnosis and management of oral cancers and potential malignant disorders. Study Design: This was a longitudinal survey. Materials and Methods: A Delphi survey was directed to a panel of 25 oral medicine specialists asking them to identify the major difficulties in diagnosing and managing patients with oral cancer or suspected malignancy. In a second phase, two groups of generalists were asked to express their ratings on the issues identified by experts. Results: The response rate of the experts to the survey was 84%, while only 44% of the generalists participated. Although the three groups agreed on most of the issues, there were significant differences of opinions on 10 of the items proposed by specialists (P < 0.05 from the Kruskal–Wallis test), which were observed mainly between experts and general dental practitioners (P < 0.017 from the Mann–Whitney U test). The opinion of the participants about future investments in the field of education resulted in similar results (P > 0.05 from the Chi-square test), with the specialists ranking highest on mandatory annual thematic courses, while the generalists prioritizing more interactive and extensive pre-graduation courses on oral cancer detection. Conclusion: This study confirms a clear need to improve the educational foundation on oral cancer by a didactic process starting with pre-graduation courses that should involve National Health Care Services, National Dental Associations, and academia.
Keywords: Delphi survey, dental education, oral cancer, potential malignant disorders screening, prevention
|How to cite this article:|
Leuci S, Aria M, Nicolo M, Spagnuolo G, Warnakulasuriya K, Mignogna M D. Comparison of views on the need for continuing education on oral cancer between general dentists and oral medicine experts: A Delphi survey. J Int Soc Prevent Communit Dent 2016;6:465-73
|How to cite this URL:|
Leuci S, Aria M, Nicolo M, Spagnuolo G, Warnakulasuriya K, Mignogna M D. Comparison of views on the need for continuing education on oral cancer between general dentists and oral medicine experts: A Delphi survey. J Int Soc Prevent Communit Dent [serial online] 2016 [cited 2022 Aug 13];6:465-73. Available from: https://www.jispcd.org/text.asp?2016/6/5/465/192944
| Introduction|| |
Oral squamous cell carcinoma (OSCC) is a worldwide problem with increasing incidence and mortality rates affecting approximately 700000 people globally, and is within the first 10 most common cancers reported globally. Despite the diagnostic and therapeutic progresses, survival rates remain low except in few highly resourced cancer centers.,
Epidemiological data reported above have considerable impact on the economy of the public healthcare system, particularly due to a large number of cases presenting at late stages (III/IV) for cancer treatment.,
To date, the best management approach for this disease is early diagnosis, which ensures improved prognosis and has much less burden on the healthcare system. For these reasons, education and training play a pivotal role in enabling physicians in early diagnosis of OSCC; it is essential to examine the process of educational practice, to realize if teachers are providing what the learners really need, and if learners are getting the right messages from the current teaching practices.
The purpose of this study was to survey the views of oral medicine leading experts in Italy using the Delphi methodology, asking them to identify any difficulties that exist in the clinical diagnostic approach to patients presenting with OSCC or suspected of malignancies and any lack of education among general dental practitioners (GDPs) and oral surgery specialists (DDSs) which contributes to the late diagnosis of OSCC.
Subsequently, the same questionnaire was submitted to GDPs and DDSs in primary care to identify any significant differences between the three groups. We explored what is perceived by oral medicine experts and the particular items that reflect the real difficulties for GDPs and DDSs (if different from the experts) to determine the real needs throughout their field of training and education.
| Materials and Methods|| |
The study was developed in two phases [Figure 1]. In the first phase, a Delphi survey developed in four rounds was directed to a panel of experts who aimed to identify and prioritize the items related to OSCC diagnosis, management, and education issues. In the second phase, based on the responses of experts, we composed the survey and addressed similar questions to DDSs and GDPs. The results obtained from the three surveys were then statistically compared. The survey was approved by Institutional Review Board, Ethical Commitee, Federico II University of Naples (ID: 134/14).
A sample of 25 Italian specialists in oral medicine was selected.,,,,, The experts were full and associate professors and researchers with experience in the field of oral medicine. The level of experience was evaluated considering the number of scientific publications and years of clinical activity (at least 10 years). The participants were approached by e-mail with a letter of invitation.
The survey software was freely downloaded from a website (http://armstrong.wharton.upenn.edu/delphi2). The first round, was composed of 5 open-ended questions each of approximately 20–25 words [Table 1].,,,, The experts were asked to respond by giving a maximum of 5 suggestions for each question. From the second round, the experts were asked to grade their agreement about the items derived from the first round on a 6-point Likert scale (0 = strongly disagree, 5 = strongly agree). A “don't know” option was also available. An even-point Likert scale, without a neutral, was chosen because we wanted to force the experts to side, which is necessary to generate priority criteria in educational planning.
In the second round, we circulated two versions of the survey, one form with the questions arranged in the reverse order to determine if fatigue affected reliability of the survey. Both forms were analyzed using the Pearson's correlation coefficient. The alternate form reliability was estimated at 0.91, and thus results of only one form of the survey were used for the second round. The reliability of the survey was also evaluated by measuring the internal consistency through the Cronbach's Alpha, which was found to be 0.95.
To obtain a higher response rate, weekly email reminders were sent. To establish if consensus was reached, we set the following criteria:
- median ≥ 3.5 or ≤ 1.5;
- Interquartile range (IQR) ≤1;
- 80% of answer with a median ≥ 3 or ≤ 2.
For each item, at least 2 of the 3 criteria were expected to be fulfilled. As the responses to the questionnaire were expressed with ordinal data, descriptive statistics were considered more appropriate than mean and standard deviation.
At the end of the 4 rounds, the items without consensus were considered less influential on diagnostics and management difficulties of an OSCC patient and, consequently, were not circulated to GDPs and DDSs in Phase II.
We administered an anonymous questionnaire composed of the items prioritized by the Delphi panelists to GDPs and DDSs. The two groups were composed of 50 DDSs and 50 GDPs, randomly chosen among those graduated from 2000 to date. A database of all graduates was available for our use. The items from Phase I were replicated unchanged, excluding items that did not reach consensus. The participants were asked to respond on the same rating scale but were allowed to respond only once. At the end of Phase II, we asked the three groups to rank how they would recommend institutions to invest future funds in the field of education and training.
Statistical analysis encompassed the Kruskal–Wallis test for nonparametric data to globally compare globally the three groups, the Mann-Whitney U test for the pair-wise comparisons and the Chi-square test to compare rankings. Data being heteroskedastic, we performed a bootstrap by the Monte Carlo method., A dedicated software was used (Statistical Package for the Social Sciences version 19, IBM inc, USA). The level of significance was set at 0.05 and 0.017 in case of Bonferroni post-hoc correction.
| Results|| |
The study was completed in 7 months. The experts' response rate for the Delphi first round was 84% (21/25 participants), with a dropout of 10% and 5% for the second and the third rounds, respectively. From the first round, 193 comments were received, of which those found to be similar (n = 149) in their meaning were excluded. After categorization and selection of common themes, 44 items were generated and proposed to the experts for the following rounds [Table 2]. Six main themes were identified as follows: (1) clinical examination issues, (2) psychological difficulties in approaching the patient, (3) difficulties in communicating with the patient, (4) problems related to the clinical management, (5) adjunctive diagnostic tools, and (6) pre and post-graduation educational issues. At the end of Phase I, consensus was reached on 33/44 (75%) of the proposed items. Most of the 11 items on which experts did not agree were related to the clinical management of cancer or potential malignant disorders (e.g., biopsy issues, post-radiation complications); experts considered that such issues were not directly related to the generalists' clinical problems and educational needs. consequently, these items were not included in the questionnaire.
In Phase II, the response rate to the questionnaire was 44% (22/50 participants) for both of the 50 GDPs and 50 DDSs. At the end of the survey, the data from the three questionnaires were collected and analyzed [Table 3],[Table 4],[Table 5].
|Table 4: Pairwise comparisons between Experts, DDSs, GDPs by Mann-.Whitney U test|
Click here to view
|Table 5: How would you invest future funds to improve early diagnosis of OSCC?|
Click here to view
The three groups rated similarly (P < 0.05) for most of the items of the questionnaire (23/33), thus sharing the same views about clinical and educational needs on oral cancer detection [Table 3]. By the Kruskal–Wallis test, for 10 of the 33 items, statistically significant differences among median scores were detected. Subsequently, such items were further investigated comparing in a pair-wise manner for the three groups, using the Mann–Whitney U test; differences were found mainly comparing experts to GDPs, while views of experts and DDS were not significantly different [Table 4]. Experts' and nonexperts' opinions about how they would invest future funds in the field of education and training were further confirmed in the last question of the survey. Using the Chi-square test, the three groups gave similar priority to the available options (P < 0.05), with the specialists ranking highest on mandatory annual thematic courses, and the generalists prioritizing more interactive and extensive pre-graduation courses [Table 5].
| Discussion|| |
Much of today's dental education is based upon traditional didactic approaches, which are ineffective for the learning needs of GDPs or DDSs. This project was initiated considering the need for change, and hence improve dentists' knowledge about disorders managed by oral medicine experts and approaches to it, investigating the reasons that lie beyond the difficulties of early diagnosis of OSCC both in primary and secondary care. Numerous efforts in this direction have been made in recent years, however, the methodologies adopted have not been driven by recognized technology.,,, Using the Delphi method, it is possible to achieve this goal, encouraging opinion exchanges and sharing the responsibility of resolving certain issues.,
The major issue to be discussed is the early diagnosis, based on a widespread awareness of the signs and symptoms of the disease among the medical and dental professionals, on the acquisition of a clinical attitude that brings all the professionals to inspect oral mucosa systematically. The dentists' role is crucial for opportunistic screening because people undergo a dental examination at least once in their life and regular attendees do so at least twice a year.
As it concerns the present study, the high response rate to the Delphi survey (84%) in Phase I has been possible thanks to the “face-to-face” motivation to participate to the study, as well as the weekly reminders., Among experts' opinions, education and training on OSCC are very salient and debated issues, and one of the first targets to be achieved in the medical and dental undergraduate classes.
The low response rate of the nonexperts' questionnaires (44%) in Phase II is hard to understand, considering the participants were personally motivated to attend the survey, and one of the aims of the study was also to improve the training models of the pre- and postgraduate courses in which they are directly involved. It is likely that professionals took into account that replying to the questionnaire was too “time-consuming.” Dental school educational programs in Italy provide specific training modules on the primary and secondary prevention of OSCC, including anamnesis and examination of the oral mucosa, however, very often we are faced with dental graduates unprepared to make a proper “ first examination,” in approaching the patient and intercepting early oral precancerous lesions. This leads, on one hand, to question the traditional teaching methods in oral medicine and, on the other hand, reflects the “negligence” usually shown by professionals during patient examination. National annual mandatory free-cost courses in postgraduate training of oral medicine and pathology are strongly recommended and the Ministry of Education, Universities and Research should encourage this essential issue in the “lifelong learning programs,” improving practice through recommendations on scientific review.
From the Kruskal–Wallis test results [Table 3] it is evident that, for 10 out of 33 (30%) items, there is a statistically significant difference (P < 0.05) among the three groups. On the basis of the Mann–Whitney U test [Table 4], the differences (P < 0.017 after Bonferroni correction) are observed mainly comparing experts to GDPs. At the same time, it is comforting to note that, for 70% of the items, the three groups appear to share the same views on the majority of the issues related to the management, approach, diagnosis, and education on OSCC. This is encouraging when planning future education strategies.
Experts and nonexperts give different priority to certain aspects of the diagnostic, therapeutic, and psychological approach to the patient with OSCC.
Among the diagnostic difficulties, GDPs, while differing with the other two groups, believe to a lesser extent that recognizing a frank carcinoma from a potentially malignant lesion is a relevant issue (item 2). Similarly, both groups of nonexperts are less concerned than experts about a wait-and-see approach of mild dysplastic lesions (item 5); this is likely linked to the fact that nonexperts usually refer patients with potentially malignant disorders to specialists rather than follow-up them directly. The same could be said about biopsy management in case of widespread/multifocal lesions; GDPs, compared to DDSs and experts, who usually perform biopsies in their clinical practice and are well-conversed with biopsy techniques, do not give considerable relevance to this issue (item 13).
Another interesting observation is that both the groups of nonexperts reveal having emotional difficulties in the verbal communication with patients diagnosed with OSCC. The three groups agree on the need for support from a behavioral psychologist when they communicate with patients, and this is particularly true for nonexperts, who are less prepared to manage the fragility, anxiety, and fear of patients with OSCC (item 8–9).
On the contrary, GDPs and DDSs are not so concerned about the prosthetic rehabilitation of their patients who have undergone OSCC surgery (item 15).
In regards to the item 28, experts believe that adjunctive diagnostic tools such as optical instruments, which evaluate tissue fluorescence and chemiluminescence, are useful only to confirm the presence of an oral mucosal disorder, but are completely unable to discriminate high/low risk lesions.,, In contrast nonexperts consider the same tools to be a valid help. This opens ample food for thought because often such devices, marketed by commercial companies as infallible methods, up to date do not have enough scientific support, validating their sensitivity and specificity on a large case-series in primary care. Furthermore, experts appear significantly distant from oral surgeons in regards to the reliability of cytology compared to microbiopsy (item 30), considering it unreliable. More efforts should be made to educate nonexperts to the rational use of adjunctive diagnostic tools because histopathology is the only means to diagnosis. There is a difference between experts' and nonexperts' sense of possessing the necessary skills and employing them in daily practice. Nonexperts recognized this lack of knowledge and expressed their willingness to improve these skills by further training.
It is imperative that nonexperts be able to apply simple algorithms in the management of patients to practice a biopsy, if deemed appropriate, and to refer to more complex cases to the special centers. Biopsy is technically easy to perform as a surgical technique, however, it requires much experience to know when, how, and where do it correctly; therefore, it is challenging to a practitioner with limited skills or working single-handed in their practices.
For what concerns the education, the experts believe that the current system of postgraduate training is insufficient to ensure adequate preparation; highlighting the need for suggesting mandatory annual courses (item 35). GDPs, instead, clearly express their will to attend more actively oral medicine units (item 39). As confirmed by Broomfield et al., nonexperts ascribe their difficulty to manage patients affected by potential malignant disorders and/or OSCC to the need of clinical training and of a more interactive way of learning rather than to own cultural problems.,
More practical sessions are needed giving the learners the possibility to develop skills in clinical reasoning, either talking directly with patients or through problem-based learning (PBL) in working groups. For this purpose, we ended the study by asking the three groups to rank how they would recommend to invest future funds in the field of education and training [Table 5]. The Chi-square test results clearly shows (P > 0.05) that participants would invest funds in undergraduate courses involving more activity by the trainees (e.g., PBL) in a higher attendance at oral medicine units, as well as for attending national/regional mandatory annual thematic meetings. Postgraduation courses and masters were chosen with a lower frequency maybe because, being optional, they have no wide spread acceptance among dental professionals. In addition, only experts have given priority to the development of a residency in oral medicine, which would create a larger number of reference centers on the territory but would not directly improve screening skills programs for GDPs on a large scale.
Targeted policies and strategies should be promoted by competent organizations, such as the NHS and the national dental associations, in order to make people aware of the possibility that no one is immune to mouth cancer.
This survey has some limitations. The first is related to the small number of respondents among the groups of nonexperts, and hence, the results may not reflect the average population but only that of the individuals most interested in the project. The second is tied to the fact that the experts, unlike nonexperts, have had the opportunity to evaluate the items of the questionnaire in subsequent rounds, which may have generated distortions at the time of the comparison between the groups. It is worth noting that, if the Delphi method is applied to nonexperts, agreement is the result of conformity to the general average, more than a constructive exchange of views on the basis of feedback received from other participants. Finally, it would have been interesting to explore the opinions of patients diagnosed with OSCC, which are pivotal to understand the phenomenon of “diagnostic delays” and to understand healthcare priorities of who is going to receive the care, but this was not the purpose of the present study.,
The authors wish to thank the following colleagues who kindly accepted to help us starting this survey: Dr. Abati Silvio, Dr. Biasotto Matteo, Dr. Campisi Giuseppina, Dr. Carbone Mario, Dr. Carrassi Antonio, Dr. Colella Giuseppe, Dr. Di Lenarda Roberto, Dr. Favia Gianfranco, Dr. Ficarra Giuseppe, Dr. Gandolfo Sergio, Dr. Giuliani Michele, Dr. Lajolo Carlo, Dr. Lo Muzio Lorenzo, Dr. Lo Russo Lucio, Dr. Lodi Giovanni, Dr. Majorana Alessandra, Dr. Manfredi Maddalena, Dr. Meleti Marco, Dr. Montebugnoli Lucio, Dr. Pentenero Monica, Dr. Sardella Andrea, Dr. Spadari Francesco, and Dr. Vescovi Paolo.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Warnakulasuriya S. Living with oral cancer epidemiology with particular reference to prevalence and life-style changes that influience survival. Oral Oncol 2010;46:407-10.
Monteiro LS, Antunes L, Bento MJ, Warnakulasuriya S. Incidence rates and trends of lip, oral and oro-pharyngeal cancers in Portugal. J Oral Pathol Med 2013;42:345-51.
Güneri P, Epstein JB. Late stage diagnosis of oral cancer: Components and possible solutions. Oral Oncol 2014;50:1131-6.
Van Agthoven M, Van Ineveld BM, De Boer MF, Leemans CR, Knegt PP, Snow GB, et al
. The costs of head and neck oncology: Primary tumors, recurrent tumours and long-term follow-up. Eur J Cancer 2001;37:2204-11.
Hasson F, Keeney S, Mckenna H. Research guidelines for the Delphi survey technique. J Adv Nurs 2000;32:1008-15.
McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm 2016;38:655-62.
Baker J, Lovell K, Harris N. How expert are the experts? An exploration of the concept of 'expert' within Delphi panel techniques. Nurse Res 2006;14:59-70.
Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al
. Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol 2014;67:401-9.
Cramer CK, Klasser GD, Epstein JB, Sheps SB. The Delphi process in dental research. J Evid Based Dent Pract 2008;8:211-20.
Mullen P. Delphi: Myths and reality. J Health Organ Manag 2003;17:37-52.
Keeney S, Hasson F, McKenna H. Consulting the oracle: Ten lessons from using the 12. Delphi technique in nursing research. J Adv Nurs 2006;53:205-12.
Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud 2001;38:195-200.
Salancik JR, Wenger W, Helfer E. The construction of Delphi event statements. Technol Forecast Soc Change 1971;3:65-73.
Ruxton GD, Beauchamp G. Some suggestions about appropriate use of the Kruskal–Wallis test. Animal Behav 2008;76:1083-7.
Reiczigel J, Land Z, Rozsa L, Tothmerez B. Measures of sociality: Two different views of group size. Animal Behav 2008;75:715-21.
Carter LM, Ogden GR. Oral cancer awareness of undergraduate medical and dental students. BMC Med Educ 2007;7:44.
Rahman B, Hawas N, Rahman MM, Rabah AF, Al Kawas S. Assessing dental students' knowledge of oral cancer in the United Arab Emirates. Int Dent J 2013;63:80-4.
Colella G, Gaeta GM, Moscariello A, Angelillo IF. Oral cancer and dentists: Knowledge, attitudes, and practices in Italy. Oral Oncol 2008;44:393-9.
Horowitz AM, Drury TF, Canto MT. Practices of Maryland dentist: Oral cancer prevention and early detection-baseline data from 1995. Oral Dis 2000;6:282-8.
Turoff M, Linstone HA. The Delphi method techniques and applications. Reading, MA: Addison-Wesley; 1975.
McKenna HP. The Delphi technique: A worthwhile approach for nursing? J Adv Nurs 1994;19:1221-5.
Swinscow TD, Campbell MJ. Statistics at Square One. 10th
Ed. London: BMJ Books; 2002. p. 168.
Awan KH, Morgan PR, Warnakulasuriya S. Evaluation of an autofluorescence based imaging system (VELscope) in the detection of oral potentially malignant disorders and benign keratoses. Oral Oncol 2011;47:274-7.
Awan KH, Morgan PR, Warnakulasuriya S. Utility of chemiluminescence (ViziLite ™
) in the detection of oral potentially malignant disorders and benign keratosis J Oral Pathol Med 2011;40:541-4.
Rashid A, Warnakulasuriya S. The use of light-based (optical) detection systems as adjuncts in the detection of oral cancer and oral potentially malignant disorders: A systematic review. J Oral Pathol Med 2015;44:307-28.
Broomfield D, Humphris GM. Using the Delphi technique to identify the cancer education requirements of general practitioners. Med Educ 2001;35:928-37.
Welch DR, Antalis TM, Burnstein K, Vona-Davis L, Jensen RA, Nakshatri H, et al
. Essential Components of Cancer Education. Cancer Res 2015;75:5202-5.
Greatorex J, Dexter T. An accessible analytical approach for investigating what happens between the rounds of a Delphi study. J Adv Nurs 2000;32:1016-24.
Efstathiou N, Coll AM, Ameen J, Daly W. Do Greek healthcare users and healthcare providers share cancer care priorities? Analysing the results from two Delphi studies. Eur J Cancer Care 2011;20:179-86.
Grant L, Silver K, Bauld L, Warnakulasuriya S. The experiences of young oral cancer patients in Scotland; Symptom recognition and delays in seeking professional help. Br Dent Journal 2010;208:465-71.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]
|This article has been cited by|
||Dentists’ Perception of Oral Potentially Malignant Disorders
| ||Bassel Tarakji |
| ||International Dental Journal. 2022; |
|[Pubmed] | [DOI]|
||The readiness of dentists to use the autofluorescence method
| ||A. A. Rykhlevich, Ya. P. Sandakov, A. V. Kochubey, V. V. Kochubey |
| ||Acta Biomedica Scientifica. 2021; 6(4): 192 |
|[Pubmed] | [DOI]|
||The influence of subject learning on the skills of decoding autofluorescent images of the oral mucosa
| ||A. A. Rykhlevich, Ya. P. Sandakov, A. V. Kochubey, V. V. Kochubey |
| ||Acta Biomedica Scientifica. 2021; 6(5): 157 |
|[Pubmed] | [DOI]|
||Current Knowledge, Attitudes, and Practice among Health Care Providers in OSCC Awareness: Systematic Review and Meta-Analysis
| ||Noemi Coppola,Michele Davide Mignogna,Immacolata Rivieccio,Andrea Blasi,Maria Eleonora Bizzoca,Roberto Sorrentino,Lorenzo Lo Muzio,Gianrico Spagnuolo,Stefania Leuci |
| ||International Journal of Environmental Research and Public Health. 2021; 18(9): 4506 |
|[Pubmed] | [DOI]|
||May VelScope Be Deemed an Opportunistic Oral Cancer Screening by General Dentists? A Pilot Study
| ||Stefania Leuci,Noemi Coppola,Anna Turkina,Maria Eleonora Bizzoca,Gianfranco Favia,Gianrico Spagnuolo,Michele Davide Mignogna |
| ||Journal of Clinical Medicine. 2020; 9(6): 1754 |
|[Pubmed] | [DOI]|
||Atención odontológica de pacientes oncológicos desde la perspectiva de actores institucionales en Cali, Colombia, 2019.
| ||Dora Ordońez,Karoll Osorio Ruiz,Freddy Moreno |
| ||Acta Odontológica Colombiana. 2020; 10(1) |
|[Pubmed] | [DOI]|
||Case Reports in Pediatric Dentistry Journals: A Systematic Review about Their Effect on Impact Factor and Future Investigations
| ||Romeo Patini,Edoardo Staderini,Andrea Camodeca,Federica Guglielmi,Patrizia Gallenzi |
| ||Dentistry Journal. 2019; 7(4): 103 |
|[Pubmed] | [DOI]|
||Evidence of past dental visits and incidence of head and neck cancers: a systematic review and meta-analysis
| ||Bhawna Gupta,Narinder Kumar,Newell W. Johnson |
| ||Systematic Reviews. 2019; 8(1) |
|[Pubmed] | [DOI]|
| Article Access Statistics|
| Viewed||2592 |
| Printed||53 |
| Emailed||0 |
| PDF Downloaded||190 |
| Comments ||[Add] |
| Cited by others ||8 |