|Year : 2020 | Volume
| Issue : 4 | Page : 458-465
|Association of periodontitis with metabolic syndrome: A case-control study
Anuradha Sadanand Bandiwadekar1, Namita Shanbhag2, MS Madhuniranjanswamy3, Sanjeev Balappa Khanagar4, Sachin Naik5, Salman Siddeeqh6
1 Public Health Dentistry Department, PMNM Dental College and Hospital, Navanagar, Bagalkot, Karnataka, India
2 Public Health Dentistry Department, Government Dental College and Research Institute, Bengaluru, Karnataka, India
3 Community Dentistry, Penang International Dental College, Butterworth, Penang, Malaysia
4 Preventive Dental Science Department, College of Dentistry, King Saud Bin Abdulaziz University For Health Sciences, Riyadh, Saudi Arabia
5 Dental Biomaterials Research Chair, Dental Health Department, College of Applied Medical Sciences, King Saud University, Riyadh, Saudi Arabia
6 Maxillofacial Surgery and Diagnostic Science Department, College of Dentistry, King Saud Bin Abdulaziz University for Health Science, Riyadh, Saudi Arabia
|Date of Submission||28-Feb-2020|
|Date of Decision||22-Mar-2020|
|Date of Acceptance||23-Mar-2020|
|Date of Web Publication||30-Apr-2020|
Dr. Anuradha Sadanand Bandiwadekar
Public Health Dentistry Department, PMNM Dental College and Hospital, Navanagar, Bagalkot, Karnataka
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Aim: This study was undertaken to assess the association between periodontitis and metabolic syndrome. Materials and Methods: A case-control study was designed among 100 cases as patients with metabolic syndrome aged 35–74 years, and age- and sex-matched 100 controls as apparently healthy relatives or friends accompanying the cases visiting the diabetic outpatient department at Victoria Hospital, Bengaluru, Karnataka, India, using convenience sampling method. Information related to diabetes, hypertension, and oral hygiene practices was collected. Periodontal health status was measured using community periodontal index. Metabolic syndrome was diagnosed based on the criteria of National Cholesterol Education Program Adult Treatment Panel III. Chi-square test and logistic regression were used for analysis. Results: Significantly more number of cases had shallow pockets 4–5 mm, deep pockets ≥ 6 mm, and also more number of loss of attachment code 1, code 2, code 3, and code 4 compared to controls. Bivariate analysis showed significant association between metabolic syndrome and body mass index, smoking, and tobacco chewing. The association between periodontitis and metabolic syndrome was significant with increased risk of developing metabolic syndrome among the subjects with community periodontal index code 3 and code 4 (odds ratio [OR] = 17) and among the subjects having loss of attachment code 1, code 2, code 3, and code 4 (OR = 12). Association remained significant even after adjustment with other variables (adjusted OR = 6). Conclusion: This study showed significant association between periodontitis and metabolic syndrome. Further prospective and randomized control trials are recommended to assess causal association between these two diseases.
Keywords: Association, chronic periodontitis, metabolic syndrome, periodontal diseases, periodontitis
|How to cite this article:|
Bandiwadekar AS, Shanbhag N, Madhuniranjanswamy M S, Khanagar SB, Naik S, Siddeeqh S. Association of periodontitis with metabolic syndrome: A case-control study. J Int Soc Prevent Communit Dent 2020;10:458-65
|How to cite this URL:|
Bandiwadekar AS, Shanbhag N, Madhuniranjanswamy M S, Khanagar SB, Naik S, Siddeeqh S. Association of periodontitis with metabolic syndrome: A case-control study. J Int Soc Prevent Communit Dent [serial online] 2020 [cited 2020 Sep 22];10:458-65. Available from: http://www.jispcd.org/text.asp?2020/10/4/458/283654
| Introduction|| |
Metabolic syndrome (MetS) is defined as the combination of three out of five of the following interrelated conditions: increased plasma glucose, hypertension, dyslipidemia (elevated triglycerides and low levels of high-density lipoprotein [HDL]), and/or elevated abdominal circumference. Abdominal obesity, hypertension, and hyperglycemia are the most frequently occurring components of MetS. MetS is multifactorial disorder, also known by other names such as Reaven’s syndrome, insulin resistance syndrome, plurimetabolic syndrome, syndrome X, and the deadly quartet.
There has been an increase in the global prevalence of MetS. It has been reported to affect 10%–84% of the population worldwide and around 25% of the population in developed countries. Prevalence of MetS is high among Asians including Indians and is rising, particularly with the adoption of modernized lifestyle. Risk factors for MetS besides age include genetic predisposition, race, low household income, weight, particularly abdominal obesity, smoking, alcohol consumption, post‐menopausal status, carbohydrate-rich diet, physical inactivity, stress, and lifestyle.,
MetS is likened to an epidemic gripping the modern civilization. MetS has attracted immense clinical significance since the last two decades. It is a high-risk factor for several systemic diseases. MetS consists of such conditions that expose an individual to an elevated risk for development of cardiovascular disease (CVD) and type 2 diabetes mellitus and also claimed as risk factor for atherosclerotic CVD. These risk factors for CVD in MetS profoundly attribute to mortality worldwide.
Periodontal disease is a common, chronic, low-grade inflammatory disease of microbial origin, affecting humans and resulting in the destruction of tooth-supporting apparatus, and affects up to 90% of the global population.,
Periodontal diseases, considered as inflammatory diseases, have proved to have a spectrum of systemic implications. Periodontitis is a known risk factor for the deterioration of glycemic control over time. Periodontitis is becoming an important public health concern with different severity rates in individuals, synchronizing with other systemic conditions.
MetS and periodontitis are linked through common risk factors and pathways, sharing inflammation and oxidative stress/mitochondrial dysfunction mechanism as a common link. [1,8] Thus, chronic systemic inflammation accelerates an individual with periodontitis to develop MetS or vice versa. However, other studies reported different strengths of association, including tobacco, gender, and age as confounding factors while evaluating the association between MetS and periodontitis. A very little information is available on the association between periodontitis and MetS as a sole clinical entity in Indian population.
Thus, this study is justified by supplementary clarifications needed on the association between periodontitis and MetS in Indian population. The null hypothesis for this study is no association of periodontitis with MetS. Thus, the aim of this study was to examine the association between periodontitis and MetS in Bengaluru city, Karnataka, India.
| Materials and Methods|| |
Setting and design
A case-control study was designed with cases as patients with MetS and age- and sex-matched controls as apparently healthy relatives or friends accompanying the cases visiting the diabetic outpatient department at Victoria Hospital, Bengaluru, from August to September 2013. Ethical clearance was obtained from Institutional Ethical Committee and Review Board of Government Dental College and Research Institute, Bengaluru. (GDCRI/ACM/PG/Ph.D./10/2013–2014, 06/08/2013). All participants voluntarily participated and submitted a written informed consent.
A pilot study was conducted to check the feasibility of the study and to obtain an estimate for sample size determination. The prevalence of periodontitis was 95% with 80% of statistical power and 95% confidence interval; the sample size was calculated by: n = (Zα/2× p × q)/d2 where n = sample size, Z = standardized normal deviate (Z value), α = 5%, Zα/2 = 1.96, p = prevalence of periodontitis = 95%, q = 100 − p = 100 − 95 = 5%, d = precision (allowable error) = 4, n = [(1.96)2 × 95 × 5]/42 = 100.
On the basis of the pilot study, the total sample size for the study was calculated to be 100 cases and 100 controls. The subjects who qualified the inclusion/exclusion criteria and who were present on the day of the study were included in the sample. A prestructured proforma was designed to record the information regarding all the variables namely sociodemographic status, general and oral health-related behaviors, diet, and oral health status.
Inclusion criteria were patients with presence of at least three of the following five criteria: increased waist circumference, elevated plasma triglycerides, reduced HDL cholesterol, high blood pressure and elevated fasting glucose suggestive of MetS, minimum of 20 natural teeth during examination, patients with age group 35–74 years, and patients giving consent to participate in the study. Controls were selected without any syndrome with aforementioned other criteria.
Exclusion criteria were patients who have undergone periodontal therapy/oral prophylaxis past 6 months; the use of any antibiotics for >1 week in the last 6 months; diagnosis of cardiovascular, cerebrovascular, or kidney disease; or any known condition for which a prophylactic antibiotic treatment is required.
Study method and observational parameters
Cases were diagnosed with MetS based on the criteria of the National Cholesterol Education Program Adult Treatment Panel III (NCEP ATP III).
According to the definition proposed by NCEP ATP III, MetS is defined as the presence of at least three of the following five criteria: waist circumference >80cm in men and >90cm in women, elevated plasma triglycerides >1.7 mmol/L (150mg/dL), reduced HDL cholesterol below l mmol/L (40mg/dL) in men and 1.3 mmol/L (50mg/dL) in women, high blood pressure >130/85 mm Hg or antihypertensive drug treatment, elevated fasting glucose >5.5 mmol/L (100mg/dL), or hypoglycemic drug treatment.
Individuals’ medical data (NCEP ATP III criteria) were collected from medical records. Eligible individuals for cases consist of 35- to 74-year-old 100 subjects from both genders with an existed diagnosis of MetS. Eligible individuals for control consist of 100 subjects from both genders without MetS.
Periodontal status was assessed using a Community Periodontal Index (CPI) given by World Health Organization 1994.
One trained and calibrated dentist examined the periodontal status of all study participants.
The inter-rater reliability of the CPI index between two raters was kappa index of 0.82. The sample used was a convenient sample between August 2013 and September 2013. In this study, confounding was noted with respect to smoking and tobacco chewing habit. This was adjusted in analysis by doing logistic regression analysis. There was no drop out of study noted.
Descriptive analysis was carried out. The chi-square test was used to assess the association between categorical variables. A value of P <0.05 was accepted as indicating statistical significance. The sociodemographic and oral health variables were expressed as an odds ratio (OR) with a 95% confidence interval. To check the relationship between periodontitis, as independent variable, and other variables with MetS, a logistic regression analysis was performed. Data were entered in a standard Microsoft Excel 2007 sheet (Microsoft Corporation, Redmond, Washington, DC) and analyzed using SPSS, version 16.0, statistical package (SPSS Inc., Chicago, IL).
| Results|| |
Cases and controls included in this study were matched for age and gender. In this study, the age of study subjects ranged from 35 to 74 years with a mean age of 50.49 ± 8.85 among cases and 50.50 ± 8.88 among controls. The study group consisted of 50% males and 50% females in cases and control group, respectively.
There was a significant difference observed among the study groups with respect to the mean number of the sextants with CPI score 2, score 3, and score 4 (P < 0.05) [Table 1].
|Table 1: Distribution of the study subjects according to the mean number of sextants affected per person as per CPI codes|
Click here to view
There was a significant difference observed among the study groups with respect to the mean number of the sextants with loss of attachment (LOA) score 0, score 1, score 2, and score 3 (P < 0.05) [Table 2].
|Table 2: Distribution of the study subjects according to the mean number of sextants affected per person as per LOA codes|
Click here to view
In this study, there was statistically significant association between MetS and body mass index (BMI), smoking, and tobacco chewing. Preobese subjects were 30 (OR) times and obese were 85 (OR) times higher risk of developing MetS compared to normal subjects. Subjects with smoking were 6.7 (OR) times whereas subjects with tobacco chewing were 3 (OR) times higher risk of developing MetS compared to nonsmokers and non-chewers, respectively [Table 3].
|Table 3: Bivariate association between metabolic syndrome and risk factors of metabolic syndrome|
Click here to view
In this study, there was statistically significant association found between MetS and tooth mobility, CPI codes 3 and 4, and LOA codes 1, 2, 3, and 4. Strong association was found between subjects having periodontitis; that is, subjects with shallow pockets 4–5 mm and deep pockets ≥6 mm (CPI code 3 and code 4) had 17 (OR) times higher risk of developing MetS. Whereas among the subjects with LOA code 1, code 2, code 3, and code 4, risk of developing MetS was almost 12 (OR) times higher compared with the subjects having LOA code 0. Strength of association increased with increasing level of severity of periodontitis. Risk was 14 (OR) times higher among the subjects having shallow pockets 4–5 mm (CPI code 3) whereas risk was 28 (OR) times higher among the subjects having deep pocket ≥6 mm (CPI code 4). We also found significant association between mobile teeth and MetS with strength of association being 1.9 (OR) [Table 4].
|Table 4: Bivariate association between oral health variables and metabolic syndrome|
Click here to view
Variables that showed statistically significant results were considered for logistic regression analysis. Model showed that subjects with shallow and deep pockets (CPI codes 3 and 4) had 6.34 (OR) times and obese subjects had 37 (OR) times higher risk of developing MetS compared to subjects without periodontitis and nonobese, respectively. Subjects with mobile teeth had 0.2 (OR) times higher risk of developing MetS compared to subjects without mobile teeth (P <0.05), whereas among the subjects with LOA more than 3 mm (LOA codes 1, 2, 3, and 4) had almost 1.4 (OR) times increased risk of developing MetS compared to subjects with no LOA (P < 0.05) [Table 5].
|Table 5: Logistic regression analysis for study variables and metabolic syndrome|
Click here to view
| Discussion|| |
In this study, the CPI index was used as a measure of periodontal disease status.
Most of the studies have considered a wide age group ranging from 18 to 90 years.,,,,,,,,,,,,,, There was no difference among cases and controls regarding age as control group was matched for age, whereas Abdalla-Aslan et al. reported that patients with MetS were significantly older than without MetS. Han and Park showed that MetS increases with age; the association between periodontitis and MetS became higher in adults aged 45–49 years compared to younger adults aged 30–44 years (OR = 1.9).
In this study, cases and controls were matched for gender. This was similar to the previous studies. Kim et al. reported that severity of periodontitis in male patients with MetS was higher compared to that of females. Abdalla-Aslan et al. reported that males in the periodontitis group presented with OR of being diagnosed with MetS of 2.25. Tegelberg et al. reported that females in the periodontitis group showed greater ORs of 2.8 of being diagnosed with MetS, whereas males in the periodontitis group presented with ORs of being diagnosed with MetS of 1.6. Kim et al. reported that the prevalence of MetS was 44.3% in the male group and 36.9% in the female group.
A statistically significant difference was observed between cases against controls with regard to tobacco chewing and smoking. With its potential pathogenic properties, smoking is a risk factor for both CVD and periodontal disease. The results have shown that smokers are not significantly associated with MetS risk with an OR of 0.67. These results are similar to studies by Pham. Tegelberg et al. also found no significant association between smoking and MetS. However, Abdalla-Aslan et al. (OR = 3.05), Campos et al. (OR = 2.19), Kim et al. (OR = 1.35), and Jaramillo et al. (OR = 1.72) observed a significant association between smoking and MetS. In this study, tobacco chewing exhibited no significant association with MetS with an OR of 0.38. These results are similar to studies by Kumar et al. (OR = 1.30) who also found no significant association between tobacco chewing and MetS.
There was a significant difference observed among the study groups regarding BMI. This was in line with the previous studies., Obese subjects were higher risk of developing periodontitis compared to normal subjects. This was in line with the previous studies.,
There was no significant difference observed among the study groups regarding number of teeth present. Also number of teeth present was not significantly associated with MetS. There was almost 1.47 (OR) times increase in risk of developing MetS among subjects with 25–28 teeth compared to subjects with more than 28 teeth present. And subjects with 20–25 teeth had 1.75 (OR) times greater risk of developing MetS. Campos et al. showed that subjects with ≤14 teeth had 1.78 (OR) times greater risk of developing MetS.
Missing teeth exhibited no significant association with MetS in this study with OR of 0.36 whereas Musskopf et al. showed that MetS was associated with tooth loss (≥6 teeth) with OR of 1.23.
Patients with MetS had poor periodontal health compared to controls (periodontitis was present among 98% of the cases and 74% in controls). Results are in accordance with the findings of Han and Park (prevalence for periodontitis was 33.7%), Campos et al. (prevalence for periodontitis was 54.6%), and Nascimento et al. (prevalence for periodontitis was 14.3%), whose studies have also found periodontitis to be more common in patients with MetS compared to controls.
The significant crude OR for periodontitis (periodontal status index score 3 and 4) was 17, whereas the significant adjusted OR for periodontitis (periodontal status index score 3 and 4) was 6. Reports of study by Campos et al. (OR = 2.02), Kim et al. (OR = 1.42), Koo and Hong (OR = 1.12), Musskopf et al. (OR = 1.17), Jaramillo et al. (OR = 2.72), Pham (OR = 3.68), Nascimento et al. (OR = 0.11), Kumar et al. (OR = 2.64), and Tegelberg et al. (OR = 1.8) are comparable with this study results. Adachi and Kobayashi showed that there was no association between periodontitis and development of MetS. Gomes Abreu et al. concluded that the chronic inflammation is an important factor in the physiopathology underlying to these conditions and that local and systemic alterations initiated by the periodontal disease may contribute to a chronic inflammatory state, increasing the probability of developing MetS and CVD.
There was significant association between LOA code and MetS. Risk of developing MetS was 12 (crude OR) times higher among the subjects having LOA code 1, code 2, code 3, and code 4 compared to subjects having LOA code 0. These associations were found to be statistically significant, whereas the adjusted OR for LOA (LOA code 1, code 2, code 3, and code 4) was 1.4 compared to LOA code 0. These associations were not statistically significant. The study conducted by Musskopf et al. observed a significant association between LOA and MetS with an OR of 1.47 for mean attachment loss ≥2 mm, and Pham’s OR of 4.55 mean clinical attachment loss ≥3.66 can be comparable with our results.
Thus, this study shows the significant association between periodontitis and MetS. Hence, we reject null hypothesis.
A majority of the studies in this analysis indicated an elevated risk of MetS associated with periodontitis. The effect seems to be maintained even after controlling for other risk factors.
With both these diseases posing a major threat to health, it is only imperative that we prevent this web of causation by delinking this chain of events. With the fact that periodontal disease is a highly prevalent disease in community, if an increased risk of MetS is attributable to periodontal disease, then a substantial proportion of population will be at risk, with its implication for clinical practice.
Dental health measures have been focusing mainly on preserving the teeth and supporting structures or reducing further disease occurrences. The benefits of periodontal health in reducing the risk of MetS could be used as a potent additional motivating factor for some patients.
Although the current therapies used to manage periodontitis may be adequate to simultaneously manage systemic sequelae, dentists will need to assume a larger responsibility for the overall health of patients and eventually periodontal care may become a medical necessity.
Thus the following recommendations can be made based on this study:
Regular periodontal health check-up is required for individuals with MetS.
Screening and referral for patients with periodontitis and MetS in dental and health care settings, respectively, can help to improve the oral health as well as general health of patients.
Additional large-scale longitudinal and interventional studies are needed to establish whether periodontal disease is a contributing factor to or a result of MetS.
Future studies preferably longitudinal aimed at establishing the underlying causal factors.
Randomized controlled trials are required to determine whether treatment of periodontal disease reduces the risk of the MetS.
Oral health is determined by many factors such as dietary practices, oral hygiene practices, and habits such as smoking, alcohol, and stress. As these factors are common to a number of chronic diseases, adopting a collaborative approach is more rational than one that is disease specific. This common risk factor approach can help in further integration of the medical and dental fields.
Patients with MetS seem to have a higher risk for periodontitis and should be screened for periodontal disease. Oral health professionals in India should recognize the association between periodontitis and MetS, and the risk factors related to MetS. This study highlights for oral health professionals the clinical evidence of association between periodontitis and MetS. The prevention and treatment of periodontal disease that oral health professionals provide for patients may help reduce the risk or adverse effects of MetS. MetS must be taken into account by the oral health professionals when evaluating risk factors for periodontitis. Most of the medical health professionals are unaware of the consequences of periodontal disease on other systemic conditions. Medical health professionals can provide proper education and guidance in collaboration with the oral health professionals to contribute for oral health and eventually for the overall health of the patients.
Other confounding variables, for example, genetics, socioeconomic status, and hereditary, were not included in the study. The design of the study is such that the causal relationship between MetS and periodontitis cannot be identified.
| Conclusion|| |
Overall this study suggested an association between periodontitis and MetS. This association was strong and significant. Thus, the study further supports the concept that chronic inflammatory conditions such as periodontal disease may have a significant role in MetS.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
All authors listed have significantly contributed to the development and the writing of this article.
Ethical policy and institutional review board statement
The study was approved by the Government Dental College and Research Institute, Bangalore. Registered in August 2013 with number GDCRI/ACM/PG/Ph.D./10/2013–2014, 06/08/2013 and all the procedures have been performed as per the ethical guidelines laid down by Declaration of Helsinki (2000).
Patient consent statement
Consent was obtained from the patients who were included in the study. As we have not included minor patients so there is no consent from the parents.
Data availability statement
The entire data have been submitted to the journal in the form of tables and statistical evaluation in the article.
| References|| |
Campos JR, Costa FO, Miranda Cota LO Association between periodontitis and metabolic syndrome: A case-control study. J Periodontol2019;6:1-8.
Srivastava MC, Srivastava R, Verma PK, Gautam A Metabolic syndrome and periodontal disease: An overview for physicians. J Family Med Prim Care 2019;8:3492-5.
Gurav NA The association of periodontitis and metabolic syndrome. Dent Res J (Isfahan) 2014;11:1-10.
Kim JS, Kim SY, Byon MJ, Lee JH, Jeong SH, Kim JB Association between periodontitis and metabolic syndrome in a Korean nationally representative sample of adults aged 35–79 years. Int J Environ Res Public Health 2019;16:2930.
Tegelberg P, Tervonen T, Knuuttila M, Jokelainen J, Keinänen-Kiukaanniemi S, Auvinen J, et al
. Long-term metabolic syndrome is associated with periodontal pockets and alveolar bone loss. J Clin Periodontol 2019;46:799-808.
Kumar N, Bhardwaj A, Negi PC, Jhingta PK, Sharma D, Bhardwaj VK Association of chronic periodontitis with metabolic syndrome: A cross-sectional study. J Indian Soc Periodontol 2016;20:324-9.
Abdalla-Aslan R, Findler M, Levin L, Zini A, Shay B, Twig G, et al
. Where periodontitis meets metabolic syndrome-the role of common health-related risk factors. J Oral Rehabil 2019;46:647-56.
Pham T The association between periodontal disease severity and metabolic syndrome in Vietnamese patients. Int J Dent Hyg 2018;16:484-91.
Benguigui C, Bongard V, Ruidavets JB, Chamontin B, Sixou M, Ferrières J, et al
. Metabolic syndrome, insulin resistance, and periodontitis: A cross-sectional study in a middle-aged French population. J Clin Periodontol 2010;37:601-8.
WHO. Oral Health Surveys: Basic Methods. 4th ed. Geneva, Switzerland: World Health Organization; 1997.
Han K, Park JB Age threshold for moderate and severe periodontitis among Korean adults without diabetes mellitus, hypertension, metabolic syndrome, and/or obesity. Medicine (Baltimore) 2017;96:e7835.
Kim OS, Shin MH, Kweon SS, Lee YH, Kim OJ, Kim YJ, et al
. The severity of periodontitis and metabolic syndrome in Korean population: The Dong-gu study. J Periodont Res 2018;53:362-8.
Jaramillo A, Contreras A, Lafaurie GI, Duque A, Ardila CM, Duarte S, et al
. Association of metabolic syndrome and chronic periodontitis in Colombians. Clin Oral Investig 2017;21:1537-44.
Musskopf ML, Daudt LD, Weidlich P, Gerchman F, Gross JL, Oppermann RV Metabolic syndrome as a risk indicator for periodontal disease and tooth loss. Clin Oral Investig 2017;21:675-83.
Nascimento GG, Leite FRM, Peres KG, Demarco FF, Corrêa MB, Peres MA Metabolic syndrome and periodontitis: A structural equation modeling approach. J Periodontol 2019;90:655-62.
Koo HS, Hong SM Prevalence and risk factors for periodontitis among patients with metabolic syndrome. Metab Syndr Relat Disord 2018;16:375-81.
Adachi N, Kobayashi Y One-year follow-up study on associations between dental caries, periodontitis, and metabolic syndrome. J Oral Sci 2020;62:52-6.
Gomes Abreu LM, Lopes FF, Fátima AD, Pereira V, Pereira AA The interface between metabolic syndrome and periodontal disease. RSBO 2012;9:434-41.
Petrukhina NB, Zorina OA, Abaev ZM, Kartysheva EV, Saltovets MV [Influence of gender, age and metabolic factors on the course of chronic generalized periodontitis in patients with metabolic syndrome]. Stomatologiia (Mosk) 2019;98:31-6.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]
| Article Access Statistics|
| Viewed||357 |
| Printed||21 |
| Emailed||0 |
| PDF Downloaded||58 |
| Comments ||[Add] |