Authors

1 PhD Candidate Reproductive Health, Student Research Committee, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

2 PhD of Nursing, Prof., in Nursing, Behavioral Sciences Research Center, Life style institute, Faculty of Nursing, Baqiyatallah University of Medical Sciences, Tehran, Iran.

3 PhD of Reproductive Health, Associate Professor, Midwifery & Reproductive Health research centre, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

4 Midwifery Expert of Shahid Rajaei Tonekabone Hospital, Student of Organizational Behavior Management, Mazandaran University of Medical Sceinces, Mazandaran, Iran.

Abstract

Background: Because of the impact of prenatal care on the health of mothers and children, improving the quality of prenatal care is necessary. Improving the quality of care is not possible without users' comments. The purpose of this study was, then, to evaluate the psychometrics of the Quality of Prenatal Care Questionnaire (QPCQ) among Iranian mothers.
Materials and Methods: The participants of this descriptive study comprised of 300 postpartum women, who were selected by convenience sampling method. After obtaining approval from the original tool designer, all of the participants were asked to complete the Persian version of QPCQ to achieve its construct validity. Confirmatory Factor Analysis (CFA) was computed to determine the construct validity, and Cronbach's alpha coefficient was calculated to determine the reliability and internal consistency; test-retest method was also performed to evaluate the repeatability using intra-class correlation coefficient (ICC).
Results: In the CFA test, the data had an acceptable fit (RMSEA = 0.048, CFI = 0.903, and IFI = 0. 904). Cronbach's alpha coefficient and ICC of the whole questionnaire were 0.883 and 0.822, respectively, which approved the reliability and stability of the Persian version of the instrument.
Conclusion: The study findings demonstrated that the Persian version of QPCQ enjoys satisfactory validity and reliability indices, which can be used as a suitable tool to assess and reveal the quality of prenatal care in Iran, in order to develop appropriate interventions in attenuated care.

Keywords

1- INTRODUCTION

Although infant mortality has been declining since 1990, there are still 2.5 million infant deaths around the world each year (1). The approximate number of 2 million prenatal deaths is really significant (2). Neonatal mortality and its general outcomes such as stillbirth, preterm birth, and low birth weight are important issues in the health system. It is, then, important to reduce the factors affecting such outcomes. Many adverse neonatal outcomes may stem from neglect or lack of attention to prenatal care, so that the prenatal care is the most effective factor in improving pregnancy outcomes. Hence, such care can considerably prevent adverse neonatal outcomes (3-7).

Prenatal care is a comprehensive and systematic care program that includes medical, psychological and social care of the pregnant mother; it begins before pregnancy and continues throughout pregnancy (8). The importance and role of prenatal care in high-risk pregnancies is more significant, especially since about 15-20% of pregnancies become high-risk (9, 10). The high-risk pregnancies include symptoms of hypertension, diabetes, anemia, blood incompatibilities ,and thyroid diseases, which are diagnosed by prenatal visits (11-16).

Diagnosis of high-risk pregnancies is the first step in preventing fetal and neonatal injury, which reduces subsequent neonatal outcomes, if performed during prenatal visits. In other words, high-quality and efficient care leads to early detection of high-risk women during care and the provision of solutions (14).

The prenatal care has two dimensions, quantity and quality. The quantity of care means the number of prenatal care performed according to gestational age and onset of first care (17). The quality of care refers to judging or evaluating the various dimensions of a service (18, 19). The quality of care is more important, as it strongly influences the outcomes (20). Neonatal survival rates can be increased by focusing on high-quality prenatal care, since poor care is associated with improved premature birth, low birth weight, and neonatal death (3, 6, 20).

If the prenatal care is of good quality, it can have a positive effect on improving neonatal outcomes and ultimately child outcomes; and vice versa, inefficient and poor quality care, in addition to failing to promote neonatal health and health indicators, causes loss of healthcare costs (21, 22). According to a study, the infant mortality was lower in women who received information about possible pregnancy complications during prenatal care, as well as blood pressure tests and tetanus vaccine injections. Moreover, various studies have reported an effective relationship between the quality of prenatal care and birth weight (22-25).

The services should be evaluated and monitored to improve the quality of care. Some indicators of prenatal care assessment include the Kessner Index (KI) and the Adequate Prenatal Care Utilization (APNCU); these indicators measure quantity, not quality (26).

The Donabedian model is widely used to assess healthcare quality. In this model, the service evaluation is based on structure, process, and outcome. According to the Donabedian model, the appropriate structure and process in the service quality assessment path leads to the desired outcome. The structural level includes material and human resources and organizational structure. Technical performance and interpersonal interaction are components of the process (27-29).

Although the Donabedian model is also used to assess the quality of prenatal care, it is not specific to pregnancy and is not considered a specific measurement tool for prenatal care. Since there is no single standard tool for measuring the quality of prenatal care, studies have used different tools for prenatal care monitoring; and, thus, it is difficult to compare the results of measurements with each other (30-34).

The Quality of Prenatal Care Questionnaire (QPCQ) is a tool designed according to Donabedian structures and existing guidelines for prenatal care. The QPCQ scale was developed by Maureen Heaman et al. (2014) in Canada and has been translated into many languages (35). The guidelines included in the design of the QPCQ were adapted from the World Health Organization, the Royal Australian and New Zealand College of Obstetricians and Gynaecologists, the National Institute for Health and Clinical Excellence, the Public Health Agency of Canada, the Society of Obstetricians and Gynaecologists of Canada (SOGC), Association the American College of Obstetricians and Gynecologists, and the American Academy of Pediatrics (35). The QPCQ has also been translated into Persian, but its validity and reliability have not been evaluated in Iran. As mentioned, the quality of prenatal care has an effective relationship with the neonatal health. Accordingly, measuring the quality of prenatal care is effective in improving the outcomes. The researchers in this study, hence, decided to evaluate the psychometric properties of the Persian version of QPCQ in this community in order to provide a valid tool available to caregivers, especially managers, by which the quality of prenatal care can be easily measured and revealed; and in consequence appropriate interventions in impaired care can be implemented.

    2- MATERIALS AND METHODS

    2-1. Study design and population

    The present descriptive study was conducted to investigate the psychometric properties of the Persian version of QPCQ. The research units were selected by Convenience sampling method in 2018 in Tonekabon County, Mazandaran Province, northern Iran. The statistical population of this study consisted of all married women in Tonekabon who had recently given birth. The sample size was estimated at 300 people, 5-10-sample per item (36, 37).

2-2. Measuring tools

Data collection tools in this study included the questionnaires of demographic characteristics (age, occupation, educational level, residence, number of pregnancies and insurance status) and the QPCQ. The QPCQ contains 46 items (questions) and 6 factors including information sharing, anticipatory guidance, sufficient time, approachability, availability, support, and respect. The QPCQ questions are answered on the basis of a 5-point Likert scale (strongly disagree; disagree; neither agree nor disagree; agree; strongly agree), and respondents express their views on the prenatal care received. For the QPCQ items, scores of 1 to 5 are respectively considered equivalent to strongly disagree, disagree, neither disagree nor agree, agree, and strongly agree, with the exception of items 8, 15, 23, 28 and 40, in which the score is 5 for strongly disagree, 4 for disagree, 3 for neither disagree nor agree, 2 for agree and 1 for strongly agree. The score of each factor is calculated in such a way that the obtained scores are added together and divided by the number of items forming that factor. The total score is obtained by summing the scores of all factors and dividing by 46 (35).

2-3. Ethical considerations

The research plan was approved at the Shahid Beheshti University of Medical Sciences with the code of ethics of (IR.SBMU.PHNM.1396.392). Prior to data collection, informed consent were obtained from the participants, while they had received complete explanations about the study objectives, and had been ensured the confidentiality of information. Written permission was first obtained from the original tool designer by sending an email prior to beginning the psychometric process of the QPCQ, after which the Persian version translated by the original tool designer was provided to the researcher.

2-4. Inclusion and exclusion criteria

The followings are the criteria to be met by the women of the population for being included in the study: having a healthy singleton birth in the past six weeks, being literate, having at least three prenatal visits, absence of mental and speech disorder to communicate with the researcher, and willingness to participate in the study. Unwillingness to continue participating in the study was considered as an exclusion criterion.

2-5. Data Analysis

To determine qualitative face validity, the questionnaire using a convenience sampling method was provided to 20 women who had just given birth and were economically and socially heterogeneous and did not constitute the main samples of the study. They were asked to express their views on the readability, clarity, and comprehensibility of the questions, writing style, and grammar in order to remove any conceptual ambiguity or writing objection.

Cronbach's alpha coefficient was used to determine the reliability and internal consistency of the questionnaire. It should be noted that an instrument will have suitable reliability when the Cronbach's alpha coefficient is greater than or equal to 0.7 (38).

The Temporal stability was tested by the test-retest method with an interval of two weeks. Therefore, the questionnaire was given to 30 women who were the main participants with an interval of two weeks, and the correlation between the scores of the two examinations was determined by the intra-class correlation coefficient (ICC).

This will be the most acceptable index for temporal stability, if it is more than 0.75 (39). At the end of these stages, the QPCQ was completed by 300 eligible women to determine its construct validity.

Confirmatory Factor Analysis (CFA) was used to assess the construct validity of the questionnaire to determine whether the questions intended to introduce the questionnaire agents really represent those factors; and how accurately they were introduced. In addition, the goodness of model fit was determined using fitness indexes, including the area covered by chi-square (x2), relative chi-square (x2│df), incremental fit index (IFI) and comparative fit index (CFI).

In this study, data were analyzed by SPSS version 23 and AMOS version 25 softwares using descriptive (to calculate the frequency and percentage of demographic characteristics of the samples) and inferential statistics.

3- RESULTS

     The age range of participants in this study was 15-46 years. Table 1 shows the demographic characteristics of the research units. The mean and standard deviation of the total score of prenatal care quality in this study was 3.56 ± 0.32, which indicates the moderate quality of prenatal care presented in Tonekabon. 

Moreover, the mean score of QPCQ sub-factors was in the range of 3.28 to 3.86 out of 5 points. The highest mean was related to the sub-factor of sufficient time, and the lowest mean was related to the sub-factor

of anticipatory guidance. The mean and standard deviation of the scores of each of the QPCQ sub-factors are shown in Table 2.

The CFA results showed a correlation between an item and the corresponding sub-factor through factor loading. As a contract, if the factor loading is less than 0.3, the correlation between the factor and the item is considered to be weak and it is better to delete the item, because it cannot explain the variable well (40).In the present study, the factor loading of all items of the Persian version of QPCQ using CFA was obtained to be over 0.3 (Table 3).

 The results of CFA with the aid of model fit indexes generally showed that the data of the present study are sufficiently fit (CMIN/DF =1.697, RMSEA = 0.048, CFI = 0.903, and IFI = 0. 904). the final construction of the model is shown in Figure 1.

In determining the reliability of QPCQ, the Cronbach's alpha coefficient for all items was found to be 0.883 and for the information sharing factor, anticipatory guidance, sufficient time, approachability, availability and support and respect, respectively 0.906, 0.899, 0.761, 0.818, 0.827, 0.907 were obtained and the total ICC was 0.822 that was optimal (Table 4).

 

4- DISCUSSION

The QPCQ is the first tool that comprehensively measures the quality of prenatal care and pays attention to the structure, technical performance, and interpersonal interaction in prenatal care. The original version of this questionnaire was designed in Canada (35) and was assessed for psychometrics among samples of Australian (2015) and French (2015) postpartum women living in Canada. The Brazilian version of this questionnaire was also reviewed for psychometrics by Nunes et al. in 2019 (41-43).

 

The psychometric results of the present study support the high level of validity and reliability of the Persian version of QPCQ. To determine the reliability in this study, the Cronbach's alpha coefficient for the whole instrument was found to be 0.883 and its range for each factor was between 0.761 and 0.907, which was over 0.7 similar to the Cronbach's alpha coefficient in the psychometric evaluation of the original Canadian version of the questionnaire (0.96), which is an acceptable value (35, 38). In the Australian, French, and Brazilian versions, the Cronbach's alpha coefficient was over the acceptable value, with a Cronbach's alpha coefficient of 0.97 in all three versions, which were consistent in this respect (41-43).

The ICC had been used to measure the stability of the questionnaire. In the present study, the ICC was 0.822, which was close to the original version (0.88), consistent in this respect (35). The ICC was also mentioned in the Brazilian version but is higher than in the present article (0.995), which may be related to the difference in the interval of repeatability in completing the questionnaires (43).

In this study, CFA verified and confirmed the presence of six factors. Various fitness indices were applied in the CFA results to assess the factor fitness.

However, the use of CFI is less affected by the number of samples in the study. The CFI is usually between 0 and 1, and the values greater than 0.9 indicate a good fit. In our study, the value of this index was 0.903, which was better compared to the Australian version (0.884). The value of RMSEA index reported in the French version was 0.06 and in the present study was 0.048. Comparison of the two studies shows that the RMSEA index of this study was better than its value in the French version (41, 42).

The mean and standard deviation of total prenatal care quality score in the present study was 3.56 ± 0.32, which was lower than that reported in the similar studies in Australia (4.11 ± 0.55) and France (4.41 ± 0.45) (41, 42).

Analyzing the results of the dimensions of quality of care, it seems that the anticipatory guidance has a lower score than other factors, which can indicate the weakness of caregivers' counseling with pregnant mothers. In a study by Simbar et al., to evaluate the quality of prenatal care, the status of counseling for pregnant mothers was not favorable (31). Therefore, in order to strengthen the quality of prenatal care and increase the satisfaction of clients in Iran, it is better to pay more attention to counseling and training in prenatal visits and to be monitored and evaluated by managers to improve the quality of care.

One of the strengths of this study is the psychometric evaluation of a comprehensive tool for quality control of prenatal care for the first time in Iran. Spatial constraint is one of the limitations of the present study, which made it difficult to generalize the results to all Iranian pregnant mothers. In order to ensure psychometrics, the tool needs to be examined in more diverse environments. Therefore, it is suggested that its validity and reliability should be examined in different cities.

5- CONCLUSION

The results of the present study showed that the Persian version of the Quality of Prenatal Care Questionnaire has an acceptable confirmatory factor analysis confirming the valid and reliable tool used to assess the quality of prenatal care in Iran.

6-ACKNOWLEDGMENTS

The current article has been adapted from the project approved by the Research Council of the Student Research Committee Shahid Beheshti University of Medical Sciences with registration number 11992. The authors would like to thank and appreciate the Student Research Committee, the Deputy of Research and Technology of the Shahid Beheshti University of Medical Sciences for supporting this study, as well as all the mothers who patiently completed the questionnaire.

7- CONFLICT OF INTEREST: None.

8- REFERENCES
1. Hug L, Alexander M, You D, Alkema L, for Child UI-aG. National, regional, and global levels and trends in neonatal mortality between 1990 and 2017, with scenario-based projections to 2030: a systematic analysis. The Lancet Global Health. 2019;7(6):e710-e20.
2. Lawn JE, Yakoob MY, Haws RA, Soomro T, Darmstadt GL, Bhutta ZA. 3.2 million stillbirths: epidemiology and overview of the evidence review. BMC pregnancy and childbirth. 2009;9(S1):S2.
3. Ryan Jr GM, Sweeney PJ, Solola AS. Prenatal care and pregnancy outcome. American Journal of Obstetrics and Gynecology. 1980;137(8):876-81.
4. Poma PA. Effect of prenatal care on infant mortality rates according to birth-death certificate files. Journal of the National Medical Association. 1999;91(9):515.
5. Malloy MH, Kao T-C, Lee Y. Analyzing the effect of prenatal care on pregnancy outcome: a conditional approach. American Journal of Public Health. 1992;82(3):448-50.
6. Krueger PM, Scholl TO. Adequacy of prenatal care and pregnancy outcome. Journal of the American Osteopathic Association. 2000;100(8):485.
7. Orvos H, Hoffmann I, Frank I, Katona M, Pál A, Kovács L. The perinatal outcome of pregnancy without prenatal care: A retrospective study in Szeged, Hungary. European Journal of Obstetrics & Gynecology and Reproductive Biology. 2002;100(2):171-3.
8. Cedars M, Euans M, Scott J, Gibbs R, KarLan B, Haney A. Danforth’s obstetrics and gynecolo-gy. 9th. Philadelphia: Lippincott Williams and Wilkins; 2003.
9. Levy-Shiff R, Lerman M, Har-Even D, Hod M. Maternal adjustment and infant outcome in medically defined high-risk pregnancy. Developmental psychology. 2002;38(1):93.
10. Conway KS, Deb P. Is prenatal care really ineffective? Or, is the ‘devil’in the distribution? Journal of Health Economics. 2005;24(3):489-513.
11. Wheeler FC, Gollmar CW, Deeb LC. Diabetes and pregnancy in South Carolina: prevalence, perinatal mortality, and neonatal morbidity in 1978. Diabetes Care. 1982;5(6):561-5.
12. Zhang J, Cai W-w, Lee DJ. Pregnancy-induced hypertension and early neonatal death: a case-control study. American journal of perinatology. 1993;10(05):401-3.
13. Kirkham C, Harris S, Grybowski S. Evidence-based prenatal care: Part I. General prenatal care and counseling issues. American family physician. 2005;71(7):1307-16.
14. CHEN XK, Wen SW, Yang Q, Walker MC. Adequacy of prenatal care and neonatal mortality in infants born to mothers with and without antenatal high‐risk conditions. Australian and New Zealand Journal of Obstetrics and Gynaecology. 2007;47(2):122-7.
15. Nazarpour S, Tehrani FR, Simbar M, Azizi F. Thyroid dysfunction and pregnancy outcomes. Iranian journal of reproductive medicine. 2015;13(7):387.
16. Pakniat H, Soofizadeh N, Movahed F. Association of The First Trimester Anemia and Fetal Birth Weight. scientific journal of ilam university of medical sciences. 2018;26(2):189-97.
17. Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Hamilton JD. Quality in Australian health care study. Medical Journal of Australia. 1996;164(12):754-.
18. Gotlieb JB, Grewal D, Brown SW. Consumer satisfaction and perceived quality: complementary or divergent constructs? Journal of applied psychology. 1994;79(6):875.
19. Vinagre MH, Neves J. The influence of service quality and patients' emotions on satisfaction. International journal of health care quality assurance. 2008.
20. Partridge S, Balayla J, Holcroft CA, Abenhaim HA. Inadequate prenatal care utilization and risks of infant mortality and poor birth outcome: a retrospective analysis of 28,729,765 US deliveries over 8 years. American journal of perinatology. 2012;29(10):787.
21. Schramm WF. Weighing costs and benefits of adequate prenatal care for 12,023 births in Missouri's Medicaid program, 1988. Public health reports. 1992;107(6):647.
22. Makate M, Makate C. The impact of prenatal care quality on neonatal, infant and child mortality in Zimbabwe: evidence from the demographic and health surveys. Health policy and planning. 2017;32(3):395-404.
23. Celik Y, Younis MZ. Effects of antenatal care services on birthweight: importance of model specification and empirical procedure used in estimating the marginal productivity of health inputs. Journal of medical systems. 2007;31(3):197-204.
24. Habibov NN, Fan L. Does prenatal healthcare improve child birthweight outcomes in Azerbaijan? Results of the national Demographic and Health Survey. Economics & Human Biology. 2011;9(1):56-65.
25. Awiti JO. A multilevel analysis of prenatal care and birth weight in Kenya. Health economics review. 2014;4(1):33.
26. Alexander GR, Kotelchuck M. Quantifying the adequacy of prenatal care: a comparison of indices. Public health reports. 1996;111(5):408.
27. Donabedian A. Evaluating the quality of medical care. The Milbank memorial fund quarterly. 1966;44(3):166-206.
28. Donabedian A. The quality of care: how can it be assessed? Jama. 1988;260(12):1743-8.
29. Campbell SM, Roland MO, Buetow SA. Defining quality of care. Social science & medicine. 2000;51(11):1611-25.
30. Lotfi R, Goshtasbi A. Using lot quality assurance sampling (LQAS) in prenatal care. Iran Journal of Nursing. 2004;17(39):8-14.
31. Simbar M, Nahidi F, Dolatian M, Akbarzadeh A. Assessment of quality of prenatal care in Shahid Beheshti Medical Science University centers. International Journal of Health Care Quality Assurance. 2012.
32. Tabatabaei SM, Pour FB, Mollashahi SS, Moakhar ZS, Zaboli M. The quality gap in the services provided by rural maternity units in Southeast of Iran. Health Scope. 2015;4(4).
33. Zahedi R, Rahmanian S, Kohpeima Jahromi V. Assessment the Quantity and Quality of Prenatal Care referred to Maternity and Obstetrics' Facility. Journal of Health Based Research. 2016;1(3):199-213.
34. Sarani M, Saravani S. Assessment of prenatal care process based on donabedian model in Zabol city. Journal of Pharmaceutical Sciences and Research. 2017;9(12):2558-63.
35. Heaman MI, Sword WA, Akhtar-Danesh N, Bradford A, Tough S, Janssen PA, et al. Quality of prenatal care questionnaire: instrument development and testing. BMC pregnancy and childbirth. 2014;14(1):188.
36. MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychological methods. 1999;4(1):84.
37. Munro BH. Statistical methods for health care research: lippincott williams & wilkins; 2005.
38. DeVon HA, Block ME, Moyle‐Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. Journal of Nursing scholarship. 2007;39(2):155-64.
39. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of chiropractic medicine. 2016;15(2):155-63.
40. Yong AG, Pearce S. A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in quantitative methods for psychology. 2013;9(2):79-94.
41. Sword W, Heaman M, Peterson WE, Salvador A, Akhtar-Danesh N, Bradford-Janke A. Psychometric Testing of the French Language Quality of Prenatal Care Questionnaire. Journal of nursing measurement. 2015;23(3):436-51.
42. Sword W, Heaman M, Biro MA, Homer C, Yelland J, Akhtar-Danesh N, et al. Quality of prenatal care questionnaire: psychometric testing in an Australia population. BMC pregnancy and childbirth. 2015;15(1):214.
43. Nunes RD, Parma GC, Campos ACd, Locatelli P, Traebert J. Cross-cultural adaptation and psychometric properties of the Brazilian-Portuguese version of the Quality of Prenatal Care Questionnaire (QPCQ). Revista de saude publica. 2018;53:01.