This was a validation study conducted at the Januário Cicco Maternity School in the city of Natal, Rio Grande do Norte, Brazil.

This study was submitted to and approved by the Research Ethics Committee of the University Hospital Onofre Lopes of the Federal University of Rio Grande do Norte (CAAE: 38145320.2.0000.5537). All research participants voluntarily agreed to participate and signed the free and informed consent form.

To develop the app, a research group consisting of 2 expert physiotherapists, 3 undergraduate students (one each from IT, physiotherapy, and graphic design), 2 physiotherapy professors, and 1 IT professor held weekly meetings throughout 2021. The app was constructed through database research; group discussions for knowledge translation; evidence-based content preparation and review of screen prototypes; implementation; and subsequent validation of content, functionality, and design.

The evaluation inclusion criteria for health professionals required experience in the obstetric health area and at least a specialist title, whereas the inclusion criteria for IT professionals required previous experience developing mHealth, React Native, or front-end software based on a previous study of mobile app validation. Postpartum women who had given birth at the Januário Cicco Maternity School and were still hospitalized in the institution were included, whereas the exclusion criteria were not agreeing to participate in the research or not signing the free and informed consent form.

A total of 80 participants were included: 39 professionals (24 health professionals with specialization in obstetrics and 15 IT professionals) and 41 postpartum women. The number of research participants was determined based on articles that use mHealth technology. It has been emphasized that there is no consensus in the international literature on the minimum number of judges, but there is agreement on the importance of clinical experience in the formation of a profile of expertise, as well as the need to balance clinical experience and solid academic training [9-12]. The participants were selected by convenience sampling according to previous research [13].

The app was developed using React Native, a JavaScript library created by Facebook (Meta Platforms Inc) to build mobile apps for the Android operating system. The development process consisted of 4 main stages, as illustrated in Figure 1.

The expert professionals were contacted via email or telephone and invited to participate in the study. They were provided with information about the research, and upon agreement, they signed the free and informed consent form. The professionals were given access to the app content, evaluated it, and provided feedback.

Postpartum women were approached in the ward, and after signing the free and informed consent form, they were given access to the app through a tablet provided by the evaluator for 20 minutes. After use, participants were requested to complete a form on the Google Forms platform using the tablet.

The process was divided into three stages: (1) evaluation of the content by health care professionals, (2) evaluation of the app’s appearance by IT professionals, and (3) usability assessment with postpartum women.

The content of the app was obtained through research in the main databases of Scientific Electronic Library Online, Science Direct, Cochrane, Web of Science, Scopus, and MEDLINE. The following Descriptors in Health Sciences and Medical Subject Headings were used: “Saúde da Mulher” (“Women’s Health” in Portuguese) and “Período Pós-Parto” (“Postpartum Period” in Portuguese).

Documents with up-to-date scientific evidence were selected. The content to be inserted in the app was discussed among the members of the research group, most of whom had experience in the area of women’s health. Subsequently, the information was transcribed into language that was easy for the target audience to understand.

The health professionals evaluated the content within the app using a Likert scale with responses ranging from 1 (strongly disagree) to 5 (strongly agree). The evaluated content themes are shown in Figure 2. The Content Validity Index was used to measure agreement on the scores given by specialists for each item, with a final score given as a percentage, which should be greater than 78% [8]. The evaluators with expertise in obstetrics participated in this stage.

The app’s appearance was evaluated through the User Experience Questionnaire with 6 questions: “Is the language used in the app easy to understand?” “Are the features used in the app implemented correctly?” “Are the features used in the app conducted comprehensively?” “Is the app interface attractive?” “Is the app easy to manage?” and “Does the app provide help in a non-tiring way?” The answers were measured using a Likert scale with 5 possible responses, as in the previous stage. IT professionals participated in this stage, and a minimum of 78% of positive responses was required for approval [6].

Postpartum women evaluated the usability of the application using the System Usability Scale (SUS), a questionnaire that has been translated and validated in Portuguese. It consists of 10 questions, with 5 positively worded statements and 5 negatively worded statements: “I think I would like to use this system frequently,” “I find the system unnecessarily complex,” “I found the system easy to use,” “I think I would need help from a person with technical knowledge to use the system,” “I think the various functions of the system are very well integrated,” “I think the system presents a lot of inconsistency,” “I imagine people will learn how to use this system quickly,” “I found the system clumsy to use,” “I felt confident using the system,” and “I had to learn a lot of new things before I could use the system.” The evaluators responded using a 5-point scale ranging from 1 (strongly disagree) to 5 (strongly agree). The overall score was then calculated on a scale from 0 to 100 points, with a cutoff point of 68 to consider the app as being usable [9,10]

The sample data were analyzed using the SPSS statistical software (version 20.0; IBM Corp) with a significance level of 5%. The Content Validity Index and User Experience Questionnaire score were calculated by summing up the values of the answers and presenting them as a percentage. The SUS score was calculated as follows: for odd items, 1 was subtracted from the position on the scale, and for even items, 5 was subtracted from the position on the scale; then, all items were summed and multiplied by 2.5 to obtain the overall usability score of the system.

Developing a technology to facilitate the acquisition of evidence-based content for a stage of life that brings countless doubts to women is of utmost relevance. This fact can be supported by the identification that such technologies are scarcely available in the main web stores and are not widely published in the major health journals [14].

The main objective of this study was not only to create an app about postpartum care but also to develop a technology that aligns with self-care for women, as empowering these women is essential to avoiding complications in the postpartum phase. As a refinement of this app, health professionals with extensive experience in obstetrics were able to give their opinion on the content, as well as find the necessary areas of improvement using their practical experience to determine what they perceive to be the main difficulties and doubts of puerperal women. Existing work in this area remains incomplete, with a limited sample size and a need of further investigation [15].

Knowledge translation is a means to communicate scientific evidence in an effortless way, with the objective of being effectively understood and applied in real life and influencing the creation of new products and technologies. In the context of education and health promotion, care should be taken regarding the adequacy of the language used to facilitate understanding. Popularly used words should preferably be used, and technical terms should be restricted to what is strictly necessary [12,16].

Learning is directly influenced by the social and cultural beliefs of the environment in which it is embedded, and therefore, the content of the app was selected with the aim of not disrespecting these issues. As a refinement, an attempt was made to adapt the guidance to all audiences without losing its scientific nature, which is supported by relevant literature. The content is presented not only in text but also in images to facilitate understanding.

According to literature, a SUS score above 68 indicates acceptable usability, whereas a score of 85 or above is related to excellent approval of software or applications. The mean SUS score for the Towards Motherhood app reached these parameters, as seen in a broad examination of the SUS [15,17].

Analysis of the SUS items showed greater variance in responses for “I think I would need help from a person with technical knowledge to use the system” and “I felt confident when using the system.” This result could be attributed to the low level of education of users, highlighting the need for simplified language, more images, and a dynamic app with less text. In terms of the appearance of the app, most technology professionals found it easy to manage and helpful but only partially agreed on its coverage and attractiveness. These points will be prioritized in future updates.

The Family Health Strategy is an ideal scenario for promoting the use of this tool since the health professionals in these teams aim to expand patient self-care and promote the accountability of care for the user [18]. The app also reinforces the information given by the multidisciplinary team in the hospital, as many women may be tired or focused on their newborn during postpartum visits and did not absorb the orientations well.

The positive results related to usability and potential for app use motivate future updates to improve functionality, update content, and add new features.

Audio and video content was suggested to be included in the app, but this would cause the app to not be compact and it would move away from the research proposal.

The Towards Motherhood mobile app is deemed to be a valid tool to promote self-care. Through the search in web stores and a literature review, no other app with a similar objective was found. In future updates, additional functions can be integrated into the app, and it can be translated into other languages to cater to a wider range of populations. A summary of this study is presented in Textbox 1.