International Journal of Environmental Research and Public Health (MDPI)
2004 | 525,942,120 words
The International Journal of Environmental Research and Public Health (IJERPH) is a peer-reviewed, open-access, transdisciplinary journal published by MDPI. It publishes monthly research covering various areas including global health, behavioral and mental health, environmental science, disease prevention, and health-related quality of life. Affili...
Development, Implementation and First Evaluation of an Online Portal to...
Caroline Lutz-Kopp
Mental Health Services for Students, Johannes Gutenberg University, 55122 Mainz, Germany
Ursula Luka-Krausgrill
Mental Health Services for Students, Johannes Gutenberg University, 55122 Mainz, Germany
Bettina Honsbrok
Mental Health Services for Students, Johannes Gutenberg University, 55122 Mainz, Germany
Bozana Meinhardt-Injac
Department of Psychology, Catholic University of Applied Sciences Berlin, 10318 Berlin, Germany
Maria Gropalis
Mental Health Services for Students, Johannes Gutenberg University, 55122 Mainz, Germany
Download the PDF file of the original publication
Year: 2021 | Doi: 10.3390/ijerph18031179
Copyright (license): Creative Commons Attribution 4.0 International (CC BY 4.0) license.
[Full title: Development, Implementation and First Evaluation of an Online Portal to Promote the Mental Health of University Students (me@JGU)]
[[[ p. 1 ]]]
International Journal of Environmental Research and Public Health Article Development, Implementation and First Evaluation of an Online Portal to Promote the Mental Health of University Students (me@JGU) Caroline Lutz-Kopp 1, *, Ursula Luka-Krausgrill 1,† , Bettina Honsbrok 1 , Bozana Meinhardt-Injac 2 and Maria Gropalis 1 Citation: Lutz-Kopp, C.; Luka-Krausgrill, U.; Honsbrok, B.; Meinhardt-Injac, B.; Gropalis, M Development, Implementation and First Evaluation of an Online Portal to Promote the Mental Health of University Students (me@JGU) Int. J Environ. Res. Public Health 2021 , 18 , 1179. https://doi.org/10.3390/ ijerph 18031179 Academic Editor: Claudia Buntrock Received: 22 December 2020 Accepted: 25 January 2021 Published: 28 January 2021 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations Copyright: © 2021 by the authors Licensee MDPI, Basel, Switzerland This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/) 1 Mental Health Services for Students, Johannes Gutenberg University, 55122 Mainz, Germany; luka-krausgrill@t-online.de (U.L.-K.); bettina.honsbrok@uni-mainz.de (B.H.); maria.gropalis@uni-mainz.de (M.G.) 2 Department of Psychology, Catholic University of Applied Sciences Berlin, 10318 Berlin, Germany; bozana.meinhardt-injac@khsb-berlin.de * Correspondence: caroline.lutz-kopp@uni-mainz.de † This co-author is retired now Abstract: Background: University students encounter various stressors such as exam preparation, workload and economic concerns. Having to deal with a multitude of stressors can lead to mental health problems and have a negative impact on academic outcomes in students attending university This paper describes the development and usability evaluation of an open and easily accessible online portal (me@JGU) designed to help students build skills they need to cope with common stressors and manage their own mental health. Methods: We developed a website that addresses the most common stressors among university students and offers strategies for dealing with difficult situations. Initial evaluation results were collected using website statistics and a short anonymous survey regarding the attractiveness and usability of the website. Results: Over an eight-month period, there were 5739 visitors, a total of 16,495 page views and 3748 downloads. The survey results indicate that me@JGU covers relevant topics and that the students like the layout. Conclusions: Online interventions promoting mental health of university populations are easily accessible and cost effective for large populations. They may prevent study difficulties, inform students about mental health and offer possible solutions. In addition, at-risk students can receive information about other relevant resources, and feel encouraged to access support and treatment Keywords: mental health in university students; online unguided self-help; prevention; resilience; online portal 1. Introduction The time spent at university is an important developmental phase and holds many challenges for the students transitioning from adolescence to young adulthood [ 1 ]. For some years now, increasing attention has been drawn to the psychological stress on students. Studies using quantitative measures such as self-report inventories consistently report exams, assignments and workload, financial pressures as well as transitioning to university as typical stressors experienced by students (for an overview see [ 2 ]). A review on qualitative research concerning college student stressors found eight major categories: relationships (e.g., family, peer, faculty), lack of resources (e.g., time, money, support), living up to expectations, academic themes (e.g., coursework, exams), environment (e.g., unfamiliar), diversity (e.g., ethnicity, disability) and transitioning to the university setting [ 3 ]. A nationwide online survey at German universities with 18,214 participants identified exams, assignments, workload and meeting one’s own expectations as most common stressors among higher education students [ 4 ]. Additionally, struggling to organize university life and to have a good “study-life balance” were referred to as important stressors Int. J. Environ. Res. Public Health 2021 , 18 , 1179. https://doi.org/10.3390/ijerph 18031179 https://www.mdpi.com/journal/ijerph
[[[ p. 2 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 2 of 15 According to a study by Gusy and colleagues [ 5 ], the demands of studying in Germany include a high workload, poorly designed study programs and environments, as well as weak relationships with other students. Resources in studies, on the other hand, include social support and feedback on work results. In a university-wide online survey at the Johannes Gutenberg University Mainz (JGU) with more than 2400 participants, 24% of the students reported a high level of exhaustion, 55% had a remarkably low level of well-being and 58% reported a low level of stress resistance [ 6 ]. Chronic stress can be a trigger for mental disorders [ 7 – 10 ]. In the context of the WHO World Mental Health International College Student Initiative (WMH-ICS), which aims at developing an infrastructure to examine and improve the mental health of college students around the world [ 11 ], a recent cross-national study including 20,842 students from 24 universities in nine countries found a significant dose–response association between the extent of perceived stress and increased probability of having a mental disorder [ 12 ]. Another study of the WMH-ICS using self-report measures found that 31% of students fulfilled the criteria of being afflicted by a mental disorder in the last 12 months [ 13 ]. In Germany, according to health insurance company data, about 17–22% of students suffer from a mental disorder [ 14 , 15 ]. Matching these results, the number of clients at the Mental Health Services for Students at JGU has been rising continuously over the last years despite decreasing student numbers (2007: 548 to 2019: 910; [ 16 ], total number of students: approximately 31,300) Having a mental disorder can lead to a reduced ability to perform and study, which could result in interruptions, delays and even discontinuation of studies [ 17 – 20 ]. College students with mental disorders are twice as likely as other students to drop out without graduating [ 21 – 23 ]. Additionally, a substantial proportion of the students with mental disorders who continue their studies experience a negative impact on academic performance due to their mental problems [ 24 – 27 ]. In order to help students to complete their studies successfully, the promotion of their mental health is of particular importance to the universities’ counseling centers. Using internet-based interventions to treat various mental disorders (e.g., [ 28 – 30 ]) as well as to promote mental health for different psychological problem areas has been successfully implemented for the general population [ 31 ]. Programs directed at reducing students’ distress and promoting mental health typically include psychoeducation and exercises on the topics of activity and mood, motivation, dealing with thoughts and feelings, social relationships, stress management, perfectionism and self-esteem (for an overview, see [ 32 ]). Various randomized-controlled trials have shown them to be effective in reducing distress in college students [ 32 – 37 ]. Two recent systematic reviews and meta-analyses have yielded small to moderate intervention effects [ 32 , 33 ]: The study by Amanvermez and colleagues (2020) found a significant moderate effect size for stress management interventions for students with high-stress levels ( g = 0.54; 95% CI (0.31, 0.78); p < 0.001), a small to-moderate effect size for depression ( g = 0.46; 95% CI (0.16, 0.77); p = 0.003), a moderate-to-large effect for stress ( g = 0.61; 95% CI (0.30, 0.93); p < 0.001), and a moderate effect for anxiety ( g = 0.52; 95% CI (0.25, 0.78); p < 0.001; [ 33 ]). Harrer et al. [ 32 ] evaluated internet interventions for mental health in college students, and report small effects on depression ( g = 0.18, 95% confidence interval (CI (0.08, 0.27)), anxiety ( g = 0.27, 95% CI (0.13, 0.40)), and stress ( g = 0.20, 95% CI (0.02, 0.38)) Another important advantage of web-based interventions is that they are easily accessible, and cost effective for large populations However, the transferability of the results to naturalistic settings, such as routine care programs, has not yet been studied The aim of this study was to develop an open and easily accessible online portal (me@JGU) to promote student’s mental health by helping them deal with common college students’ stressors. This website is meant specially to promote the students’ resources and self-help skills by teaching strategies for dealing with difficult (study-relevant) situations and critical life events. The strategies are all based on cognitive-behavioral therapy.
[[[ p. 3 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 3 of 15 This article presents the development and implementation of the online portal (me@JGU) as well as the first evaluation results 2. Materials and Methods 2.1. Background and Scope of the Project The Mental Health Services for Students at JGU are open to all university’s students and are free of charge. We provide professional psychotherapeutic help in dealing with specific problems that may occur during studies (e.g., depressive symptoms, writing difficulties, test anxiety, stress). We applied for and realized me@JGU as a subproject within the university-wide LOB (“Lehren-Organisieren-Beraten”) project at JGU. The LOB project was funded by the Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung) and ran from 2017 until the end of 2020. It developed measures in three fields of action—teaching, organizing, advising—that focus on a sustainable improvement of study conditions. The aim was to support students in completing a successful course of study in terms of competence acquisition, personal development and the achievement of formal qualifications. It was a university-wide networked project with 30 individual projects in 9 departments and 10 central institutions 2.2. Development: Website Creation We named the website “me@JGU—mental fit durchs Studium”, which roughly translates to “me@JGU—staying mentally healthy during your studies”. (The “me” in “me@JGU” is a wordplay: on the one hand it represents an abbreviation of the German phrase “mental fit durchs Studium” (Engl. “mentally healthy during your studies”) and also is meant to stand for “I at JGU”.) At the beginning, we conducted an extensive literature research to identify typical stressors among university students and online interventions for mental health in student populations (for an overview, see [ 32 ]). Based on our findings from the literature research, we then carried out a needs analysis to ensure that the content of the planned online portal appropriately addressed the needs of the students at JGU. We first assessed the current mental health of the students [ 6 ] Second, we asked about typical stressful events in everyday university life and the students’ wishes regarding the content and the presentation of an online portal promoting mental health (unsubmitted data). The needs analysis has shown similar results as our literature research. Taking both sources of information together, we focused on the most common student stressors: (1) academic themes (i.e., exams, assignments, workload, organizing studies), (2) relationships, (3) transitioning to university, and (4) living up to one’s own expectations [ 2 – 5 ]. We did not include the stressors “financial resources”, “environment”, and “diversity” in our program, because there are other internal university offices at JGU that are specialized in these topics (e.g., coordination office for diversity or student union in case of financial needs). However, we linked theses offers on our website In the next step, the contents and the website were developed. The chapters were then gradually published on the website, evaluated, and revised. At the end of the development process, the online portal consisted of eight chapters. Each chapter is dedicated to one topic (see Table 1 for further information). Considering academic themes being the most often reported stressors for college students, three of our chapters aimed directly at reducing stress in this area in order to promote the students’ mental well-being: (a) the chapter “mastering exam stress” provides psychoeducative information and skills to improve exam preparation and learning strategies; (b) the chapter “well organized” contains information on implementing time schedules throughout the semester and how to balance studies with other important parts of life; (c) the chapter “defeating procrastination” provides strategies on how to stay motivated during studies.
[[[ p. 4 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 4 of 15 Table 1. Titles and contents of the eight chapters of the me@JGU website Chapter Title Chapter Contents Based on Cognitive Behavioral Therapy Examples of Downloads, Tips, Videos 1. Well organized stress and time management “Why we get stressed—and what effect it has on us.”; “Boosting your energy.”; “Your weekly schedule.”; “12-month project plan.”; “Time-eaters at university.”; “Be bold and set priorities.” 2. Mastering exam stress techniques for test preparation, learning techniques, tips for presentations, lectures and oral exams, tips for academic writing “Proper planning.”; “Learning techniques.”; “Mind-blanking—when your brain shuts down.”; “Rehearse an exam.”; “Being confident in public.”; “Writing exercises.” 3. Strengthening self-esteem psychoeducation on self-esteem, strategies to improve self-esteem and self-care “Self-esteem and self-evaluation.”; “Typical phrases that can influence your self-esteem.”; “My achievements, strengths, weaknesses.”; “Get to know your perfectionism.”; “Looking after yourself.”; “Self-esteem and body image.”; “A ‘positive events’ journal.” 4. Promoting relaxation relaxation techniques, mindfulness exercises “Exercise combats stress.”; “Get outdoors.”; “Progressive muscle relaxation.”; “Breath relaxation.”; “Mindfulness in daily university life.” 5. Managing negative feelings and thoughts psychoeducation about the development of feelings, strategies for dealing with negative thoughts, strategies for regulating emotions “Observe your thoughts.”; “Core beliefs influence your (automatic) thoughts.”; “Your core beliefs.”; “Typical thinking errors.”; “Modify your thoughts.”; “Reason is a tiger, emotion is a snail.”; “Be mindful of your emotions.”; “Controlling your emotions.”; “Emotional vulnerability.” 6. Your social network strategies for making new contacts, maintaining relationships and dealing with conflicts “Reviewing your social network.”; “Making new friends.”; “Maintaining your social network.”; “Expressing wishes.”; “Saying no.”; “Dealing with conflict.”; “Meeting with your supervisor/mentor.” 7. Defeating procrastination psychoeducation on the vicious circle of procrastination, motivation strategies, dealing with obstructive thoughts “The vicious circle of procrastination.”; “Pros and cons: Procrastination”; “Motivation strategies for routine use at university.”; “Using small time windows.”; “Procrastinating and postponing—there’s a big difference” 8. Finding goals strategies to develop values and goals “What are you passionate about?”; “A perfect day.”; “Your values.”; “Properly formulating your goals.”; “Dealing with setbacks.” In order to ease the transition to university and to improve the students’ relationships, the chapter “your social network” was compiled The chapters “strengthening self-esteem” and “finding goals” were developed in order to help students living up to their own expectations, and included information and strategies to reflect on their strengths and values. An additional advantage of the chapter “strengthening self-esteem” is that increasing an individual’s self-esteem might also increase their ability to cope with stress [ 38 ]. The two remaining chapters are meant to strengthen the students’ resilience to stress in a more general way [ 34 ]: (a) “promoting relaxation” targets with behavioral interventions the management of the physical stress reaction (e.g., tension); (b) “managing negative feelings and thoughts” aims to assist individuals in identifying and modifying dysfunctional beliefs that influence response to stimuli and subsequent physiological and psychological distress as well as successfully regulating emotions In the beginning, we planned to design the website ourselves and shoot the videos on our own. Due to the already implemented online counseling programs at the Mental Health Services for Students, the counseling team has the necessary technical skills. However, the website would then have looked very similar to the university’s teaching offerings. We were concerned that it would remind the students of coursework and therefore be less
[[[ p. 5 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 5 of 15 interesting and fun to work with. Furthermore, in order to address all students, the website was planned to function without our counseling support, which is known to lead to lower user numbers [ 29 , 39 – 41 ]. We decided to obtain professional support to ensure that the website would be visually attractive and stand out from other offers of the university to appeal to the students and keep them motivated. Nevertheless, the layout shows clearly that it is an offer of the university for its students (i.e., we used the university’s logo and added specific information concerning JGU and the responsibility for the content) in order to ensure the trustworthiness of the program. The layout and programming of the website was done by a design agency, in close cooperation with us (see Appendix A ). The videos were produced with the support of the JGU’s Center for Audiovisual Production. Currently, the website can only be accessed by students and staff of JGU. Opening up the website for other universities is planned for the future At the time of data analysis, we had already published six of the planned eight chapters. (The publication of the last two chapters (“your social network”, “managing thoughts and feelings”) was unfortunately delayed due to the COVID-19 pandemic until the end of 2020. Thus, we are not able to report data on these two chapters.) In every chapter, we teach central competences that help to improve coping skills in stressful situations and events and, therefore, should strengthen students’ mental health. We offer information, tips and exercises on various topics in the form of texts, videos and audios. For a more in-depth confrontation with the topic, students have the possibility to download worksheets with exercises, tips and checklists as PDF files. Each chapter is structured in the same way: first there is a photo, followed by a brief introduction to the topic with short examples from everyday university life. Then, a table of contents is displayed, followed by a box with “the most important facts at a glance”. After that, the chapter is offered as a podcast, for those who prefer to listen to the content. Subsequently, the main information text with psychoeducational elements, tips and downloads follows (see Figure 1 ). Int. J. Environ. Res. Public Health 2021 , 18 , 1179 6 of 16 Figure 1. Structure of each chapter of the website (me@JGU). In order to establish a local connection to Mainz and JGU, we tried to relate all of the content and tips to the city and the university. In the chapter “promoting relaxation”, for example, there is a relaxation exercise in the form of a video that takes students on a walk through the JGU botanical garden. We also linked offers from other internal university offices at JGU (such as Career Service, student advisory services, university sport offers, advice in case of financial needs) in the corresponding chapters of the website. Furthermore, we recommended self-help literature. 2.3. Implementing the Website On 24 October 2019, the Mental Health Services for Students of JGU participated in the World Mental Health Day with a day of action on campus to raise awareness of mental health issues students face. According to the motto “every 5 th student is affected—keep an eye on your mental health”, the team of the counseling center informed students with a quiz about interesting facts concerning mental disorders. Within this action day, we also launched and promoted me@JGU. Further advertising measures were an information mail to all students (approximately 31,300 enrolled students in winter semester 2019/2020), an entry on JGU’s Facebook and Instagram channel, and various university departments reported on their websites about the launch of me@JGU. We also advertised on our own website as well as informed clients in individual counseling and workshops at the Mental Health Services for Students. In addition, we had posters and bookmarks with short tips such as “do it today” or “set priorities” made, which were given to students and sent to study offices and student advisors. Furthermore, a short video teaser introducing the website was shot and shown on different occasions. Additionally, an interview about the online portal was published in a local student newspaper (STUZ) 2.4. (First) Evaluation of the Concept Although the ultimate aim in evaluating a new online mental health intervention may be to conduct randomized controlled trials (RCT), there are several distinct phases of evaluation that need to be considered before this stage [42]. Early stage evaluations usually focus on usability, and subsequent testing includes issues such as engagement and Figure 1. Structure of each chapter of the website (me@JGU) In order to establish a local connection to Mainz and JGU, we tried to relate all of the content and tips to the city and the university. In the chapter “promoting relaxation”, for example, there is a relaxation exercise in the form of a video that takes students on a walk through the JGU botanical garden. We also linked offers from other internal university offices at JGU (such as Career Service, student advisory services, university sport offers,
[[[ p. 6 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 6 of 15 advice in case of financial needs) in the corresponding chapters of the website. Furthermore, we recommended self-help literature 2.3. Implementing the Website On 24 October 2019, the Mental Health Services for Students of JGU participated in the World Mental Health Day with a day of action on campus to raise awareness of mental health issues students face. According to the motto “every 5 th student is affected—keep an eye on your mental health”, the team of the counseling center informed students with a quiz about interesting facts concerning mental disorders. Within this action day, we also launched and promoted me@JGU Further advertising measures were an information mail to all students (approximately 31,300 enrolled students in winter semester 2019/2020), an entry on JGU’s Facebook and Instagram channel, and various university departments reported on their websites about the launch of me@JGU. We also advertised on our own website as well as informed clients in individual counseling and workshops at the Mental Health Services for Students. In addition, we had posters and bookmarks with short tips such as “do it today” or “set priorities” made, which were given to students and sent to study offices and student advisors. Furthermore, a short video teaser introducing the website was shot and shown on different occasions. Additionally, an interview about the online portal was published in a local student newspaper (STUZ) 2.4. (First) Evaluation of the Concept Although the ultimate aim in evaluating a new online mental health intervention may be to conduct randomized controlled trials (RCT), there are several distinct phases of evaluation that need to be considered before this stage [ 42 ]. Early stage evaluations usually focus on usability, and subsequent testing includes issues such as engagement and efficacy analyses. Perceived usefulness and perceived ease of use have proven to be fundamental determinants of user acceptance of information technology in general (for further information concerning the Technology Acceptance Model, see [ 43 , 44 ]), but also in understanding university students’ behavioral intention to use e-learning [ 45 ]. We therefore focused in our first evaluation on questions concerning this matter. The results reported here will influence further website adaptations In order to investigate the appeal and use of the website, we collected various data anonymously without any information on the profile of the users (e.g., demographic data) The decision to collect only anonymous data in this early phase of the study was made in order to adhere to privacy protection guidelines according to the European General Data Protection Regulation. Next steps will involve evaluating the efficacy of the program in promoting mental health in more detail 2.4.1. Website Usage Collecting website usage data in order to evaluate web-based interventions provides information on levels of intervention use as well as typical navigation patterns through a website and represents an important addition to self-reporting [ 46 ]. It represents the most commonly used objective measure of engagement in the behavioral science literature [ 47 ]. The usually collected data is the number of log-ins, the number of completed intervention components, activity, and the time spent on the website. As our website is designed as an unguided self-help offer, we focused on evaluating the click numbers (i.e., numbers of log-ins), the time spent on the website, and downloads from the website via Matomo ( https://matomo.org/ ) [ 48 ]. Matomo is an open source software for statistical analysis of user interaction. Information collected via Matomo is client (browser) based, stored on a server of JGU, and is compliant with the European General Data Protection Regulation.
[[[ p. 7 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 7 of 15 2.4.2. Short Survey A short online survey regarding the attractiveness and the comprehensibility of the website was linked at the end of each chapter The online questionnaire was realized using SoSci Survey [ 49 ] and made available to participants at www.soscisurvey.de . We were particularly interested in knowing whether the website covers the relevant topics for students, is understandable and attractive. The questionnaire consisted of 13 questions on different topics: First, we asked which chapters the participants had read (“chapters read”; one item), followed by questions concerning the “selection of topics” (two items; “yes”/“no” answer format). We then addressed the “attractiveness of the website” (five items). As we had given a lot of thought to different linguistic issues in advance, such as the length and complexity of the individual texts and the use of psychological terms, we also asked the students about the “comprehensibility of the website” (one item) One challenge of the online portal is its preventive character. The aim is to motivate students to reflect on their behavior or even change their (inappropriate) behavior although they may not have encountered any difficulties during their studies so far. We were therefore interested in whether the website’s contents motivated the students to interact with the topics in greater depth, and asked about “impulses for action” (three items) As the likelihood of recommending something to friends is an indicator of one’ s own satisfaction, we also asked about “recommendation to others” (one item). The topics “attractiveness of the website”, “comprehensibility of the website”, “impulses for action”, and “recommendation to others” were all rated on a 4-level scale from 1 “I do not agree” to 4 “I fully agree.” There was no incentive to fill in the questionnaire 3. Results (Status: 24.06.2020) 3.1. Website Usage From October 2019 to June 2020, the website was visited 5739 times, 2357 of which were very short visits of 0–10 s. Excluding the ultra-short visits, 855 of the remaining were recurring visits with an average length of stay of 8 min and 18 s. Of the 2527 one-time visits, the average length of stay was 4 min and 35 s. There were, in total, 16,495 page views (see also Table 2 ) and 3748 downloads. Overall, 41% of visitors left the website after only one page Table 2. (Selected) page views of the chapters of me@JGU website 1 Chapter Number of Page Views Average Time per Page (min) Minimum (min) Maximum (min) Well organized 1647 02:39 0 2 55 Strengthening self-esteem 1056 02:05 0 56 Defeating procrastination 909 01:47 0 18 Promoting relaxation 837 01:21 0 24 Mastering exam stress 701 01:42 0 17 Finding goals 495 01:50 0 35 1 The table shows only the data for the content chapters of the website 2 0 min means that there were days during the evaluated time period, during which there were no visitors on the page The most frequently visited chapter is the chapter “well organized”, which is about time and stress management. Consistent with this result, the three most frequently downloaded informationand worksheets are from this chapter. The most frequently downloaded worksheet is a time management skill for creating a plan for the week (314 downloads), followed by an information sheet about typical “time killers” (e.g., using a smart-
[[[ p. 8 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 8 of 15 phone, roommates causing disruptions while studying for an exam) and strategies to overcome them (254 downloads). The third most common download was a template for a monthly project plan (210 times), which is also a time management skill (all data collected via Matomo) 3.2. Short Survey N = 372 website visitors clicked on the survey link; N = 114 questionnaires were completed fully. Most of the respondents looked at the chapters “well organized” (43%) and “strengthening self-esteem” (42.1%), see also Figure 2 . Int. J. Environ. Res. Public Health 2021 , 18 , 1179 9 of 16 Figure 2. Chapters read (multiple answers possible; N = 114). 3.2.1. Selection of Topics The majority of respondents indicated that the website addresses problems that affect them (90.4%, Figure 3) and 93.9% felt that it dealt with issues that affect everyday life at university. Figure 3. Response rate to the statement “The website addresses problems that relate to me”, in percent, N = 114 3.2.2. Attractiveness of the Website Altogether, 62.3% of the participants fully agreed with having had fun reading the website and more than half of the participants indicated that the layout of the website is visually appealing. The presentation of the texts on the website is considered attractive. Since the content is conveyed in different ways, there is something for every type of learner (texts to read, audio files and videos), which students evaluate as good (see Table 3). 90.4 2.6 7.0 yes no not answered Figure 2. Chapters read (multiple answers possible; N = 114) 3.2.1. Selection of Topics The majority of respondents indicated that the website addresses problems that affect them (90.4%, Figure 3 ) and 93.9% felt that it dealt with issues that affect everyday life at university Int. J. Environ. Res. Public Health 2021 , 18 , 1179 9 of 16 Figure 2. Chapters read (multiple answers possible; N = 114). 3.2.1. Selection of Topics The majority of respondents indicated that the website addresses problems that affect them (90.4%, Figure 3) and 93.9% felt that it dealt with issues that affect everyday life at university. Figure 3. Response rate to the statement “The website addresses problems that relate to me”, in percent, N = 114 3.2.2. Attractiveness of the Website Altogether, 62.3% of the participants fully agreed with having had fun reading the website and more than half of the participants indicated that the layout of the website is visually appealing. The presentation of the texts on the website is considered attractive. Since the content is conveyed in different ways, there is something for every type of learner (texts to read, audio files and videos), which students evaluate as good (see Table 3). 90.4 2.6 7.0 yes no not answered Figure 3. Response rate to the statement “The website addresses problems that relate to me”, in percent, N = 114.
[[[ p. 9 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 9 of 15 3.2.2. Attractiveness of the Website Altogether, 62.3% of the participants fully agreed with having had fun reading the website and more than half of the participants indicated that the layout of the website is visually appealing. The presentation of the texts on the website is considered attractive Since the content is conveyed in different ways, there is something for every type of learner (texts to read, audio files and videos), which students evaluate as good (see Table 3 ). Table 3. Response rates to the statements about the attractiveness of the website (in percent, N = 114) Item I Do Not Agree I Somewhat Disagree I Somewhat Agree I Fully Agree Not Answered It was fun to look at the website - 5.3 22.8 62.3 6.1 I like the website./The website is attractive 0.9 1.8 23.7 60.5 6.1 The texts on the website are presented in an interesting way - 4.4 20.2 68.4 7.0 I like that audio files are offered 3.5 7.0 21.1 51.8 9.6 I like the podcast 0.9 9.6 31.6 28.1 22.8 3.2.3. Comprehensibility of the Website The answers concerning the comprehensibility of the texts and information are mostly positive and show that the language of the texts is understandable and appropriate for this age group (Figure 4 ). Int. J. Environ. Res. Public Health 2021 , 18 , 1179 10 of 16 Table 3. Response rates to the statements about the attractiveness of the website (in percent, N = 114). Item I Do Not Agree I Somewhat Disagree I Somewhat Agree I Fully Agree Not Answered It was fun to look at the website. - 5.3 22.8 62.3 6.1 I like the website./The website is attractive. 0.9 1.8 23.7 60.5 6.1 The texts on the website are presented in an interesting way. - 4.4 20.2 68.4 7.0 I like that audio files are offered. 3.5 7.0 21.1 51.8 9.6 I like the podcast. 0.9 9.6 31.6 28.1 22.8 3.2.3. Comprehensibility of the Website The answers concerning the comprehensibility of the texts and information are mostly positive and show that the language of the texts is understandable and appropriate for this age group (Figure 4). Figure 4. Response rate to the statement “The texts on the website are written in an understandable way”, in percent, N = 114 3.2.4. Impulses for Action Overall, 38.6% of the participants indicated that they wanted to implement some of the tips and 45.6% received new inspiration through the website. In addition, 59.6% would look at the website again if they needed some support at a later date (see Table 4). Table 4. Response rates to the statements concerning impulses for action (in percent, N = 114). Item I Do Not Agree I Somewhat Disagree I Somewhat Agree I Fully Agree Not Answered I think that I will put some tips into practice. 0.9 6.1 44.7 38.6 6.1 I have received new ideas/information. 4.4 12.3 28.1 45.6 6.1 I would return to the website if I needed help. 3.5 9.6 17.5 59.6 6.1 3.2.5. Recommendation to Others In total, 81.6% of the respondents would recommend me@JGU (see Figure 5). 84.2 9.6 6.1 I fully agree I somewhat agree not answered 0.0 20.0 40.0 60.0 80.0 100.0 The texts on the website are written in an understandable way. Figure 4. Response rate to the statement “The texts on the website are written in an understandable way”, in percent, N = 114 3.2.4. Impulses for Action Overall, 38.6% of the participants indicated that they wanted to implement some of the tips and 45.6% received new inspiration through the website. In addition, 59.6% would look at the website again if they needed some support at a later date (see Table 4 ). 3.2.5. Recommendation to Others In total, 81.6% of the respondents would recommend me@JGU (see Figure 5 ).
[[[ p. 10 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 10 of 15 Table 4. Response rates to the statements concerning impulses for action (in percent, N = 114) Item I Do Not Agree I Somewhat Disagree I Somewhat Agree I Fully Agree Not Answered I think that I will put some tips into practice 0.9 6.1 44.7 38.6 6.1 I have received new ideas/information 4.4 12.3 28.1 45.6 6.1 I would return to the website if I needed help 3.5 9.6 17.5 59.6 6.1 Int. J. Environ. Res. Public Health 2021 , 18 , 1179 11 of 16 Figure 5. Response rate to the statement “I would recommend the website to a friend”, in percent, N = 114 4. Discussion In this article, we presented the development, implementation and an initial usability evaluation on the use of me@JGU, a website with information on dealing with common stressors and mental health promotion for students. In summary, it can be said that we have succeeded in arousing curiosity and interest in the topic of mental health among students. The results of the survey show that the website covers topics that concern and interest the students (see Figure 3). This, in turn, indicates that it was helpful to carry out a needs analysis in advance. The answers also show that the layout of the website is visually appealing and the students rate the website as attractive (see Table 3), which encourages us in our decision to engage an agency for the realization so the website stands out from other teaching offers of the university. The students perceived the website as highly useful and highly user-friendly. These two factors contribute to user acceptance and help explain and predict user behavior of information technology [44] The objective measures of engagement collected by the web usage data, showed that the website achieves high and continuous click rates, which we are very pleased about (Table 2). However, here too, as reported by other unaccompanied self-help offers, a relatively high drop-out rate of 41% is evident that we cannot explain (see Section 3.1). To our knowledge, there are no comparable naturalistic studies on usage and drop-out rates for unguided mental health promotion websites. However, in an internet-based program to improve the mental health and well-being of young men, only approximately 10% of the website visitors registered to the program and only 11.7% completed the program [50]. Furthermore, Richards and Richardson [40] found a higher drop-out rate for unguided web-based interventions for depression (level of adherence 26%) compared to guided web-based interventions (level of adherence 72%). Spek and colleagues [51] examined 12 RCT studies on the treatment of depression and anxiety disorders in a meta-analytic study and found drop-out rates between 3% and 34%. Considering the results on drop-outs in Massive Open Online Courses (MOOCs), dropout rates of up to 90% can be found [52]. MOOCs are courses that provide learning content—mostly of a psychoeducational character—online and can be taken without attendance restrictions, and are therefore comparable to the open, unaccompanied character of me@JGU. Perhaps the high drop-out rate of the me@JGU website could be partly explained by students who only briefly call up the page out of interest and read through it at a later time. Unfortunately, this is not interpretable by our click figures/data. Nevertheless, the students who stay on the website seem to read the content, download further information and come back again later (see also Section 3.1). The majority of the survey participants indicate that they are planning to implement the tips in everyday life (Table 59.6 21.9 7.0 1.8 6.1 I fully agree I somewhat agree I somewhat disagree I do not agree not answered 0.0 20.0 40.0 60.0 80.0 100.0 I would recommend the website to a friend. Figure 5. Response rate to the statement “I would recommend the website to a friend”, in percent, N = 114 4. Discussion In this article, we presented the development, implementation and an initial usability evaluation on the use of me@JGU, a website with information on dealing with common stressors and mental health promotion for students. In summary, it can be said that we have succeeded in arousing curiosity and interest in the topic of mental health among students. The results of the survey show that the website covers topics that concern and interest the students (see Figure 3 ). This, in turn, indicates that it was helpful to carry out a needs analysis in advance. The answers also show that the layout of the website is visually appealing and the students rate the website as attractive (see Table 3 ), which encourages us in our decision to engage an agency for the realization so the website stands out from other teaching offers of the university. The students perceived the website as highly useful and highly user-friendly. These two factors contribute to user acceptance and help explain and predict user behavior of information technology [ 44 ]. The objective measures of engagement collected by the web usage data, showed that the website achieves high and continuous click rates, which we are very pleased about (Table 2 ). However, here too, as reported by other unaccompanied self-help offers, a relatively high drop-out rate of 41% is evident that we cannot explain (see Section 3.1 ). To our knowledge, there are no comparable naturalistic studies on usage and drop-out rates for unguided mental health promotion websites However, in an internet-based program to improve the mental health and well-being of young men, only approximately 10% of the website visitors registered to the program and only 11.7% completed the program [ 50 ]. Furthermore, Richards and Richardson [ 40 ] found a higher drop-out rate for unguided web-based interventions for depression (level of adherence 26%) compared to guided web-based interventions (level of adherence 72%). Spek and colleagues [ 51 ] examined 12 RCT studies on the treatment of depression and anxiety disorders in a meta-analytic study and found drop-out rates between 3% and 34%. Considering the results on drop-outs in Massive Open Online Courses (MOOCs), drop-out rates of up to 90% can be found [ 52 ]. MOOCs are courses that provide learning content—mostly of a psychoeducational character—online and can be taken without atten-
[[[ p. 11 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 11 of 15 dance restrictions, and are therefore comparable to the open, unaccompanied character of me@JGU. Perhaps the high drop-out rate of the me@JGU website could be partly explained by students who only briefly call up the page out of interest and read through it at a later time. Unfortunately, this is not interpretable by our click figures/data. Nevertheless, the students who stay on the website seem to read the content, download further information and come back again later (see also Section 3.1 ). The majority of the survey participants indicate that they are planning to implement the tips in everyday life (Table 4 ). This means that there are some students who are intensively engaged with the topics and benefit from the offer Unfortunately, we cannot draw any conclusions on the efficacy of our program yet Various randomized-controlled trials have shown similar programs to be effective in reducing distress in college students [ 32 – 37 ]. Proof of the efficacy of our naturalistic and unguided setting remains to be shown A further benefit is that through this website, offers of help, such as Mental Health Services for Students, are made known to students and any barriers towards help-seeking can be reduced 4.1. Future Perspective We plan to translate the website into English in order to also provide support for international students at JGU. In addition, a further evaluation of the usefulness and attractiveness of the website will be carried out. Another interesting point would be to examine more closely who benefits from and uses the information on the website and why. In the present study, we focused on early stage evaluations regarding usability and attractiveness. Subsequent testing should include issues like engagement, adherence and effectiveness. Pilot interviews with a small group of users could help make adjustments to the program before a timeand cost-intensive study is conducted The maintenance and further development of the project is also to be integrated into everyday counseling work of the Mental Health Services at JGU. Permanent technical support, e.g., for marketing purposes, and adaptation to current conditions (e.g., in April 2020, we created a subpage on the topic of Corona and mental health in studies) seems necessary and important to us. Currently, only JGU students have access to the website. Opening the offer for other students is under consideration 4.2. Limitations A limiting factor of the present study is that taking part in the survey was uncontrolled The collected data therefore is selective, as the participants in an evaluation/survey are often those who are satisfied with a product. In addition, the online questionnaire was completed by only approximately 2% of the website users. This limits the generalizability of the findings. Furthermore, we cannot draw any conclusions concerning the efficacy of our program in promoting mental health 5. Conclusions Chronic stress in students can cause mental health problems and, therefore, have a negative impact on academic participation and outcomes The website me@JGU has been shown to cover topics that interest the students, is visually appealing, and achieves high and continuous click rates Initial evaluation results indicate that the website me@JGU provides impulses to engage with the website’s content Further studies addressing efficacy and adherence are needed Author Contributions: Conceptualization, C.L.-K. and M.G.; methodology, C.L.-K. and M.G.; formal analysis, C.L.-K.; investigation, C.L.-K.; data curation, C.L.-K.; writing—original draft preparation, C.L.-K. and M.G.; writing—review and editing, C.L.-K., B.H., U.L.-K., B.M.-I. and M.G.; visualization, C.L.-K. and B.M.-I.; supervision, M.G.; project administration, C.L.-K.; funding acquisition, C.L.-K. and U.L.-K. All authors have read and agreed to the published version of the manuscript.
[[[ p. 12 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 12 of 15 Funding: This project is funded by the Federal Ministry of Education and Research under the funding code 01 PL 17055. The author is responsible for the content of this publication Institutional Review Board Statement: Ethical review and approval were waived for this study for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students. Furthermore, no intervention was conducted. In addition, at the time of data collection the ethics committee at the JGU Psychology Institute only required an ethics application for children or patients as participants, so none was necessary in our survey Informed Consent Statement: Patient consent was waived for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students, and no intervention was conducted Data Availability Statement: The data presented in this study are available on request from the corresponding author Conflicts of Interest: The authors declare no conflict of interest Appendix A Two Screenshots of the website (me@JGU) Int. J. Environ. Res. Public Health 2021 , 18 , 1179 13 of 16 Institutional Review Board Statement: Ethical review and approval were waived for this study for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students. Furthermore, no intervention was conducted. In addition, at the time of data collection the ethics committee at the JGU Psychology Institute only required an ethics application for children or patients as participants, so none was necessary in our survey. Informed Consent Statement: Patient consent was waived for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students, and no intervention was conducted Data Availability Statement: The data presented in this study are available on request from the corresponding author. Conflicts of Interest: The authors declare no conflict of interest. Appendix A Two Screenshots of the website (me@JGU) Figure A 1. Chapter 2 “Mastering exam stress”. Figure A 2. Chapter 4“Promoting relaxation”. Figure A 1. Chapter 2 “Mastering exam stress” Int. J. Environ. Res. Public Health 2021 , 18 , 1179 13 of 16 Institutional Review Board Statement: Ethical review and approval were waived for this study for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students. Furthermore, no intervention was conducted. In addition, at the time of data collection the ethics committee at the JGU Psychology Institute only required an ethics application for children or patients as participants, so none was necessary in our survey. Informed Consent Statement: Patient consent was waived for the following reason: The survey was online and could be conducted completely anonymously by the participants. There was no contact whatsoever with the students, and no intervention was conducted Data Availability Statement: The data presented in this study are available on request from the corresponding author. Conflicts of Interest: The authors declare no conflict of interest. Appendix A Two Screenshots of the website (me@JGU) Figure A 1. Chapter 2 “Mastering exam stress”. Figure A 2. Chapter 4“Promoting relaxation”. Figure A 2. Chapter 4“Promoting relaxation”.
[[[ p. 13 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 13 of 15 Int. J. Environ. Res. Public Health 2021 , 18 , 1179 14 of 16 Figure A 3. An advertising banner for Social Media. References 1 Kim, H.S.; Sherman, D.K.; Taylor, S.E. Culture and social support. Am. Psychol. 2008 , 63 , 518–526, doi:10.1037/0003-066 x. 2 Robotham, D.; Julian, C. Stress and the higher education student: A critical review of the literature. J. Furth. High. Educ. 2006 , 30 , 107–117, doi:10.1080/03098770600617513. 3 Hurst, C.S.; Baranik, L.E.; Daniel, F. College Student Stressors: A Review of the Qualitative Research. Stress Health 2012 , 29 , 275– 285, doi:10.1002/smi.2465. 4 Herbst, U.; Voeth, M.; Eidhoff, A.T.; Müller, M.; Stief, S. Studierendenstress in Deutschland—Eine Empirische Untersuchung ; Hrsg. AOK: Berlin, Germany, 2016. 5 Gusy, B.; Wörfel, F.; Lohmann, K. Erschöpfung und Engagement im Studium [Exhaustion and engagement in studying]. Z. Gesundheitspsychol. 2016 , 24 , 41–53, doi:10.1026/0943-8149/a 000153. 6 Lutz-Kopp, C.; Meinhardt-Injac, B.; Luka-Krausgrill, U. Psychische Belastung Studierender. Prävention Gesundheitsförderung 2018 , 14 , 256–263, doi:10.1007/s 11553-018-0691-9. 7 Benjet, C.; Borges, G.; Medina-Mora, M.E. Chronic childhood adversity and onset of psychopathology during three life stages: Childhood, adolescence and adulthood. J. Psychiatr. Res. 2010 , 44 , 732–740, doi:10.1016/j.jpsychires.2010.01.004. 8 Kessler, R.C.; McLaughlin, K.A.; Green, J.G.; Gruber, M.J.; Sampson, N.A.; Zaslavsky, A.M.; Aguilar-Gaxiola, S.; Alhamzawi, A.O.; Alonso, J.; Angermeyer, M.; et al. Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys. Br. J. Psychiatry 2010 , 197 , 378–385, doi:10.1192/bjp.bp.110.080499. 9 Scott, K.M.; McLaughlin, K.A.; Smith, D.A.R.; Ellis, P.M. Childhood maltreatment and DSM-IV adult mental disorders: Comparison of prospective and retrospective findings. Br. J. Psychiatry 2012 , 200 , 469–475, doi:10.1192/bjp.bp.111.103267. 10 Cohen, S.; Murphy, M.L.M.; Prather, A. Ten Surprising Facts About Stressful Life Events and Disease Risk. Annu. Rev. Psychol. 2019 , 70 , 577–597, doi:10.1146/annurev-psych-010418-102857. 11 Cuijpers, P.; Auerbach, R.P.; Benjet, C.; Bruffaerts, R.; Ebert, D.D.; Karyotaki, E.; Kessler, R.C. The World Health Organization World Mental Health International College Student initiative: An overview. Int. J. Methods Psychiatr. Res. 2019 , 28 , e 1761, doi:10.1002/mpr.1761. 12 Karyotaki, E.; Cuijpers, P.; Albor, Y.; Alonso, J.; Auerbach, R.P.; Bantjes, J.; Bruffaerts, R.; Ebert, D.D.; Hasking, P.; Kiekens, G.; et al. Sources of Stress and Their Associations With Mental Disorders Among College Students: Results of the World Health Organization World Mental Health Surveys International College Student Initiative. Front. Psychol. 2020 , 11 , 1759, doi:10.3389/fpsyg.2020.01759. 13 Auerbach, R.P.; Collaborators, W.W.-I.; Mortier, P.; Bruffaerts, R.; Alonso, J.; Benjet, C.; Cuijpers, P.; Demyttenaere, K.; Ebert, D.D.; Green, J.G.; et al. WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. J. Abnorm. Psychol. 2018 , 127 , 623–638, doi:10.1037/abn 0000362. 14 Grobe, T.; Steinmann, S. Gesundheitsreport 2015. In Gesundheit von Studierenden ; Hrsg. TK: Hamburg, Germany, 2015. 15 Grobe, T.; Steinmann, S.; Szecsenyi, J. BARMER Gesundheitsreport 2018 ; Hrsg. BARMER: Berlin, Germany, 2018. 16 Jahresbericht 2019 der Psychotherapeutischen Beratungsstelle der JGU. Available online: https://www.pbs.unimainz.de/files/2020/12/PBS_Jahresbericht-2019.pdf (accessed on 10 December 2020). 17 Middendorff, E.; Apolinarski, B.; Poskowsky, J.; Kandulla, M.; Netz, N. Die wirtschaftliche und soziale Lage der Studierenden in Deutschland 2012. 20. In Sozialerhebung des Deutschen Studentenwerks—Durchgeführt durch HIS Hochschul-Informations-System ; BMBF: Berlin, Germany, 2013. 18 Middendorff, E.; Apolinarski, B.; Becker, K.; Bornkessel, P.; Brandt, T.; Heißenberg, S.; Poskowsky, J. Die wirtschaftliche und soziale Lage der Studierenden in Deutschland 2016. Zusammenfassung zur 21. In Sozialerhebung des Deutschen Studentenwerks— Durchgeführt vom Deutschen Zentrum für Hochschulund Wissenschaftsforschung ; BMBF: Berlin, Germany, 2017. 19 Eicher, V.; Staerklé, C.; Clémence, A. I want to quit education: A longitudinal study of stress and optimism as predictors of school dropout intention. J. Adolesc. 2014 , 37 , 1021–1030, doi:10.1016/j.adolescence.2014.07.007. Figure A 3. An advertising banner for Social Media References 1 Arnett, J. J. Emerging adulthood. A theory of development from the late teens through the twenties Am. Psychol 2000 , 55 , 469–480 [ CrossRef ] 2 Robotham, D.; Julian, C. Stress and the higher education student: A critical review of the literature J. Furth. High. Educ 2006 , 30 , 107–117. [ CrossRef ] 3 Hurst, C.S.; Baranik, L.E.; Daniel, F. College Student Stressors: A Review of the Qualitative Research Stress Health 2012 , 29 , 275–285. [ CrossRef ] [ PubMed ] 4 Herbst, U.; Voeth, M.; Eidhoff, A.T.; Müller, M.; Stief, S Studierendenstress in Deutschland—Eine Empirische Untersuchung ; Hrsg AOK: Berlin, Germany, 2016 5 Gusy, B.; Wörfel, F.; Lohmann, K. Erschöpfung und Engagement im Studium [Exhaustion and engagement in studying] Z Gesundheitspsychol 2016 , 24 , 41–53. [ CrossRef ] 6 Lutz-Kopp, C.; Meinhardt-Injac, B.; Luka-Krausgrill, U. Psychische Belastung Studierender Prävention Gesundheitsförderung 2018 , 14 , 256–263. [ CrossRef ] 7 Benjet, C.; Borges, G.; Medina-Mora, M.E. Chronic childhood adversity and onset of psychopathology during three life stages: Childhood, adolescence and adulthood J. Psychiatr. Res 2010 , 44 , 732–740. [ CrossRef ] 8 Kessler, R.C.; McLaughlin, K.A.; Green, J.G.; Gruber, M.J.; Sampson, N.A.; Zaslavsky, A.M.; Aguilar-Gaxiola, S.; Alhamzawi, A.O.; Alonso, J.; Angermeyer, M.; et al. Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys Br. J. Psychiatry 2010 , 197 , 378–385. [ CrossRef ] 9 Scott, K.M.; McLaughlin, K.A.; Smith, D.A.R.; Ellis, P.M. Childhood maltreatment and DSM-IV adult mental disorders: Comparison of prospective and retrospective findings Br. J. Psychiatry 2012 , 200 , 469–475. [ CrossRef ] 10 Cohen, S.; Murphy, M.L.M.; Prather, A. Ten Surprising Facts About Stressful Life Events and Disease Risk Annu. Rev. Psychol 2019 , 70 , 577–597. [ CrossRef ] 11 Cuijpers, P.; Auerbach, R.P.; Benjet, C.; Bruffaerts, R.; Ebert, D.D.; Karyotaki, E.; Kessler, R.C. The World Health Organization World Mental Health International College Student initiative: An overview Int. J. Methods Psychiatr. Res 2019 , 28 , e 1761 [ CrossRef ] 12 Karyotaki, E.; Cuijpers, P.; Albor, Y.; Alonso, J.; Auerbach, R.P.; Bantjes, J.; Bruffaerts, R.; Ebert, D.D.; Hasking, P.; Kiekens, G.; et al. Sources of Stress and Their Associations With Mental Disorders Among College Students: Results of the World Health Organization World Mental Health Surveys International College Student Initiative Front. Psychol 2020 , 11 , 1759. [ CrossRef ] [ PubMed ] 13 Auerbach, R.P.; Collaborators, W.W.-I.; Mortier, P.; Bruffaerts, R.; Alonso, J.; Benjet, C.; Cuijpers, P.; Demyttenaere, K.; Ebert, D.D.; Green, J.G.; et al. WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders J. Abnorm. Psychol 2018 , 127 , 623–638. [ CrossRef ] [ PubMed ] 14 Grobe, T.; Steinmann, S. Gesundheitsreport 2015. In Gesundheit von Studierenden ; Hrsg. TK: Hamburg, Germany, 2015 15 Grobe, T.; Steinmann, S.; Szecsenyi, J BARMER Gesundheitsreport 2018 ; Hrsg. BARMER: Berlin, Germany, 2018 16 Jahresbericht 2019 der Psychotherapeutischen Beratungsstelle der JGU. Available online: https://www.pbs.uni-mainz.de/files/ 2020/12/PBS_Jahresbericht-2019.pdf (accessed on 10 December 2020) 17 Middendorff, E.; Apolinarski, B.; Poskowsky, J.; Kandulla, M.; Netz, N. Die wirtschaftliche und soziale Lage der Studierenden in Deutschland 2012. 20. In Sozialerhebung des Deutschen Studentenwerks—Durchgeführt durch HIS Hochschul-Informations-System ; BMBF: Berlin, Germany, 2013.
[[[ p. 14 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 14 of 15 18 Middendorff, E.; Apolinarski, B.; Becker, K.; Bornkessel, P.; Brandt, T.; Heißenberg, S.; Poskowsky, J. Die wirtschaftliche und soziale Lage der Studierenden in Deutschland 2016. Zusammenfassung zur 21. In Sozialerhebung des Deutschen Studentenwerks— Durchgeführt vom Deutschen Zentrum für Hochschulund Wissenschaftsforschung ; BMBF: Berlin, Germany, 2017 19 Eicher, V.; Staerkl é , C.; Cl é mence, A. I want to quit education: A longitudinal study of stress and optimism as predictors of school dropout intention J. Adolesc 2014 , 37 , 1021–1030. [ CrossRef ] [ PubMed ] 20 Bruffaerts, R.; Mortier, P.; Kiekens, G.; Auerbach, R.P.; Cuijpers, P.; Demyttenaere, K.; Green, J.G.; Nock, M.K.; Kessler, R.C. Mental health problems in college freshmen: Prevalence and academic functioning J. Affect. Disord 2018 , 225 , 97–103. [ CrossRef ] 21 DeBerard, M.S.; Spielmans, G.I.; Julka, D.L. Predictors of academic achievement and retention among college freshmen: A longitudinal study Coll. Stud. J 2004 , 38 , 66–80 22 Hartley, M.T. Increasing Resilience: Strategies for Reducing Dropout Rates for College Students with Psychiatric Disabilities Am J. Psychiatr. Rehabil 2010 , 13 , 295–315. [ CrossRef ] 23 Kessler, R.C.; Foster, C.L.; Saunders, W.B.; Stang, P.E. Social consequences of psychiatric disorders, I: Educational attainment Am J. Psychiatry 1995 , 152 , 1026–1032. [ CrossRef ] 24 Andrews, B.; Wilding, J. The relation of depression and anxiety to life-stress and achievement in students Br. J. Psychol 2004 , 95 , 509–521. [ CrossRef ] 25 Eisenberg, D.; Golberstein, E.; Hunt, J.B. Mental Health and Academic Success in College J. Econ. Anal. Policy 2009 , 9 . [ CrossRef ] 26 Kernan, W.D.; Wheat, M.E.; Lerner, B.A. Linking Learning and Health: A Pilot Study of Medical Students’ Perceptions of the Academic Impact of Various Health Issues Acad. Psychiatry 2008 , 32 , 61–64. [ CrossRef ] 27 McEwan, R.C.; Downie, R. Patterns of Academic Success and Engagement among College Students with Psychiatric Disabilities J. Coll. Stud. Psychother 2018 , 33 , 257–272. [ CrossRef ] 28 Andersson, G.; Cuijpers, P. Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta- Analysis Cogn. Behav. Ther 2009 , 38 , 196–205. [ CrossRef ] 29 Cuijpers, P.; Donker, T.; Johansson, R.; Mohr, D.C.; Van Straten, A.; Andersson, G. Self-Guided Psychological Treatment for Depressive Symptoms: A Meta-Analysis PLoS ONE 2011 , 6 , e 21274. [ CrossRef ] 30 Berger, T Internetbasierte Interventionen bei Psychischen Störungen ; Hogrefe: Göttingen, Germany, 2011 31 Sander, L.B.; Rausch, L.; Baumeister, H. Effectiveness of Internet-Based Interventions for the Prevention of Mental Disorders: A Systematic Review and Meta-Analysis JMIR Ment. Health 2016 , 3 , e 38. [ CrossRef ] 32 Harrer, M.; Adam, S.H.; Baumeister, H.; Cuijpers, P.; Karyotaki, E.; Auerbach, R.P.; Kessler, R.C.; Bruffaerts, R.; Berking, M.; Ebert, D.D. Internet interventions for mental health in university students: A systematic review and meta-analysis Int. J. Methods Psychiatr. Res 2019 , 28 , e 1759. [ CrossRef ] 33 Amanvermez, Y.; Rahmadiana, M.; Karyotaki, E.; De Wit, L.; Ebert, D.D.; Kessler, R.C.; Cuijpers, P. Stress management interventions for college students: A systematic review and meta-analysis Clin. Psychol. Sci. Pract 2020 , e 12342. [ CrossRef ] 34 Regehr, C.; Glancy, D.; Pitts, A. Interventions to reduce stress in university students: A review and meta-analysis J. Affect. Disord 2013 , 148 , 1–11. [ CrossRef ] 35 Day, V.; McGrath, P.J.; Wojtowicz, M. Internet-based guided self-help for university students with anxiety, depression and stress: A randomized controlled clinical trial Behav. Res. Ther 2013 , 51 , 344–351. [ CrossRef ] 36 Musiat, P.; Conrod, P.; Treasure, J.; Tylee, A.; Williams, C.; Schmidt, U. Targeted Prevention of Common Mental Health Disorders in University Students: Randomised Controlled Trial of a Transdiagnostic Trait-Focused Web-Based Intervention PLoS ONE 2014 , 9 , e 93621. [ CrossRef ] 37 Farrer, L.; Gulliver, A.; Chan, J.K.Y.; Batterham, P.J.; Reynolds, J.; Calear, A.; Tait, R.; Bennett, K.; Griffiths, K.M. Technology-Based Interventions for Mental Health in Tertiary Students: Systematic Review J. Med. Internet Res 2013 , 15 , e 101. [ CrossRef ] 38 Abouserie, R. Sources and levels of stress in relation to locus of control and self-esteem in university students Educ. Psychol 1994 , 14 , 323–330. [ CrossRef ] 39 Baumeister, H.; Reichler, L.; Munzinger, M.; Lin, J. The impact of guidance on Internet-based mental health interventions—A systematic review Internet Interv 2014 , 1 , 205–215. [ CrossRef ] 40 Richards, D.; Richardson, T. Computer-based psychological treatments for depression: A systematic review and meta-analysis Clin. Psychol. Rev 2012 , 32 , 329–342. [ CrossRef ] 41 Kelders, S.M.; Kok, R.N.; Ossebaard, H.C.; Van Gemert-Pijnen, J.E. Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-based Interventions J. Med. Internet Res 2012 , 14 , e 152. [ CrossRef ] 42 Doherty, G.; Coyle, D.; Matthews, M. Design and evaluation guidelines for mental health technologies Interact. Comput 2010 , 22 , 243–252. [ CrossRef ] 43 Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology MIS Q 1989 , 13 , 319–340 [ CrossRef ] 44 Legris, P.; Ingham, J.; Collerette, P. Why do people use information technology? A critical review of the technology acceptance model Inf. Manag 2003 , 40 , 191–204. [ CrossRef ] 45 Park, S.Y. An Analysis of the Technology Acceptance Model in Understanding University Students’ Behavioral Intention to Use e-Learning Educ. Technol. Soc 2009 , 12 , 150–162 46 Koneska, E.; Appelbe, D.; Williamson, P.R.; Dodd, S. Usage Metrics of Web-Based Interventions Evaluated in Randomized Controlled Trials: Systematic Review J. Med. Internet Res 2020 , 22 , e 15474. [ CrossRef ] [ PubMed ]
[[[ p. 15 ]]]
Int. J. Environ. Res. Public Health 2021 , 18 , 1179 15 of 15 47 Perski, O.; Blandford, A.; West, R.; Michie, S. Conceptualising engagement with digital behaviour change interventions: A systematic review using principles from critical interpretive synthesis Transl. Behav. Med 2017 , 7 , 254–267. [ CrossRef ] 48 Matomo. Available online: https://matomo.org/ (accessed on 20 January 2021) 49 Leiner, D.J. SoSci Survey (Version 3.2.05-i) [Computer software]. 2019. Available online: https://www.soscisurvey.de (accessed on 20 June 2020) 50 Ellis, L.A.; McCabe, K.; Davenport, T.; Burns, J.M.; Rahilly, K.; Nicholas, M.; Hickie, I.B. Development and evaluation of an Internet-based program to improve the mental health and wellbeing of young men Interact. Technol. Smart Educ 2015 , 12 , 2–13 [ CrossRef ] 51 Spek, V.; Cuijpers, P.; Nykl í ˇcek, I.; Riper, H.; Keyzer, J.; Pop, V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis Psychol. Med 2007 , 37 , 319–328. [ CrossRef ] [ PubMed ] 52 Khalil, H.; Ebner, M. MOOCs Completion Rates and Possible Methods to Improve Retention—A Literature Review. In Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications, Tampere, Finland, 23–27 June 2014; pp. 1236–1244.
