Continuities and Changes in Self change Research Summary
Introduction
"When you're trying to help someone let go of a drug, you are competing with a powerful and long-practiced reinforcer. People change when they see an alternative that is better".—William Miller, PhD [1].
Various substance use disorders (SUD) stubbornly resist remission—even with pharmacotherapy [2,3,4]; the majority of patients relapse within 6 months post-treatment [4,5,6,7,8,9,10], and 3-month rates can exceed 90% [4]. SUD behavior (excessive drug-taking and impaired physical, psychological, professional, and social well-being [11]) prioritizes immediate hedonic reward over future outcomes.
Undervaluation of future rewards—often quantified as the relative preference between an immediate reward and a larger delayed reward (temporal discounting)—is linked to SUD by a large body of literature (meta-analyses; [12,13,14,15]). These findings are potentially explained by shortened time horizons (time perspective), which manifest as an out-of-focus future that exerts minimal influence on current behavior [16,17,18,19]—dramatically illustrated by one study reporting healthy controls' time perspective as 4.7 years and SUD as 9 days [17]. This tendency is not readily explained by ignorance of contingencies, as awareness of immediate gratification costs does not necessarily predict advantageous choices [20]. In parallel with future time perspective, the future self-continuity model [21,22,23,24] posits that undervaluation of future rewards is explained by greater psychological distance between the present and future selves [25, 26]. Only the present self can experience stimuli and emit behavior, but the future self receives those positive or negative outcomes. In SUD, the present self enjoys drug reward and forces the future self to pay for it. While rooted in different perspectives, temporal discounting, time perspective, and future self-continuity make the same prediction for SUD decision-making: the perception of less salient and valuable future rewards biases preference toward immediate rewards. Therefore, increasing future self-continuity should increase delayed reward preference and focus on future consequences [21, 22].
Manipulations that increase sensitivity to future outcomes (meta-analyses; [27, 28]) are a compelling basis for emerging SUD interventions, with one promising method referencing specific future events (episodic future thinking; EFT [29,30,31]) to provoke mental simulation of the future [32]. EFT shifts time perspective [33] and is most effective when experiences are autobiographical [34], vivid [28], content-specific [35], episodic [32], future-oriented [33], and positive [28]. Using future selves to strengthen future thinking may have stronger ecological validity and is more generalizable, as versions of the self are expected to be present in all imagined self-relevant future events—potentially as the "feared self" or the "positive possible future self" [36]. Therefore, increasing future self-continuity should increase the relevance and salience of the future and delayed rewards [21, 23].
Immersive virtual reality (VR) is an accessible Footnote 1 technology that vividly simulates otherwise impossible realities [37] and imparts "presence"—the illusion of actually being in the virtual place and experiencing the events [37,38,39]. VR's use in addiction research mostly targets drug cue reactivity for studying craving, buts shows mixed results for reducing drug use [40, 41]. However, VR's capacity for incorporating social and environmental elements into immersive experiences promises more robust and creative future paradigms [42]. VR also shows considerable promise in the flip side of addiction decision-making, i.e., increasing introspection and focus on healthy long-term goals. VR avatars of the self can promote prosocial behaviors, such as saving money [23], exercising [43], and behaving ethically [44]. Importantly, VR maximizes the vividness of future selves, which is key to increasing future self-connectedness [44, 45]. We reasoned that VR is particularly well-suited for targeting future outcomes in early recovering SUD. We developed a VR experience informed by schema theory [46] that incorporated key EFT elements portraying two personal futures in a VR vignette. We presented individualized age-progressed future selves to orient focus toward plausible futures: one unpleasant and one desirable. By extending theoretical conceptualizations of multiple possible future selves [36, 47, 48], we targeted future self-continuity [21, 22] and self-discrepancy [36, 49], i.e., dysphoria induced by actual versus ideal self dissonance—a key recovery change agent [50,51,52,53]. We recruited early-recovering SUD participants to experience a decision point and realistic expected future outcomes of SUD or sustained abstinence. After the VR intervention study day, we delivered 30 daily smartphone images of the recovery future self as visual retrieval cues.
We conducted an open-label study to evaluate a promising efficacy signal and the feasibility of using this novel VR intervention in a clinical context. Recent work indicates that VR methods would be adopted at high rates among SUD treatment professionals, particularly if VR demonstrated efficacy for increasing positive outcomes [54]. We hypothesized that the intervention would: (1) be well-tolerated, (2) increase future self-continuity, and (3) increase behavioral delayed reward preference. Exploratory analyses assessed relationships between the study day intervention response and recovery outcomes of interest at the 30-day follow-up.
Methods
Participants
Interested adults attending recovery programming in Indianapolis, Indiana, treatment centers and recovery houses for alcohol and/or substance use disorders completed a phone screen (including demographics, substance use history, treatment history, medical conditions, and current medications questions) to determine initial eligibility. Study inclusion criteria were: diagnosis and treatment for use disorders of alcohol and/or illicit drugs, early SUD recovery (< 1-year continuous abstinence, Footnote 2 similar to NIAAA's AUD remission definition [55]), greater than 14 days abstinent from drug/alcohol use at the time of the study day (exception: one enrollee with a single alcohol lapse six days prior to study), between ages 21 and 50, fluent in English, and actively engaging in recovery activities. Comorbid psychiatric conditions were permitted to maximize generalizability [56, 57]. Exclusion criteria included contraindications for VR or MRI (fMRI data to be reported separately), current use of alcohol or illicit drugs (including mu-opioid agonist pharmacotherapy), > 1 lapse event between the interview and the study day, disorders or history of neurological disease of cerebral origin, or head injury with > 20 min loss of consciousness. Participants agreed to participate in the study day and 30-day follow-up, with compensation for each phase completed ($250 total for full completion). All study procedures were approved by the Indiana University Institutional Review Board.
VR
VR design and prototyping
Informed by prior work [23], we tailored a VR experience for early SUD recovery using age-progressed future selves. Our paradigm was carefully designed with consulting from long-term SUD-recovering members of the local community, treatment professionals, addiction psychiatrists, and faculty in the Indiana Alcohol Research Center. We crafted the VR experience to connect with the future in a narrative integrating established therapeutic elements: catharsis, new behaviors, and positive expectancies [58]. Feedback from volunteers and technical staff informed optimized artistic and technical aspects. Specific narrative elements were furnished by participants—reflecting their actual experience and/or expectations of continued SUD. We maximized presence, realism, and emotional impact [59] and optimized design features to avoid motion sickness [60, 61], discomfort [62], and uncanniness [63]. The design priorities of the intervention were: (i) personalization, (ii) a discrete decision point, (iii) instantiation of the future, (iv) contingency of present choice and future outcomes, and (v) agency. The 15-year aging interval was selected due to its effectiveness in teen participants [45], and displays sufficient visual markers of aging; this interval is intermediate to delays commonly used in temporal discounting tasks (e.g., [64]).
VR equipment
All prototype pilot and test sessions were administered using a high-quality tethered headset and VR-capable computer. Photos and voice samples were utilized to construct personalized VR avatars; the Present Self, SUD Future Self, and Recovery Future Self (see the workflow as applied to the senior author, Fig. 1). The paradigm included a black steel park bench that was both real and digital, and co-registered in space; Supplemental Materials for details.
VR habituation
All participants experienced the virtual park for 4.55 ± 1.76 min (mean ± SD) to ensure non-novel VR. The city park was the same environment used for the intervention and included chirping birds, moving tree leaves, and lawn mowing. After a brief respite, participants experienced the VR intervention.
VR avatars
The Present Self avatars reflected participants' current appearance. The age-progressed Future Self avatars were designed to appear 15 years older, with the SUD Future Self showing visible indicators of sustained drug use and the Recovery Future Self appearing healthy (Supplemental Materials for additional details).
VR intervention
Self avatars spoke to participants using a mostly fixed verbal script that matched their voice (manually-tuned text-to-speech engine) and incorporated important personal details provided in the structured interview. Social realism was maximized by avatars tracking participants' position with their eyes and head movements. To maintain presence, technical staff remained silent and avoided touching participants aside from necessary physical guidance and instructions.
The paradigm progressed through four scenes and was designed to take 5 min (although participants' behavior induced some variation with actual time taken being 5.7 ± 0.52 min). Scene 1 (white room): A narrator explained how VR permits simulated time travel. Participants established 'body transfer' [23, 65] in a virtual mirror. The Present Self then appeared as a full body, along with two park benches, and verbally recounted personal details. The Present Self foreshadowed multiple possible futures and presented a choice point, announcing, "choose your future." Scene 2 (city park): Participants were teleported to the city park in the future and listened to the SUD Future Self describe the past 15 years and the ongoing costs of SUD. The SUD Future Self exhibited nonverbal and visual indicators of continued drug use. The participant was teleported back to the white room, where they 'chose another future.' Scene 3: (city park): Resembling Scene 2, but the healthy Recovery Future Self recounted the successes of the past 15 years. Scene 4: (white room): The Present Self debriefed the participant, promoted agency, and reiterated the temporal contingency between present behavior and future outcomes. See Supplemental Materials for further elaboration.
Participants completed delay discounting, the emotion questionnaire, and confidence in recovery item before and after the VR intervention, and the VR Inventory (Table S2) after the intervention. See Fig. 2 for timeline of study procedures. The ACE-Q was always collected after the intervention and behavioral tests to mitigate the potential effects of recalling childhood trauma. Immediately prior to discharge, participants were familiarized with the SMS messaging system ('mRecovery') with a smartphone test image and message (we planned to provide smartphones if needed, which proved unnecessary).
Assessments
Demographics and biometrics
We collected demographic data, photographs, voice samples, and personal details (names of loved ones, favorite activities, future goals, substance use-related punishments, and preferred terminology for intoxication and abstinence).
Alcohol, drug use, and recovery
The Structured Clinical Interview for the Diagnostic and Statistical Manual for Mental Disorders Fifth Edition (SCID-5 [66]) yielded symptom counts for alcohol and the three most-used substances. The Timeline Follow-back (TLFB [67]) administered during the interview characterized participants' substance use patterns 35 days prior to treatment. Accuracy was enhanced with memorable event dates, past text messages, calendars, pictures, and bank statements. NIAAA-defined heavy drinking (≥ 5 or ≥ 4 for males and females, respectively) days were identified, and illicit drug use was characterized by type and amount, in addition to current nicotine use. SUD family history was quantified by degree of relatedness with probable SUD positive relatives. We also characterized current recovery-related activities, treatment history, and confidence in remaining abstinent.
Personality, traits, and emotional states
Measurements included the Adverse Childhood Experiences Questionnaire assessing childhood trauma (ACE-Q [68]), recovery confidence (ad hoc self-efficacy item; 'confidence in maintaining recovery'; 0–100 scale anchored by "not confident at all" to "very confident"; modified from [69]), the Interpersonal Reactivity Index for cognitive and emotional aspects of empathy (IRI [70]), emotion states questionnaire (modified from [23], see Table S3), the Zimbardo Time Perspective Inventory (ZTPI [71]), Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ [72]), trait impulsivity (short UPPS-P [73]), and Center for Epidemiologic Studies Depression Scale (CES-D [74]). Self-reported craving ("How much do I crave drugs right now?") was assessed before and after the VR habituation and intervention, and at the follow-up, to monitor potential intervention effects. A brief suicide screen, Ask Suicide-Screening Questions (ASQ [75]), was conducted during the interview, before, and after the intervention to monitor participants' safety. We administered the Quality of Life Scale (QOLS [76]) at the interview, on the study day, and at the follow-up to quantify participants' self-appraised well-being (social life, personal development, and recreation).
Future self-continuity
The validated future self-continuity scale indexes the perceived psychological distance to the imagined future self [21, 22]. Participants endorsed future self-similarity and connectedness with Euler circle pairs (varying in overlap), labeled 'Current Self' and 'Future Self.' We used the original scale with two minor modifications: an additional option depicting complete overlap (suggested by Hershfield and colleagues [22]), Figure S1; and an expanded temporal window of 15 years to match the age progression of the future self avatars in the paradigm (the first four participants rated according to 10 years).
VR questionnaire
Participants rated the VR experience on elements of presence [77], tolerability/cybersickness, and enjoyment (detailed in Table S2).
Behavioral and neuropsychological tasks
Delay discounting (DD)
An adjusting-amount DD task quantified relative preference for delayed rewards [78, 79]. Choices between smaller immediate versus larger delayed monetary rewards adjusted the next trial's immediate amount down or up, respectively, allowing the procedure to converge on indifference points. The $100 amount was delayed by 2 days, 1 week, 1 month, 6 months, 1 year, and 5 years in 30 choice trials (5 trials × 6 delays). Participants were instructed to choose according to their real preference, and that some choices would be selected at random and paid according to their choice. The actual payout was an additional $20 at the end of the study day, obfuscated by computer selection and rounding.
Aroma choice task
The Aroma Choice Task (ACT) measures behavioral sensation seeking by quantifying the preference for intense, exciting, and novel sensory experiences [80, 81]. Participants chose between receiving a mild and pleasant odorant versus a more exciting (intense and varied aroma with an aversiveness risk) odorant [82, 83].
Stroop task
Executive attention was assessed using a 144-trial Stroop task [84].
Study day procedures
On the study day, participants' urine was screened for common illicit drugs (Wondfo Biotech, Ltd.), and exhaled breath was tested for alcohol (Alcotest® by Dräger). Daily nicotine users were provided an appropriately-dosed nicotine patch (CVS Pharmacy, Inc.) to prevent withdrawal, unless refused (n = 2). Participants completed self-report inventories and behavioral tests interspersed with the VR paradigm; Footnote 3 Fig. 2 for details.
Telehealth; 'mRecovery' SMS
Participants received a scheduled Qualtrics SMS delivery for 30 days following the study day at randomized times between 10 AM and 10 PM. The SMS displayed an image of their Recovery Future Self on the park bench (VR screenshot). Beneath the image, participants rated "How confident am I that I will remain abstinent and recovering today?" on a visual analog scale from 0 to 100% (markers at 25% increments). The daily SMS push ensured image viewing and quantified confidence in remaining abstinent. We tested the system with participants at the end of the study day and clarified the incentives ($40 bonus for full completion with $2 omission penalties).
Follow-up procedures
Participants completed follow-up procedures in-person 30 days post-study (actual follow-ups occurred at 38.57 ± 11.19 days; n = 2 required a phone follow-up). Procedures included self-reported alcohol/drug use, alcohol breath testing, and urine drug screening. Participants endorsing or testing positive for alcohol/drug use completed the TLFB to quantify use type, amount, and frequency. Participants completed the emotion states questionnaire, future self-continuity, QOLS, and DD task again.
Power, analyses, and statistics
We estimated that N = 18 would be required to detect significant effects (G*Power 3.1.9.7 [85]), based on early work using future self avatars' effect on temporal discounting [23], and the assumptions of alpha = 0.05 and power = 0.80. Paired t-tests assessed VR intervention effects on the study day (post- versus pre-VR) for future self-continuity, DD, emotional states, craving, and quality of life. Skewness and kurtosis are reported, and normality was assessed with Q-Q plots for the primary outcomes of interest (Figure S2); to mitigate against spurious effects due to non-normality or outliers we also assessed natural log normalized values (post-VR minus pre-VR, with 2 added to generate positive values, and one-sample t-tested against 0.6931 [i.e., ln2]). Exploratory analyses tested for differences at the 30-day follow-up to assess the persistence of those effects. Exploratory analyses also examined group differences between those who remained abstinent (n = 18) versus those who relapsed within 30 days (n = 3) in demographic variables, outpatient recovery activities, future self-continuity change, and short UPPS-P scores, with additional assessment of executive function and impulsivity traits. Demographic factors with potential explanatory interest (Table 1) were tested for effects of group (t-test or Chi-Square). Spearman correlation tested for associations between the response to the intervention on the study day, follow-up day (delta future self-continuity and DD), and other factors of interest. Change in use was tested against zero in a one-sample t-test in those who relapsed. The alpha level was set to 0.05 (two-sided) for all results, with effect sizes reported as Cohen's d and in-text values as mean ± SD unless otherwise specified. Primary analyses were pre- versus post-VR, uncorrected for multiple testing due to the feasibility nature of the study. Analyses were performed with SPSS v28 (Chicago, IL).
Results
Participants
Phone screens (n = 189) and disqualifications (in descending order: MRI contraindications, current psychotropic medications, length of abstinence, age, health conditions, and VR contraindications) yielded 91 participants scheduled for in-person interviews. We obtained informed consent from 34 participants, with 13 of those later disqualified (MRI/VR safety concerns, VR technical difficulty, lost contact, positive breath reading/drug screen or no-show on the study day, major medical history concern, or > 1-year abstinence). The final n = 21 sample is summarized in Table 1. Alcohol and polysubstance use were highly prevalent, with AUD criteria met for n = 19 (90%) and use disorders of more than one substance met for n = 17 (85%); see Table S1.
Retention
Of n = 21 study day completers, retention was 100% (although phone follow-ups were required in n = 2).
Adverse events
There were no expected or unexpected adverse events observed in this study.
VR tolerability, usability, and emotion states
Average score of presence subscales was moderately high (4.7 ± 1.4 on a 1–7 scale, anchored by "Not at all" to "Very much"), with good tolerability (1.1 ± 0.1 on a 1–4 scale, anchored by "None" to "Severe"), high liking and comfort (6.4 ± 0.7 on a 1–7 scale, anchored by "Strongly Disagree" to "Strongly Agree"), and not too heavy (rating of 1.8 ± 0.9 on a 1–7 scale, anchored by "Strongly Disagree" to "Strongly Agree"). Table S2 details all items and scores. The VR experience did not change negative (1.7 ± 0.9 and 1.6 ± 0.7, post- versus pre-VR, respectively) or positive emotions (5.2 ± 1.3 and 5.3 ± 1.1, post- versus pre-VR, respectively), ps > 0.5. See Table S3 for all items and scores.
Suicide screening
The ASQ was performed pre- and post-VR intervention on the study day and at the follow-up. No participants reported suicidal thoughts during the past month. Five participants reported making a suicide attempt in the past (all were > 5 years prior to study participation). No changes in suicidal thoughts or attempts were reported. Note: the first participant was not screened, and another omitted the ASQ, given remotely (due to Covid-19).
VR effects on the imagined future self and delayed rewards
Future self-continuity
The VR intervention increased participants' future self-similarity post versus pre-VR (1 missing datum for pre-VR), t(19) = 2.80, p = 0.011 (Fig. 3A), skew = 1.60 and kurtosis = 2.73 (log-normalized: t(19) = 2.62, p = 0.017, skew = 0.16 and kurtosis = 0.13), and future self-connectedness post versus pre-VR, t(19) = 5.38, p < 0.001 (Fig. 3B), skew = 1.00 and kurtosis = 0.80 (log-normalized: t(19) = 6.47, p < 0.001, skew = 0.26 and kurtosis = − 0.20).
Delay discounting
The VR intervention increased delayed reward preference in the DD task (area under the curve) post- versus pre-VR (0.36 ± 0.24, and 0.26 ± 0.14, respectively), t(20) = 2.36, p = 0.029, skew = 1.79 and kurtosis = 3.72 (log-normalized: t(20) = 2.38, p = 0.028, skew = 1.54 kurtosis = 2.88). To quantify delay tolerance in units of time delay, k (the fitted parameter indexing discounting) was used to calculate ED50—the delay corresponding to the halving of subjective value (1/k [86])—which revealed a doubling of delay tolerance for rewards, post- versus pre-VR; Fig. 4.
Exploratory analyses
Abstinence and recovery activities
The VR intervention yielded alcohol/drug abstinence in n = 18 (86%) 30 days following the study day. The post-study time to relapse in the n = 3 was 5.3 ± 7.5 days. The total amount of drug use was reduced at follow-up compared to prior-to-treatment use amount reported at the interview, t(2) = 8.76, p = 0.013. Qualitatively, those n = 3 who relapsed (#1) refrained from their primary drug of choice entirely (alcohol), and the quantity of marijuana used dropped 71.6%; (#2) methamphetamine use declined by 68.6%; and (#3) use dropped by 97.6% and 97.0% for alcohol and cocaine, respectively. Participants remaining abstinent did not differ in demographic characteristics (Table 1) from those who relapsed (ps > 0.1), except that those relapsing had more years of education than abstainers (18.7 ± 0.6 and 14.3 ± 2.9, respectively, t(19) = 2.59, p = 0.018).
Future self-continuity response, abstinence, and self-efficacy
We examined intervention response to potentially explain relapse. The VR experience increased future self-similarity in abstainers post- compared to pre-VR [n = 17 (one missing), t(16) = 3.32, p = 0.004] but not in those relapsing (n = 3, p > 0.1); Fig. 5A, B. The change (delta) in post- versus pre-VR future self-similarity between abstainers and those relapsing showed a trend-level difference (1.6 ± 2.0 and − 0.7 ± 0.6, respectively), t(18) = 1.93, p = 0.070, but did not reach significance. Importantly, all participants showing a positive response in future self-similarity (an increase post- versus pre-VR intervention) remained abstinent. Those who relapsed showed either a negative or no change (Fig. 5C).
Sensation seeking and impulsivity
Participants reported representative Sensation Seeking scores relative to published means from an SUD population [87]; 11.3 ± 3.2 versus 11.1 ± 2.9, respectively, p > 0.7. Comparing those who remained abstinent to those who relapsed for trait differences revealed that abstainers were higher sensation seekers than those relapsing (11.9 ± 3.0 and 7.7 ± 2.5, respectively); t(19) = 2.32, p = 0.032, but did not differ in other subscales of UPPS impulsivity (ps > 0.2). Behavioral sensation seeking (measured by ACT) did not correlate with delta DD or delta future self-continuity (post- versus pre-VR and follow-up versus pre-VR), ps > 0.2. ACT choice ratio did not differ between abstainers and those who relapsed, p > 0.4.
Craving
The VR intervention significantly reduced participants' self-reported craving post versus pre-VR, t(19) = 2.36, p = 0.029, although this appeared to be a transient effect that waned 30 days post-VR; Fig. 3C.
Empathy
Personal Distress negatively correlated with the change in future self-similarity at follow-up compared to baseline, r s(17) = − 0.51, p = 0.027. The Empathic Concern subscale correlated positively with the change in post- versus pre-VR intervention in future self-connectedness, r s(18) = 0.57, p = 0.009 and negatively with future self-similarity, r s(18) = − 0.44, p = 0.0496.
30-day follow-up
Change in future self-similarity post- compared to pre-VR correlated with self-reported ratings of recovery importance at follow-up, r s(16) = 0.51, p = 0.031, and confidence in recovery at follow-up r s (16) = 0.55, p = 0.017. Participants' future self-similarity was significantly higher at follow-up compared to pre-VR (4.6 ± 1.9 and 3.4 ± 1.5, respectively), t(17) = 2.29, p = 0.035. Abstainers' future self-similarity response on the study day persisted for 30 days (follow-up versus pre-VR, 4.8 ± 1.8 and 3.4 ± 1.6, respectively), t(15) = 2.36, p = 0.033 (one missing datum). Participants' quality of life (measured by QOLS) significantly improved at the follow-up relative to the study day (80.1 ± 11.7 and 76.5 ± 15.0, respectively), t(15) = 2.37, p = 0.032. The effect of the VR intervention on DD, while significant on the study day, did not persist at follow-up (p > 0.8, relative to pre-VR DD).
VR history, pre-habituation VR comparison, and intervention response
Eight participants (38%) had previously experienced VR in some form. The VR habituation did not significantly change future self-continuity (connectedness and similarity, ps > 0.4). It did reduce negative mood, however (post-habituation versus pre-habituation average subscale scores 1.71 ± 0.94 and 1.61 ± 0.66, respectively), t(19) = 3.88, p = 0.001. Participants with or without prior VR experience did not differ in pre-VR future self-connectedness, pre- or post-VR DD AUC, change in future self-similarity post- versus pre-VR, change in future self-similarity at follow-up compared to pre-VR, change in DD AUC post- compared to pre-VR, or change in DD AUC follow-up compared to pre-VR (ps > 0.1). However, pre-VR future self-similarity was significantly higher in those with prior VR experience compared to those without (4.7 ± 1.3 and 2.7 ± 1.2, respectively), t(18) = 3.58, p = 0.002.
Executive attention (Stroop task)
Executive attention negatively correlated with delta future self-similarity post- versus pre-VR, rs(15) = − 0.49, p = 0.044, but not delta future self-similarity follow-up versus pre-VR or delta future self-connectedness (ps > 0.05). Interestingly, executive attention positively correlated with delta DD follow-up versus pre-VR, r(14) = 0.52, p = 0.041, but not post- versus pre-VR (p > 0.7). Executive function in abstainers and those who relapsed did not differ, p > 0.6. One outlier Stroop score was excluded (3.66 SD below the mean).
Subjective feedback
We initiated sound recording during post-study day interviews after the study commenced. For the n = 12 recorded, all reported that the VR intervention was memorable. Eleven recounted that it was emotional and helpful, and 10 described it as believable and affirmed the technical realism. Ten desired an extended-length VR experience. See Table S4 for representative comments.
Discussion
To our knowledge, this is the first intervention designed to provide SUD recovery support using age-progressed avatars in VR, targeting future self-continuity and temporal discounting. By experiencing vivid and realistic personal futures, participants showed greater future self-continuity (which persisted 30 days later), increased delayed reward preference, reduced craving, and refrained from drug use at high rates. Importantly, the effect on future self-similarity tracked with abstinence, with increased future self-similarity in abstainers, and a lack of response with relapse. Interestingly, abstainers were higher sensation seekers than those relapsing, raising the possibility that this intervention may interact with a predilection for high-intensity experiences. The intervention was well-tolerated and demonstrated the feasibility of implementing a VR intervention in the clinic.
SUD can be conceptualized as overvalued immediate drug reward and undervalued (imagined) longer-term rewards [88]. Inverting this preference should facilitate SUD remission. While cue reactivity and craving are attractive targets for attenuation, more future development is required for effective VR cue exposure therapies (CET) [89]. While CET efficacy may be ultimately limited by the persistence of associative learning that cannot be truly unlearned [90, 91], the power of yet-untested new VR experiences may extend those boundaries [42]. VR is well-suited for creating potentially profound experiences that are autobiographical, vivid, immersive, emotional, and interactive. Therefore, increasing the value of future rewards through attentional and executive focus should shift preference toward more adaptive prosocial delayed reward choices. This massive shift in reward-seeking strategy, reorientating reward drive from immediate hedonic drug rewards toward imagined long-term healthy rewards, potentially reflects the quantum change [92], variously described as a "moment of clarity" [93], Footnote 4 or metaphysically as a "spiritual awakening" (e.g., Step 12 [94])—an often pivotal process for SUD recovery [92, 95, 96].
Autonoetic (self-knowing) consciousness permits humans to mentally simulate themselves in different scenarios in time and space[97, 98]. Footnote 5 'Mental time travel'—projecting oneself into specific imagined personal events—is believed to increase the subjective value of future rewards [32, 99]. We created a VR intervention that incorporated key future thinking elements (autobiographical, future-oriented, vivid, content-specific, and positive [28, 100]), making distant, abstract future rewards potentially capable of competing with drug reward for future-myopic SUD. From an autonoetic perspective, steeply discounting the future arises from pleasing the present self by robbing the future self—an obvious analogy to SUD behavior.
We detected positive correlations between the intervention-induced increase in future self-similarity and both confidence in recovery and recovery importance. These findings suggest an intriguing possibility—that the capacity to increase future self-similarity corresponds to recovery self-efficacy-related traits. The questions we posed addressed "recovery" as a superordinate construct encompassing self-identified recovery-related behavior, rather than abstinence. Insofar as recovery confidence and importance map onto abstinence self-efficacy, this may be an important relationship. Abstinence self-efficacy is key for SUD behavior change, with high confidence in post-treatment abstinence the single strongest predictor of 1-year abstinence [101]; of note, abstinence self-efficacy is also predicted by delay discounting rates in recovering SUD [102]. Executive attention may be more closely aligned with intertemporal choice rather than future self-similarity, as we detected divergent associations with VR changes in these measures.
We conceived the fictional time travel storyline around two central themes: a decision point with agency and salient visible future outcomes. The narrative featured personally-imagined outcomes presented in familiar terminology to maximize engagement and persuasive impact [103]. While the experience could potentially be constructed to present just one future self, we preserved the decision-point-to-outcome contingency by illustrating two plausible outcomes. By animating both selves, we pit the "feared self" against the "positive possible future self" to elicit motivational power [36]. Prior work using therapeutic VR experiences shows that both negative and positive versions of the self possess motivational efficacy [43]. Future iterations of the current intervention should ascertain if similar effects could be obtained with only one future self.
VR applications targeting SUD require special design considerations beyond the standard technical concerns related to simulation sickness [60], namely attention toward exacerbating craving states [104] or comorbid psychiatric conditions (particularly anxiety disorders) or symptoms of trauma (for review, [105]). Informed consent documents must clearly outline the nature of VR, especially for the uninitiated, due to the "superrealism" of modern VR [106]. The nascent field of VR telehealth poses new risks regarding confidentiality [105], which must be carefully managed. We measured craving and suicidality in particular to assess potential psychiatric risks our paradigm posed for this subject population, and were encouraged to find decreased craving and unchanged suicidality (while craving was not a primary outcome, it was an important marker for potential risks of the intervention). Comporting with modern clinical applications of VR, our participants tolerated the VR hardware well (high comfort, low negative effects) and found the experience enjoyable. Despite the realistic portrayal of a decidedly negative version of themselves, participants found the overall experience positive. There were no adverse events observed during the course of the study. Two participants' comments in particular well-articulated the intent of the intervention: "If I stay on the path, I can see the life I envisioned for myself" and "It made me imagine what it would be like the next 15 years to get to that point, all the wasted money, opportunities, and relationships—it made me feel sad. Hearing myself saying getting sober was the best decision I ever made stuck with me." The non-directive feedback highlighted a major strength of VR; even though the experience is not real, the cognitive and emotional states it elicits are real. We believe that carefully designed therapeutic VR experiences have the potential to facilitate emotional epiphanies and the progression to the action and maintenance stages of change. Our results suggest that interacting with virtual age-progressed future selves increases attention on the future: a feature that is often invoked clinically, but difficult to convincingly present in a therapeutic setting. It is easy to imagine modified extensions of the current paradigm to other psychiatric and psychological conditions requiring greater attention on the future. Moreover, with the advent of inexpensive standalone headsets and user-friendly software, therapeutic VR is increasingly accessible to clinicians and practicable for interventions.
Several limitations should be considered. First, this feasibility study was limited in sample size and lacked a control group. While the lack of control groups does not preclude claims of within-subject differences pre- and post-VR, effects related to demand characteristics cannot be ruled out. Our primary goal was to establish that an intervention utilizing digital future selves in immersive VR could produce meaningful changes in future-oriented outcomes (future self-continuity and temporal discounting). Future iterations will employ controls for a simple VR experience and VR interaction with self avatars. Second, future self-continuity was somewhat open to interpretation, raising the possibility that participants did not all visualize the same future self when rating similarity and connectedness. We "deliberately left the concept of similarity open to interpretation for our research participants" (Hershfield 2011, pg. 6 [21]), presuming that the singular imagined future self represented participants' exemplar of their personalized futures. Third, while we described 'mRecovery' as an assessment, it is arguably also an intervention. While our analyses focused on the primary outcomes assessed on the study day (unaffected by 'mRecovery'), our exploratory analyses included effects potentially influenced by 'mRecovery'. Indeed, telehealth SUD interventions may rival in-person therapy [107] and warrant further testing for additive effects in future studies. Finally, although the effects on temporal discounting did not persist 30 days later, the intervention demonstrated short-term efficacy, suggesting promise for future iterations presenting repeated future self experiences that may produce more durable effects.
We believe this approach shows considerable promise for much-needed interventions promoting SUD remission. These findings provide the basis for future randomized controlled trials using larger samples and potentially higher "doses" of the intervention. Future investigations should optimize parameters and identify the "active ingredients" to maximize effects. Accelerated VR adoption suggests that the potential for VR to be used in clinical settings will continue to expand, providing increasingly sophisticated tools for clinicians.
References
-
White WL. The psychology of addiction recovery: an interview with William R. Miller, PhD. published in abridged form in Counselor 2012;13(4):64–73. https://www.chestnut.org/resources/3fbdce0f-6f4d-4196-b992-142dcf7936e8/2012-Dr.-William-Miller-v2.pdf. Accessed 09 June 2022.
-
Rösner S, et al. Opioid antagonists for alcohol dependence. Cochrane Database Syst Rev. 2010. https://doi.org/10.1002/14651858.CD001867.pub3.
-
Anton RF, et al. Combined pharmacotherapies and behavioral interventions for alcohol dependence: the COMBINE study: a randomized controlled trial. JAMA. 2006;295(17):2003–17.
-
Weiss RD, et al. Adjunctive counseling during brief and extended buprenorphine-naloxone treatment for prescription opioid dependence: a 2-phase randomized controlled trial. Arch Gen Psychiatry. 2011;68(12):1238–46.
-
Czapla M, et al. The impact of cognitive impairment and impulsivity on relapse of alcohol-dependent patients: implications for psychotherapeutic treatment. Addict Biol. 2016;21(4):873–84.
-
Hunt WA, Barnett LW, Branch LG. Relapse rates in addiction programs. J Clin Psychol. 1971;27(4):455–6.
-
Kirshenbaum AP, Olsen DM, Bickel WK. A quantitative review of the ubiquitous relapse curve. J Subst Abuse Treat. 2009;36(1):8–17.
-
Jones BT, McMahon J. Negative alcohol expectancy predicts post-treatment abstinence survivorship: the whether, when and why of relapse to a first drink. Addiction. 1994;89(12):1653–65.
-
Jones BT, McMahon J. Negative and positive alcohol expectancies as predictors of abstinence after discharge from a residential treatment program: a one-month and three-month follow-up study in men. J Stud Alcohol. 1994;55(5):543–8.
-
Chen YC, Chen CK, Wang LJ. Predictors of relapse and dropout during a 12-week relapse prevention program for methamphetamine users. J Psychoactive Drugs. 2015;47(4):317–24.
-
APA. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington: American Psychiatric Publishing; 2013.
-
Amlung M, et al. Delay discounting as a transdiagnostic process in psychiatric disorders: a meta-analysis. JAMA Psychiatry. 2019. https://doi.org/10.1001/jamapsychiatry.2019.2102.
-
Amlung M, et al. Steep delay discounting and addictive behavior: a meta-analysis of continuous associations. Addiction. 2017;112(1):51–62.
-
Schüller CB, et al. Neuronal correlates of delay discounting in healthy subjects and its implication for addiction: an ALE meta-analysis study. Am J Drug Alcohol Abuse. 2019;45(1):51–66.
-
MacKillop J, et al. Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology. 2011;216(3):305–21.
-
Smart RG. Future time perspectives in alcoholics and social drinkers. J Abnorm Psychol. 1968;73(1):81–3.
-
Petry NM, Bickel WK, Arnett M. Shortened time horizons and insensitivity to future consequences in heroin addicts. Addiction. 1998;93(5):729–38.
-
Manganiello JA. Opiate addiction: a study identifying three systematically related psychological correlates. Int J Addict. 1978;13(5):839–47.
-
Kooij DTAM, et al. Future time perspective: a systematic review and meta-analysis. J Appl Psychol. 2018;103(8):867–93.
-
O'Donoghue T, Rabin M. The economics of immediate gratification. J Behav Decis Making. 2000;13(2):233–50.
-
Hershfield HE. Future self-continuity: how conceptions of the future self transform intertemporal choice. Ann N Y Acad Sci. 2011;1235:30.
-
Ersner-Hershfield H, et al. Don't stop thinking about tomorrow: individual differences in future self-continuity account for saving. Judgm Decis Mak. 2009;4(4):280–6.
-
Hershfield HE, et al. Increasing saving behavior through age-progressed renderings of the future self. J Mark Res. 2011;48:S23–37.
-
Rutchick AM, et al. Future self-continuity is associated with improved health and increases exercise behavior. J Exp Psychol Appl. 2018;24(1):72–80.
-
Parfit D. Personal identity. The Philosophical Review. 1971;80(1):3–27.
-
Frederick S, Loewenstein G, O'Donoghue T. Time discounting and time preference: a critical review. J Econ Lit. 2002;40(2):351–401.
-
Rung JM, Madden GJ. Experimental reductions of delay discounting and impulsive choice: a systematic review and meta-analysis. J Exp Psychol Gen. 2018;147(9):1349–81.
-
Rösch SA, Stramaccia DF, Benoit RG. Promoting farsighted decisions via episodic future thinking: a meta-analysis. J Exp Psychol Gen. 2021. https://doi.org/10.1037/xge0001148.
-
Patel H, Amlung M. Acute and extended exposure to episodic future thinking in a treatment seeking addiction sample: a pilot study. J Subst Abuse Treat. 2020;116: 108046.
-
Snider SE, LaConte SM, Bickel WK. Episodic future thinking: expansion of the temporal window in individuals with alcohol dependence. Alcohol Clin Exp Res. 2016;40(7):1558–66.
-
Athamneh LN, et al. Future thinking to decrease real-world drinking in alcohol use disorder: repairing reinforcer pathology in a randomized proof-of-concept trial. Exp Clin Psychopharmacol. 2022;30(3):326–37.
-
Atance CM, O'Neill DK. Episodic future thinking. Trends Cogn Sci. 2001;5(12):533–9.
-
Lin H, Epstein LH. Living in the moment: effects of time perspective and emotional valence of episodic thinking on delay discounting. Behav Neurosci. 2014;128(1):12–9.
-
Daniel TO, Stanton CM, Epstein LH. The future is now: reducing impulsivity and energy intake using episodic future thinking. Psychol Sci. 2013;24(11):2339–42.
-
Chiou WB, Wu WH. Episodic future thinking involving the nonsmoking self can induce lower discounting and cigarette consumption. J Stud Alcohol Drugs. 2017;78(1):106–12.
-
Paternoster R, Bushway S. Desistance and the "feared self": toward an identity theory of criminal desistance. J Crim Law Criminol. 2009;99:1103–56.
-
Bailenson JN. Experience on demand: what virtual reality is, how it works, and what it can do. 1st ed. New York: W.W. Norton & Company; 2018.
-
Slater M. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc B. 2009;364(1535):3549–57.
-
Sanchez-Vives MV, Slater M. From presence to consciousness through virtual reality. J Nat Rev Neurosci. 2005;6(4):332.
-
Segawa T, et al. Virtual reality (VR) in assessment and treatment of addictive disorders: a systematic review. Front Neurosci. 2019;13:1409.
-
Hone-Blanchet A, Wensing T, Fecteau S. The use of virtual reality in craving assessment and cue-exposure therapy in substance use disorders. Front Hum Neurosci. 2014. https://doi.org/10.3389/fnhum.2014.00844.
-
Lebiecka Z, et al. Is virtual reality cue exposure a promising adjunctive treatment for alcohol use disorder? J Clin Med. 2021;10(13):2972.
-
Fox J, Bailenson JN. Virtual self-modeling: the effects of vicarious reinforcement and identification on exercise behaviors. Media Psychol. 2009;12(1):1–25.
-
van Gelder JL, Hershfield HE, Nordgren LF. Vividness of the future self predicts delinquency. Psychol Sci. 2013;24(6):974–80.
-
Van Gelder J, et al. Friends with my future self: longitudinal vividness intervention reduces delinquency. Criminology. 2015;53(2):158–79.
-
Wang T, et al. Integrating episodic future thinking into virtual reality to mitigate substance use disorders: a theoretical framework. Proc Hum Factors Ergon Soc Annu Meet. 2019. https://doi.org/10.1177/1071181319631026.
-
Silver E, Ulmer JT. Future selves and self-control motivation. Deviant Behav. 2012;33(9):699–714.
-
Oyserman D, Markus H. Possible selves in balance: implications for delinquency. J Soc Issues. 1990;46(2):141–57.
-
Higgins ET. Self-discrepancy: a theory relating self and affect. Psychol Rev. 1987;94(3):319–40.
-
McIntosh J, McKeganey N. Addicts' narratives of recovery from drug use: constructing a non-addict identity. Soc Sci Med. 2000;50(10):1501–10.
-
Biernacki P. Pathways from heroin addiction: recovery without treatment. Philadelphia: Temple University Press; 1986.
-
McIntosh J, McKeganey N. Identity and recovery from dependent drug use: the addict's perspective. Drugs Educ Prev Policy. 2001;8(1):47–59.
-
Miller WR, Rollnick S. Motivational interviewing: preparing people for change. New York: Guilford Press; 2002.
-
Wray TB, Emery NN. Feasibility, appropriateness, and willingness to use virtual reality as an adjunct to counseling among addictions counselors. Subst Use Misuse. 2022. https://doi.org/10.1080/10826084.2022.2092148.
-
NIAAA. NIAAA recovery research definitions. 2020. https://www.niaaa.nih.gov/research/niaaa-recovery-from-alcohol-use-disorder/definitions. Accessed 16 July 2021.
-
Chambers RA, Krystal JH, Self DW. A neurobiological basis for substance abuse comorbidity in schizophrenia. Biol Psychiat. 2001;50(2):71–83.
-
Grant BF, et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Arch Gen Psychiatry. 2004;61(8):807–16.
-
Grencavage LM, Norcross JC. Where are the commonalities among the therapeutic common factors? Prof Psychol Res Pract. 1990;21(5):372.
-
Riva G, et al. Affective interactions using virtual reality: the link between presence and emotions. CyberPsychology. 2007;10(1):45–56.
-
Kolasinski EM. Simulator sickness in virtual environments. Alexandria VA: US Army; 1995. p. 1–40.
-
Reason JT. Motion sickness adaptation: a neural mismatch model. J R Soc Med. 1978;71(11):819–29.
-
Ames SL, et al. The development of a symptom questionnaire for assessing virtual reality viewing using a head-mounted display. J Optometry. 2005;82(3):168–76.
-
Mori M. The uncanny valley. Energy. 1970;7(4):33–5.
-
Madden GJ, et al. Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Exp Clin Psychopharmacol. 1997;5(3):256–62.
-
Yee N, Bailenson JN. The Proteus effect: self transformations in virtual reality. J Hum Commun Res. 2007;33(3):271–90.
-
First MB, et al. Structured clinical interview for DSM-5—research version. American Psychiatric Association: Arlington; 2015.
-
Sobell MB, et al. The reliability of a timeline method for assessing normal drinker college students' recent drinking history: utility for alcohol research. Addict Behav. 1986;11(2):149–61.
-
Felitti VJ, et al. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults. The Adverse Childhood Experiences (ACE) Study. Am J Prev Med. 1998;14(4):245–58.
-
Hoeppner BB, et al. Comparative utility of a single-item versus multiple-item measure of self-efficacy in predicting relapse among young adults. J Subst Abuse Treat. 2011;41(3):305–12.
-
Davis MH. Interpersonal reactivity index. Washington, DC: American Psychological Association; 1980.
-
Keough KA, Zimbardo PG, Boyd JN. Who's smoking, drinking, and using drugs? Time perspective as a predictor of substance use. Basic Appl Soc Psychol. 1999;21(2):149–64.
-
Torrubia R, et al. The Sensitivity To Punishment And Sensitivity To Reward Questionnaire (SPSRQ) as a measure of Gray's anxiety and impulsivity dimensions. Pers Individ Differ. 2001;31(6):837–62.
-
Cyders MA, et al. Examination of a short English version of the UPPS-P Impulsive Behavior Scale. Addict Behav. 2014;39(9):1372–6.
-
Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.
-
Horowitz LM, et al. Ask suicide-screening questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. 2012;166(12):1170–6.
-
Flanagan JC. A research approach to improving our quality of life. Am Psychol. 1978;33(2):138.
-
Sheridan TB. Musings on telepresence and virtual presence. Presence Teleoper Virtual Environ. 1992;1(1):120–6.
-
Du W, Green L, Myerson J. Cross-cultural comparisons of discounting delayed and probabilistic rewards. Psychol Rec. 2002;52(4):479–92.
-
Oberlin BG, et al. Monetary discounting and ventral striatal dopamine receptor availability in nontreatment-seeking alcoholics and social drinkers. Psychopharmacology. 2015. https://doi.org/10.1007/s00213-014-3850-5.
-
Zuckerman M. The psychophysiology of sensation seeking. J Pers. 1990;58(1):313–45.
-
Zuckerman M, Eysenck S, Eysenck HJ. Sensation seeking in England and America: cross-cultural, age, and sex comparisons. J Consult Clin Psychol. 1978;46(1):139–49.
-
Oberlin BG, et al. Quantifying behavioral sensation seeking with the aroma choice task. Assessment. 2020;27(5):873–86.
-
Oberlin BG, et al. Intoxication effects on impulsive alcohol choice in heavy drinkers: correlation with sensation seeking and differential effects by commodity. Alcohol Clin Exp Res. 2021;45(1):204–14.
-
Stroop JR. Studies of interference in serial verbal reactions. J Exp Psychol. 1935;18(6):643.
-
Faul F, et al. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91.
-
Yoon JH, Higgins ST. Turning k on its head: comments on use of an ED50 in delay discounting research. Drug Alcohol Depend. 2008;95(1–2):169–72.
-
Dugre JR, et al. The psychometric properties of a short UPPS-P impulsive behavior scale among psychiatric patients evaluated in an emergency setting. Front Psychiatry. 2019;10:139.
-
Bickel WK, et al. The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction. Curr Psychiatry Rep. 2011;13(5):406–15.
-
Mellentin AI, et al. Cue exposure therapy for the treatment of alcohol use disorders: a meta-analytic review. Clin Psychol Rev. 2017;57:195–207.
-
Havermans RC, Jansen AT. Increasing the efficacy of cue exposure treatment in preventing relapse of addictive behavior. Addict Behav. 2003;28(5):989–94.
-
Bouton ME. Context, ambiguity, and classical conditioning. Curr Dir Psychol Sci. 1994;3(2):49–53.
-
Miller WR. The phenomenon of quantum change. J Clin Psychol. 2004;60(5):453–60.
-
Lawford CK. Moments of clarity: voices from the front lines of addiction and recovery. New York: Harper Collins; 2009.
-
Anonymous A. Alcoholics anonymous: the story of how many thousands of men and women have recovered from alcoholism. 4th ed. New York: Alcoholics Anonymous World Services Inc.; 2001.
-
Kelly JF, et al. Spirituality in recovery: a lagged mediational analysis of alcoholics anonymous' principal theoretical mechanism of behavior change. Alcohol Clin Exp Res. 2011;35(3):454–63.
-
Green LL, Fullilove MT, Fullilove RE. Stories of spiritual awakening. The nature of spirituality in recovery. J Subst Abuse Treat. 1998;15(4):325–31.
-
Tulving E. Memory and consciousness. Can Psychol. 1985;26(1):1–12.
-
Klein SB, Loftus J, Kihlstrom JF. Memory and temporal experience: the effects of episodic memory loss on an amnesic patient's ability to remember the past and imagine the future. Soc Cogn. 2002;20(5):353–79.
-
Boyer P. Evolutionary economics of mental time travel? Trends Cogn Sci. 2008;12(6):219–24.
-
Daniel TO, Stanton CM, Epstein LH. The future is now: comparing the effect of episodic future thinking on impulsivity in lean and obese individuals. Appetite. 2013;71:120–5.
-
Ilgen M, McKellar J, Tiet Q. Abstinence self-efficacy and abstinence 1 year after substance use disorder treatment. J Consult Clin Psychol. 2005;73(6):1175–80.
-
Athamneh LN, et al. The phenotype of recovery III: delay discounting predicts abstinence self-efficacy among individuals in recovery from substance use disorders. Psychol Addict Behav. 2019. https://doi.org/10.1037/adb0000460.
-
Busselle R, Bilandzic H. Fictionality and perceived realism in experiencing stories: a model of narrative comprehension and engagement. Commun Theory. 2008;18(2):255–80.
-
Lee JH, et al. Experimental application of virtual reality for nicotine craving through cue exposure. CyberPsychology. 2003;6(3):275–80.
-
Parsons TD. Ethical challenges of using virtual environments in the assessment and treatment of psychopathological disorders. J Clin Med. 2021;10(3):378.
-
Slater M, et al. The ethics of realism in virtual and augmented reality. Front Virtual Real. 2020;1:1.
-
Mark TL, et al. Alcohol and opioid dependence medications: prescription trends, overall and by physician specialty. Drug Alcohol Depend. 2009;99(1–3):345–9.
mckinneysymee1942.blogspot.com
Source: https://link.springer.com/article/10.1007/s44192-022-00022-1
0 Response to "Continuities and Changes in Self change Research Summary"
Enregistrer un commentaire