ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展, 2020, 28(8): 1337-1350 doi: 10.3724/SP.J.1042.2020.01337

研究前沿

身体活动的双系统理论:一种强化学习的视角

褚昕宇1,3, 王泽军,2, 肖焕禹3

1 上海工程技术大学体育教学部, 上海 201620

2 同济大学国际足球学院, 上海 200092

3 上海体育学院休闲学院, 上海 200438

Dual system theory of physical activity: A reinforcement learning perspective

CHU Xin-Yu1,3, WANG Ze-Jun,2, XIAO Huan-Yu3

1 Shanghai University of Engineering Science, Department of Physical Education, Shanghai 201620, China

2 Tongji University, International College of Football, Shanghai 200092, China

3 Shanghai University of Sport, School of Leisure Sport, Shanghai 200438, China

通讯作者: 王泽军, E-mail:ddbbt@126.com

收稿日期: 2019-10-24   网络出版日期: 2020-08-15

基金资助: * 国家社科基金青年项目(17CTY019)

Received: 2019-10-24   Online: 2020-08-15

摘要

以理性决策为基础的锻炼行为理论被认为是理解身体活动的主导体系, 它提供了与身体活动相关的认知构念作为有价值的信息。基于社会生态模型设计的行为干预措施, 因表现出了更好的效果而备受关注。近期研究表明, 积极的运动认知和当前体育环境都没能很好地促进个人锻炼习惯的养成, 因此有必要探索新的理论体系来阐明个人锻炼习惯的形成机制。解释身体活动的最新体系是双系统理论, 由于其考虑了身体活动的无意识和快乐决定因素, 有望提供一个更广泛的动机视角。一方面, 多个有代表性的身体活动双系统模型, 从简单的自发路径, 到情境线索与锻炼习惯, 再到突出自动情感评价作用的复杂概念模型, 阐明了系统1的构建, 结合锻炼行为理论所关注的系统2, 为模型的构建提供了依据。另一方面, 通过对双系统的竞争、协调和层级控制原则的分析, 为模型的控制提供了建议。经典的强化学习框架解释了双系统模型的构建与控制原则:在模型的构建方面, 无模型与基于模型的强化学习分别表示系统1和系统2。在模型的控制方面, Dyna协作架构与分层强化学习, 为身体活动可能是一种相互协作、分层执行的复杂行动组合提供了合理解释。最后提出强化学习视角下锻炼者-体育环境的互动模式, 试图从一个全新的角度探讨锻炼行为。

关键词: 身体活动; 双系统模型; 计划行为理论; 锻炼习惯; 强化学习

Abstract

Exercise behavior theory based on rational decision making is regarded as the dominant framework for understanding physical activity, which provides valuable information on cognitive constructs linked to physical activity. Behavioral interventions based on social ecological model have attracted much attention due to its better performance. However, recent studies show that exercise benefits cognition and current sport environment do not promote the formation of individual exercise habit, so it is necessary to explore a new theoretical framework to clarify the formation mechanism of individual exercise habit. The latest framework for explaining physical activity is dual system model, which promises to provide a broader perspective on motivation by considering the non-conscious and hedonic determinants of physical activity. Multiple representative dual system models associated with physical activity, on the one hand, from simple spontaneous path to context cues and exercise habit, and then to complex concept model highlighting the role of automatic affective evaluations, the construct of system 1 is elaborated. Combined with system 2, which is concerned by exercise behavior theory, they offer a basis on how to build dual system model for physical activity. On the other hand, through analysis of the principle for competitive, cooperative and hierarchical control of dual systems, proposals are provided for the control of dual system model. Canonical reinforcement learning framework explains the principle for construct and control of dual system model: in terms of construct of the model, model-free and model-based reinforcement learning represent system 1 and system 2, respectively. In terms of control of the model, Dyna cooperative architecture and hierarchical reinforcement learning provide a reasonable explanation for physical activity is more likely to be a complex combination of actions which is hierarchically operated with a cooperative form than competitive control. Finally, the exerciser-sport environment interaction in reinforcement learning is put forward to explore exercise behavior from a brand-new perspective.

Keywords: physical activity; dual system model; theory of planned behavior; exercise habit; reinforcement learning

PDF (848KB) 元数据 多维度评价 相关文章 导出 EndNote| Ris| Bibtex  收藏本文

本文引用格式

褚昕宇, 王泽军, 肖焕禹. 身体活动的双系统理论:一种强化学习的视角. 心理科学进展, 2020, 28(8): 1337-1350 doi:10.3724/SP.J.1042.2020.01337

CHU Xin-Yu, WANG Ze-Jun, XIAO Huan-Yu. Dual system theory of physical activity: A reinforcement learning perspective. Advances in Psychological Science, 2020, 28(8): 1337-1350 doi:10.3724/SP.J.1042.2020.01337

1 引言

经常进行身体活动有助于促进人们的身心健康, 因此积极参加体育锻炼, 养成良好的个人锻炼习惯十分重要(Rhodes, Janssen, Bredin, Warburton, & Bauman, 2017)。过去的几十年时间里, 研究者在理解和预测个人行为方面取得了巨大进展, 提出了诸如健康信念模型、计划行为理论、自我决定理论以及跨理论模型等具有深刻影响的锻炼行为理论模型(司琦, 2007)。这些理论主要以理性决策为基础, 认为人们只要意识到锻炼的益处, 就会产生参与锻炼的意向、动机, 从而进行有规律的体育锻炼(许昭, 毛志雄, 2015)。然而迄今为止, 依据这些理论设计的行为干预措施都没能有效扩大锻炼者的范围并取得长期而持久的效果(朱为模, 2009), 积极的运动认知并未发现直接促进儿童青少年活动水平的作用(郭强, 汪晓赞, 蒋健保, 2017)。另外, 社会生态模型由于纳入环境因素对个体的影响, 它的提出促使对锻炼行为的理论研究从个人水平跃升到多层次的总体水平, 并因其表现出更好的干预效果, 受到研究者的广泛关注(韩慧, 郑家鲲, 2016; 张展嘉, 王正珍, 于洪军, 陈蔚云, 2018)。张加林、唐炎和胡月英(2017)按日常的生活空间将体育环境划分为家庭、学校、社区及其他体育环境, 家庭、学校、社区体育环境又分别位于社会生态模型的人际、组织、社区三个层面上。鉴于环境层面的评分普遍高于行为层面, 认为当前体育环境并没能更好地促进儿童青少年锻炼习惯的养成。

笔者推测这可能与两个方面的因素有关:首先, 相比较于由知识、态度和技能所组成的个人层面, 环境层面的因素作为影响锻炼行为的远端效应, 影响力可能相对较弱。其次, 多数个人行为是自动化的, 受情境线索(context cues)的提示, 导致行为几乎不会伴随有意识的思考(Marteau, Hollands, & Fletcher, 2012)。因此有必要探索新的理论体系来阐明个人锻炼习惯的形成机制。用于解释身体活动的最新体系是双系统理论, 它认为身体活动是由自动化过程(习惯)和目标定向控制过程(意向)共同调控的复杂行为(Rebar et al., 2016)。从模型的构建与控制两个方面, 本研究对已有身体活动相关的双系统模型进行了介绍, 并引入强化学习(reinforcement learning, RL)框架, 解释双系统模型的构建与控制原则, 同时从RL角度出发, 提出锻炼者-体育环境的互动模式, 用以阐释锻炼行为。

2 身体活动的双系统模型

在认知与社会心理学研究中, 双系统理论认为行为现象是两种不同的心理过程的结果。1型加工(系统1)被认为是快速和自动化的, 因为它需要最小的认知资源和努力; 2型加工(系统2)通常被认为是缓慢和熟虑的, 采用更多受控推理(Evans & Stanovich, 2013)。对双系统的描述有许多不同的名称, 其中系统1被命名为内隐、情境、联想、启发、经验、冲动; 对应的系统2被命名为外显、抽象、命题、分析、理性、熟虑, 这些不同的模型命名通常强调了人的思想、情感和行为的不同方面。虽然理论上习惯的自动化和无意识特征似乎与身体活动所需的努力和复杂性相矛盾, 但习惯作为大脑的捷径, 允许人们在成功参与日常生活行为的同时, 将推理和执行能力留给其他想法和行动。

系统评述与元分析方法的研究表明, 身体活动亦属于由目标定向控制过程(意向)和自动化过程(习惯)共同调控的双系统理论范畴(Gardner, Phillips, & Judah, 2016; Rebar et al., 2016)。一方面, 对计划行为理论(theory of planned behavior, TPB)应用于身体活动的元分析研究表明, 意向与锻炼行为之间的相关性处于中等水平(r = 0.48; McEachan, Conner, Taylor, & Lawton, 2011)。另一方面, Rebar等人(2016)发现, 在37项关于锻炼习惯的研究中, 有70%的研究显示自我报告测量的习惯与锻炼行为之间存在显著的正相关。并且两篇评述都得出一致的结论, 认为习惯与锻炼行为之间存在中等水平的相关性(r = 0.43, Gardner, de Bruijn, & Lally, 2011; r = 0.32, Rebar et al., 2016)。因此, 目前的研究证实了意向和习惯分别与锻炼行为之间存在中等强度的正相关, 意向与习惯均是影响锻炼行为的重要因素。

尽管以理性决策为基础的锻炼行为理论目前仍是身体活动研究领域中的主导方法, 然而考虑到体系的效率问题, 研究者也开始强调快速、自动和无意识因素(习惯)在身体活动中的重要作用, 并逐步提出和完善了身体活动的双系统模型。笔者认为对于身体活动双系统模型的研究需要涵盖两方面的问题:首先, 如何合理构建身体活动双系统模型中系统1和系统2, 即模型的构建问题。其次, 如何有效控制身体活动双系统模型中系统1和系统2, 即模型的控制问题。

2.1 身体活动双系统模型中系统1的构建

在系统1的构建方面, 身体活动整合行为改变(Integrated Behavioral Change, IBC)模型通过整合TPB、自我决定理论、两阶段模型和双系统模型的主要特点于一体, 试图弥补锻炼行为理论模型的不足, 但它所构建的自发路径相对简单(Hagger & Chatzisarantis, 2014)。习惯理论模型则强调情境线索是通过自动化过程影响身体活动的, 在体育环境与个人锻炼习惯的养成之间构建了一条合理的路径, 为改变不良生活方式的干预策略设计提供了新的目标(Wood & Runger, 2016)。而突出自动情感评价(automatic affective evaluations)作用的身体活动双系统模型, 通过自动情感评价将情境线索与身体活动联系起来, 充分考虑了身体活动的情感因素, 可以更好地解释情感启发下的复杂锻炼行为(Conroy & Berry, 2017)。

2.1.1 自发路径

Ajzen (1991)提出的TPB假设行为意向是影响行为最直接的因素, 行为意向反过来受态度、主观规范和主观行为控制的影响(段文婷, 江光荣, 2008)。TPB由于其理论模型的简洁性、便于操作性, 在锻炼行为改变领域得到了大多数锻炼心理学家的认可(沈梦英, 毛志雄, 张一民, 2010)。目前, 对于如何扩展TPB模型以提高它对行为的解释力和预测力, 也一度成为研究者所关注的热点(Ajzen, 2011; Sniehotta, Presseau, & Araujo- Soares, 2014)。近来由Hagger和Chatzisarantis (2014)基于TPB提出的身体活动IBC模型, 描述了来自多种理论的动机与心理构念, 对身体活动参与行为的影响的熟虑与自发路径。

其中, 熟虑路径是由自我决定理论的自主动机对身体活动的远端效应构建的, 这种远端效应是由TPB的态度、主观规范、主观行为控制、意向构念来调节的。自发路径包括内隐态度和内隐动机对身体活动的直接影响。Calitri, Lowe, Eves和Bennett (2009)通过研究发现, 当控制由自我报告测量的外显态度时, 对身体活动的积极内隐态度与身体活动参与水平呈显著相关。另外, Keatley, Clarke和Hagger (2012)的研究主要关注内隐动机对身体活动的影响, 提出自主和控制形式的动机可以在外显和内隐两个层面运行, 并且内隐动机和外显动机对身体活动均有显著的影响。其中, 外显动机对身体活动参与的影响是由意向介导的, 而内隐动机的影响是直接的、非中介的, 这也证实了内隐动机可以反映自发路径对身体活动的影响。

在IBC模型中, TPB的构念取代了自我决定理论的调节构念, 同时该模型也使用了阶段性结构(动机性、意志性), 并考虑了熟虑和内隐决定因素对身体活动的作用, 弥补了早期锻炼行为理论的不足。然而IBC模型仍有一些方面需要改进(Rhodes, 2014)。例如, IBC模型可能缺乏对身体活动中情感方面的考虑。相比TPB中的一般态度构念, 自我决定理论的内部调节构念可以更好地构建这个情感领域, 但在IBC模型中被省略。此外, IBC模型并没有提及社会生态环境的作用, 与熟虑路径相比较, 对于自发路径的构建显得太过简单。

2.1.2 情境线索与锻炼习惯

相较于IBC模型中简单的自发路径, Wood和Runger (2016)提出的习惯理论模型强调情境线索通过激活相应的记忆表征来诱导习惯的应答。随着时间的推移, 如果行为发生在具有相似线索的环境中, 那么可以假设一种习惯只会引发一种相应的行动提示(cue-to-action), 用以替代该行为的熟虑和以目标为基础的决策。从双系统模型的角度看, 这种习惯的应答被认为是更有效的默认, 因为注意力和努力可以被释放到其他需要关注的方面。只有当系统中出现值得关注的变化时(比如移除的线索, 精神状态的改变), 才会使注意力回到更有意识和熟虑的系统。

另外, 锻炼习惯也适用于上述习惯理论模型。首先, 锻炼目标(比如减肥、健身)通过激励人们进行反复的锻炼实践和促使他们接触锻炼情境来影响个人锻炼习惯的形成。一旦形成锻炼习惯, 情境线索(比如锻炼场景、其他锻炼者和先前的锻炼体验)会自动激活记忆中的习惯表征(比如锻炼强度、时间与频率)。例如, Neal, Wood, Labrecque和Phillippa (2012)发现, 当那些具有更强烈跑步习惯的锻炼者接触到与经常跑步的情境相关的词语(比如运动场所名称)时, 就会自动联想到跑步与慢跑。并且, 对那些定期进行锻炼者的研究发现, 大约90%的人都会有一个特定的锻炼场景或时间线索提示, 而那些日常通过特定的场景提示进行锻炼的人, 他们对锻炼习惯的应答会更加突出(Tappe & Glanz, 2013)。当经常去校园体育馆的学生们接触到体育馆的场景时, 由于习惯了这种场景, 他们会主动地提高自己说话的音量(Neal et al., 2012)。

其次, 人们不仅会关注到他们已经形成的锻炼习惯, 还会关注他们锻炼的目标。除非锻炼者有足够的动机, 依据当前的情况调整他们的锻炼行为, 否则锻炼习惯就会成为一种默认的应答方式。例如, 当锻炼者参加身体活动的意向比平时要弱的时候, 他们会倾向于依靠锻炼习惯, 只锻炼到习惯的运动强度(Rebar, Elavsky, Maher, Doerksen, & Conroy, 2014)。而深入研究发现, 行动规划增加了锻炼习惯相对较弱者的身体活动水平, 但与没有行动规划的锻炼者相比, 行动规划减少了具有强烈锻炼习惯者的身体活动水平(Maher & Conroy, 2015)。此外, 中等强度的习惯会自动受到目标的影响, 产生一个习惯强度与现实目标有着互动关系的U型曲线(Neal et al., 2012)。许多有跑步习惯的锻炼者强烈认同, 他们的跑步活动受到了自身目标的影响。在适当情境下, 只有当习惯处于中等强度时才会被目标激活。一旦习惯很强烈, 目标几乎没有作用, 而无论当前目标如何, 情境线索依旧可以激活习惯的应答。另外, 人们会根据他们的锻炼行为来推理自身的锻炼目标。

2.1.3 情境线索、自动情感评价与身体活动

对身体活动的自动情感评价是一种直觉反应, 它反映了当锻炼的概念在一个人的头脑中被激活时, 迅速、非自愿产生的情感体验, 被认为是随着时间的推移和通过锻炼的体验而习得的联想(Conroy & Berry, 2017)。然而, 一些研究者似乎更喜欢使用内隐态度(Calitri et al., 2009; Markland, Hall, Duncan, & Simatovic, 2015)或情感联想(Sala, Baldwin, & Williams, 2016)来表述自动情感评价, 但这些术语的同义用法通常是不被接受的。在情感和健康行为体系的背景下, 自动情感评价最类似于IBC模型中内隐态度的自动情感处理方式, 它反映了对身体活动的瞬时情感评价, 并可以从对身体活动的直接或替代体验中获得(比如在身体活动中观察他人时所唤醒的情感; Williams & Evans, 2014)。由Conroy和Berry (2017)提出的强调自动情感评价作用的身体活动双系统模型, 认为愉快的情感过程提供了内部奖励以激励身体活动(近端效应)。另外, 自动情感评价不同于熟虑情感评价, 但两种评价可能存在重叠。自动情感评价可以快速、不费力的进行, 不需要有意识的处理或精细化, 既可以影响自动动机(比如无意识的促进目标追求), 也可以影响熟虑情感过程(比如情感预期或情感态度; Kiviniemi, Voss-Humke, & Seifert, 2007), 而这些过程被认为是决定锻炼动机的上游因素。

图1总结了如何在双系统体系内将情境线索、自动情感评价与身体活动联系起来的概念模型。具体而言, 自动情感评价是指人们的经验随时间的推移不断积累的过程中, 个人根据身体活动的概念和不同的情感体验之间的特殊联系来创造记忆, 这些记忆的特征组成了联想的效价和强度。当一个人接触到激活身体活动概念的线索时, 相关的记忆被激活, 这种激活方式可以扩散到网络中密切相关的节点(比如特征情感体验)。实际上, 在没有必要经历明显的快乐或不快乐的情况下, 可能会产生一种直觉使得平衡偏向或偏离身体活动。因此, 对身体活动的自动情感评价可能会产生一种冲动, 从而增加不活跃的个体参与锻炼的可能性。另外, 联想-命题评价(Associative- Propositional Evaluation, APE)模型主要分析了内隐态度转变为外显态度的心理机制, 它认为大脑存在两种信息处理方式, 即联想和推理评价过程(Gawronski & Bodenhausen, 2006)。内隐态度是联想评价过程, 由记忆中的联结唤起; 外显态度是推理评价过程, 以对真值(即价值和信念)的确认作为特征(叶娜, 佐斌, 2007)。APE模型在这里被用来解释自动情感评价与TPB的态度构念之间的联系。

图1

图1   突出自动情感评价作用的身体活动双系统概念模型

资料来源:Conroy和Berry (2017)


此外, 经常锻炼者比不经常锻炼者拥有更积极的自动情感评价, 而积极的自动情感评价具有对未来锻炼行为的预测能力。Antoniewicz和Brand (2016b)的研究表明, 改变自动情感评价后, 锻炼行为会出现即刻差异, 而另有研究采用了1周(Calitri et al., 2009)、3个月(Antoniewicz & Brand, 2016a)或6个月的时间范畴(Endrighi et al., 2016), 同样发现自动情感评价与短期和长期锻炼行为都有着联系。并且, 自动情感评价越积极的锻炼者越有可能达到理想的锻炼频率(Brand & Antoniewicz, 2016)。另外, 现有研究为将自动情感评价作为目标的行为改变干预的可行性提供了初步建议(Antoniewicz & Brand, 2014; Calitri et al., 2009; Endrighi et al., 2016)。但在将自动情感评价作为目标进行锻炼干预之前, 首先要明确自动情感评价与锻炼行为之间是否具有因果关系。而目前仅有一项研究证实了两者之间确实存在着因果关系(Antoniewicz & Brand, 2016b)。还有研究报道了自动情感评价和自我报告的锻炼量之间存在正相关(Bluemke, Brand, Schweizer, & Kahlert, 2010; Chevance, Caudroit, Romain, & Boiche, 2017)。

2.2 身体活动双系统模型中系统2的构建

早期的锻炼行为理论是基于信息加工范式的认知主义理论, 它们出自于同一元理论体系, 关注的是意向和规划这样的认知构念, 而忽略了情感构念的动机属性以及自动化过程的重要性(Ekkekakis, 2017)。Biddle, Hagger, Chatzisarantis和Lippke (2007)建议将锻炼行为理论分为5类:第一, 信念-态度理论关注的是行为意向的认知前提, 即某人准备为实现目标行为而投入的努力, 比如TPB。第二, 能力基础理论主要以自我效能构念为例, 自我效能被定义为个人对他人组织和执行达到指定类型的表现所需的行动过程的能力的判断。第三, 控制基础理论认为个人有体验自己作为行为的发起者和调节者的内在欲望或目标, 比如自我决定理论将这种渴望归因于对自我决定的基本心理需求。第四, 以跨理论模型为代表的阶段模型则将行为改变概念化为使一个人更接近所设想的目标的过程。第五, 以健康行动过程取向理论为代表的混合模型将阶段概念与动机变量相结合, 从而预测意向, 并添加了决策后变量(比如执行意向)。这些理论模型定义了研究中的变量, 提供了变量之间的结构, 描述了应该如何操作变量的假设, 允许研究的复制和泛化, 为假设的检验和证伪提供了对话框架。随后在研究中发现, 这些理论都有各自的优点与缺点, 没有哪一个理论能够全面且便于操作地对锻炼行为做出解释、预测, 并能有效地采取干预措施(沈梦英等, 2010)。鉴于这些理论本身存在的一些不足和待改进之处, 不少国内外研究者尝试将多种理论结合起来构建一个整合模型, 以期提高模型对锻炼行为的解释、预测能力(冯玉娟, 毛志雄, 2014; Hagger & Chatzisarantis, 2014)。

2.3 身体活动双系统模型的控制原则

在模型的控制方面, 基于Strack和Deutsch (2004)建议的熟虑-冲动模型(Reflective-Impulsive Model, RIM), Bluemke等人(2010)以跑步为例, 提出了基于竞争控制的身体活动RIM。它认为如果熟虑和冲动系统的方向是一致的, 那么两个系统就会增强跑步的执行; 如果两个系统的方向是冲突的, 那么它们就会竞争控制跑步行为。而Aarts, Paulussen和Schaalma (1997)早前提出了基于协调控制的身体活动与习惯养成模型, 将主要涉及到的对过往锻炼体验记忆的认知过程整合到一个锻炼习惯养成模型中。它假设锻炼的起始在很大程度上是由熟虑决策决定的, 随着不断的重复和更多的练习, 最终形成了一种习惯。此外, Rhodes和Rebar (2018)新近提出基于层级控制的双系统模型, 它认为像身体活动这样的复杂行为是分层描述每个行动的, 这些行动是由较低层级的子行动(sub-actions)所组成的, 行动之间存在熟虑转换, 而其子行动之间又存在自动转换。

2.3.1 竞争控制

RIM强调了与社会行为的联系, 将熟虑和冲动看作是行为的过程(Strack & Deutsch, 2004)。它关注的是由线索或刺激激活的评价和语义联系。这些联系是在接近或逃避导向的冲动系统中对刺激情感反应的基础。熟虑系统将这些自动联想阐述为命题, 联想的真值是经过熟虑后确定的。它可以克服习惯性反应, 或在习惯失效的新情况下, 将行动规划整合到一起。RIM假定信息在两个分离的系统中并行加工, 经过多种渠道相互联系。熟虑系统的作用路径:行为选择→形成行为意向→启动行为计划→行为意向有助于执行行为; 冲动系统的作用路径:知觉到刺激→激发冲动系统网络中的更多节点→激活行为模式(许昭, 毛志雄, 2015)。依据RIM, 没有一个过程是完全熟虑或冲动的, 两个系统相互作用影响行为。尽管RIM与APE模型分享某些重要的假设, 两个模型之间也有明显的区别。例如, RIM假设这两个系统是同时被独立调用的。而在APE模型的默认干预逻辑中, 内隐联想为进一步的命题加工提供了默认值, 使所有的系统2加工都依赖于初始的系统1输入(Evans & Stanovich, 2013)。

Bluemke等人(2010)以跑步为例, 认为如果熟虑系统和冲动系统的方向是一致的, 人们充分了解跑步的益处, 并且跑步与正效价情感形成情感联系, 那么两个系统就会增强跑步的执行; 如果两个系统的方向是冲突的, 人们充分了解跑步的益处, 但将跑步知觉为不快乐的, 把跑步与负效价情感形成情感联系, 那么两个系统就会竞争控制跑步行为。此外, 许昭和毛志雄(2015)构建了由10个变量的熟虑系统和1个变量的冲动系统组成的身体活动RIM模型, 经模型验证发现, 双系统对身体活动的影响受行为习惯性(有无规律运动训练经历)的调节, 行为习惯性越强, 冲动作用越小, 反之越大; 另外, 双系统对身体活动的影响还受意志品质(执行熟虑系统的能力)的调节, 意志品质越高, 熟虑系统对身体活动的影响越大, 反之冲动系统的作用更大, 认为身体活动是由两个系统共同决定的。

2.3.2 协调控制

Aarts, Paulussen和Schaalma (1997)提出的身体活动与习惯养成模型, 将主要涉及过往锻炼体验记忆的认知过程(对锻炼习惯决定因素的认识)整合到一个锻炼习惯养成模型中(图2)。并且认为该模型只是包括社会-人口、生物和遗传因素的一般模式中的一部分, 强调了影响身体活动的心理因素(近端效应)。身体活动与习惯养成模型假设锻炼的起始在很大程度上是由熟虑决策决定的, 比如态度、主观社会规范、行为控制和运动经验(图2上半部分描述了起始的熟虑决策过程); 随着不断的重复和更多的练习, 锻炼的基本决策过程逐步从启发式的决策过程转变为自动化的决策过程, 最终形成了一种不再需要理性思考指导的习惯(图2左下角的粗体箭头表示习惯养成过程的反馈循环)。

图2

图2   身体活动与习惯养成模型

资料来源:Aarts et al. (1997)


然而理性行为和习惯可以看作一个统一体的两端。在目标定向行为既不完全是自动化的, 也不完全是熟虑的情况下, 决策者可以使用类似于启发式决策的方法来进行选择。可以将这种启发式的决策过程设想为一种认知捷径。例如, 不仔细检查所有执行行为的后果, 而是迅速考虑行为的最突出优势, 以明确它的可行性, 或简单地确认能否执行相同的行为。随着练习的增加, 熟虑的决策过程可能会通过对过去行为经历的记忆逐步转变为更具启发性的过程(认知捷径的发展)。一旦这些结果储存在记忆中, 并能够很容易从记忆中被检索, 就不再需要反复思考。启发式处理的核心特征就是从记忆中检索过去的决策过程中得出的结论或作出的决定。在身体活动与习惯养成模型中, 这种学习表现为过去行为对记忆的反馈以及运动事件的记忆对感知的影响。

2.3.3 层级控制

身体活动并不是一种简单的行为, 而是由许多子行动组成的各种复杂行为的组合(Rhodes & Rebar, 2018)。虽然习惯与熟虑的动机可能是一种全或无的现象(即一种影响只能解释某一时刻的行为), 但这不一定适用于长时间(30分钟以上)的身体活动。Gardner等人(2016)基于Cooper和Shallice (2006)的理论, 从行动-阶段的角度概述了这一过程, 认为身体活动这样的复杂行为是分层描述每个行动的, 这些行动由较低层级的子行动组成。这种理解身体活动的方式允许各种行动序列模块化(chunked)为自动调节的行为(Graybiel, 2008)。如图3所示, 一个刚开始跑步锻炼的新手需要预先仔细考虑身体活动的各个方面, 从准备决策(时间、服装等的选择)到执行方面(路线、跑步速度、节奏和风格)。随着时间的推移, 通过简单的子行动(跑步风格)的技能获取, 或更高层级决策与行动的习惯养成, 这些方面中的某一部分可能会形成自动化(前往目的地, 决定要做的活动)。随后当锻炼者形成将前一个子行动的结束与下一个子行动的开始相联系的记忆时, 每个子行动将不再需要思考, 而是由情境触发的接近倾向自动提示行动。

图3

图3   熟虑与习惯促进身体活动之间的建议转换

资料来源:Rhodes和Rebar (2018)


采用这种方法来理解锻炼习惯的形成需要识别行为序列的要素。考虑到锻炼决策(做出锻炼的决定)是影响锻炼行为的重要因素, Verplanken和Melkevik (2008)提出了一种更为可行的方法, 即在身体活动的启动阶段测量习惯。随后Gardner和同事(Gardner et al., 2016; Phillips & Gardner, 2016)提出启动/选择阶段(决定对其他潜在刺激采取行动)与执行阶段(后续的有序行动)可能是对复杂身体活动序列概念化的有效途径。Kaushal, Rhodes, Meldrum和Spence (2017)也认为准备阶段(身体活动前的行为和启动)与执行阶段可能是理解个人锻炼习惯的有效途径。虽然启动阶段与执行阶段都可能成为习惯, 但启动阶段对于理解有规律的身体活动可能更重要, 因为它代表了之前的决策过程。相比之下, 执行阶段可以解释身体活动的持续时间或努力程度, 但似乎不能解释身体活动被反复选择和启动的原因(Gardner et al., 2016)。因此, 上述研究表明启动阶段可能才是身体活动参与频率的主导预测因子。

总之, 在模型的控制方面, 上述三个模型所建议的竞争、协调与层级控制的原则, 为系统1与系统2在复杂身体活动中执行有序控制提供了合理解释。另外, 协调控制是一种序列加工的方式, 而竞争控制是双系统并行加工的方式。鉴于竞争控制并不符合人类认知加工的经济、快捷原则, 在心理学上不太可能实现(艾炎, 胡竹菁, 2018)。因此, 相较于RIM提出的竞争控制, 身体活动更可能是一种相互协作、分层执行的复杂行动组合。

3 强化学习视角下的双系统模型

近年来机器学习领域的计算RL理论对心理学和神经科学产生了持久而深远的影响(Botvinick, Niv, & Barto, 2009; Botvinick & Weinstein, 2014)。虽然RL最初被视为特定计算技术的存储库, 但它已逐步发展成为用于思考人与动物的动机行为和学习过程的一个通用框架。这些影响最初体现在对经典条件反射和操作条件反射的研究中, 随后扩展到运用时序差分学习范式解释中脑多巴胺神经元活动的一个框架。目前基于RL的理论已被用于解决各类问题。因此, 有必要从RL的角度分析双系统模型的构建与控制问题。在模型的构建方面, 基于认知神经科学的观点, 无模型(model-free, MF)和基于模型(model-based, MB)的RL分别表示双系统的系统1与系统2。在模型的控制方面, Dyna协作架构假设MF受到MB控制, 建议通过目标控制不断影响习惯过程, 促进与目标一致的习惯养成。另外, 分层RL (hierarchical RL, HRL)假设MF与MB控制的组合方式应该是任意的, 这进一步扩展了身体活动双系统模型的层级控制机制。并且, MF的目标选择为锻炼习惯养成的重要性提供了依据, 有强烈锻炼习惯的人会优先考虑他们熟悉的行为方式。

3.1 强化学习概述

RL是指智能体(agent)在与环境的连续互动过程中学习最优行动策略的机器学习问题以及解决这类问题的方法(Sutton & Barto, 2018)。在RL任务中有两个互动的对象:智能体与环境。一般而言, 学习者或决策者被称为智能体, 它感知外界环境的状态和反馈的奖励, 并进行学习与决策。智能体泛指人、动物以及机器人和自动驾驶汽车等人工智能应用。环境是指智能体外部的所有事物, 它受到智能体行为的影响而发生状态变化, 并反馈给智能体对应的奖励。如图4所示, 在每一个时间步t, 智能体从环境中观察到一个状态St与一个奖励Rt, 采取一个行动At。环境根据智能体的决策行动决定下一步t+1的状态St+1与奖励Rt+1。学习的策略表示成给定状态下采取的行动。智能体的目标不是短期奖励的最大化, 而是长期累积奖励的最大化。

图4

图4   强化学习中智能体-环境的互动

资料来源:Sutton和Barto (2018)


3.2 强化学习视角下双系统模型的构建

RL的核心问题是对状态-行动配对(预期贴现回报)的值估计, 用以指导行动的选择。一般而言, 解决这个问题有两种策略:一种是根据经验进行值估计的MF策略, 另一种是根据环境模型(奖励和转换函数)学习的MB策略, 随后用它来规划最优策略。MF策略由习惯系统执行, MB策略由目标定向系统执行(Daw, Niv, & Dayan, 2005; Dolan & Dayan, 2013)。

从心理学的角度看, MF-RL是桑代克的效应定律的衍生物, 个体依据这个定律习惯性重复过去强化过的行为(Gershman, Markman, & Otto, 2014)。它不依赖于环境的内部模型, 相反, 配对值以缓存格式(比如查找表)存储, 允许对其快速检索。这些值可以使用简单的试错驱动的学习规则(比如时序差分学习范式)进行增量更新(Sutton & Barto, 2018)。MF策略的主要缺点是缺乏灵活性:当环境或任务发生改变时, 需要重新学习整个缓存值的集。由于这种不灵活重复导致MF策略习惯化。因此, MF-RL从理论上捕获了习惯的关键属性——对奖励变化的不敏感。

相比之下, MB-RL是托尔曼的认知地图概念的衍生物。MB策略以内部模型的形式表示其认知, 当发生改变时, 可以在局部对其进行修改(只需修改模型的一部分)。因此, 与MF策略不同, MB策略不需要缓存值。它可以在不重新学习整个模型的情况下, 灵活地修改策略以追求目标。然而执行MB策略不可避免地比MF策略需要更多的时间和资源(Daw et al., 2005; Keramati, Dezfouli, & Piray, 2011)。另外, TPB将客观环境的作用(比如来自配偶、亲友、榜样的社会支持与锻炼的物质条件)体现在主观规范与主观行为控制两个因素中。它被认为联通了个体与环境, 将客观社会环境与物质条件等因素对个体的约束转变为个体的主观感知, 解释了客观环境因素对行为的作用机制(沈梦英 等, 2010)。这类似于MB-RL中内部模型的作用。

3.3 强化学习视角下双系统模型的控制机制

当学习一个新的不确定任务时, 个体应该仔细考虑行动的后果(MB), 但是在对一个稳定的任务进行长时间的练习之后, 个体通常可以通过重复同一个任务来更快地获得相同的结果(MF)。尽管在最初的双系统RL中假设了一种竞争的赢者通吃机制, 认为MF或MB系统获得对行为的控制是取决于哪个系统提供了更可靠的行动值估计(Daw et al., 2005; Daw, Gershman, Seymour, Dayan, & Dolan, 2011)。然而RL模型调用的这种并行处理作为一种昂贵的中央处理, 几乎随时准备执行规划与熟虑, 因而在心理学上不太可能实现(Evans & Stanovich, 2013)。后续研究更倾向于一种动态整合, 两个系统都根据它们的相对可靠性来计算行动值(Lee, Shimojo, & O’Doherty, 2014)。因此, 结合MF和MB的模型不是简单地假设行为是习惯或目标定向的, 而是在不同的行为控制模型的互动中探索如何产生适应行为。

3.3.1 Dyna协作架构

除整合独立计算的行动值以外, 一些RL模型还建议了MB规划对MF学习的直接影响。例如, Gershman等人(2014)发现在两步决策任务中, 受试者在独立学习了第二步奖励后, 在第一步任务中改变了他们的选择偏好(被认为反映了MF习惯处理)。为了解释这一发现, Gershman等人提出MB系统模拟了一个完整的两步决策过程, MF系统可以从模拟中学习。并且, 他们还引入了一个能够有效整合MF与MB系统的Dyna架构。如图5所示, Dyna架构中行动完全由MF系统控制(允许以最小的计算成本在线进行决策), MB系统通过离线的方式训练MF系统(在两段真实体验之间), 可以对行动产生间接影响。因此, Dyna架构中使用模拟体验替代了部分真实体验。具体而言, MB系统回放经历的状态-行动配对, 然后在习得的环境模型基础上模拟一次转换和奖励。随后MF系统从这些模拟轨迹中进行学习, 如同从真实体验中学习一样。

图5

图5   Dyna协作架构

资料来源:Gershman et al. (2014)


Dyna架构假设熟虑的学习规划能够更新与改进习惯学习的值估计, 通过目标影响习惯学习表示的行动值, 促进与目标一致的习惯养成。因此, 不同于我们通常认为的习惯是MF学习结果的RL假设, 习惯是习得的行为模式, 受到MB控制(Dezfouli & Balleine, 2012)。这可能是由于标准的两步RL决策任务无法有效捕获对结果不敏感的习惯过程, 而在这些任务中的MF学习可能会反映其他刺激驱动的策略, 比如简单的启发式决策。今后对MF学习的研究可能需要开发新的实验任务, 以便更有效地捕获习惯过程。

3.3.2 分层强化学习

HRL的主要目标是将复杂的问题分解成多个小问题, 通过分别解决小问题从而达到解决原问题的目的(周文吉, 俞扬, 2017)。HRL的核心思想是引入抽象机制对学习任务进行分解。Sutton, Precup和Singh (1999)的研究中, 学习任务被抽象为若干选择项(options), 并将这些选择项作为一个特定的行动加入到原来的行动集中。一个选择项可以理解为要完成某子目标而按一定策略执行的行动序列。选择项可以由设计者根据专家知识预先确定, 利用先验知识加速从学习到相关任务的迁移, 也可以通过MF方法学习(Botvinick et al., 2009), 或重复连接到一个模块化的行动序列中(Dezfouli & Balleine, 2012)。因此, HRL可以划分为MF-HRL和MB-HRL。

HRL理论假设将单个动作串联起来, 并将序列作为一个反应单元或模块可能是有利的(Botvinick & Weinstein, 2014)。因为通过模块化方式执行的快速反应会带来更多的平均回报(Keramati et al., 2011)。任何层级的决策原则上都可以通过MF或MB (或两者任意组合)的方式执行。例如, 可以通过目标控制在较高层级上选择先前习得的行动序列来执行期望的目标(Dezfouli & Balleine, 2013), 也可以执行对MB规划的MF控制。Cushman和Morris (2015)研究表明, 个人通过习惯控制来解决目标选择过程, 同时利用规划实现被选择的目标。如图6所示, 左图描述了一个有大量可能的未来行动序列树的程式化选择问题, 它为MB规划提供了一个困难的搜索问题。右图描述的是Cushman和Morris (2015)的假设, MB规划可以通过初始的MF进行目标选择来简化步骤(三个连续实线箭头)。这些模型不是互相排斥的, 而是基于一个共同的假设:个人会灵活地运用习惯或目标控制, 跨层级组合行为以适应特定任务的需求。

图6

图6   基于模型的搜索与无模型的目标选择

资料来源:Daw (2015)


这种MF的目标选择也符合个人一贯的行为方式。出于习惯, 头脑中会减少已有的刻意反应, 甚至在需要作出明确决策时也会减少关注。例如, 一个多属性选择任务涉及一系列出行方式的决策, 有较强骑自行车或开车习惯的人进行了有限的信息检索, 只考虑较少的出行方案, 并偏向于他们习惯的选择(Aarts, Verplanken, & van Knippenberg, 1997; Betsch, Haberstroh, Glockner, Haar, & Fiedler, 2001; Verplanken, Aarts, & van Knippenberg, 1997)。从本质上讲, 有强烈习惯的人处理信息的方式减少了他们考虑采取其他行动的可能性。

3.4 强化学习视角下锻炼者-体育环境的互动模式

从RL的角度看, 锻炼者通过锻炼行为作用于体育环境, 而体育环境又依据锻炼者的行为变化进行状态更新, 并反馈给锻炼者相应的奖励, 促使锻炼者不断调整锻炼行为, 以期累积获得最高回报(图7)。首先, 锻炼者可以通过双系统控制自身的身体活动:MF系统(系统1)受到情境线索提示, 激活包括自动情感评价在内的锻炼习惯行为; MB系统(系统2)通过主观规范与主观行为控制将客观体育环境的作用转变为锻炼者的主观感知(即内部模型, 未画出)。系统2的加工依赖于系统1的输入, 比如态度的情感成分受到自动情感评价的影响(见图7由系统1指向系统2的虚线箭头); 通过系统2对系统1的作用, 促进与目标一致的习惯养成(见图7由系统2指向系统1的虚线箭头)。此外, 双系统是以一种相互协作的形式对身体活动执行分层控制的。例如, 在开始一项新的身体活动或在不同子行动之间进行转换时, 锻炼者更多依赖于系统2, 但在特定情境下重复已习得的锻炼习惯行为时启用系统1, 从而达到节省资源、提高效率的目的。

图7

图7   强化学习视角下锻炼者-体育环境的互动


其次, 特定的体育环境能够自动激活锻炼习惯行为, 被认为是锻炼习惯自动化的情境线索。最近有学者将体育环境划分为建成环境、社会环境和信息通讯环境(张展嘉 等, 2018)。相关研究表明, 从城市的步行性、锻炼者的社交网络以及智能手机使用的信息反馈这三个方面来看, 体育环境能够显著影响锻炼行为(Althoff et al., 2017; Aral & Nicolaides, 2017)。另外, 对锻炼行为的奖励通常可以划分为内部和外部奖励。区别于外部奖励(报酬), 内部奖励被认为是情绪反应和随后对身体活动的情感判断, 代表了个人对情感体验的期望, 有助于形成更强烈的习惯, 比如对内在调节、享受、乐趣和愉悦感的期望(Ekkekakis, Hargreaves, & Parfitt, 2013; Rhodes, Fiala, & Conner, 2009)。外部奖励又与主观规范有关, 可以通过现代媒介化社会中起主导作用的互联网和智能手机等新媒介的积极运用来实现(张业安, 2018)。

此外, 如何在RL框架内运用奖励机制来激发个人的锻炼行为, 或许是行为改变干预策略设计的一个潜在目标。MF-RL是依据候选行动的奖励历史为其分配存储值的, 由此形成类似于刺激-应答习惯的存储策略。可以认为MF-RL维护了一个查找表, 包含对每个状态-行动配对的(存储值)未来回报的预测。另一方面, 内隐评价依赖于MF学习过程(Kurdi, Gershman, & Banaji, 2019)。如果先前的锻炼体验让人感觉良好, 那么锻炼的概念和记忆中的情感状态之间就会产生联想。随后, MB-RL将这些自动联想阐述成命题(其中联想的真值是经过熟虑后确定的), 这也符合APE模型的假设(Conroy & Berry, 2017)。这进一步提示我们, 如果锻炼者对不同“情境线索-锻炼习惯配对”的相关记忆进行主观赋值, 那么同样可以构建一个内部的锻炼习惯查找表, 为从RL角度理解个人锻炼决策的动机效应提供了新的见解。例如, 当个人拥有对锻炼的积极熟虑评价(比如对健康的认识、个人能力的评价、可及社会支持的感知)和愉快的情感体验(比如一种生理兴奋、对过去成绩的自豪感), 因而对身体活动的赋值较高, 那么会更倾向于选择积极的身体活动; 相反, 如果个人对身体活动持有负面评价, 背负着不愉快的体验(比如身体疼痛、对运动损伤的恐惧、由羞愧带来的情感伤害), 那么会更倾向于久坐不动的生活方式, 因为久坐不动的行为也会伴有愉快的体验(比如使用社交软件、上网冲浪、看电视), 导致对久坐行为的赋值高于持有负面评价的身体活动。

总之, RL视角下锻炼者与体育环境的互动模式强调了两者之间的连续互动, 这与社会生态系统理论既有联系又有区别。例如, 由Bronfenbrenner (1979)提出的生态系统理论, 作为社会生态模型早期的版本, 强调了个体的发展嵌套于相互影响的一系列环境系统之中, 在这个系统中环境与个体互相作用并最终影响个体的发展。研究者最近通过系统评述身体活动中社会认知与建成环境的互动机制, 发现两者只在休闲体育活动中存在互动(Rhodes, Saelens, & Sauvage-Mar, 2018)。这或许提示我们, 应当更多关注休闲体育活动领域中体育环境对锻炼行为的影响。

4 小结

身体活动的双系统理论认为情境线索是通过快速、自动、无意识的认知过程(习惯)影响锻炼行为的, 这不仅弥补了早期锻炼行为理论模型的不足, 也在体育环境与个人锻炼习惯的养成之间构建了一条合理的路径。并且, 在双系统模型中通过自动情感评价将情境线索与身体活动联系起来, 可以更好地解释情感启发下的复杂锻炼行为。此外, 身体活动可能是一种相互协作、分层执行的复杂行动组合。习惯与熟虑系统交替控制身体活动, 从而使锻炼者与体育环境之间实现连续的互动。RL视角下的Dyna协作架构建议习惯养成依赖于目标控制, 而情境线索也通过自动化过程影响身体活动, 因此认为身体活动的自动化过程(习惯)可能是整合情境线索(环境)与目标定向控制过程(意向)的关键:自动化过程为目标定向控制提供情境线索输入, 同时受到目标定向控制的影响。最后提出RL视角下锻炼者-体育环境的互动模式, 以期为今后锻炼行为的研究提供一个全新的视角。

参考文献

艾炎, 胡竹菁. (2018).

推理判断中双重加工过程的协作与转换机制

心理科学进展, 26(10), 1794-1806.

[本文引用: 1]

段文婷, 江光荣. (2008).

计划行为理论述评

心理科学进展, 16(2), 315-320.

[本文引用: 1]

冯玉娟, 毛志雄. (2014).

高中生身体活动意向和行为的促进策略:自我决定动机对TPB的贡献

体育科学, 34(8), 64-69.

[本文引用: 1]

郭强, 汪晓赞, 蒋健保. (2017).

我国儿童青少年身体活动与久坐行为模式特征的研究

体育科学, 37(7), 17-21.

[本文引用: 1]

韩慧, 郑家鲲. (2016).

西方国家青少年体力活动相关研究述评——基于社会生态学视角的分析

体育科学, 36(5), 62-70.

[本文引用: 1]

沈梦英, 毛志雄, 张一民. (2010).

中国成年人锻炼行为的影响因素——HAPA与TPB两个理论模型的整合

体育科学, 30(12), 48-54.

[本文引用: 3]

司琦. (2007).

身体活动的行为科学理论综述

体育科学, 27(9), 72-80.

[本文引用: 1]

许昭, 毛志雄. (2015).

身体活动熟虑-冲动双系统模型的构建与检验

体育科学, 35(8), 16-23.

[本文引用: 3]

叶娜, 佐斌. (2007).

联想-命题评价模型——态度改变的新解释

心理科学进展, 15(5), 834-839.

[本文引用: 1]

张加林, 唐炎, 胡月英. (2017).

我国儿童青少年体育环境特征与存在问题研究

体育科学, 37(3), 21-34.

[本文引用: 1]

张业安. (2018).

青少年体质健康促进的媒介责任: 概念、目标及机制

体育科学, 38(6), 14-26.

[本文引用: 1]

张展嘉, 王正珍, 于洪军, 陈蔚云. (2018).

第65届美国运动医学会年会关于身体活动促进的研究热点与进展综述

北京体育大学学报, 41(8), 72-76.

[本文引用: 2]

周文吉, 俞扬. (2017).

分层强化学习综述

智能系统学报, 12(5), 590-594.

[本文引用: 1]

朱为模. (2009).

从进化论、社会-生态学角度谈环境、步行与健康

体育科研, 30(5), 12-16.

[本文引用: 1]

Aarts, H., Paulussen, T., & Schaalma, H. (1997).

Physical exercise habit: On the conceptualization and formation of habitual health behaviours

Health Education Research, 12(3), 363-374.

URL     PMID:10174219      [本文引用: 3]

Aarts, H., Verplanken, B., & van Knippenberg, A. (1997).

Habit and information use in travel mode choices

Acta Psychologica, 96(1-2), 1-14.

[本文引用: 1]

Ajzen, I. (1991).

The theory of planned behavior

Organizational Behavior & Human Decision Processes, 50(2), 179-211.

[本文引用: 1]

Ajzen, I. (2011).

The theory of planned behaviour: Reactions and reflections

Psychology & Health, 26(9), 1113-1127.

DOI:10.1080/08870446.2011.613995      URL     PMID:21929476      [本文引用: 1]

The seven articles in this issue, and the accompanying meta-analysis in Health Psychology Review [McEachan, R.R.C., Conner, M., Taylor, N., & Lawton, R.J. (2011). Prospective prediction of health-related behaviors with the theory of planned behavior: A meta-analysis. Health Psychology Review, 5, 97-144], illustrate the wide application of the theory of planned behaviour [Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179-211] in the health domain. In this editorial, Ajzen reflects on some of the issues raised by the different authors. Among the topics addressed are the nature of intentions and the limits of predictive validity; rationality, affect and emotions; past behaviour and habit; the prototype/willingness model; and the role of such background factors as the big five personality traits and social comparison tendency.

Althoff, T., Sosič, R., Hicks, J. L., King, A. C., Delp, S. L., & Leskovec, J. (2017).

Large-scale physical activity data reveal worldwide activity inequality

Nature, 547(7663), 336-339.

DOI:10.1038/nature23018      URL     PMID:28693034      [本文引用: 1]

To be able to curb the global pandemic of physical inactivity and the associated 5.3 million deaths per year, we need to understand the basic principles that govern physical activity. However, there is a lack of large-scale measurements of physical activity patterns across free-living populations worldwide. Here we leverage the wide usage of smartphones with built-in accelerometry to measure physical activity at the global scale. We study a dataset consisting of 68 million days of physical activity for 717,527 people, giving us a window into activity in 111 countries across the globe. We find inequality in how activity is distributed within countries and that this inequality is a better predictor of obesity prevalence in the population than average activity volume. Reduced activity in females contributes to a large portion of the observed activity inequality. Aspects of the built environment, such as the walkability of a city, are associated with a smaller gender gap in activity and lower activity inequality. In more walkable cities, activity is greater throughout the day and throughout the week, across age, gender, and body mass index (BMI) groups, with the greatest increases in activity found for females. Our findings have implications for global public health policy and urban planning and highlight the role of activity inequality and the built environment in improving physical activity and health.

Antoniewicz, F., & Brand, R. (2014).

Automatic evaluations and exercise setting preference in frequent exercisers

Journal of Sport & Exercise Psychology, 36(6), 631-636.

DOI:10.1123/jsep.2014-0033      URL     PMID:25602145      [本文引用: 1]

The goals of this study were to test whether exercise-related stimuli can elicit automatic evaluative responses and whether automatic evaluations reflect exercise setting preference in highly active exercisers. An adapted version of the Affect Misattribution Procedure was employed. Seventy-two highly active exercisers (26 years +/- 9.03; 43% female) were subliminally primed (7 ms) with pictures depicting typical fitness center scenarios or gray rectangles (control primes). After each prime, participants consciously evaluated the

Antoniewicz, F., & Brand, R. (2016a).

Learning to like exercising: Evaluative conditioning changes automatic evaluations of exercising and influences subsequent exercising behavior

Journal of Sport & Exercise Psychology, 38(2), 138-148.

DOI:10.1123/jsep.2015-0125      URL     PMID:27385674      [本文引用: 1]

This multistudy report used an experimental approach to alter automatic evaluations of exercise (AEE). First, we investigated the plasticity of AEE (study 1). A computerized evaluative conditioning task was developed that altered the AEE of participants in two experimental groups (acquisition of positive/negative associations involving exercising) and a control group (eta2 part. = .11). Second, we examined connections between changes in AEE and subsequent exercise behavior (chosen intensity on a bike ergometer; study 2) in individuals that were placed in groups according to their baseline AEE. Group differences in exercise behavior were detected (eta2 part. = .29). The effect was driven by the performance of the group with preexisting negative AEE that acquired more positive associations. This illustrates the effect of altered AEE on subsequent exercise behavior and the potential of AEE as a target for exercise intervention.

Antoniewicz, F., & Brand, R. (2016b).

Dropping out or keeping up? Early-dropouts, late-dropouts, and maintainers differ in their automatic evaluations of exercise already before a 14-week exercise course

Frontiers in Psychology, 7, 838.

URL     PMID:27313559      [本文引用: 2]

Aral, S., & Nicolaides, C. (2017).

Exercise contagion in a global social network

Nature Communication, 8, 14753.

[本文引用: 1]

Betsch, T., Haberstroh, S., Glockner, A., Haar, T., & Fiedler, K. (2001).

The effects of routine strength on adaptation and information search in recurrent decision making

Organizational Behavior and Human Decision Processes, 84(1), 23-53.

[本文引用: 1]

Biddle, S. J. H., Hagger, M. S., Chatzisarantis, N. L. D., & Lippke, S. (2007).

Theoretical frameworks in exercise psychology

In G. Tenenbaum & R. C. Eklund (Eds.). Handbook of sport psychology (3rd ed., pp. 537-559). Hoboken, NJ: Wiley.

[本文引用: 1]

Bluemke, M., Brand, R., Schweizer, G., & Kahlert, D. (2010).

Exercise might be good for me, but I don’t feel good about it: Do automatic associations predict exercise behavior?

Journal of Sport & Exercise Psychology, 32(2), 137-153.

DOI:10.1123/jsep.32.2.137      URL     PMID:20479475      [本文引用: 3]

Models employed in exercise psychology highlight the role of reflective processes for explaining behavior change. However, as discussed in social cognition literature, information-processing models also consider automatic processes (dual-process models). To examine the relevance of automatic processing in exercise psychology, we used a priming task to assess the automatic evaluations of exercise stimuli in physically active sport and exercise majors (n = 32), physically active nonsport majors (n = 31), and inactive students (n = 31). Results showed that physically active students responded faster to positive words after exercise primes, whereas inactive students responded more rapidly to negative words. Priming task reaction times were successfully used to predict reported amounts of exercise in an ordinal regression model. Findings were obtained only with experiential items reflecting negative and positive consequences of exercise. The results illustrate the potential importance of dual-process models in exercise psychology.

Botvinick, M. M., Niv, Y., & Barto, A. G. (2009).

Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective

Cognition, 113(3), 262-280.

DOI:10.1016/j.cognition.2008.08.011      URL     PMID:18926527      [本文引用: 2]

Research on human and animal behavior has long emphasized its hierarchical structure-the divisibility of ongoing behavior into discrete tasks, which are comprised of subtask sequences, which in turn are built of simple actions. The hierarchical structure of behavior has also been of enduring interest within neuroscience, where it has been widely considered to reflect prefrontal cortical functions. In this paper, we reexamine behavioral hierarchy and its neural substrates from the point of view of recent developments in computational reinforcement learning. Specifically, we consider a set of approaches known collectively as hierarchical reinforcement learning, which extend the reinforcement learning paradigm by allowing the learning agent to aggregate actions into reusable subroutines or skills. A close look at the components of hierarchical reinforcement learning suggests how they might map onto neural structures, in particular regions within the dorsolateral and orbital prefrontal cortex. It also suggests specific ways in which hierarchical reinforcement learning might provide a complement to existing psychological models of hierarchically structured behavior. A particularly important question that hierarchical reinforcement learning brings to the fore is that of how learning identifies new action routines that are likely to provide useful building blocks in solving a wide range of future problems. Here and at many other points, hierarchical reinforcement learning offers an appealing framework for investigating the computational and neural underpinnings of hierarchically structured behavior.

Botvinick, M., & Weinstein, A. (2014).

Model-based hierarchical reinforcement learning and human action control

Philosophical Transactions of the Royal Society B, 369(1655), 20130480.

[本文引用: 2]

Brand, R., & Antoniewicz, F. (2016).

Affective evaluations of exercising: The role of automatic-reflective evaluation discrepancy

Journal of Sport & Exercise Psychology, 38(6), 631-638.

DOI:10.1123/jsep.2016-0171      URL     PMID:28033023      [本文引用: 1]

Sometimes our automatic evaluations do not correspond well with those we can reflect on and articulate. We present a novel approach to the assessment of automatic and reflective affective evaluations of exercising. Based on the assumptions of the associative-propositional processes in evaluation model, we measured participants' automatic evaluations of exercise and then shared this information with them, asked them to reflect on it and rate eventual discrepancy between their reflective evaluation and the assessment of their automatic evaluation. We found that mismatch between self-reported ideal exercise frequency and actual exercise frequency over the previous 14 weeks could be regressed on the discrepancy between a relatively negative automatic and a more positive reflective evaluation. This study illustrates the potential of a dual-process approach to the measurement of evaluative responses and suggests that mistrusting one's negative spontaneous reaction to exercise and asserting a very positive reflective evaluation instead leads to the adoption of inflated exercise goals.

Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, Massachusetts: Harvard University Press.

[本文引用: 4]

Calitri, R., Lowe, R., Eves, F. F., & Bennett, P. (2009).

Associations between visual attention, implicit and explicit attitude and behaviour for physical activity

Psychology & Health, 24(9), 1105-1123.

DOI:10.1080/08870440802245306      URL     PMID:20205048      [本文引用: 1]

The current study explored associations between previous physical activity and both implicit and explicit attitudes, as well as visual attention and activity motivation (intention). Analyses were performed on participants initially unaware of the physical activity focus of the study (N = 98). Higher levels of physical activity were associated with positive implicit attitudes and an attentional bias towards exercise cues. There was a quadratic ('U' shaped) relationship between implicit attitude and attention: the more extreme individuals' implicit attitudes towards exercise (positive or negative) the greater their attentional bias to exercise cues. Furthermore, explicit attitude moderated the relationship between attentional bias and physical activity: attentional bias to exercise cues was associated with higher levels of physical activity only for those who had a strong positive explicit attitude. Findings suggested that implicit cognitions are linked with previous physical activity. Future research should consider strategies for strengthening positive implicit and explicit attitudes and directing attention to cues signalling healthy behaviour.

Chevance, G., Caudroit, J., Romain, A. J., & Boiche, J. (2017).

The adoption of physical activity and eating behaviors among persons with obesity and in the general population: The role of implicit attitudes within the Theory of Planned Behavior

Psychology, Health & Medicine, 22(3), 319-324.

DOI:10.1080/13548506.2016.1159705      URL     PMID:26952746      [本文引用: 1]

Obesity can be prevented by the combined adoption of a regular physical activity (PA) and healthy eating behaviors (EB). Researchers mainly focused on socio-cognitive models, such as the Theory of Planned Behavior (TPB), to identify the psychological antecedents of these behaviors. However, few studies were interested in testing the potential contribution of automatic processes in the prediction of PA and EB. Thus, the main objective of this study was to explore the specific role of implicit attitudes in the pattern of prediction of self-reported PA and EB in the TPB framework, among persons with obesity and in adults from the general population. One hundred and fifty-three adults participated to this cross-sectional study among which 59 obese persons (74% women, age: 50.6 +/- 12.3 years, BMI: 36.8 +/- 4.03 kg m(-)(2)) and 94 people from the general population (51% women; age: 34.7 +/- 8.9 years). Implicit attitudes toward PA and EB were estimated through two Implicit Association Tests. TPB variables, PA and EB were assessed by questionnaire. Regarding to the prediction of PA, a significant contribution of implicit attitudes emerged in obese people, beta = .25; 95%[CI: .01, .50]; P = .044, beyond the TPB variables, contrary to participants from the general population. The present study suggests that implicit attitudes play a specific role among persons with obesity regarding PA. Other studies are needed to examine which kind of psychological processes are specifically associated with PA and EB among obese people.

Conroy, D. E., & Berry, T. R. (2017).

Automatic affective evaluations of physical activity

Exercise & Sport Sciences Reviews, 45(4), 230-237.

URL     PMID:28704217      [本文引用: 5]

Cooper, R. P., & Shallice, T. (2006).

Hierarchical schemas and goals in the control of sequential behavior

Psychological Review, 113(4), 887-916.

URL     PMID:17014307      [本文引用: 1]

Cushman, F., & Morris, A. (2015).

Habitual control of goal selection in humans

Proceedings of the National Academy of Science of the United States of America, 112(45), 13817-13822.

[本文引用: 2]

Daw, N. D. (2015).

Of goals and habits

Proceedings of the National Academy of Science of the United States of America, 112(45), 13749-13750.

[本文引用: 1]

Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011).

Model-based influences on humans’ choices and striatal prediction errors

Neuron, 69(6), 1204-1215.

DOI:10.1016/j.neuron.2011.02.027      URL     PMID:21435563      [本文引用: 3]

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making.

Daw, N. D., Niv, Y., & Dayan, P. (2005).

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

Nature Neuroscience, 8(12), 1704-1711.

DOI:10.1038/nn1560      URL     [本文引用: 1]

Dezfouli, A., & Balleine, B. W. (2012).

Habits, action sequences and reinforcement learning

European Journal of Neuroscience, 35(7), 1036-1051.

DOI:10.1111/j.1460-9568.2012.08050.x      URL     [本文引用: 2]

It is now widely accepted that instrumental actions can be either goal-directed or habitual; whereas the former are rapidly acquired and regulated by their outcome, the latter are reflexive, elicited by antecedent stimuli rather than their consequences. Model-based reinforcement learning (RL) provides an elegant description of goal-directed action. Through exposure to states, actions and rewards, the agent rapidly constructs a model of the world and can choose an appropriate action based on quite abstract changes in environmental and evaluative demands. This model is powerful but has a problem explaining the development of habitual actions. To account for habits, theorists have argued that another action controller is required, called model-free RL, that does not form a model of the world but rather caches action values within states allowing a state to select an action based on its reward history rather than its consequences. Nevertheless, there are persistent problems with important predictions from the model; most notably the failure of model-free RL correctly to predict the insensitivity of habitual actions to changes in the actionreward contingency. Here, we suggest that introducing model-free RL in instrumental conditioning is unnecessary, and demonstrate that reconceptualizing habits as action sequences allows model-based RL to be applied to both goal-directed and habitual actions in a manner consistent with what real animals do. This approach has significant implications for the way habits are currently investigated and generates new experimental predictions.

Dezfouli, A., & Balleine, B. W. (2013).

Actions, action sequences and habits: Evidence that goal-directed and habitual action control are hierarchically organized

PLoS Computational Biology, 9(12), e1003364.

DOI:10.1371/journal.pcbi.1003364      URL     PMID:24339762      [本文引用: 1]

Behavioral evidence suggests that instrumental conditioning is governed by two forms of action control: a goal-directed and a habit learning process. Model-based reinforcement learning (RL) has been argued to underlie the goal-directed process; however, the way in which it interacts with habits and the structure of the habitual process has remained unclear. According to a flat architecture, the habitual process corresponds to model-free RL, and its interaction with the goal-directed process is coordinated by an external arbitration mechanism. Alternatively, the interaction between these systems has recently been argued to be hierarchical, such that the formation of action sequences underlies habit learning and a goal-directed process selects between goal-directed actions and habitual sequences of actions to reach the goal. Here we used a two-stage decision-making task to test predictions from these accounts. The hierarchical account predicts that, because they are tied to each other as an action sequence, selecting a habitual action in the first stage will be followed by a habitual action in the second stage, whereas the flat account predicts that the statuses of the first and second stage actions are independent of each other. We found, based on subjects' choices and reaction times, that human subjects combined single actions to build action sequences and that the formation of such action sequences was sufficient to explain habitual actions. Furthermore, based on Bayesian model comparison, a family of hierarchical RL models, assuming a hierarchical interaction between habit and goal-directed processes, provided a better fit of the subjects' behavior than a family of flat models. Although these findings do not rule out all possible model-free accounts of instrumental conditioning, they do show such accounts are not necessary to explain habitual actions and provide a new basis for understanding how goal-directed and habitual action control interact.

Dolan, R. J., & Dayan, P. (2013).

Goals and habits in the brain

Neuron, 80(2), 312-325.

URL     PMID:24139036      [本文引用: 1]

Ekkekakis, P. (2017).

People have feelings! Exercise psychology in paradigmatic transition

Current Opinion in Psychology, 16, 84-88.

DOI:10.1016/j.copsyc.2017.03.018      URL     PMID:28813362      [本文引用: 1]

Exercise psychology has yet to produce intervention methods capable of increasing exercise and physical activity behavior in a sustainable manner. This situation is forcing a critical reevaluation of current conceptual models, especially the assumption that behavioral decisions are driven solely by the rational evaluation of information. Like other behavioral sciences, exercise psychology is transitioning to dual-process models that acknowledge the importance of non-reflective processes. Emerging evidence suggests that the pleasure or displeasure experienced during exercise may influence subsequent physical activity. These data raise the possibility of inactivity resulting from a conflict between positively evaluated information on health benefits and unpleasant affective experiences. Thus, researchers must devise methods to make exercise and physical activity more pleasant and enjoyable across the lifespan.

Ekkekakis, P., Hargreaves, E. A., & Parfitt, G. (2013).

Invited Guest Editorial: Envisioning the next fifty years of research on the exercise-affect relationship

Psychology of Sport & Exercise, 14(5), 751-758.

[本文引用: 1]

Endrighi, R., Basen-Engquist, K., Szeto, E., Perkins, H., Baum, G., Cox-Martin, M., … Waters, A. J. (2016).

Self-reported and automatic cognitions are associated with exercise behavior in cancer survivors

Health Psychology, 35(8), 824-828.

URL     PMID:27505202      [本文引用: 2]

Evans, J., & Stanovich, K. E. (2013).

Dual-process theories of higher cognition: Advancing the debate

Perspectives on Psychological Science, 8(3), 223-241.

DOI:10.1177/1745691612460685      URL     PMID:26172965      [本文引用: 3]

Dual-process and dual-system theories in both cognitive and social psychology have been subjected to a number of recently published criticisms. However, they have been attacked as a category, incorrectly assuming there is a generic version that applies to all. We identify and respond to 5 main lines of argument made by such critics. We agree that some of these arguments have force against some of the theories in the literature but believe them to be overstated. We argue that the dual-processing distinction is supported by much recent evidence in cognitive science. Our preferred theoretical approach is one in which rapid autonomous processes (Type 1) are assumed to yield default responses unless intervened on by distinctive higher order reasoning processes (Type 2). What defines the difference is that Type 2 processing supports hypothetical thinking and load heavily on working memory.

Gardner, B., de Bruijn, G.-J., & Lally, P. (2011).

A systematic review and meta-analysis of applications of the self-report habit index to nutrition and physical activity behaviours

Annals of Behavioral Medicine, 42(2), 174-187.

URL     PMID:21626256      [本文引用: 3]

Gardner, B., Phillips, L. A., & Judah, G. (2016).

Habitual instigation and habitual execution: Definition, measurement, and effects on behaviour frequency

British Journal of Health Psychology, 21(3), 613-630.

DOI:10.1111/bjhp.12189      URL     PMID:26991427      [本文引用: 2]

OBJECTIVES: 'Habit' is a process whereby situational cues generate behaviour automatically, via activation of learned cue-behaviour associations. This article presents a conceptual and empirical rationale for distinguishing between two manifestations of habit in health behaviour, triggering selection and initiation of an action ('habitual instigation'), or automating progression through subactions required to complete action ('habitual execution'). We propose that habitual instigation accounts for habit-action relationships, and is the manifestation captured by the Self-Report Habit Index (SRHI), the dominant measure in health psychology. DESIGN: Conceptual analysis and prospective survey. METHODS: Student participants (N = 229) completed measures of intentions, the original, non-specific SRHI, an instigation-specific SRHI variant, an execution-specific variant, and, 1 week later, behaviour, in three health domains (flossing, snacking, and breakfast consumption). Effects of habitual instigation and execution on behaviour were modelled using regression analyses, with simple slope analysis to test habit-intention interactions. Relationships between instigation, execution, and non-specific SRHI variants were assessed via correlations and factor analyses. RESULTS: The instigation-SRHI was uniformly more predictive of behaviour frequency than the execution-SRHI and corresponded more closely with the original SRHI in correlation and factor analyses. CONCLUSIONS: Further, experimental work is needed to separate the impact of the two habit manifestations more rigorously. Nonetheless, findings qualify calls for habit-based interventions by suggesting that behaviour maintenance may be better served by habitual instigation and that disrupting habitual behaviour may depend on overriding habits of instigation. Greater precision of measurement may help to minimize confusion between habitual instigation and execution. Statement of contribution What is already known on this subject? Habit is often used to understand, explain, and change health behaviour. Making behaviour habitual has been proposed as a means of maintaining behaviour change. Concerns have been raised about the extent to which health behaviour can be habitual. What does this study add? A conceptual and empirical rationale for discerning habitually instigated and habitually executed behaviour. Results show habit-behaviour effects are mostly attributable to habitual instigation, not execution. The most common habit measure, the Self-Report Habit Index, measures habitual instigation, not execution.

Gawronski, B., & Bodenhausen, G. V. (2006).

Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change

Psychological Bulletin, 132(5), 692-731.

URL     PMID:16910748      [本文引用: 1]

Gershman, S. J., Markman, A. B., & Otto, A. R. (2014).

Retrospective revaluation in sequential decision making: A tale of two systems

Journal of Experimental Psychology: General, 143(1), 182-194.

[本文引用: 3]

Graybiel, A. M. (2008).

Habits, rituals, and the evaluative brain

Annual Review of Neuroscience, 31, 359-387.

DOI:10.1146/annurev.neuro.29.051605.112851      URL     PMID:18558860      [本文引用: 1]

Scientists in many different fields have been attracted to the study of habits because of the power habits have over behavior and because they invoke a dichotomy between the conscious, voluntary control over behavior, considered the essence of higher-order deliberative behavioral control, and lower-order behavioral control that is scarcely available to consciousness. A broad spectrum of behavioral routines and rituals can become habitual and stereotyped through learning. Others have a strong innate basis. Repetitive behaviors can also appear as cardinal symptoms in a broad range of neurological and neuropsychiatric illness and in addictive states. This review suggests that many of these behaviors could emerge as a result of experience-dependent plasticity in basal ganglia-based circuits that can influence not only overt behaviors but also cognitive activity. Culturally based rituals may reflect privileged interactions between the basal ganglia and cortically based circuits that influence social, emotional, and action functions of the brain.

Hagger, M. S., & Chatzisarantis, N. L. (2014).

An integrated behavior change model for physical activity

Exercise & Sport Sciences Reviews, 42(2), 62-69.

URL     PMID:24508739      [本文引用: 3]

Kaushal, N., Rhodes, R. E., Meldrum, J. T., & Spence, J. C. (2017).

The role of habit in different phases of exercise

British Journal of Health Psychology, 22(3), 429-448.

DOI:10.1111/bjhp.12237      URL     PMID:28374463      [本文引用: 1]

OBJECTIVES: The primary purpose of this study was to investigate how habit strength in a preparatory and performance phase predicts exercise while accounting for intention. The secondary purpose was to determine the strength of potential habit antecedents (affective judgement, perceived behavioural control, consistency, and cues) in both exercise phases. DESIGN: This was a prospective study with measures collected at baseline and week 6. METHODS: Participants (n = 181) were a sample of adults (18-65) recruited across nine gyms and recreation centres who completed baseline and follow-up questionnaires after 6 weeks. RESULTS: Intention (beta = .28, p = .00) and habit preparation (beta = .20, p = .03), predicted exercise, and change of exercise with coefficients of beta = .25, (p = .00) and beta = .18, (p = .04), respectively, across 6 weeks but not habit performance (p>.05). CONCLUSIONS: This study highlighted the distinction between the two phases of exercise and the importance of preparatory habit in predicting behaviour. Focusing on a consistent preparatory routine could be helpful in establishing an exercise habit. Statement of contribution What is already known on this subject? A recent meta-analysis found habit to correlate r = .43 with behaviour (Gardner, de Bruijn, & Lally, ). Verplanken and Melkevik () propose that habit in exercise should be measured in separate components. Phillips and Gardner () interpreted this as habitual instigation (thought) to exercise and execution. What does this study add? Extended pervious work and identified two distinct behavioural phases (preparation and performance) for exercise. Habit model revealed that temporal consistency was the strongest predictor in both phases of exercise. Intention and habit of preparatory behaviour predicted exercise fluctuations in gym members.

Keatley, D., Clarke, D. D., & Hagger, M. S. (2012).

Investigating the predictive validity of implicit and explicit measures of motivation on condom use, physical activity, and healthy eating

Psychology & Health, 27(5), 550-569.

URL     PMID:21895458      [本文引用: 2]

Keramati, M., Dezfouli, A., & Piray, P. (2011).

Speed/accuracy trade-off between the habitual and the goal-directed processes

PLoS Computational Biology, 7(5), e1002055.

URL     PMID:21637741      [本文引用: 1]

Kiviniemi, M. T., Voss-Humke, A. M., & Seifert, A. L. (2007).

How do I feel about the behavior? The interplay of affective associations with behaviors and cognitive beliefs as influences on physical activity behavior

Health Psychology, 26(2), 152-158.

URL     PMID:17385966      [本文引用: 1]

Kurdi, B., Gershman, S. J., & Banaji, M. R. (2019).

Model-free and model-based learning processes in the updating of explicit and implicit evaluations

Proceedings of the National Academy of Science of the United States of America, 116(13), 6035-6044.

[本文引用: 1]

Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014).

Neural computations underlying arbitration between model-based and model-free learning

Neuron, 81(3), 687-699.

DOI:10.1016/j.neuron.2013.11.028      URL     PMID:24507199      [本文引用: 1]

There is accumulating neural evidence to support the existence of two distinct systems for guiding action selection, a deliberative

Maher, J. P., & Conroy, D. E. (2015).

Habit strength moderates the effects of daily action planning prompts on physical activity but not sedentary behavior

Journal of Sport & Exercise Psychology, 37(1), 97-107.

DOI:10.1123/jsep.2014-0258      URL     PMID:25730895      [本文引用: 1]

This study was designed to examine the moderating influence of habit strength on daily action planning effects on physical activity and sedentary behavior. A 2 by 2 design was used with experimental factors corresponding to action planning interventions for (a) engaging in physical activity and (b) limiting or interrupting sedentary behavior. At the end of each day for 1 week, university students (n = 195) completed (a) a questionnaire about their behavior during the day and behavioral intentions for the following day and (b) a planning intervention(s) corresponding to their randomly assigned experimental condition. Action planning increased physical activity in those with weak habits but decreased physical activity in those with strong habits compared with those who did not create action plans. Action planning did not impact sedentary behavior. Action planning was a useful behavior change technique for increasing physical activity in people with weak habits, but may be iatrogenic for those with strong habits.

Markland, D., Hall, C. R., Duncan, L. R., & Simatovic, J. (2015).

The effects of an imagery intervention on implicit and explicit exercise attitudes

Psychology of Sport and Exercise, 17, 24-31.

DOI:10.1016/j.psychsport.2014.11.007      URL     [本文引用: 1]

Marteau, T. M., Hollands, G. J., & Fletcher, P. C. (2012).

Changing human behavior to prevent disease: The importance of targeting automatic processes

Science, 337(6101), 1492-1495.

DOI:10.1126/science.1226918      URL     PMID:22997327      [本文引用: 1]

Much of the global burden of disease is associated with behaviors--overeating, smoking, excessive alcohol consumption, and physical inactivity--that people recognize as health-harming and yet continue to engage in, even when undesired consequences emerge. To date, interventions aimed at changing such behaviors have largely encouraged people to reflect on their behaviors. These approaches are often ineffectual, which is in keeping with the observation that much human behavior is automatic, cued by environmental stimuli, resulting in actions that are largely unaccompanied by conscious reflection. We propose that interventions targeting these automatic bases of behaviors may be more effective. We discuss specific interventions and suggest ways to determine whether and how interventions that target automatic processes can enhance global efforts to prevent disease.

McEachan, R. R. C., Conner, M., Taylor, N. J., & Lawton, R. J. (2011).

Prospective prediction of health-related behaviours with the theory of planned behaviour: A meta-analysis

Health Psychology Review, 5(2), 97-144.

DOI:10.1080/17437199.2010.521684      URL     [本文引用: 3]

This meta-analysis explored the efficacy of the Theory of Planned Behaviour (TPB) dependent on behaviour and methodological moderators. A lack of hierarchical analysis in previous reviews risks confounding these moderators. Here moderating roles of behaviour type, length of follow-up, sample age and behavioural measure are explored hierarchically amongst prospective tests of the TPB, controlling for past behaviour where possible. Searching identified 237 prospective tests from 206 articles. Random-effects meta-analytic procedures were used to correcting correlations for sampling and measurement error. Behaviour type moderated the model; physical activity and diet behaviours were better predicted (23.9% and 21.2% variance explained, respectively) whilst risk, detection, safer sex and abstinence from drugs were poorly predicted (between 13.8 and 15.3% variance explained). Methodological moderators were also apparent: age of sample moderated relations with student samples better predicted for physical activity, and adolescent samples better predicted for abstinence behaviours. Behaviours assessed in the shorter term, and those assessed with self-reports (compared with objective measures) were also better predicted. Both behavioural and methodological characteristics moderated relations amongst model components. The results can aid selection of appropriate targets upon which to base interventions.

Neal, D. T., Wood, W., Labrecque, J. S., & Phillippa, L. (2012).

How do habits guide behavior? Perceived and actual triggers of habits in daily life

Journal of Experimental Social Psychology, 48(2), 492-498.

DOI:10.1016/j.jesp.2011.10.011      URL     [本文引用: 1]

What are the psychological mechanisms that trigger habits in daily life? Two studies reveal that strong habits are influenced by context cues associated with past performance (e.g., locations) but are relatively unaffected by current goals. Specifically, performance contexts but not goals automatically triggered strongly habitual behaviors in memory (Experiment 1) and triggered overt habit performance (Experiment 2). Nonetheless, habits sometimes appear to be linked to goals because people self-perceive their habits to be guided by goals. Furthermore, habits of moderate strength are automatically influenced by goals, yielding a curvilinear, U-shaped relation between habit strength and actual goal influence. Thus, research that taps self-perceptions or moderately strong habits may find habits to be linked to goals. (C) 2011 Elsevier Inc.

Phillips, L. A., & Gardner, B. (2016).

Habitual exercise instigation (vs. execution) predicts healthy adults’ exercise frequency

Health Psychology, 35(1), 69-77.

[本文引用: 4]

Rebar, A. L., Dimmock, J. A., Jackson, B., Rhodes, R. E., Kates, A., Starling, J., & Vandelanotte, C. (2016).

A systematic review of the effects of non-conscious regulatory processes in physical activity

Health Psychology Review, 10(4), 395-407.

URL     PMID:27118430      [本文引用: 1]

Rebar, A. L., Elavsky, S., Maher, J. P., Doerksen, S. E., & Conroy, D. E. (2014).

Habits predict physical activity on days when intentions are weak

Journal of Sport & Exercise Psychology, 36(2), 157-165.

URL     PMID:24686952      [本文引用: 1]

Rhodes, R. E. (2014).

Adding depth to the next generation of physical activity models

Exercise & Sport Sciences Reviews, 42(2), 43-44.

DOI:10.1249/JES.0000000000000014      URL     PMID:24657940      [本文引用: 1]

Rhodes, R. E., Fiala, B., & Conner, M. (2009).

A review and meta-analysis of affective judgments and physical activity in adult populations

Annals of Behavioral Medicine, 38(3), 180-204.

DOI:10.1007/s12160-009-9147-y      URL     PMID:20082164      [本文引用: 1]

BACKGROUND: Popular theories of health behavior have often been criticized for neglecting an affective component to behavioral engagement. PURPOSE: This study reviewed affective judgment (AJ) constructs employed in physical activity research to assess the relationship with behavior. Studies were eligible if they included: (a) a measure of physical activity; (b) a distinct measure of AJ (e.g., affective attitude, enjoyment, intrinsic motivation); and (c) involved participants with a mean age of 18 years or older. METHODS: Literature searches were concluded in September, 2009 among five key search engines. This search yielded a total of 10,631 potentially relevant records; of these, 102 passed the eligibility criteria. Random effects meta-analysis procedures with correction for sampling and measurement bias were employed in the analysis. RESULTS: Articles were published between 1989 and 2009, with sample sizes ranging from 15 to 6,739. Of the studies included, 82 were correlational and 20 were experimental, yielding 114 independent samples. The majority of the correlational samples reported a significant positive correlation between AJ and physical activity (83 out of 85), with a summary r of 0.42 (95% CI 0.37 to 0.46) that was invariant across the measures employed, study quality, population sampled and cultural variables. Experimental studies demonstrated that persuasive, information-based, and self-regulatory interventions failed to change AJ; by contrast, environmental and experiential interventions showed promise in their capability to influence AJ. CONCLUSIONS: The results point to a medium-effect size relationship between AJ and physical activity. Interventions that change AJ are scarce despite their potential for changing physical activity. Future experimental work designed to evaluate the causal impact ofAJ on physical activity is required.

Rhodes, R. E., Janssen, I., Bredin, S. S. D., Warburton, D. E. R., & Bauman, A. (2017).

Physical activity: Health impact, prevalence, correlates and interventions

Psychology & Health, 32(8), 942-975.

DOI:10.1080/08870446.2017.1325486      URL     PMID:28554222      [本文引用: 1]

OBJECTIVE: To provide a broad overview of the state of physical activity (PA) research in the form of (1) definitions of PA, (2) health benefits, (3) prevalence, (4) correlates and (5) interventions. DESIGN: A high-level overview of published reviews of the literature. RESULTS: Regular PA is an effective primary and secondary preventative strategy against at least 25 chronic medical conditions with risk reduction typically in the 20-30% range. While approximately 75% of adults meet recommended PA guidelines, the prevalence is slightly lower for women compared to men, and considerably lower for youth, older adults and those in higher income countries. Motivation, self-efficacy and self-regulation remain consistent correlates of PA. Interventions show PA changes in the small effect size range for adults and youth but the heterogeneity is considerable across studies. Only a few (aggregate of behavioural regulation strategies, supervision, high frequency of contact) reliable moderators of intervention success were identified across study quality, sample characteristics, theory/behaviour change techniques and delivery modes/settings. CONCLUSION: PA research should continue to examine the mechanisms causing health outcomes, the dose that can lead to clinically relevant changes in health status, the scope and validity of PA surveillance and innovative behaviour change techniques, while improving the reach and duration of PA interventions.

Rhodes, R. E., & Rebar, A. L. (2018).

Physical activity habit: Complexities and controversies

In Verplanken, B. (Eds.), The psychology of habit: Theory, mechanisms, change, and contexts

[本文引用: 3]

Rhodes, R. E., Saelens, B. E., & Sauvage-Mar, C. (2018).

Understanding physical activity through interactions between the built environment and social cognition: A systematic review

Sports Medicine, 48(8), 1893-1912.

[本文引用: 1]

Sala, M., Baldwin, A. S., & Williams, D. M. (2016).

Affective and cognitive predictors of affective response to exercise: Examining unique and overlapping variance

Psychology of Sport & Exercise, 27, 1-8.

[本文引用: 1]

Sniehotta, F. F., Presseau, J., & Araujo-Soares, V. (2014).

Time to retire the theory of planned behaviour

Health Psychology Review, 8(1), 1-7.

URL     PMID:25053004      [本文引用: 1]

Strack, F., & Deutsch, R. (2004).

Reflective and impulsive determinants of social behavior

Personality and Social Psychology Review, 8(3), 220-247.

URL     PMID:15454347      [本文引用: 2]

Sutton, R. S., & Barto, A. G. (2018) . Reinforcement learning: An introduction Cambridge, Massachusetts: Massachusetts Institute of Technology Press An introduction. Cambridge, Massachusetts: Massachusetts Institute of Technology Press.

[本文引用: 3]

Sutton, R. S., Precup, D., & Singh, S. (1999).

Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Artificial Intelligence, 112(1-2), 181-211.

[本文引用: 1]

Tappe, K. A., & Glanz, K. (2013).

Measurement of exercise habits and prediction of leisure-time activity in established exercise

Psychology, Health & Medicine, 18(5), 601-611.

[本文引用: 1]

Verplanken, B., Aarts, H., & van Knippenberg, A. (1997).

Habit, information acquisition, and the process of making travel mode choices

European Journal of Social Psychology, 27(5), 539-560.

[本文引用: 1]

Verplanken, B., & Melkevik, O. (2008).

Predicting habit: The case of physical exercise

Psychology of Sport & Exercise, 9(1), 15-26.

[本文引用: 1]

Williams, D. M., & Evans, D. R. (2014).

Current emotion research in health behavior science

Emotion Review, 6(3), 277-287.

[本文引用: 1]

Wood, W., & Runger, D. (2016).

Psychology of habit

Annual Reviews of Psychology, 67(1), 289-314.

[本文引用: 2]

/


版权所有 © 《心理科学进展》编辑部
地址:北京市朝阳区林萃路16号院 
邮编:100101 
电话:010-64850861 
E-mail:jinzhan@psych.ac.cn
备案编号:京ICP备10049795号-1 京公网安备110402500018号

本系统由北京玛格泰克科技发展有限公司设计开发