Abstract
Living systems, from single cells to higher vertebrates, receive a continuous stream of non-stationary inputs that they sense, for e.g. via cell surface receptors or sensory organs.
生物系统,从单细胞到高等脊椎动物,接收连续的非稳态输入流,这些输入通过细胞表面受体或感官器官进行感知。
By integrating these time-varying, multi-sensory, and often noisy information with memory using complex molecular or neuronal networks, they generate a variety of responses beyond simple stimulus-response association, including avoidance behavior, life-long-learning or social interactions. In a broad sense, these processes can be understood as a type of biological computation.
通过将这些随时间变化的、多感官的、且通常是噪声的信息与记忆结合,利用复杂的分子或神经网络,它们产生了多种反应,超越了简单的刺激-反应关联,包括 回避行为、终身学习 或社会互动。从广义上讲,这些过程可以理解为一种生物计算。
Taking as a basis generic features of biological computations, such as real-time responsiveness or robustness and flexibility of the computation, we highlight the limitations of the current attractor-based framework for understanding computations in biological systems.
基于生物计算的通用特征,如实时响应能力或计算的鲁棒性和灵活性,我们强调了当前基于吸引子的框架在理解生物系统中的计算方面的局限性。
We argue that frameworks based on transient dynamics away from attractors are better suited for the description of computations performed by neuronal and signaling networks.
我们认为,基于远离吸引子的瞬态动力学的框架更适合描述神经和信号网络执行的计算。
In particular, we discuss how quasi-stable transient dynamics from ghost states that emerge at criticality have a promising potential for developing an integrated framework of computations, that can help us understand how living system actively process information and learn from their continuously changing environment.
特别是,我们讨论了在临界状态下出现的幽灵状态所产生的准稳定瞬态动力学如何具有开发综合计算框架的潜力,这可以帮助我们理解生物系统如何主动处理信息并从其不断变化的环境中学习。
Introduction
When referring to computations, the associated concept usually reflects the formal definition of computation adopted during the first half of the 20th century which was devised with the purpose of answering questions relating e.g. the extent to which mathematics can be reduced to discrete logical formulas, and how mathematical proofs or calculations may be automated [14,51].
当提到计算时,相关的概念通常反映了 20 世纪上半叶采用的计算的正式定义,该定义旨在回答与数学在多大程度上可以简化为 离散逻辑公式 以及如何自动化数学证明或计算等问题[14,51]。
For example, a function on the integer numbers is called computable, if an output integer can be calculated by an algorithm after a finite number of steps [51]. This implies that computation, in an abstract way, refers to a defined mapping between inputs and outputs.
In that broad sense, many basic processes characteristic of living systems on all scales of organization, from single cells in tissues to free-living single-cell organisms and higher vertebrates, can be defined in terms of computation.
比如,如果一个整数函数可以通过算法在有限步数后计算出输出整数,则称其为可计算的[51]。这意味着计算在抽象意义上是指输入和输出之间的定义映射。
从这个广义上讲,从组织中单个细胞到自由生活的单细胞生物和高等脊椎动物,许多生物系统在所有组织尺度上具有的基本过程都可以用计算来定义。
While vertebrates and many other multi-cellular organisms rely on neuronal networks, single cells and single-cell organisms use protein and/or gene-regulatory networks as computational entities to integrate multi-dimensional sensory information (inputs) with memory, generating complex self-organized behavior (output) [26].
虽然脊椎动物和许多其他多细胞生物依赖于神经网络,但单细胞和单细胞生物使用蛋白质和/或基因调控网络作为计算实体,将多维感官信息(输入)与记忆整合,产生复杂的自组织行为(输出)[26]。
A fox that chases a rabbit, for example, uses its neuronal network to continually process sensory (visual, auditory, olfactory, tactile etc.) information which is disrupted and changes over time and space, i.e. when the rabbit hides behind a bush (Fig. 1a, top).
比如,一只追逐兔子的狐狸使用其神经网络不断处理感官(视觉、听觉、嗅觉、触觉等)信息,这些信息会随着时间和空间的变化而中断,即当兔子躲在灌木丛后面时(图 1a,顶部)。
In order to avoid random change in the running direction in the absence of a visual contact with the rabbit, the fox integrates the current sensory information with the memory of the last localization of the rabbit to determine its behavior.
为了避免在没有视觉接触兔子的情况下随机改变奔跑方向,狐狸将当前的感官信息与上次定位兔子的记忆积分,以确定其行为。
Immune cells in our body that chase invading bacteria, however, face similar challenges as the fox chasing the rabbit: the cells’ navigation is guided by local chemical cues secreted by the bacteria that are noisy, disrupted, and vary over time and space, in order to engulf and degrade the motile invading microbes (Fig. 1a, bottom).
在我们体内追逐入侵细菌的免疫细胞,然而,面临着与狐狸追逐兔子类似的挑战:细胞的导航是由细菌分泌的局部化学线索引导的,这些线索是嘈杂的、被破坏的,并且随时间和空间变化,以吞噬和降解运动的入侵微生物(图 1a,底部)。
To avoid immediate switching to random migration when signals are disrupted, single cells, just like the fox chasing a rabbit, require a memory of the localization of the last encountered chemical signal, as a means of generating a reliable migration trajectory over long distances. We will refer to such computations performed by living systems as biological or natural computations.
为了避免在信号中断时立即切换到随机迁移,单个细胞就像追逐兔子的狐狸一样,需要记住上次遇到的化学信号的位置,以便在长距离上生成可靠的迁移轨迹。我们将把生物系统执行的这种计算称为生物计算或自然计算。
This description of processes in living systems through the concept of computation has inevitably led to a frequent referral to terms such as ’circuitry’, ’computer/machine’, ’execution of programs’ or ’interpretation of code’. However, their indiscriminate use can easily convey misleading ideas (and often does) by neglecting fundamental differences between the computational process in living and engineered systems [13,44,59,60,65,72,74].
这种通过计算概念描述生物系统过程的方式不可避免地导致频繁引用诸如“电路”、“计算机/机器”、“程序执行”或“代码解释”等术语。然而,它们的不加区分的使用很容易传达误导性的想法(并且经常会这样做),因为它忽略了生物系统和工程系统中计算过程的根本差异[13,44,59,60,65,72,74]。
For example, computers accept input once at the beginning of the computation (i.e., do not accept signals while performing a particular task), and obtaining the result of the computation requires presentation of the complete input [47]. In contrast, living systems compute in real-time (like the fox and the immune cell), using incomplete inputs which continuously change across time and space.
比如,计算机在计算开始时一次性接受输入(即,在执行特定任务时不接受信号),并且获取计算结果需要提供完整的输入[47]。相比之下,生物系统实时计算(就像狐狸和免疫细胞一样),使用不断随时间和空间变化的不完整输入。
The process of natural computation itself is adaptive, while yielding robust and reproducible responses even in the presence of noise, whereas computer algorithms account only for robustness and reproducibility of computations, which is achieved by minimizing noise (in the constituting computer circuits). Moreover, living systems are characterized by on-the-fly and life-long learning, features that have not been realized in any man-made system so far.
自然计算的过程本身是自适应的,即使在存在噪声的情况下也能产生稳健且可重复的响应,而计算机算法仅考虑计算的稳健性和可重复性,这是通过最小化噪声(在构成计算机电路中)来实现的。此外,生物系统的特点是即时学习和终身学习,这些特征迄今为止尚未在任何人造系统中实现。
We therefore discuss in this article the current concepts of computation from a dynamical systems point of view and argue that they explain information processing in living systems only to a very limited extent. We advocate the necessity to base theories of biological computation on transients which can serve as a dynamical basis through which the majority of the observed features of natural computation can be captured [5,7,8,16,22,37,46,47,50,53,63].
因此,我们在本文中从动力系统的角度讨论当前的计算概念,并认为它们仅在很大程度上解释了生物系统中的信息处理。我们主张有必要将生物计算理论建立在瞬态基础上,这可以作为动力学基础,通过它可以捕捉到自然计算的大多数观察特征[5,7,8,16,22,37,46,47,50,53,63]。
Given that from a conceptual viewpoint, the challenges, which single cells and higher vertebrates face are overlapping to a large degree, we emphasize in this review the necessity for a general theory of natural computations and learning that is applicable to both neural and aneural systems.
鉴于从概念上看,单细胞和高等脊椎动物所面临的挑战在很大程度上是重叠的,我们在本综述中强调了对适用于神经系统和非神经系统的一般自然计算和学习理论的必要性。
Results
Computing with stable attractors: machines, neuronal networks and cellular signaling
The existing theoretical frameworks for biological computations mainly refer to Turing-like computations [83]. Let us exemplify this by considering an every-day example of a finite-state machine, a turnstile. A turnstile can be found in two different states, closed (S1) and open (S2). It requires an input, i.e. a coin to switch from the closed to the open state (S1 → S2), and a second input, a push, to return to the closed state (S2 → S1). If a coin is inserted when the system is in S2 (open), or if its bars are pushed when it is in S1 (closed), the machine does not respond (Fig. 1b). For this system, the computation is realized through the switching between the distinct stable states (S1, S2) that are available, such that the specific inputs (coin, push) are mapped to a defined state of the turnstile. Despite that this machine has a very limited computational power that does not reflect that of Turing machines in general, we will use it to demonstrate a line of thought that (i) the state-dependent computations performed by machines display limitations for tasks that are relevant for living systems, and that (ii) a range of computations performed by living systems lie outside of the domain of machines, prompting us to propose that a broader definition and mechanisms of computations are necessary to describe biological computations.
现存的生物计算理论框架主要参考图灵式计算[83]。让我们通过考虑一个日常的有限状态机示例——旋转门来说明这一点。旋转门可以处于两种不同的状态:关闭(S1)和打开(S2)。它需要一个输入,即一枚硬币,以从关闭状态切换到打开状态(S1 → S2),以及第二个输入,即推动,以返回到关闭状态(S2 → S1)。如果在系统处于 S2(打开)时插入硬币,或者在系统处于 S1(关闭)时推动其栏杆,机器不会响应(图 1b)。对于该系统,计算是通过在可用的不同稳定状态(S1、S2)之间切换来实现的,这样特定的输入(硬币、推动)就映射到旋转门的定义状态。尽管这台机器的计算能力非常有限,并不反映图灵机的一般能力,但我们将用它来展示一种思路,即(i)机器执行的状态依赖计算在与生物系统相关的任务中显示出局限性,以及(ii)生物系统执行的一系列计算超出了机器的领域,这促使我们提出需要更广泛的计算定义和机制来描述生物计算。
The computations of the turnstile, in the language of dynamical systems, can be formalized as attractor-based computation. Turing implicitly used this idea in his unpublished work on intelligent machines [85], as well as in his seminal work on self-organization in living systems [84]. The idea, however, was clearly explicated by Hebb [27] and Hopfield [29] for neuronal networks, receiving formalization by Hirsch and Baird [28]: ”as the overall system evolves in time, each subsystem passes through a sequence of attractors that are related to specific output of the system, and this sequence is termed as the computation process”. In this view, the number and type of attractors is an intrinsic property of the system, determined by the underlying network topology and nodal dynamics. Thus, restricting only to fixed point dynamics for simplicity, the possible solutions of the system form a so-called quasi-potential landscape which can be explicitly calculated for gradient systems [73]. Each valley in the landscape corresponds to a stable state, separated by unstable states or saddles (Fig. 1c). The external signals induce switching between the available states, such that a signal is uniquely associated with a specific valley. This also implies that in absence of a perturbation, the dynamics would be retained indefinitely in a valley. The same conceptual framework has been also adopted to study signaling networks in single cells. Large numbers of experimental and theoretical studies over the past two decades have been focused on identifying the underlying protein- or gene-interaction networks or network modules [12,18], relating the possible attractors with the observed phenotypes or responses [1,3,32,62,66,67,69]. The question is however, to which extent attractor-based computations can explain the basic features of natural computations, the simplest being real-time processing of non-stationary signals.
以动力系统的语言来说,旋转门的计算可以形式化为基于吸引子的计算。Turing 在他关于智能机器的未发表工作以及他关于生物系统自组织的开创性工作中隐含地使用了这一思想。然而,这一思想被 Hebb 和 Hopfield 明确阐述用于神经网络,并由 Hirsch 和 Baird 进行了形式化:“随着整个系统随时间演化,每个子系统都会经历一系列与系统特定输出相关的吸引子,这个序列被称为计算过程”。在这种观点下,吸引子的数量和类型是系统的内在属性,由底层网络拓扑和节点动力学决定。因此,为了简化,仅限于不动点动力学,系统的可能解形成所谓的准势景观,可以显式地计算梯度系统[73]。景观中的每个山谷对应一个稳定状态,由不稳定状态或鞍点分隔(图 1c)。外部信号引起可用状态之间的切换,使得信号与特定山谷唯一关联。这也意味着,在没有扰动的情况下,动力学将无限期地保留在一个山谷中。同样的概念框架也被采用来研究单细胞中的信号网络。在过去二十年中,大量实验和理论研究集中于识别潜在的蛋白质或基因相互作用网络或网络模块[12,18],将可能的吸引子与观察到的表型或反应相关联[1,3,32,62,66,67,69]。然而,问题是,基于吸引子的计算在多大程度上可以解释自然计算的基本特征,其中最简单的是对非稳态信号的实时处理。
Limitations of the current framework: an example from single-cell signaling
Let us consider a bistable system as a minimal case of multistability, i.e. as a system that has multiple, coexisting states/attractors (cf. Box 1). In the quasi-potential landscape analogy, this corresponds to a landscape with two valleys, separated by a saddle. Generally, bistability can emerge via double negative or positive feedback loops, common motifs in gene regulatory [61,87], neuronal [41,43], as well as in signaling networks including, e.g., the experimentally identified Epidermal growth factor receptor (EGFR) network [75] (Fig. 2a). For parametric organization in the bistable regime (Fig. 2b), in this case defined by a certain range of EGFR concentrations on the plasma membrane, the system has two available stable states: basal (S1) and high EGFR-phosphorylated (S2) state. A pulse of epidermal growth factor (EGF) induces a transition from S1 to S2, however, the high EGFRp state will be maintained even after removal of the EGF signal, as S2 is also a stable attractor. This can be seen from the temporal EGFRp profile, as well as the trajectory of the signaling state of the EGFR network (Fig. 2c). Thus, addition of subsequent EGF pulses will not lead to further state changes in the system, implying that the cell will remain unresponsive to upcoming changes in the environment. Better understanding of these temporal system’s responses can be gained from a quasi-potential landscape description: as noted above, the organization in the bistable regime corresponds to a quasi-potential landscape with two wells, corresponding to S1 and S2 (Fig. 2d). In absence of a signal, the system resides in S1. Upon EGF addition, the quasi-potential landscape remodels to a single well corresponding to S2, resulting in a robust EGFR phosphorylation. When the EGF is removed, however, the landscape resets to its former double-well shape, but the system remains in the S2 well and thereby is unresponsive to upcoming signals (Fig. 1c), just like the turnstile does not respond to a coin when already in S2.
让我们考虑一个双稳态系统,作为多稳态的最小情况,即具有多个共存状态/吸引子的系统(参见框 1)。在准势景观类比中,这对应于具有两个山谷的景观,由一个鞍点分隔。一般来说,双稳态可以通过双负反馈或正反馈环路出现,这些是基因调控[61,87]、神经元[41,43]以及信号网络(包括实验确定的表皮生长因子受体(EGFR)网络[75])中的常见模式(图 2a)。在双稳态区域的参数组织中(图 2b),在这种情况下由质膜上一定范围的 EGFR 浓度定义,系统有两个可用的稳定状态:基础状态(S1)和高 EGFR-磷酸化状态(S2)。一脉冲的表皮生长因子(EGF)会诱导从 S1 到 S2 的转变,然而,即使在移除 EGF 信号后,高 EGFRp 状态仍将维持,因为 S2 也是一个稳定的吸引子。这可以从时间 EGFRp 曲线以及 EGFR 网络信号状态的轨迹中看到(图 2c)。因此,随后的 EGF 脉冲的添加不会导致系统进一步的状态变化,这意味着细胞将对即将到来的环境变化保持无响应。对这些时间系统响应的更好理解可以通过准势景观描述获得:如上所述,在双稳态区域中的组织对应于具有两个井的准势景观,对应于 S1 和 S2(图 2d)。在没有信号的情况下,系统驻留在 S1。当添加 EGF 时,准势景观重塑为对应于 S2 的单井,导致稳健的 EGFR 磷酸化。然而,当移除 EGF 时,景观重置为其先前的双井形状,但系统仍然驻留在 S2 井中,从而对即将到来的信号无响应(图 1c),就像旋转门在已经处于 S2 时不会对硬币做出反应一样。