SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS

A modeling exploration of how synaptic feedback to descending projection neurons shapes the activity of an oscillatory network
Kintos N and Nadim F
Rhythmic activity which underlies motor output is often initiated and controlled by descending modulatory projection pathways onto central pattern generator (CPG) networks. In turn, these descending pathways receive synaptic feedback from their target CPG network, which can influence the CPG output. However, the mechanisms underlying such bi-directional synaptic interactions are mostly unexplored. We develop a reduced mathematical model, including both feed-forward and feedback circuitry, to examine how the synaptic interactions involving two projection neurons, MCN1 and CPN2, can produce and shape the activity of the gastric mill CPG in the crab stomatogastric nervous system. We use simplifying assumptions that are based on the behavior of the biological system to reduce this model down to 2 dimensions, which allows for phase plane analysis of the model output. The model shows a distinct activity for the gastric mill rhythm that is elicited when MCN1 and CPN2 are co-active compared to the rhythm elicited by MCN1 activity alone. Furthermore, the presence of feedback to the projection neuron CPN2 provides a distinct locus of pattern generation in the model which does not require reciprocally inhibitory interactions between the gastric mill CPG neurons, but is instead based on a half-center oscillator that occurs through a tri-synaptic pathway that includes CPN2. Our modeling results show that feedback to projection pathways may provide additional mechanisms for the generation of motor activity. These mechanisms can have distinct dependence on network parameters and may therefore provide additional flexibility for the rhythmic motor output.
Locally Contractive Dynamics in Generalized Integrate-and-Fire Neurons
Jimenez ND, Mihalas S, Brown R, Niebur E and Rubin J
Integrate-and-fire models of biological neurons combine differential equations with discrete spike events. In the simplest case, the reset of the neuronal voltage to its resting value is the only spike event. The response of such a model to constant input injection is limited to tonic spiking. We here study a generalized model in which two simple spike-induced currents are added. We show that this neuron exhibits not only tonic spiking at various frequencies but also the commonly observed neuronal bursting. Using analytical and numerical approaches, we show that this model can be reduced to a one-dimensional map of the adaptation variable and that this map is locally contractive over a broad set of parameter values. We derive a sufficient analytical condition on the parameters for the map to be globally contractive, in which case all orbits tend to a tonic spiking state determined by the fixed point of the return map. We then show that bursting is caused by a discontinuity in the return map, in which case the map is . We perform a detailed analysis of a class of piecewise contractive maps that we call bursting maps and show that they robustly generate stable bursting behavior. To the best of our knowledge, this work is the first to point out the intimate connection between bursting dynamics and piecewise contractive maps. Finally, we discuss bifurcations in this return map, which cause transitions between spiking patterns.
The effects of time-varying temperature on delays in genetic networks
Gomez MM, Murray RM and Bennett MR
Delays in gene networks result from the sequential nature of protein assembly. However, it is unclear how models of gene networks that use delays should be modified when considering time-dependent changes in temperature. This is important, as delay is often used in models of genetic oscillators that can be entrained by periodic fluctuations in temperature. Here, we analytically derive the time dependence of delay distributions in response to time-varying temperature changes. We find that the resulting time-varying delay is nonlinearly dependent on parameters of the time-varying temperature such as amplitude and frequency, therefore, applying an Arrhenius scaling may result in erroneous conclusions. We use these results to examine a model of a synthetic gene oscillator with temperature compensation. We show that temperature entrainment follows from the same mechanism that results in temperature compensation. Under a common Arrhenius scaling alone, the frequency of the oscillator is sensitive to changes in the mean temperature but robust to changes in the frequency of a periodically time-varying temperature. When a mechanism for temperature compensation is included in the model, however, we show that the oscillator is entrained by periodically varying temperature even when maintaining insensitivity to the mean temperature.
Combinatorial representation of parameter space for switching networks
Cummins B, Gedeon T, Harker S, Mischaikow K and Mok K
We describe the theoretical and computational framework for the Dynamic Signatures for Genetic Regulatory Network ( DSGRN) database. The motivation stems from urgent need to understand the global dynamics of biologically relevant signal transduction/gene regulatory networks that have at least 5 to 10 nodes, involve multiple interactions, and decades of parameters. The input to the database computations is a regulatory network, i.e. a directed graph with edges indicating up or down regulation. A computational model based on switching networks is generated from the regulatory network. The phase space dimension of this model equals the number of nodes and the associated parameter space consists of one parameter for each node (a decay rate), and three parameters for each edge (low level of expression, high level of expression, and threshold at which expression levels change). Since the nonlinearities of switching systems are piece-wise constant, there is a natural decomposition of phase space into cells from which the dynamics can be described combinatorially in terms of a state transition graph. This in turn leads to a compact representation of the global dynamics called an annotated Morse graph that identifies recurrent and nonrecurrent dynamics. The focus of this paper is on the construction of a natural computable finite decomposition of parameter space into domains where the annotated Morse graph description of dynamics is constant. We use this decomposition to construct an SQL database that can be effectively searched for dynamical signatures such as bistability, stable or unstable oscillations, and stable equilibria. We include two simple 3-node networks to provide small explicit examples of the type of information stored in the DSGRN database. To demonstrate the computational capabilities of this system we consider a simple network associated with p53 that involves 5 nodes and a 29-dimensional parameter space.
Model Rejection and Parameter Reduction via Time Series
Cummins B, Gedeon T, Harker S and Mischaikow K
We show how a graph algorithm for finding matching labeled paths in pairs of labeled directed graphs can be used to perform model invalidation for a class of dynamical systems including regulatory network models of relevance to systems biology. In particular, given a partial order of events describing local minima and local maxima of observed quantities from experimental time series data, we produce a labeled directed graph we call the for which every path from root to leaf corresponds to a plausible sequence of events. We then consider the regulatory network model, which can itself be rendered into a labeled directed graph we call the via techniques previously developed in computational dynamics. Labels on the pattern graph correspond to experimentally observed events, while labels on the search graph correspond to mathematical facts about the model. We give a theoretical guarantee that failing to find a match invalidates the model. As an application we consider gene regulatory models for the yeast .
Generalizing Koopman Theory to Allow for Inputs and Control
Proctory JL, Bruntonz SL and Kutzx JN
We develop a new generalization of Koopman operator theory that incorporates the e ects of inputs and control. Koopman spectral analysis is a theoretical tool for the analysis of nonlinear dynamical systems. Moreover, Koopman is intimately connected to dynamic mode decomposition (DMD), a method that discovers coherent, spatio-temporal modes from data, connects local-linear analysis to nonlinear operator theory, and importantly creates an equation-free architecture for the study of complex systems. For actuated systems, standard Koopman analysis and DMD are incapable of producing input-output models; moreover, the dynamics and the modes will be corrupted by external forcing. Our new theoretical developments extend Koopman operator theory to allow for systems with nonlinear input-output characteristics. We show how this generalization is rigorously connected to a recent development called dynamic mode decomposition with control. We demonstrate this new theory on nonlinear dynamical systems, including a standard susceptible-infectious-recovered model with relevance to the analysis of infectious disease data with mass vaccination (actuation).
Mechanistic Modeling of Longitudinal Shape Changes: Equations of Motion and Inverse Problems
Hsieh DN, Arguillère S, Charon N and Younes L
This paper examines a longitudinal shape evolution model in which a three-dimensional volume progresses through a family of elastic equilibria in response to the time-derivative of an internal force, or yank, with an additional regularization to ensure diffeomorphic transformations. We consider two different models of yank and address the long time existence and uniqueness of solutions for the equations of motion in both models. In addition, we derive sufficient conditions for the existence of an optimal yank that best describes the change from an observed initial volume to an observed volume at a later time. The main motivation for this work is the understanding of processes such as growth and atrophy in anatomical structures, where the yank could be roughly interpreted as a metabolic event triggering morphological changes. We provide preliminary results on simple examples to illustrate, under this model, the retrievability of some attributes of such events.
Calcium and Metabolic Oscillations in Pancreatic Islets: Who's Driving the Bus?
Watts M, Fendler B, Merrins MJ, Satin LS, Bertram R and Sherman A
Pancreatic islets exhibit bursting oscillations in response to elevated blood glucose. These oscillations are accompanied by oscillations in the free cytosolic Ca concentration ( ), which drives pulses of insulin secretion. Both islet Ca and metabolism oscillate, but there is some debate about their interrelationship. Recent experimental data show that metabolic oscillations in some cases persist after the addition of diazoxide (Dz), which opens K(ATP) channels, hyperpolarizing -cells and preventing Ca entry and Ca oscillations. Further, in some islets in which metabolic oscillations were eliminated with Dz, increasing the cytosolic Ca concentration by the addition of KCl could restart the metabolic oscillations. Here we address why metabolic oscillations persist in some islets but not others, and why raising restarts oscillations in some islets but not others. We answer these questions using the dual oscillator model (DOM) for pancreatic islets. The DOM can reproduce the experimental data and shows that the model supports two different mechanisms for slow metabolic oscillations, one that requires calcium oscillations and one that does not.
Conley Index Approach to Sampled Dynamics
Batko B, Mischaikow K, Mrozek M and Przybylski M
The topological method for the reconstruction of dynamics from time series [K. Mischaikow et al., ., 82 (1999), pp. 1144-1147] is reshaped to improve its range of applicability, particularly in the presence of sparse data and strong expansion. The improvement is based on a multivalued map representation of the data. However, unlike the previous approach, it is not required that the representation has a continuous selector. Instead of a selector, a recently developed new version of Conley index theory for multivalued maps [B. Batko, ., 16 (2017), pp. 1587-1617; B. Batko and M. Mrozek, ., 15 (2016), pp. 1143-1162] is used in computations. The existence of a continuous, single valued generator of the relevant dynamics is guaranteed in the vicinity of the graph of the multivalued map constructed from data. Some numerical examples based on time series derived from the iteration of Hénon-type maps are presented.
Bayesian Evidence Accumulation on Social Networks
Karamched B, Stolarczyk S, Kilpatrick ZP and Josić K
To make decisions we are guided by the evidence we collect and the opinions of friends and neighbors. How do we combine our private beliefs with information we obtain from our social network? To understand the strategies humans use to do so, it is useful to compare them to observers that optimally integrate all evidence. Here we derive network models of rational (Bayes optimal) agents who accumulate private measurements and observe the decisions of their neighbors to make an irreversible choice between two options. The resulting information exchange dynamics has interesting properties: When decision thresholds are asymmetric, the absence of a decision can be increasingly informative over time. In a recurrent network of two agents, the absence of a decision can lead to a sequence of belief updates akin to those in the literature on common knowledge. On the other hand, in larger networks a single decision can trigger a cascade of agreements and disagreements that depend on the private information agents have gathered. Our approach provides a bridge between social decision making models in the economics literature, which largely ignore the temporal dynamics of decisions, and the single-observer evidence accumulator models used widely in neuroscience and psychology.
Neurologically Motivated Coupling Functions in Models of Motor Coordination
Słowiński P, Al-Ramadhani S and Tsaneva-Atanasova K
We present an analysis of two Haken-Kelso-Bunz (HKB) oscillators coupled by a neurologically motivated function. We study the effect of time delay and weighted self-feedback and mutual feedback on the synchronization behavior of the model. We focus on identifying parameter regimes supporting experimentally observed decrease in oscillation amplitude and loss of anti-phase stability that has inspired the development of the HKB model. We show that a combination of cross-talk and nonlinearity in the coupling, along with physiologically relevant time delay, is able to quantitatively account for both drop in oscillation amplitude and loss of anti-phase stability in a frequency dependent manner. Furthermore, we demonstrate that the transition between discrete and rhythmic movements could be captured by this model. To this end, we carry out theoretical and numerical analysis of the emergence of in-phase and anti-phase oscillations.
Shape versus timing: linear responses of a limit cycle with hard boundaries under instantaneous and static perturbation
Wang Y, Gill JP, Chiel HJ and Thomas PJ
When dynamical systems that produce rhythmic behaviors operate within hard limits, they may exhibit limit cycles with sliding components, that is, closed isolated periodic orbits that make and break contact with a constraint surface. Examples include heel-ground interaction in locomotion, firing rate rectification in neural networks, and stick-slip oscillators. In many rhythmic systems, robustness against external perturbations involves response of both the shape and the timing of the limit cycle trajectory. The existing methods of infinitesimal phase response curve (iPRC) and variational analysis are well established for quantifying changes in timing and shape, respectively, for smooth systems. These tools have recently been extended to nonsmooth dynamics with transversal crossing boundaries. In this work, we further extend the iPRC method to nonsmooth systems with sliding components, which enables us to make predictions about the synchronization properties of weakly coupled stick-slip oscillators. We observe a new feature of the isochrons in a planar limit cycle with hard sliding boundaries: a nonsmooth kink in the asymptotic phase function, originating from the point at which the limit cycle smoothly departs the constraint surface, and propagating away from the hard boundary into the interior of the domain. Moreover, the classical variational analysis neglects timing information and is restricted to instantaneous perturbations. By defining the "infinitesimal shape response curve" (iSRC), we incorporate timing sensitivity of an oscillator to describe the shape response of this oscillator to parametric perturbations. In order to extract timing information, we also develop a "local timing response curve" (lTRC) that measures the timing sensitivity of a limit cycle within any given region. We demonstrate in a specific example that taking into account local timing sensitivity in a nonsmooth system greatly improves the accuracy of the iSRC over global timing analysis given by the iPRC.
Sequential Attractors in Combinatorial Threshold-Linear Networks
Parmelee C, Alvarez JL, Curto C and Morrison K
Sequences of neural activity arise in many brain areas, including cortex, hippocampus, and central pattern generator circuits that underlie rhythmic behaviors like locomotion. While network architectures supporting sequence generation vary considerably, a common feature is an abundance of inhibition. In this work, we focus on architectures that support sequential activity in recurrently connected networks with inhibition-dominated dynamics. Specifically, we study emergent sequences in a special family of threshold-linear networks, called combinatorial threshold-linear networks (CTLNs), whose connectivity matrices are defined from directed graphs. Such networks naturally give rise to an abundance of sequences whose dynamics are tightly connected to the underlying graph. We find that architectures based on generalizations of cycle graphs produce limit cycle attractors that can be activated to generate transient or persistent (repeating) sequences. Each architecture type gives rise to an infinite family of graphs that can be built from arbitrary component subgraphs. Moreover, we prove a number of for the corresponding CTLNs in each family. The graph rules allow us to strongly constrain, and in some cases fully determine, the fixed points of the network in terms of the fixed points of the component subnetworks. Finally, we also show how the structure of certain architectures gives insight into the sequential dynamics of the corresponding attractor.
Distinct Excitatory and Inhibitory Bump Wandering in a Stochastic Neural Field
Cihak HL, Eissa TL and Kilpatrick ZP
Localized persistent cortical neural activity is a validated neural substrate of parametric working memory. Such activity "bumps" represent the continuous location of a cue over several seconds. Pyramidal (excitatory ()) and interneuronal (inhibitory ()) subpopulations exhibit tuned bumps of activity, linking neural dynamics to behavioral inaccuracies observed in memory recall. However, many bump attractor models collapse these subpopulations into a single joint /(lateral inhibitory) population and do not consider the role of interpopulation neural architecture and noise correlations. Both factors have a high potential to impinge upon the stochastic dynamics of these bumps, ultimately shaping behavioral response variance. In our study, we consider a neural field model with separate / populations and leverage asymptotic analysis to derive a nonlinear Langevin system describing / bump interactions. While the bump attracts the bump, the bump stabilizes but can also repel the bump, which can result in prolonged relaxation dynamics when both bumps are perturbed. Furthermore, the structure of noise correlations within and between subpopulations strongly shapes the variance in bump position. Surprisingly, higher interpopulation correlations reduce variance.
Understanding Policy Diffusion in the U.S.: An Information-Theoretical Approach to Unveil Connectivity Structures in Slowly Evolving Complex Systems
Anderson RP, Jimenez G, Bae JY, Silver D, Macinko J and Porfiri M
Detecting and explaining the relationships among interacting components has long been a focal point of dynamical systems research. In this paper, we extend these types of data-driven analyses to the realm of public policy, whereby individual legislative entities interact to produce changes in their legal and political environments. We focus on the U.S. public health policy landscape, whose complexity determines our capacity as a society to effectively tackle pressing health issues. It has long been thought that some U.S. states innovate and enact new policies, while others mimic successful or competing states. However, the extent to which states learn from others, and the state characteristics that lead two states to influence one another, are not fully understood. Here, we propose a model-free, information-theoretical method to measure the existence and direction of influence of one state's policy or legal activity on others. Specifically, we tailor a popular notion of causality to handle the slow time-scale of policy adoption dynamics and unravel relationships among states from their recent law enactment histories. The method is validated using surrogate data generated from a new stochastic model of policy activity. Through the analysis of real data in alcohol, driving safety, and impaired driving policy, we provide evidence for the role of geography, political ideology, risk factors, and demographic and economic indicators on a state's tendency to learn from others when shaping its approach to public health regulation. Our method offers a new model-free approach to uncover interactions and establish cause-and-effect in slowly-evolving complex dynamical systems.
Stability of Systems with Stochastic Delays and Applications to Genetic Regulatory Networks
Gomez MM, Sadeghpour M, Bennett MR, Orosz G and Murray RM
The dynamics of systems with stochastically varying time delays are investigated in this paper. It is shown that the mean dynamics can be used to derive necessary conditions for the stability of equilibria of the stochastic system. Moreover, the second moment dynamics can be used to derive sufficient conditions for almost sure stability of equilibria. The results are summarized using stability charts that are obtained via semi-discretization. The theoretical methods are applied to simple gene regulatory networks where it is demonstrated that stochasticity in the delay can improve the stability of steady protein production.
Comparison of Combinatorial Signatures of Global Network Dynamics Generated by Two Classes of ODE Models
Crawford-Kahrl P, Cummins B and Gedeon T
Modeling the dynamics of biological networks introduces many challenges, among them the lack of first principle models, the size of the networks, and difficulties with parameterization. Discrete time Boolean networks and related continuous time switching systems provide a computationally accessible way to translate the structure of the network to predictions about the dynamics. Recent work has shown that the parameterized dynamics of switching systems can be captured by a combinatorial object, called a Dynamic Signatures Generated by Regulatory Networks (DSGRN) database, that consists of a parameter graph characterizing a finite parameter space decomposition, whose nodes are assigned a Morse graph that captures global dynamics for all corresponding parameters. We show that for a given network there is a way to associate the same type of object by considering a continuous time ODE system with a continuous right-hand side, which we call an L-system. The main goal of this paper is to compare the two DSGRN databases for the same network. Since the L-systems can be thought of as perturbations (not necessarily small) of the switching systems, our results address the correspondence between global parameterized dynamics of switching systems and their perturbations. We show that, at corresponding parameters, there is an order preserving map from the Morse graph of the switching system to that of the L-system that is surjective on the set of attractors and bijective on the set of fixed-point attractors. We provide important examples showing why this correspondence cannot be strengthened.
MONOMIALS AND BASIN CYLINDERS FOR NETWORK DYNAMICS
Austin D and Dinwoodie IH
We describe methods to identify cylinder sets inside a basin of attraction for Boolean dynamics of biological networks. Such sets are used for designing regulatory interventions that make the system evolve towards a chosen attractor, for example initiating apoptosis in a cancer cell. We describe two algebraic methods for identifying cylinders inside a basin of attraction, one based on the Groebner fan that finds monomials that define cylinders and the other on primary decomposition. Both methods are applied to current examples of gene networks.
Synchronization of Electrically Coupled Resonate-and-Fire Neurons
Chartrand T, Goldman MS and Lewis TJ
Electrical coupling between neurons is broadly present across brain areas and is typically assumed to synchronize network activity. However, intrinsic properties of the coupled cells can complicate this simple picture. Many cell types with electrical coupling show a diversity of post-spike subthreshold fluctuations, often linked to subthreshold resonance, which are transmitted through electrical synapses in addition to action potentials. Using the theory of weakly coupled oscillators, we explore the effect of both subthreshold and spike-mediated coupling on synchrony in small networks of electrically coupled resonate-and-fire neurons, a hybrid neuron model with damped subthreshold oscillations and a range of post-spike voltage dynamics. We calculate the phase response curve using an extension of the adjoint method that accounts for the discontinuous post-spike reset rule. We find that both spikes and subthreshold fluctuations can jointly promote synchronization. The subthreshold contribution is strongest when the voltage exhibits a significant post-spike elevation in voltage, or plateau potential. Additionally, we show that the geometry of trajectories approaching the spiking threshold causes a "reset-induced shear" effect that can oppose synchrony in the presence of network asymmetry, despite having no effect on the phase-locking of symmetrically coupled pairs.
Modeling microtubule-based transport and anchoring of mRNA
Ciocanel MV, Sandstede B, Jeschonek SP and Mowry KL
Localization of messenger RNA (mRNA) at the vegetal cortex plays an important role in the early development of oocytes. While it is known that molecular motors are responsible for the transport of mRNA cargo along microtubules to the cortex, the mechanisms of localization remain unclear. We model cargo transport along microtubules using partial differential equations with spatially-dependent rates. A theoretical analysis of reduced versions of our model predicts effective velocity and diffusion rates for the cargo and shows that randomness of microtubule networks enhances effective transport. A more complex model using parameters estimated from fluorescence microscopy data reproduces the spatial and timescales of mRNA localization observed in oocytes, corroborates experimental hypotheses that anchoring may be necessary to achieve complete localization, and shows that anchoring of mRNA complexes actively transported to the cortex is most effective in achieving robust accumulation at the cortex.
Optimal phase-selective entrainment of heterogeneous oscillator ensembles
Singhal B, Kiss IZ and Li JS
We develop a framework to design optimal entrainment signals that entrain an ensemble of heterogeneous nonlinear oscillators, described by phase models, at desired phases. We explicitly take into account heterogeneity in both oscillation frequency and the type of oscillators characterized by different Phase Response Curves. The central idea is to leverage the Fourier series representation of periodic functions to decode a phase-selective entrainment task into a quadratic program. We demonstrate our approach using a variety of phase models, where we entrain the oscillators into distinct phase patterns. Also, we show how the generalizability gained from our formulation enables us to meet a wide range of design objectives and constraints, such as minimum-power, fast entrainment, and charge-balanced controls.