Attempting a toy model of vertebrate understanding

Tag: locomotion

Essay 30: Real Time Place Avoidance

I’m looking to improve the foraging algorithm with an idea from essay 17, which suggested that when the foraging fails, the animal should avoid the failed area. The foraging task uses an odor cue to seek food. Currently when the model gives up (times out), it disables seeking, but doesn’t actively avoid the current place, but returns to the wide-ranging roaming search.

For now, I’m still avoiding memory, but consider the alternating T-maze used in rodent behavior [Deacon and Rawlins 2006]. Mice are released at the base of the T and choose one of the directions to search for food. If the experiment repeats (by picking up the mice and restarting) mice will tend to explore the unexplored end first.

But for our foraging task, let’s use the same device for a different purpose. Instead of repeating the experiment by unnatural teleportation, consider the simpler problem of foraging with this device as an environment.

T-maze exploration. Food might be at either the red dot or the blue dot.

When rodents are foraging and reach one end, they will reverse and search the other end. Because rodents are far more advanced than the toy model, they can remember which arm of the maze they’ve already explored. But consider a simpler sub-strategy that uses RTPA (real-time place avoidance) where the animal temporarily avoids the current area or areas associated with food. By actively avoiding the already-explored area, the animal will save time by avoiding repeated searching.

A difficulty in finding the neural correlates of RTPA is the great diversity of reasons for RTPA, and circuits even in the brainstem. There are many reasons for place avoidance:

  • Startle: reflex escape
  • Escape from an imminent predator
  • Escape from an environment hazard (CO2, temperature)
  • Avoiding innate cues (predator odors)
  • Avoiding learned cues (CPA conditioned place avoidance)
  • Search optimization: avoiding already searched areas

Because this topic is large and the number of circuits is also large, I’ll start with a more abstract view to provide some context for a later dive into details. The two architectures will be a set of labeled path seek and avoidance circuits, and a secondary consensus circuit to coordinate the labeled paths.

Labeled path

A labeled path architecture uses individual circuit paths for each behavior and sense, as opposed to bringing all stimuli into a central node with a general decision algorithm [Helmbrecht 2018]. (Helmbrecht uses “labeled line,” which conflicts with the fish “lateral line” sense.) As least to some extend, the brainstem is designed around labeled paths, which is particularly evident if using the chimera model of the bilateral brain [Tosches and Arendt 2017].

The chimera model posits that brains of bilateral animals combine features from apical (unilateral) and bilateral (“blastoporal” in their terminology because they focus on zooplankton larvae). The apical mode is associated with the front of the brain, such as the hypothalamus, and its locomotion is temporally gradient based, like the tumble-and-run of bacteria. The bilateral mode is more reflexive, turning left if touched on the right, like Braitenberg vehicles [Braitenberg 1984]. Apical systems include olfactory search and phototaxis, while bilateral touch, lateral line, auditory and bilateral vision in a second system. For zebrafish one study describes multiple paths as a “high road” through Hb (habenula, apical) and a “low road” through OT (optic tectum, bilateral) [do Camo Silva et al 2018].

Some labeled paths for locomotion in vertebrates. H.l (lateral hypothalamus), Hb (habenula), MLR (midbrain locomotive region), N8 (acoustic-vestibular cranial nerve 8), OT (optic tectum), R.ip (interpeduncular nucleus), R.mcell (Mauthner-cell), R.rs (reticulospinal motor command)

The above diagram shows some vertebrate labeled paths, which is clearer in simpler vertebrates like the lamprey and zebrafish. In the zebrafish startle reflex, a sudden noise triggers a fast C-bend turn followed by rapid swimming. The trigger can be a noise, vestibular, or lateral line motion [Berg et al 2018]. The startle circuit is only three synapses from the original sensor to the muscle, from the N8 auditory/vestibular nerve to the giant M-cell (Mauthner cell in r4) to the motor neuron that drives locomotion. In young zebrafish larva, head touch neurons (N5 trigeminal) connect to M-cells and are later replaced by N8 [Kohashi et al 2012]. M-cells fire only once per escape to drive the initial turn. Interestingly the escape turn choice uses an axo-axonic repeater and amplifier [Guan et al 2021].

In a different path looming and dimming visual signals that represent predators or obstacles drive OT (optic tectum), which can drive escape that either uses or bypasses the M-cell depending on the threat level [Bhattacharya et al 2017]. OT also pre-programs the M-cell circuit by suppressing the left or right to avoid an obstacle [Zwaka et al 2022].

Phototaxis (seeking or avoiding light) uses a temporal gradient system composed of left Hb.m (medial habenula) and R.ip.d (dorsal interpeduncular nucleus), which projects to the R.rs (reticulospinal motor command) neurons via relays in V.mr (median raphe) and P.ldt (laterodorsal nuclei) [Chen and Engert 2014]. Food odor seeking uses the right Hb.m and R.ip.v (ventral interpeduncular nucleus) [Chen et al 2019].

In lamprey a distinct food-seeking path through V.pt (posterior tuberculum – possibly homologous to vertebrate Vta/Snc) to MLR (midbrain locomotor region) and finally to R.rs [Derjean et al 2010]. Zebrafish has a similar dual path through Hb.l (lateral habenula) through a midbrain TSN circuit [Koide et al 2018].

Slower escape uses a distinct prepontine (rhombomere r0-r1) circuit, which is suppressed by the M-cell escape circuits [Marquart et al 2019].

Some of these paths have shared elements, particularly at the motor control like MLR, but the general pattern is multiple labeled paths for each behavior. The paths already mentioned don’t include more complex food-seeking paths through the basal ganglia and hypothalamus.

Multiple labeled paths immediately raises the difficulty of coordination. How does the system juggle priorities? Even the simple startle reflex needs to be modulated because the animal shouldn’t startle if the loud sound is expected, such as near a waterfall. In contrast in a dangerous area with possible predators the animal should increase the reflex to a hair-trigger. Similarly if the threat is weak and the animal is hunting or eating and hungry, it might ignore the threat to continue eating. A second architecture, distinct from the label path, emphasizes the coordination of multiple paths, possibly using a consensus system to decide on an appropriate action.

Consensus loops

While the labeled paths have strong evidence, the consensus loop is only a thought experiment to tie the paths together. Multiple paths for food seeking and for avoiding is a distributed system, and distributed systems makes decision circuitry more complicated because they’re not central decision node. Every node needs to agree with the decision. Whether to avoid or approach needs to be agreed on by all the systems. It wouldn’t make sense for one system to believe the animal is approaching an object but another system believes the action is avoiding. Voting distributes the consensus.

Illustration of a consensus loop. Multiple drives or labeled paths vote for approval to drive motor output.

The above diagram shows the model. The different labeled paths of seeking or avoiding join a voting consensus system in a motivational look, which allows one path to drive motor output.

Consensus system showing one path. The driving sense or motivation tries to disinhibit itself by voting in the consensus loop.

A single labeled path has a sense or motivation drive that tries to act on motor output, but is inhibited by the consensus system. For example, if a predator odor arrives, the odor avoidance path votes to enable its own locomotion. If the consensus system agrees, it will disinhibit the odor avoidance path, letting the animal escape. Note that a high priority threat could bypass the consensus system.

Seek and avoid consensus system

This system can manage conflicts between seek and avoidance, such as animals continuing to eat if a predator threat exists but is low. Consider a simplified consensus system with only one seek node and one avoid node, using the consensus to select one when there’s a conflict.

Managing conflicts between seeking and avoiding.

If there’s a food cue and no conflicting threats, the food vote passes easily and the animal seeks the food. Similarly a predator odor with no conflict will enable avoidance. If there’s a conflict, the system can weigh the costs and benefits of the threat and the food, possibly depending on hunger state or a more sophisticated threat assessment.

Keeping these general ideas of the labeled path and consensus systems in mind, let’s start working through several specific paths. The end goal is to organize the main brainstem locomotive areas into a simplified, unified model. The two major paths will be apical paths through Hb (habenula) using temporal gradients (klinotaxis) [Chen and Engert 2014] and bilateral paths through OT (optic tectum) using spatial gradients (tropotaxis).

Apical and bilateral avoidance

Because there are many labeled paths, dividing them up might help organize the model. An early division between labeled paths goes back to the bilaterian (worm-like, slug-like) ancestors, which added bilateral, dual-sensory navigation (tropotaxis, spatial gradient) to an older single-sensor navigation that used the animal’s movement to choose a direction (klinotaxis, temporal gradient), such as the simple tumble-and-run that even bacteria and simple radial zooplankton use for seeking odors (chemotaxis) and seeking or avoiding light (phototaxis). This chimera hypothesis [Tosches and Arendt 2013] considers bilateral animals as a fusion between the locomotive systems. The apical zooplankton larvae of bilaterian worms may have been a secondary development to escape predation [Mallatt 2021]. In vertebrates, apical klinotaxis is implemented by Hb (habenula) temporal gradient seeking and H.l (lateral hypothalamus) motivation. Bilateral tropotaxis navigation is implemented by several labeled path systems, typified by OT (optic tectum) and the M-cell start reflex.

A primitive apical example is the helical phototaxis of many annelid (marine worm) zooplankton larvae, and a primitive bilateral example is the mollusk sea slug navigation.

Zooplankton apical phototaxis

One type of zooplankton is essentially a globe with a fringe of cilia and an apical tuft for chemical processing, such as the Platynereis larva.

Apical zooplankton with cilia navigation.
Platyneris annelid (marine worm) zooplankton larva

Phototaxis for this larva depends on its helical movement (helical klinotaxis). As it moves forward, the larva also rotates and wobbles, which means that parts of the equatorial band are nearer the light or further from the light depending on the rotation. If the upper cilia halt, the larva will steer toward the light. If the lower cilia halt, the larva will steer away from the light [Randel and Jékely 2016].

Phototaxis for an zooplankton larva.

The system depends on a directional eye, which uses a photoreceptor and a pigment cell that imposes directionality by shading the photoreceptor, because other cells of the larva are transparent. The photoreceptor compares the current brightness to its average brightness as the larva rotates. If it’s brighter than average, then it must be facing the light, and will signal the cilia to briefly halt, using ACh (acetylcholine) as a neurotransmitter. This trivial one-neuron circuit is sufficient for simple phototaxis [Randel and Jékely 2016].

Although this example larva uses two photoreceptors, it’s not truly bilateral and the two photoreceptors don’t communicate. Ablating one photoreceptor doesn’t abolish phototaxis, although it does reduce efficiency. Using three or four photoreceptor/pigment pairs would work, as well as removing all but one. This system is apical klinotaxis, not bilateral tropotaxis, which makes sense because the above zooplankton is not bilateral. While this zooplankton uses helical klinotaxis, another common form of klinotaxis is a side to side “casting” motion used by other simple animals like c. Elegans [Izquierdo and Lockery 2010].

If zooplankton phototaxis is an example of apical navigation, then the mollusk sea slug is an example of bilateral navigation.

Mollusk sea slug seek and avoid

The mollusk sea slug circuit is a pure bilateral circuit, almost directly a Braitenberg circuit [Braitenberg 1984], discussed in essay 14. The following shows a rough schematic of the sea slug seek and avoid. This circuit is interesting because with only a few neurons, the slug can switch from turning toward a food odor when hungry to turning away from the odor when not hungry [Gillette and Brown 2015].

Odor seek and avoid circuit for a sea slug. Hunger switches a food odor from seek to avoid.

In the diagram above, the central grey area is a switchboard circuit. Hunger reconfigures the switches connecting the odor to the turn motor neurons. When the slug is hungry, the right odor sensor connects with the left turn muscle, seeking the odor. But when the slug is sated, the right odor sensor connects with the right turn muscle, avoiding the odor. When the slug is hungry, it approaches food but when it’s not hungry, it avoids food odor cues.

A similar animal with a different circuit configuration uses serotonin to switch from avoidance to approach [Hirayama et al 2014].

For the goal of this essay, avoiding a failed food cue, this circuit is perfect because when the animal finds a false cue, it reversed movement from seek to avoid, which exactly fits the essay needs. Unfortunately, the vertebrate circuits aren’t nearly as straightforward. As a start for the vertebrate navigation paths, the startle reflex managed in vertebrates by the giant Mauthner cells is a simple starting point.

Amphioxus fast twitch reflex

The fast twitch startle reflex is a clear example of a bilateral labeled path avoidance circuit. A noxious sense on one side causes a fast turn away from the sense. The sense can be a touch on the head, such as running into an object, or a loud sound or a vestibular imbalance signal. This circuit predates vertebrates and a similar circuit exists in amphioxus, a filter-feeding chordate that looks something like a fish without a distinct head and without eyes, but with several photoreceptors including a frontal “eye.”

In amphioxus the startle reflex drives fast twitch muscle fibers, where normal swimming uses slow twitch fibers [Lacalli and Candiani 2017]. This circuit path is entirely distinct even to using the different muscles. The following diagram shows part of the amphioxus motor control circuit. (Because the neuron names are specific to amphioxus, they’re not hugely important for this essay.)

Amphioxus fast twitch escape uses LPN3, glutamate large paired neuron.

The diagram shows the LPN3 (large paired neuron) fast twitch escape path, and the PPN2 normal swimming match, including intermediary motor control neurons [Lacalli and Candiani 2017]. This amphioxus escape circuit resembles the zebrafish Mauthner cell escape.

Zebrafish Mauthner cell escape

Zebrafish have a pair of large M-cell (Mauthner cell) neurons that are specialized for auditory and vestibular startle escape. These are very fast reflexes on the order of 10ms, which can be modulated by higher context [Zwaka et al 2014] including OT. Although the M-cells perform a similar role to the amphioxus LPN3, it’s not clear that they’re homologous, which requires common descent, because the large escape neuron is a common pattern in non-chordate systems.

Zebrafish startle response at right in context with other labeled paths. M-cell (Mauthner R.rs cells in r4), N8 (acoustic/vestibular cranial nerve 8), OT (optic tectum), R.pp (prepontine avoidance in r0-r1), R.rs (reticulospinal motor control)

The primary input to M-cell escape is an auditory and vestibular signal from N8 (8th cranial nerve is auditory and vestibular). In water, sound and primitive vestibular sense have some similarities, because water motion produces not just sound but animal motion, depending on the frequency. The M-cell directly connects to motor neurons to muscles. The startle escape is only a three neurons and a clear, distinct labeled path.

A second zebrafish threat avoidance path uses neurons in R.pp (pre-pontine r0-r1) [Marquart et al 2019] for more distance threats. Unlike the M-cell circuit, this R.pp path is more than a reflex, but it’s still a hardwired path. A third threat circuit uses OT (optic tectum), for example the looming response. Most vertebrates will flee or freeze from a rapid and overhead expanding dark object, representing a potential predator or an obstacle. The mammalian startle circuit shares similarity with an acoustic projection to R.pn.c (caudal pontine reticular) neurons, in an analogous area to the M-cell [Kim et al 2017].

Some of these circuits do share sub circuits. For example, hindbrain locomotion and turning are distinct circuits that are used by both bilateral and apical avoidance circuits.

Hindbrain locomotion and turning

Senses are not the only source of distinct paths because actions can be split into parts like a car’s divided steering and acceleration. In vertebrates, accelerating and turning use distinct hindbrain circuits. Although both MLR (midbrain locomotive region) and OT.d (deep layer of the optic tectum) encode seeking and avoiding, they don’t encode left or right turns. Activating the left or the right MLR produces straight movement [Brocard et al 2010]. Turning is managed from OT.i (intermediate layer of the optic tectum) to distinct R.rs motor command neurons, marked by the chx10 transcription factory [Cregg et al 2020].

Hindbrain acceleration and turning circuits. R.rs (reticulospinal motor control)

The above diagram shows the basic idea. The upstream MLR can command forward movement without specifying details, because swimming is an oscillatory process with CPG (central pattern generators) in the spinal cord and the hindbrain. To turn, the chx10 neurons inhibit the swimming stroke in one direction [Cregg et al 2020], similar functionally to the apical zooplankton inhibition of cilia for phototaxis.

Splitting out turning can simplify the system by dividing labor, where OT.i is always responsible for obstacle avoidance, but a diverse set of labeled paths decode whether to seek or to avoid.

Optic tectum and dimming

The OT is named after its retinotopic visual map that is used for avoiding looming/dimming obstacles and predators, and also for seeking prey [Basso et al 2021]. For most vertebrates, OT is the primary visual area, and the visual cortex only provides abstract context, and amphibians and fish lack a proper visual cortex [Heap et al 2018]. For this essay, OT is less important for its sophisticated visual organization, but more because it also contains motor maps for seeking or prey and avoidance of looming objects, and dimming fields. Its motor map also contains drinking and licking [Liu et al 2022].

Looming/dimming path through optic tectum. OT.m (medial, deep optic tectum), R.rs (reticulospinal motor command)

OT processes looming and dimming objects and avoids them. Since the essay’s model lacks proper vision, the dimming is currently most important. Because OT also has obstacle avoidance, it’s a more sophisticated system than simply reflex. It’s likely that other avoidance systems will use OT for obstacle handling. Even in the case of the M-cell reflex, the OT.i pre-programs the M-cell, to avoid obstacles in case of a future startle [Zwaka et al 2014].

Optic tectum and turning

This division between turning and acceleration applies to OT itself. OT is a layered structure where the top layer is a visual map, the intermediate layer integrates other senses and produces turns, and the deepest layer includes actions such as avoiding and seeking [Liu et al 2022]. OT.d (deep OT) is a motor area for seek and avoid, connected with MLR and M.pag (periaqueductal grey) motor output, and integrates general dimming from the retina with distinct expansion calculation in OT itself [Heap et al 2018], to avoid looming objects. OT.i (intermediate OT) includes multi sensory integration and turning motor area, connected with LL (lateral line) electro sensation and water motion, somatosensory (whiskers in mice), auditory input from M.ic (inferior colliculus) and optic input from OT.s (superficial OT).

Optic tectum layered structure, emphasizing turning and motion. LL (lateral line water motion), MLR (midbrain locomotor region), OT.s (superficial optic tectum), OT.i (intermediate OT), OT.d (deep OT), R.rs (reticulospinal motor command)

Because only the top layer is specifically optic, some neuroscientists use “tectum” (roof in latin) instead of OT to emphasize its multi sensory and motor function, not just the optic features. On argument suggests that the optic layer OT.s is a secondary layer, added to a more primitive OT.i and OT.d that are more connected with reticular areas like MLR and M.pag [Edwards 1980], [Basso et al 2021]. With that argument, OT is primarily a moving and turning structure, receiving turning and moving input from touch, lateral line, primitive dimming, and other directional senses and combining with seek and avoid decisions. When the visual system developed enough detail to support crude images like looming disks or moving prey-like dots, the OT integrated vision into its top layer.

On the other hand, since OT.d receives dimming information from H.lg (central lateral geniculate nucleus) for looming escape [Heap et al 2018], it’s also conceivable that the base OT function is visual escape from dimming, where the later expanding, looming visual processing is an optimization.

Optic tectum obstacle avoidance combined with MLR seek or avoid movement. MLR (midbrain locomotor region), OT.i (intermediate optic tectum), R.rs (reticulospinal motor neurons).

This separation of obstacle avoidance turning from seeking and avoiding greatly simplifies some other circuitry that doesn’t need to duplicate the obstacle avoidance. Since other circuitry from the apical path, like the Hb-R.ip (habenula – interpeduncular nucleus) has its own turning system, OT.i doesn’t have a monopoly on turning. But even in that case, OT.i obstacle avoidance can inform apical navigation.

Some of these avoidance circuits are from the bilateral part of the chimera, such as the M-cell and the looming OT circuits, and others are from the apical part, such as Hb.m phototaxis, chemotaxis, and thermotaxis. So, let’s now more from the bilateral avoidance circuits, explore the vertebrate apical navigation.

Tunicate helical swimming and phototaxis

Tunicates (including sea squirts) are the closest chordates to the vertebrates, but because they have evolved at a greater rate and in specialized directions, comparison with vertebrates is difficult [Stolfi and Brown 2016]. Ascidian tunicates (sea squirts) have a mobile tadpole stage that plants itself in under 24 hours and transforms into a sessile filter feeder, reforming the entire brain. In general, neuroscientists believe amphioxus more resembles the ancestral vertebrate, and that ascidians have lost too many ancestral structures for a reasonable comparison [Holland 2016]. But for the sake of exploration let’s run through a thought experiment as if the ascidian larva is a compressed and simplified version of the vertebrate ancestor, although possibly only the vertebrate larva.

Specifically, consider phototaxis in the apical helical klinotaxis mode that follows a temporal gradient, since both amphioxus and ascidian larva swim in a helical pattern. Even bacteria can follow odor gradients [Hengenius et al 2012] and as discussed above zooplankton phototaxis can move toward light with only a single photosensor [Randel and Jekely 2016]. Both amphioxus and ascidian larva have single unpaired eyes, amphioxus as a single frontal eye [Lacalli 2022] and ascidians with an asymmetrical eye paired with a second pigment cell used for geotaxis as a primitive vestibular sense [Hoyer et al 2024]. In both cases, the “eye” is directional with a pigment cell, but a non-image-forming collection of photoreceptors. The ascidian asymmetrical eye works because the ascidian tadpole swims in a helical pattern so the timing of the light on the eye matters more than its position [Ryan et al 2016].

Ascidian larvae swim in a helical pattern comprised of unilateral tail flicks and symmetrical swimming [Ryan et al 2017] and use the asymmetry of the photoreceptor and photopigment to swim toward light [Mast 1921], [Zega et al 2006]. Since helical swimming doesn’t need stabilizing fins or vestibular systems to manage roll, yaw, and pitch with 3d swimming, it’s available to evolutionarily simpler systems. Another advantage of helical phototaxis is that the photoreceptors are auto-calibrating by simply averaging the light in a rotation and requires less circuitry than a bilateral comparison of light [Randel and Jekely 2016].

However, unlike the trivial zooplankton circuit that directly connected the photoreceptor to arrest the cilia, ascidian larvae need to modulate the bilateral swimming in the primitive hindbrain, timing the muscle inhibition to achieve the same effect.

The ascidian ocellus (“eye”) has two types of photoreceptors with distinct responses. Type 1 has a pigment and lens and is directional (37 cells), while type 2 is non-directional (no pigment partner) [Salas et al 2018]. If the pigment is genetically deleted, the animal can’t use phototaxis but does respond to dimming with an escape response. In other words, the dimming response and phototaxis use distinct labeled paths with distinct input neurons [Kourakis et al 2019]. The following shows the circuit for the type 1 photoreceptors for phototaxis, where the boxes represent single neurons or small collections (5-8) of neurons, not large functions (from [Ryan et al 2016]).

Ascidian larva phototaxis (ocellus) and geotaxis (otolith) circuit. Ant2 (antenna geotaxis sensors), antRN (antenna relay neuron), mgIN (motor ganglion interneurons, left and right), MN (motor neurons, left and right), PR-1 (type-1 phototaxis photoreceptors), prRN (photoreceptor relay neuron)

The above diagram shows both geotaxis and phototaxis circuits, which are specific to right or left motor neurons respectively, because the ascidian larva neuron circuits are highly asymmetrical. Ascidian larva geotaxis swims upward and phototaxis swims away from light, generally downward. The combination encourages swimming to the underside of ledges, such as the underside of boats and harbor piers [Ryan et al 2016]. Because of the helical swimming, the left and right motor neurons aren’t left or right turns, but turns toward or away from the target. Although this circuit is more complicated than the purely apical zooplankton because of the interface to bilateral swimming, the helical swimming keeps the circuit relatively simple.

The above partial circuits are complicated by the coronet cells, another sensory cell that are paired with the photoreceptors, but with unknown function. The circuit connectivity is interesting, because coronet cells modulate both the phototaxis and geotaxis paths, but aren’t a path of their own. The phototaxis and geotaxis relay neurons above are partially bilateral. Only 70% of their connectivity is to the main side, but 30% of the connectivity is to the opposite side. In contract, the coronet-enabled neurons are 100% to the main connection [Ryan et al 2016].

Coronet cell modulation of phototaxis and geotaxis in the ascidian larva. ant2 (antenna geotaxis cell), ant-core (antenna-coronet relay neuron), antRN (antenna relay neuron), DA (dopamine), mgIN (motor ganglia interneuron, left and right), MN (motor neuron, left and right), PR-1 (photoreceptors type-1), pr-cor (photoreceptor-coronet relay neuron), prRN (photoreceptor relay neuron)

As a thought experiment (unsupported by scientific evidence) the main phototaxis path might be uncertain and stochastic, while the coronet-enabled path would be a certain, deterministic connection. If the coronet cells measured the certainty of the animal’s current direction, it could encourage sticking to the current path. For example, if the coronet cells were food-odor gradient sensors, they could fire when the animal was heading toward food, enabling a chemotaxis based on modulation of geotaxis and phototaxis.

Tunicate dimming response

The ascidian dimming response triggers locomotion with a strong turn as an escape response to predators [Kourakis et al 2019]. Unlike the phototaxis photoreceptor, the dimming photoreceptors are non-directional because’er not shaded by the pigment cell. There are 23 type-1 directional photoreceptors and 7 type-2 non-directional photoreceptors for dimming.

Ascidian larva dimming circuit in context with phototaxis circuit. AMG (ascending motor ganglion neurons), mgIN (motor ganglion interneuron), MN (motor neuron), PR-1 (type-1 photoreceptor), PR-2 (type-2 photoreceptor), pr-AMG (photoreceptor-AMG relay neuron), pr-RN (photoreceptor relay neuron).

The above diagram shows the dimming path in context with the previous phototaxis path. Like the phototaxis path, the dimming path starts from the type-2 photoreceptors to a relay neuron and to the control neurons in the motor ganglion. Unlike the phototaxis path, the dimming path is modulated by ascending motor signals from AMG (ascending motor ganglion) and from the phototaxis path [Ryan et al 2016], presumably so the normal helical phototaxis doesn’t trigger a dimming response.

Cement gland and attachment

The ascidian larva hatches before dawn, swims upward for a few hours because geotaxis is enabled before phototaxis neurons attach, and then swims away from the light, settling on a lively rock, preferring a ledge to settle under if possible. Larva do not feed [Ryan et al 2016]. The larva will attach with a cement gland on the front of its head, a trio of palms, and then transforms into the adult sessile filter feeder. The palp sensors trigger the attachment circuit, which stops all swimming and begins the metamorphosis [Anselmi et al 2024].

Ascidian larva attachment circuit. AMG (ascending motor ganglion), ATEN (anterior trunk touch / chemosensor), mgIN (motor ganglion interneuron), MN (motor neuron), RTEN (rostral trunk touch / chemosensory), PN (palp neuron), pnIN (palp interneuron), pnRN (palp relay neuron)

Although the full details of the above circuit [Ryan et al 2016] aren’t critical, the PN (palp neuron) senses the animal bumping into a rock modulated by chemical senses that avoid toxic area, and triggers a swimming shutdown by inhibiting the motor neurons and interneurons [Hoyer et al 2024]. Like the previous diagrams, the boxes represent individual neurons or small group, not large functional regions.

While the ascidian cement gland is permanent, several fish [Pottin et al 2010] and amphibians [Rétaux and Pottin 2011] have a homologous cement gland used for larvae, not adults. For example, frog tadpoles can attach to the bottom of leaves or to the water surface to avoid predators until they are large enough to hunt [Jamieson et al 2000], [Yoshizawa et al 2008]. Because of the widespread cement gland among many fish species and amphibians as well as the tunicates, it’s likely the original vertebrates had a similar cement gland [Rétaux and Pottin 2011]. Whether the gland was larva-only like in vertebrates or also used for adults as in tunicates is unknown. In either case, the cement gland circuit that inhibits locomotion must have been part of the original vertebrate.

Vertebrate analogies to the ascidian circuits

Because the ascidians are so specialized and reduced from the common ancestor with vertebrates, including major losses in genes, cells and structures, comparing the two is essentially impossible to be homologous (shared descent) [Holland 2016]. However, for the sake of exploration, I’m ignoring that advice, and looking for analogous vertebrate circuits to the ascidian larva.

The ascidian behavior each have distinct circuit paths that mostly only come together at the motor control neurons. The exception is the feedback from the AMG (ascending motor ganglion) neurons, which do feedback to the midbrain neurons, but the main paths are separate forward paths. Each of the geotaxis, phototaxis, dimming, cement gland attachment, and bilateral escape are circuit paths that are distinct until the motor command neurons.

Analogy between ascidian larva neurons and vertebrate neural nuclei. AMG (ascending motor ganglion), cor-pr (coronet-photoreceptor relay neuron), DA (dopamine), Hb (habenula), H.stn (subthalamic nucleus), mgIN (motor ganglion interneuron), MN (motor neuron), OT.d (deep optic tectum), P.ldt (laterodorsal tegmental nucleus), pnIN (palp interneuron), PNS (peripheral nervous system), Ppt (pedunculopontine nucleus), PR (photoreceptor), pr-AMG (photoreceptor-AMG relay neuron), R.ip (interpeduncular nucleus), R.rs (reticulospinal motor command), S/P (striatum/pallidum basal ganglia), V.mr (median raphe), Vta (ventral tegmental area).

A vertebrate analogy to the ascidian phototaxis gradient path might be the path from the retina to Hb.m (medial habenula) to R.ip (interpeduncular nucleus) and V.mr (median raphe), which then project to R.rs (reticulospinal motor command). Like the ascidian path, the Hb-R.ip phototaxis path is relatively isolated from the other paths, although Hb.m does receive large modulation from the hypothalamus. Although R.ip is mostly descending, like ascidian mgIN, V.mr is both ascending and descending like mgIN and AMG.

The dimming path from the type-2 photoreceptors resembles the dimming input to the vertebrate OT (optic tectum). Although existing vertebrates have more sophisticated eyes that can distinguish expanding objects, the dimming input to OT is still important and used for escape directionality [Fotowat and Engert 2023], [Heap et al 2018]. Retina dimming cells reach AF6 and AF8 [Temizer et al 2015], which are thalamic arborization fields before reaching OT.d. Although more complicated expanding looming response in vertebrates is better studied, expansion detection requires an image-supporting eye, and OT.d receives the simpler dimming input. Like the ascidian dimming pr-AMG (photoreceptor – ascending motor ganglion) neuron, OT.d receives multiple ascending and descending inputs that modulate the dimming response. In particular Ppt (pedunculopontine nucleus) and P.ldt (laterodorsal nucleus) both receive OT.d output and forward to R.rs, functionally similar to mgIN (motor ganglion interneuron), and send ascending feedback from R.rs to OT.d, resembling the AMG (ascending motor ganglion) functionality.

Because the cement gland exists in vertebrates, the circuit should be available, and studies do show that N5 (head touch trigeminal nerve) innervates it automatically [Pottin et al 2010], but I haven’t read any study that says this this specific group of trigeminal neurons connects to. As a through experiment, consider H.stn (subthalamic nucleus) as a choice for the cement gland, because H.stn halts ongoing action, and because H.stn receives direct input from C.i (insular cortex) and C.ss (somatosensory cortex), which are more sophisticated versions of the chemo / mechanosensory palp neurons.

The coronet path enhances taxis confidence, reducing stochastic choice, and is a set of dopamine neurons. The striatum circuit and dopamine’s role has a similar function. Without dopamine, the basal ganglia suppress weak input, and allow stochastic action. With dopamine, the basal ganglia suppresses the randomness and keep action on track. This path resembles rheotaxis food seeking, where a fish approaches a food odor by swimming upstream [Coombs et al 2020]. The “what” signal (odor) differs from the “how” signal (water current cues). Like rheotaxis, the coronet cells enhance the existing phototaxis and geotaxis, reducing the default stochastic noise.

Hb.m Medial habenula

Of the ascidian labeled paths above, the Hb (habenula) phototaxis path will be a useful anchor for the upcoming consensus circuit. Like the ascidian asymmetrical phototaxis neurons, the vertebrates Hb.m (medial habenula) is also governed by Nodal asymmetry [Roussigne et al 2009], where Nodal is a developmental genetic transcription factor. In zebrafish the left Hb.m support phototaxis, and the right Hb.m supports chemotaxis [Chen et al 2019]. Hb.m phototaxis receives both “on” and “off” neurons from the retina with a relay either in H.em (pre thalamic eminence) [Zhang et al 2017] or T.a (an area in the anterior thalamus) [Cheng et al 2017], where the connections are debated. Although Hb.m does receive dimming input from the adjacent photoreceptive pineal gland, the retina photoreceptors are more important for phototaxis [Dreosti et al 2014].

Vertebrate phototaxis circuit. Hb.m (median habenula), H.em (pre thalamic eminence), P.ldt (laterodorsal tegmental nucleus), R.gc (pontine central grey), R.ip (interpeduncular nucleus), R.rs (reticulospinal), T.a (anterior thalamus), V.dr (dorsal raphe), V.mr (medial raphe)

As an anatomical note, the zebrafish Hb.m is actually dorsal and therefore named Hb.d. Similarly the zebrafish Hb.m is ventral and named Hb.v, but as a simplification I’ve used the mammalian name.

The output path from Hb.m is through R.ip (interpeduncular nucleus), which projects to several areas including R.gc (pontine central era), V.mr (median raphe – serotonin), V.dr (dorsal raphe – serotonin), and P.ldt (laterodorsal nucleus – ACh) [Quina et al 2017]. The V.mr glutamate and GABA neurons may be more important for this circuit than the serotonin neurons, which they outnumber. Also, note that V.mr is located in the same hindbrain rhombomeres (r2-r5) as some of R.rs, but are more ventral, and are reciprocally connected. In other words, V.mr is highly action and motor associated.

As described above, the Hb.m-R.ip path is a klinotaxis path for phototaxis [Chen and Engert 2014], chemotaxis and thermotaxis, where the klinotaxis is temporal from the animals movement, but not the helical movement of the ascidian larvae. The Hb.m-R.ip klinotaxis has multiple inputs for lamprey, including light, odor, and lateral line (water movement) [Stephenson-Jones et al 2011].

Habenula klinotaxis for lamprey for light, odor, and lateral line. Hb.m (medial habenula), LL (lateral line), R.ip (interpeduncular nucleus)

Although I’ve focused on Hb.m as an avoidance gradient circuit, it’s also a food odor seeking circuit [Chen et al 2019]. The Hb.m klinotaxis for light and odor also applies to temperature, using input from Po.m (medial preoptic nucleus) [Palieri et al 2024] and social seek and avoidance [Okamoto et al 2021], [Chou et al 2016].

Habenula thermotaxis with input from Po.m Hb.m (medial habenula), P.ldt (laterodorsal tegmental nucleus), Po.m (medial preoptic area), R.gc (pontine central grey), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.dr (dorsal raphe), V.mr (median raphe)

Because Hb.m has several sub-nuclei and genetic clusters, it likely represents different labeled paths, supporting multiple distinct seek and avoidance paths. A binary seek vs avoid circuit is likely an oversimplification, because studies have found at least 5-6 olfactory Hb.m clusters in the larval zebrafish [Jetti et al 2014], [Beretta et al 2014]. Hb.m is asymmetrical, like the ascidian larva. Odors from either olfactory bulb activate the right Hb.m [Chen et al 2019]. Hb.m neurons have at least 262 neuropeptide receptors [Ables et al 2023] as well as morphine receptors [Gardon et al 2014], [Boulos et al 2020] including neuropeptides modulating hunger or social motivation from hypothalamic areas like H.l and H.pv.

R.ip interpeduncular nucleus

Since I’ve already covered some of the R.ip klinotaxis function in essay 24 and essay 25, I’m going to focus on the R.ip connectivity, particularly the ascending connectivity. R.ip descending efferents don’t target R.rs directly, but instead use intermediaries like R.gc (pontine central gray), V.mr (median raphe) and P.ldt (laterodorsal tegmental area) [Lima et al 2017], [Quina et al 2017].

Descending R.ip connectivity. Hb.m (medial habenula), P.ldt (laterodorsal tegmental), R.gc (pontine central grey), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.dr (dorsal raphe), V.mr (median raphe)

The ascending afferents of R.ip also work through intermediaries, particularly P.ldt and V.mr [Quina et al 2017], although other connectivity studies report R.ip as directly producing ascending connectivity [Lima et al 2017]. Because V.mr is directly caudal to R.ip, the disagreement is essentially about the boundaries between R.ip and V.mr.

Ascending R.ip connectivity. E.ca1.v (hippocampus ventral CA1), H.sum (supermammillary nucleus), P.ldt (laterodorsal tegmentum), R.ip (interpeduncular nucleus), S.ls.v (ventral lateral septum), V.dr (dorsal raphe), V.mr (median raphe), Vta (ventral tegmental area)

The ascending R.ip connectivity will become important in the next section on the consensus circuit because it completes the consensus loop, where other labeled path connectivity is descending. The ascending role is analogous to the ascidian AMG (ascending motor ganglion) neurons. For a consensus circuit to work, all nodes need to be informed of the consensus decision.

Consensus circuit narrative

Let’s now consider the consensus circuit and how it might develop from a strict labeled path system. This is just a thought experiment as a narrative explanation for the Hb.l (lateral habenula) system.

For simplicity, let’s restrict the narrative to apical systems only, ignoring bilateral systems like OT, and let’s start from a labeled path system. In the lamprey, odor information from Ob (olfactory bulb) splits into multiple paths. One path reaches Hb.m directly and another contacts V.pt (posterior tuberculum), considered a homologue of Vta / Snc (substantia nigra pars compacts), which then contacts MLR in lamprey [Derjean et al 2010] and zebrafish [Kermen et al 2013].

Pre-consensus labeled paths for odor seek and avoid. Hb.m (medial habenula), MLR (midbrain locomotor region), P.ldt (laterodorsal tegmentum), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.mr (median raphe), V.pt (posterior tuberculum)

In this example, these two paths are distinct with threat odors going through the Hb.m – R.ip circuit and using P.ldt as an apical version of the MLR (which in lamprey may not be distinct from Ppt MLR, since the lamprey doesn’t have distinct Ppt, P.ldt and M.cnf (cuneiform nucleus)). The animal seeks food using the V.pt to MLR path.

These two system can come into conflict. For the above simple system, suppose conflicts are resolved in R.rs itself, as a hard-coded priority where threats always win. But now consider a system where the conflict is resolved earlier in the stream by adding Hb.l as a lateral inhibition relay.

Lateral inhibition circuit giving threat avoidance a priority over food seeking. Hb.l (lateral habenula), Hb.m (medial habenula), MLR (midbrain locomotor region), P.ldt (laterodorsal tegmentum), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.mr (median raphe), V.pt (posterior tuberculum).

As a first step consider lateral inhibition of threat odor suppressing food seeking. Here the lateral inhibition path uses a relay from Hb.m to Hb.l [Gouveia and Ibrahim 2022] in a primitive Hb.l that then suppresses the V.pt path. This lateral inhibition duplicates the earlier lateral inhibition in R.rs, but is more specific because it inhibits earlier in the two paths.

In the above diagram, the blue lines represent new connections. Notice the gating pattern for V.pt resembles the gating for the consensus circuit where the action nodes are V.pt and V.mr. Hb.l then becomes the vote accumulator for the consensus circuit. Also notice the similarity with the sleep model from essay 29, where Hb inhibits food seeking for sleep. An alternative narrative might repurpose the sleep inhibition into a path inhibition [Hikosaka 2010].

Both Hb.l and Hb.m are tonically acting, meaning that without any input their resting output is a middle value, not a binary output. This means Hb.l can gate V.pt seek and also gate its opposing avoidance circuit in V.mr and P.ldt.

For the next step, let’s add both a bidirectional selection and also add some internal state management, because the animal shouldn’t seek food if it’s sated.

H.l hunger modulation

H.l (lateral hypothalamus) has access to hunger and satiety information by sensing blood levels directly and from connections from R.pb (parabrachial), which has signals from the digestive system via N10 vagus nerve through R.nts (solitary tract nucleus). When Ob (olfactory bulb) senses a food odor , H.l can modulate it with the current hunger sense. This means H.l as gating input to Hb.l is more effective than the simple lateral inhibition from Hb.m If the animal is sufficiently hungry, it might ignore weak threats. Note the similarity to the mollusk sea hare circuit, where hunger changed food odor from seeking to avoidance depending on the internal state.

Adding H.l hunger modulation to the decision between the threat odor avoidance path and the food odor seek path. H.l (lateral hypothalamus), Hb.l (lateral habenula), Hb.m (medial habenula), MLR (midbrain locomotor region), P.ldt (laterodorsal tegmentum), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.mr (median raphe), V.pt (posterior tuberculum).

In addition to hunger, other internal states can modulate Hb such as hypothalamic threat signaling ([Wagle et al 2022]. This step also adds control of the threat path, taking advantage of the Hb.l tonic activity to either inhibit food seeking or threat avoidance.

Place avoidance without a threat

Suppose we take the above circuit, but ignore or disable the threat avoidance path via Hb.m. Even without the threat path, there is an avoidance path from Hb.l to V.mr and P.ldt, where Hb.l not only disinhibits threat avoidance, but can produce place avoidance without a threat.

H.l seek / place avoid circuit without a matching threat path. H.l (lateral hypothalamus), Hb.l (lateral habenula), MLR (midbrain locomotor region), P.ldt (laterodorsal tegmentum), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.mr (median raphe), V.pt (posterior tuberculum)

The above diagram shows deletion of the threat path, while retaining the abstract place avoidance path. If place avoidance is triggered, the animal will avoid the current location without needing a specific threat to avoid. This means that H.l stimulation by itself can trigger real-time avoidance [Stamatakis et al 2016]. In mammals the H.l to Hb.l connection has at least 6 clusters [Calvigioni et al 2023], which suggests multiple paths even in the abstract place avoidance.

S.v ventral striatum digression

This model of the seek vs avoid circuit can be extended to S.v (ventral striatum aka nucleus accumbens) and P.v (ventral pallidum). Consider S.v / P.v as a generalization of H.l, providing more general context beyond hunger. This basal ganglia extension allows for a positive feedback loop. which enables multiple rounds of voting, integrating values, such as with drift diffusion.

Ventral striatum as a sophisticated extension of H.l state modulation. H.l (lateral hypothalamus), Hb.l (lateral habenula), MLR (midbrain locomotor region), P.ldt (laterodorsal tegmentum), P.v (ventral pallidum), R.ip (interpeduncular nucleus), R.rs (reticulospinal), S.v (ventral striatum aka nucleus accumbens), V.mr (median raphe), V.pt (posterior tuberculum), Vta (ventral tegmental area)

In the above, I’ve split the V.pt of the lamper into an ascending Vta (ventral tegmental area) dopamine area from mammals, but left the V.pt to represent the descending glutamate / GABA portion of Vta, despite mammals lacking a distinct V.pt. If there’s a food cue when hungry, H.l to Vta stimulation will generate high DA in S.v, enabling it, which will disinhibit V.pt to enable food seeing. Here, S.v / P.v is acting as the consensus circuit and the V.pt path is the action for food seeking.

As with the smaller Hb.l circuit, S.v / P.v is also part of a sleep / wake circuit using dopamine as a wake signal, as used in essay 29. If the animal is currently seeking food, it shouldn’t fall asleep, and the high dopamine signals to stay away. Again, from a narrative sense, this circuit could have been repurposed from a wake circuit, as opposed to a path conflict system.

In zebrafish Hb.l only projects to V.mr and does not project to any DA [Amo et al 2014], while in the more primitive lamprey Hb.l projects to both V.mr and DA [Stephensen-Jones et al 2011], which suggests that the V.mr projection is more functionally critical to this circuit than the Vta projection, or that the Vta circuit is a later development. The zebrafish V.pt has descending dopamine but the existence of significant projections to the striatum is questioned [Yamamoto and Vernier 2011].

Note that H.l retains its central role, where the S.v circuit generalizes the base H.l function without replacing it. Stimulating H.l.g (H.l GABA neurons) can trigger seeking through its projection to Vta [Nieh et al 2016], and stimulating H.l.glu (glutamate H.l neurons) can trigger place avoidance through the H.l.glu projection to Hb.l [Stamatakis et al 2016].

Hippocampus digression

For place preference and place avoidance E.hc (hippocampus) plays a natural because E.hc represents context and place such as place cells, and H.hc projection strongly to both the hypothalamus and S.v. If we add the H.hc projections to H.l via S.ls, the seek / avoidance circuit looks something like the following.

Hippocampus modulation of H.l place seek and avoid. DA (dopamine), E.hc (hippocampus), H.l (lateral hypothalamus), Hb.l (lateral habenula), P.v (ventral pallidum), S.ls (lateral septum), S.v (ventral striatum), Vta (ventral tegmental area).

H.l has neurons that represent food zones and non-food zones [Jennings et al 2015], presumably using E.hc place information, although possibly using P.bst (bed nucleus of the stria terminals) as an intermediary.

H.sum completing consensus loop

The consensus circuits needs to return the final action and motor choice back into the early layers, otherwise the motivation circuit wouldn’t know if a lower-level startle or OT looming escape took priority of the seek path. With analogy to the ascidian larva, this role resembles the AMG (ascending motor ganglia) neurons, which I associated with P.ldt and V.mr. For this consensus narrative, I’m taking H.sum (supramammillary) as the primary feedback node with an assist from Poa (preoptic area) to complete the loop to Hb.m and M.pag (periaqueductal gray).

H.sum as completing the consensus loop, linking the habenula output back to habenula input. H.l (lateral habenula), H.sum (supramammillary nucleus), Hb.m (medial habenula), MLR (midbrain locomotor region), M.pag (periaqueductal gray), P.ldt (laterodorsal tegmentum), Poa (preoptic area), R.ip (interpeduncular nucleus), R.rs (reticulospinal), V.mr (median raphe), V.pt (posterior tuberculum).

H.sum has several sub circuits with different functions, which studies are only starting to untangle. H.sum tac1 (neurotransmitter aka substance P) is strongly associated with upcoming locomotion [Farrell et al 2021]. H.sum’s Poa projection is specifically associated with threat avoidant locomotion [Escobedo et al 2023].

V.mr and P.ldt are connected with R.rs and the bilateral OT circuit, and therefore have information about the selected action at the level of the hindbrain and motor afferent copies. Both are strongly connected to H.sum. H.sum also connects with M.pag (periaqueductal gray) and H.sum activates when M.pag.d is stimulated [Pan et al 2004]. H.sum also activates when the H.vm (ventromedial hypothalamus) threat nuclei are stimulated.

H.sum is immediately rostral to Vta and highly connected with it (not shown in the diagram.) H.sum contains some DA neurons itself, which are sometimes considered as an extension of A10, the Vta dopamine neuron area, although the neuron types differ [Yetnikoff et al 2014], [Menegas et al 2015].

H.sum is strongly connected with E.hc (hippocampus) and is one of the few external input to both E.dg (dentate gyrus) and E.ca2 (cornu ammonia), and is a major theta source to P.ms (medial septum), which drives E.hc theta. Its link to E.hc are important for both novel object exploration [Chen et al 2020], [Takahashi et al 2023] and social memory [Qin et al 2022]. Although I’m not yet adding E.hc to the essays, the novel object detection will be important soon to avoid repeated exploration of the same object.

Note that Poa has already participated in the Hb.m to R.ip circuit because Poa drives thermotaxis [Palieri et al 2024] as part of the original Hb aversive apical path.

M.pag tetrapod complications

In a sense, the vertebrate brain is designed around fish navigation, exemplified by the simple M-cell startle circuit that requires only three neurons between the acoustic sense and the swimming muscles. Although the direct Braitenberg-like connections to R.rs work for fish locomotion, tetrapod locomotion is more complex. M.pag (periaqueductal grey) is a central grey area surrounding the midbrain ventricle (“periaqueductal”), and it an inner ring to OT, which is immediately dorsal to it. Naming it “OT.dd” (deep, deep layer of OT) would not be unreasonable. Among other tasks like vocalization [Jürgens 1994] and hunting [Marín-Blasco et al 2020], M.pag provides a similar to R.rs but at a higher level, like syllables to phonemes. So in the following examples, M.pag can be viewed as similar functionality to R.rs.

Unlike R.rs, M.pag can access more sophisticated navigation. Where the M-cell can only turn left or right, M.pag can use OT for obstacle avoidance and even higher navigation of the hippocampus using H.pm.d (dorsal premammillary nucleus) [Wang et al 2021].

M.pag flight

M.pag implements innate behaviors, including flight, freezing, hunting, grooming, and vocalizations. The following diagram shows some of the looming flight circuitry [Zhou et al 2019]. As before, OT.m primarily processes the looming signal and OT.m sends input to M.pag.d as an integrated threat signal, where M.pag.d computes a threshold for responding to the threat [Evans et al 2018].

M.pag flight for the looming circuit. M.pag.d (dorsal periaqueductal gray), OT.m (medial, deep optic tectum), R.rs (reticulospinal), S.a (central amygdala), Vta.g (gaba neurons of the ventral tegmental area).

In the diagram, the second interesting path is through Vta.g (Vta GABA neurons) and S.a (central amygdala). Because OT.m and M.pag.d directly output to R.rs neurons, the projects to Vta.g and S.a aren’t required for motor control, but because of the distributed consensus system, other systems need to be informed of the looming response. S.a modulates defense, hunting, and eating systems, and Vta.g also inhibits the current action by suppressing dopamine, back to the consensus loop, suppressing any current seek action.

M.pag.vl avoidance

While M.pag.d is strongly associated with fast escape, M.pag.vl is more complicated with diverse functions including hunting [Franklin 2019], [Marín-Blasco et al 2020], vocalization [González-García et al 2024], and laughter [Klingbeil et al 2021]. Since this essay focuses on avoidance, where avoidance here isn’t the high speed predator escape of M.pag.d.

M.pag.vl avoidance afferents. H.l.glu (lateral hypothalamus glutamate), H.sum (supramammillary nucleus), Po.m (medial preoptic area), P.v (ventral pallidum), V.mr.glu (median raphe glutamate), Vta (ventral tegmental area glutamate and GABA)

H.l lateral hypothalamus

As discussed above, H.l is a central motivational node, filling a similar role to the central hunger node in the mollusk sea hare navigation. However, H.l is much more complicated than a simple hunger node. One developmental paper divided H.l into nine distinct regions [Diaz et al 2013], but that anatomical division understates the complexity. A genetic transcription analysis finds 15 glutamate and 15 GABA clusters [Mickelson et al 2019]. Interestingly, the Diaz study identifies their H.l.1 area with H.sum.l, treating H.sum.l as part of H.l.

In general, H.l.glu produces place avoidance and H.l.g enables seeking, but as mentioned above with at least 15 genetic types and 9 regions, this division is almost certainly an oversimplification.

H.l seek and avoid efferents. E.ca1.v (ventral hippocampus), H.l (lateral hypothalamus glutamate and GABA), Hb.l (lateral habenula), M.pag (periaqueductal gray), S.ls (lateral septum), Vta.g (ventral tegmental area GABA).

The H.l.glu to M.pag connection is certainly capable of driving motor avoidance. Interestingly, a different H.l population is part of the M.pag hunting circuit. Both Vta.g and Hb.l enter the motivation loop. I’ve added the E.ca1.v (ventral hippocampus CA1) input to H.l because E.hc.v (ventral hippocampus) is strongly associated with place, and E.hc.v specifically with aversive context.

R.pb peribrachial nucleus

R.pb (peribrachial nucleus) is a pain, alarm, feeding, and respiration hub in the prepontine isthmus area (r0-r1). As an alarm center [Campos et al 2018], R.pb is connected with escaping and avoiding circuits. As covered in essay 29 speed, it includes a high Co2 trigger that drives place avoidance. It also includes pain triggers for escape. R.pb has multiple functions defined more by chemical markers than topology. One study explored R.pb’s role in escape and avoidance behavior [Chiang et al 2020].

R.pb avoidance circuits. dyn (dynorphin neurotransmitter), H.vm (ventromedial hypothalamus), M.pag.l (periaqueductal gray), P.bst (bed nucleus of the stria terminalis), R.pb (peribrachial nucleus), RTPA (real-time place avoidance), S.a (central amygdala), tac1 (tachykinin 1 / substance P neurotransmitter)

R.pb.dl (dorsolateral R.pb) and R.pb.el are adjacent R.pb areas that are associated with alarm and pain responses. R.pb.dl receives direct N5 (trigeminal – head, jaw) and N.sp (spinal) pain input, including pain input marked by tac1 (tachykinin 1 peptide aka substance P). Relevant to this essay, the outputs divide between direct escape behavior with not learning and indirect avoidance behavior with learning. The M.pag.l projection produces flight and jumping. The S.a (central amygdala) and P.bst (bed nucleus of the stria terminalis – extended amygdala) projections produce real-time place avoidance and are capable of CPA (conditioned place avoidance) [Chiang et al 2020]. The R.pb example is useful because it combines a direct locomotion to M.pag with output to the slower consensus circuit.

Preoptic area

Poa (preoptic area) is a multifunctional area directly anterior to the hypothalamus and often considered part of the hypothalamus, although genetic markers suggest it’s more closely related to the forebrain. Like other brainstem areas, its functionality is more organized by genetic markers than topology.

Preoptic area avoidance and seek areas. H.l (lateral hypothalamus), H.pv (periventricular hypothalamus), H.sum (supramammillary), Hb.m (medial habenula), Pom (medial preoptic area), S.ls (lateral septum)

The above diagram shows some of the Pom (medial preoptic area)functions. Temperature management has been discussed with a connection through Hb.m gradient following. Threat avoidance from signals from H.sum, H.pv (periventricular hypothalamus), or S.ls (lateral septum) can lead to RTPA through a M.pag projection [Escobedo et al 2023]. Local exploration, a RTPP function, also uses a M.pag projection [Shin et al 2023], and Pom can also enable hunting [Park et al 2018], although through a M.pag projection. The recent genetic research tools will likely unravel more of its functionality.

Poa has a strong projection to both Hb.m and Hb.l, suggesting that it’s an important node in the locomotion consensus circuit. In the thought experiment I’ve outlined above, Poa is part of the feedback system through H.sum, but Poa also receives E.hc.v (ventral hippocampus) input through S.ls (lateral septum), so it may be an important node in its own right.

Ppt / P.ldt

The ACh (acetylcholine) neurons near the midbrain-hindbrain boundary Ppt (pedunculopontine tegmentum) and P.ldt (laterodorsal tegmentum) are the core of the MLR. In simpler vertebrates like the lamprey, the MLR is only a single area, generally named P.ldt. In mammals, not only are P.ldt and Ppt split, but a chunk of locomotive action is in a different nucleus M.cnf (cuneiform). Although M.cnf is more of a direct locomotive area, the locomotive neurons don’t respect the anatomical boundary, but are a group of glutamate neurons spanning from Ppt to M.ncf, where Ppt and M.cnf are neighbors [Caggiano et al 2018]. Tetrapod locomotion is more complex than fish swimming, which may be a partial reason for the expansion and division.

Ppt connections. H.stn (subthalamic nucleus), M.pag (periaqueductal gray), OT.d (deep layer of optic tectum), P.g (globus pallidus), Ppt (pedunculopontine nucleus), R.rs (reticulospinal), S.d (dorsal striatum)

Ppt is strongly reciprocally connected with the deeper layers of OT: OT.i for turning and sensory integration, and OT.d for seek and avoid. Its connections resemble the R.pgb (parabigeminal aka nucleus isthmi) which sustains attention for the OT.s (superficial OT) [Knudsen 2011] and covered in essay 19. R.pgb, Ppt, and P.ldt are sibling nuclei that develop from the same area in r1 that also produces R.pb and cerebellum granule cells [Pose-Méndez et al 2023].

Some P.ldt connections, emphasizing that Vta connections are collaterals of R.rs. H.sum (supramammillary), P.ldt (laterodorsal tegmentum), R.rs (reticulospinal), Vta (ventral tegmental area)

P.ldt is complicated by the relative lack of recent studies of its descending projections since [Cornwall 1990] and an over-focus on its Vta connection. Because neuron tracing in [Zhao et al 2023] suggests that P.ldt has more descending connections to R.rs than Ppt and that all Vta connections are collaterals of R.rs connections, studies like [Coimbra et al 2021] and [Liu et al 2022] that find locomotion through Vta projections could be produced by its R.rs projection. P.ldt has reciprocal connections with H.sum.

Vta

Although Vta (ventral tegmental area) is most studied for its ascending dopamine projections to S.v (ventral stratum) and F.pfc (prefrontal cortex), it also contains glutamate and GABA projections, including descending connections. Non-tetrapods like fish and lamprey have a homologous V.pt (posterior tuberculum) with prominent descending locomotor connections to MLR [Ryczko et al 2017], [Derjean et al 2010]. The earlier thought experiment for the development of a locomotor consensus split out an ancient V.pt from the mammalian Vta as a way of describing the old descending functionality.

Vta glutamate and GABA connections. H.l.glu (lateral hypothalamus glutamate), Hb.l (lateral habenula), M.pag (periaqueductal gray), OT (optic tectum), P.bst (bed nucleus of the stria terminalis), S.a (central amygdala), S.am (medial central amygdala), S.msh.pv (medial shell of the ventral striatum, parvalbumin neurons), Vta.da (ventral tegmental area, dopamine), Vta.g (Vta GABA), Vta.glu (Vta glutamate)

The above diagram shows some of the connections of the glutamate and GABA Vta [Taylor et al 2014], including projections to M.pag and to Hb.l that are direct locomotor for seek and avoid. The Vta is a main dopamine source for S.v and F.pfc with multiple distinct areas. Vta.m, which projects to S.msh (medial shell of S.v) is aversive, while Vta.l, which projects to S.lsh (lateral shell of S.v) and S.core (core of S.v) promotes seek [Szőnyi et al 2019]. Vta.m is non-reinforcing, as opposed to Vta.l, which is well-studied for reinforcement.

P.v ventral pallidum

P.v is a main output of S.v and the only output of S.ot (olfactory tubercle). As essay 29 covered, it’s an important sleep/wake node. For this essay, the important bit is a split between RTPP and RTPA depending on its output.

P.v RTPA and RTPP circuits. H.l (lateral hypothalamus), Hb.l (lateral habenula), M.pag.vl (periaqueductal grey), Ppt (pedunculopontine tegmentum), P.v (ventral pallidum), V.mr (median raphe), Vta (ventral tegmental area)

Links

References

Ables JL, Park K, Ibañez-Tallon I. Understanding the habenula: A major node in circuits regulating emotion and motivation. Pharmacol Res. 2023 Apr;190:106734. 

Anselmi C, Fuller GK, Stolfi A, Groves AK, Manni L. Sensory cells in tunicates: insights into mechanoreceptor evolution. Front Cell Dev Biol. 2024 Mar 14;12:1359207.

Basso MA, Bickford ME, Cang J. Unraveling circuits of visual perception and cognition through the superior colliculus. Neuron. 2021 Mar 17;109(6):918-937. 

Berg EM, Björnfors ER, Pallucchi I, Picton LD, El Manira A. Principles Governing Locomotion in Vertebrates: Lessons From Zebrafish. Front Neural Circuits. 2018 Sep 13;12:73. 

Beretta CA, Dross N, Guiterrez-Triana JA, Ryu S, Carl M. Habenula circuit development: past, present, and future. Front Neurosci. 2012 Apr 23;6:51.

Bhattacharyya K, McLean DL, MacIver MA. Visual Threat Assessment and Reticulospinal Encoding of Calibrated Responses in Larval Zebrafish. Curr Biol. 2017 Sep 25;27(18):2751-2762.e6.

Boulos LJ, Ben Hamida S, Bailly J, Maitra M, Ehrlich AT, Gavériaux-Ruff C, Darcq E, Kieffer BL. Mu opioid receptors in the medial habenula contribute to naloxone aversion. Neuropsychopharmacology. 2020 Jan;45(2):247-255. 

Braitenberg, V. (1986). Vehicles: Experiments in synthetic psychology. MIT press.

Brocard F, Ryczko D, Fénelon K, Hatem R, Gonzales D, Auclair F, Dubuc R. The transformation of a unilateral locomotor command into a symmetrical bilateral activation in the brainstem. J Neurosci. 2010 Jan 13;30(2):523-33.

Caggiano V, Leiras R, Goñi-Erro H, Masini D, Bellardita C, Bouvier J, Caldeira V, Fisone G, Kiehn O. Midbrain circuits that set locomotor speed and gait selection. Nature. 2018 Jan 25;553(7689):455-460.

 Calvigioni D, Fuzik J, Le Merre P, Slashcheva M, Jung F, Ortiz C, Lentini A, Csillag V, Graziano M, Nikolakopoulou I, Weglage M, Lazaridis I, Kim H, Lenzi I, Park H, Reinius B, Carlén M, Meletis K. Esr1+ hypothalamic-habenula neurons shape aversive states. Nat Neurosci. 2023 Jul;26(7):1245-1255. 

Campos CA, Bowen AJ, Roman CW, Palmiter RD. Encoding of danger by parabrachial CGRP neurons. Nature. 2018 Mar 29;555(7698):617-622. 

Chen S, He L, Huang AJY, Boehringer R, Robert V, Wintzer ME, Polygalov D, Weitemier AZ, Tao Y, Gu M, Middleton SJ, Namiki K, Hama H, Therreau L, Chevaleyre V, Hioki H, Miyawaki A, Piskorowski RA, McHugh TJ. A hypothalamic novelty signal modulates hippocampal memory. Nature. 2020 Oct;586(7828):270-274. 

Chen WY, Peng XL, Deng QS, Chen MJ, Du JL, Zhang BB. Role of Olfactorily Responsive Neurons in the Right Dorsal Habenula-Ventral Interpeduncular Nucleus Pathway in Food-Seeking Behaviors of Larval Zebrafish. Neuroscience. 2019 Apr 15;404:259-267. 

Chen X, Engert F. Navigational strategies underlying phototaxis in larval zebrafish. Front Syst Neurosci. 2014 Mar 25;8:39.

Cheng RK, Krishnan S, Lin Q, Kibat C, Jesuthasan S. Characterization of a thalamic nucleus mediating habenula responses to changes in ambient illumination. BMC Biol. 2017 Oct 31;15(1):104. 

Chiang MC, Nguyen EK, Canto-Bustos M, Papale AE, Oswald AM, Ross SE. Divergent Neural Pathways Emanating from the Lateral Parabrachial Nucleus Mediate Distinct Components of the Pain Response. Neuron. 2020 Jun 17;106(6):927-939.e5.

Chou MY, Amo R, Kinoshita M, Cherng BW, Shimazaki H, Agetsuma M, Shiraki T, Aoki T, Takahoko M, Yamazaki M, Higashijima S, Okamoto H. Social conflict resolution regulated by two dorsal habenular subregions in zebrafish. Science. 2016 Apr 1;352(6281):87-90. 

Coimbra B, Domingues AV, Soares-Cunha C, Correia R, Pinto L, Sousa N, Rodrigues AJ. Laterodorsal tegmentum-ventral tegmental area projections encode positive reinforcement signals. J Neurosci Res. 2021 Nov;99(11):3084-3100. 

Coombs S, Bak-Coleman J, Montgomery J. Rheotaxis revisited: a multi-behavioral and multisensory perspective on how fish orient to flow. J Exp Biol. 2020 Dec 7;223(Pt 23):jeb223008.

 Cornwall J, Cooper JD, Phillipson OT. Afferent and efferent connections of the laterodorsal tegmental nucleus in the rat. Brain Res Bull. 1990 Aug;25(2):271-84.

Cregg JM, Leiras R, Montalant A, Wanken P, Wickersham IR, Kiehn O. Brainstem neurons that command mammalian locomotor asymmetries. Nat Neurosci. 2020 Jun;23(6):730-740. 

Deacon RM, Rawlins JN. T-maze alternation in the rodent. Nat Protoc. 2006;1(1):7-12.

Derjean D, Moussaddy A, Atallah E, St-Pierre M, Auclair F, Chang S, Ren X, Zielinski B, Dubuc R. A novel neural substrate for the transformation of olfactory inputs into motor output. PLoS Biol. 2010 Dec 21;8(12):e1000567.

Diaz C, de la Torre MM, Rubenstein JLR, Puelles L. Dorsoventral Arrangement of Lateral Hypothalamus Populations in the Mouse Hypothalamus: a Prosomeric Genoarchitectonic Analysis. Mol Neurobiol. 2023 Feb;60(2):687-731. 

do Carmo Silva RX, Lima-Maximino MG, Maximino C. The aversive brain system of teleosts: Implications for neuroscience and biological psychiatry. Neurosci Biobehav Rev. 2018 Dec;95:123-135. 

Dreosti E, Vendrell Llopis N, Carl M, Yaksi E, Wilson SW. Left-right asymmetry is required for the habenulae to respond to both visual and olfactory stimuli. Curr Biol. 2014 Feb 17;24(4):440-5.

Edwards SB (1980). The deep cell layers of the superior colliculus: their reticular characteristics and structural organization. In The Reticular Formation Revisted, Hobson JA, and Brazier MAB, eds. (New York: Raven Press; ), pp. 193–209.

Escobedo Abraham, Holloway Salli-Ann, Votoupal Megan, Cone Aaron L, Skelton Hannah E, Legaria Alex A., Ndiokho Imeh, Floyd Tasheia, Kravitz Alexxai V., Bruchas Michael R., Norris Aaron J. (2023) Glutamatergic Supramammillary Nucleus Neurons Respond to Threatening Stressors and Promote Active Coping eLife 12:RP90972

Evans DA, Stempel AV, Vale R, Ruehle S, Lefler Y, Branco T. A synaptic threshold mechanism for computing escape decisions. Nature. 2018 Jun;558(7711):590-594.

Farrell JS, Lovett-Barron M, Klein PM, Sparks FT, Gschwind T, Ortiz AL, Ahanonu B, Bradbury S, Terada S, Oijala M, Hwaun E, Dudok B, Szabo G, Schnitzer MJ, Deisseroth K, Losonczy A, Soltesz I. Supramammillary regulation of locomotion and hippocampal activity. Science. 2021 Dec 17;374(6574):1492-1496.

Fotowat H, Engert F. Neural circuits underlying habituation of visually evoked escape behaviors in larval zebrafish. Elife. 2023 Mar 14;12:e82916. 

Franklin TB. Recent Advancements Surrounding the Role of the Periaqueductal Gray in Predators and Prey. Front Behav Neurosci. 2019 May 10;13:60. 

Gardon O, Faget L, Chu Sin Chung P, Matifas A, Massotte D, Kieffer BL. Expression of mu opioid receptor in dorsal diencephalic conduction system: new insights for the medial habenula. Neuroscience. 2014 Sep 26;277:595-609. 

Gillette R, Brown JW. The Sea Slug, Pleurobranchaea californica: A Signpost Species in the Evolution of Complex Nervous Systems and Behavior. Integr Comp Biol. 2015 Dec;55(6):1058-69. 

González-García M, Carrillo-Franco L, Morales-Luque C, Dawid-Milner MS, López-González MV. Central Autonomic Mechanisms Involved in the Control of Laryngeal Activity and Vocalization. Biology (Basel). 2024 Feb 13;13(2):118.

Gouveia FV, Ibrahim GM. Habenula as a Neural Substrate for Aggressive Behavior. Front Psychiatry. 2022 Feb 17;13:817302

Guan NN, Xu L, Zhang T, Huang CX, Wang Z, Dahlberg E, Wang H, Wang F, Pallucchi I, Hua Y, El Manira A, Song J. A specialized spinal circuit for command amplification and directionality during escape behavior. Proc Natl Acad Sci U S A. 2021 Oct 19;118(42):e2106785118. 

Heap LAL, Vanwalleghem G, Thompson AW, Favre-Bulle IA, Scott EK. Luminance Changes Drive Directional Startle through a Thalamic Pathway. Neuron. 2018 Jul 25;99(2):293-301.e4.

Helmbrecht TO, Dal Maschio M, Donovan JC, Koutsouli S, Baier H. Topography of a Visuomotor Transformation. Neuron. 2018 Dec 19;100(6):1429-1445.e4. 

Hengenius JB, Connor EG, Crimaldi JP, Urban NN, Ermentrout GB. Olfactory navigation in the real world: Simple local search strategies for turbulent environments. J Theor Biol. 2021 May 7;516:110607.

Hikosaka O. The habenula: from stress evasion to value-based decision-making. Nat Rev Neurosci. 2010 Jul;11(7):503-13.

Hirayama K, Moroz LL, Hatcher NG, Gillette R. Neuromodulatory control of a goal-directed decision. PLoS One. 2014 Jul 21;9(7):e102240.

 Holland, L. Z. (2016). Tunicates. Current Biology, 26(4), R146-R152.

Hoyer J, Kolar K, Athira A, van den Burgh M, Dondorp D, Liang Z, Chatzigeorgiou M. Polymodal sensory perception drives settlement and metamorphosis of Ciona larvae. Curr Biol. 2024 Mar 25;34(6):1168-1182.e7.

Izquierdo EJ, Beer RD. Connecting a connectome to behavior: an ensemble of neuroanatomical models of C. elegans klinotaxis. PLoS Comput Biol. 2013;9(2):e1002890.

Jamieson D, Roberts A. Responses of young Xenopus laevis tadpoles to light dimming: possible roles for the pineal eye. J Exp Biol. 2000 Jun;203(Pt 12):1857-67.

Jennings JH, Ung RL, Resendez SL, Stamatakis AM, Taylor JG, Huang J, Veleta K, Kantak PA, Aita M, Shilling-Scrivo K, Ramakrishnan C, Deisseroth K, Otte S, Stuber GD. Visualizing hypothalamic network dynamics for appetitive and consummatory behaviors. Cell. 2015 Jan 29;160(3):516-27. 

 Jetti SK, Vendrell-Llopis N, Yaksi E. Spontaneous activity governs olfactory representations in spatially organized habenular microcircuits. Curr Biol. 2014 Feb 17;24(4):434-9. 

Jürgens U. The role of the periaqueductal grey in vocal behaviour. Behav Brain Res. 1994 Jun 30;62(2):107-17.

Kermen F, Franco LM, Wyatt C, Yaksi E. Neural circuits mediating olfactory-driven behavior in fish. Front Neural Circuits. 2013 Apr 11;7:62. 

Kim LH, Sharma S, Sharples SA, Mayr KA, Kwok CHT, Whelan PJ. Integration of Descending Command Systems for the Generation of Context-Specific Locomotor Behaviors. Front Neurosci. 2017 Oct 18;11:581.

Knudsen EI. Control from below: the role of a midbrain network in spatial attention. Eur J Neurosci. 2011 Jun;33(11):1961-72. 

Klingbeil, J., Wawrzyniak, M., Stockert, A., Brandt, M. L., Schneider, H. R., Metelmann, M., & Saur, D. (2021). Pathological laughter and crying: insights from lesion network-symptom-mapping. Brain, 144(10), 3264-3276.

Kohashi T, Nakata N, Oda Y. Effective sensory modality activating an escape triggering neuron switches during early development in zebrafish. J Neurosci. 2012 Apr 25;32(17):5810-20. 

Koide T, Miyasaka N, Morimoto K, Asakawa K, Urasaki A, Kawakami K, Yoshihara Y. Olfactory neural circuitry for attraction to amino acids revealed by transposon-mediated gene trap approach in zebrafish. Proc Natl Acad Sci U S A. 2009 Jun 16;106(24):9884-9.

Kourakis MJ, Borba C, Zhang A, Newman-Smith E, Salas P, Manjunath B, Smith WC. Parallel visual circuitry in a basal chordate. Elife. 2019 Apr 18;8:e44753. 

Lacalli, T., & Candiani, S. (2017). Locomotory control in amphioxus larvae: new insights from neurotransmitter data. EvoDevo, 8, 1-8.

Lacalli Thurston 2022 An evolutionary perspective on chordate brain organization and function: insights from amphioxus, and the problem of sentience Phil. Trans. R. Soc. B3772020052020200520

Lima LB, Bueno D, Leite F, Souza S, Gonçalves L, Furigo IC, Donato J Jr, Metzger M. Afferent and efferent connections of the interpeduncular nucleus with special reference to circuits involving the habenula and raphe nuclei. J Comp Neurol. 2017 Jul 1;525(10):2411-2442.

Liu C, Tose AJ, Verharen JPH, Zhu Y, Tang LW, de Jong JW, Du JX, Beier KT, Lammel S. An inhibitory brainstem input to dopamine neurons encodes nicotine aversion. Neuron. 2022 Sep 21;110(18):3018-3035.e7.

Liu X, Huang H, Snutch TP, Cao P, Wang L, Wang F. The Superior Colliculus: Cell Types, Connectivity, and Behavior. Neurosci Bull. 2022 Dec;38(12):1519-1540. 

Mallatt, Jon, Vertebrate origins are informed by larval lampreys (ammocoetes): a response to Miyashita et al., 2021, Zoological Journal of the Linnean Society, Volume 197, Issue 2, February 2023, Pages 287–321.

Marín-Blasco, I. J., José Rangel Jr, M., Baldo, M. V. C., Motta, S. C., & Canteras, N. S. (2020). The lateral periaqeductal gray and its role in controlling the opposite behavioral choices of predatory hunting and social defense. bioRxiv, 2020-09.

Marquart GD, Tabor KM, Bergeron SA, Briggman KL, Burgess HA. Prepontine non-giant neurons drive flexible escape behavior in zebrafish. PLoS Biol. 2019 Oct 15;17(10):e3000480. doi: 10.1371/journal.pbio.3000480.

Mast, S. O. (1921). Reactions to light in the larvae of the ascidians, Amarocium constellatum and Amarocium pellucidum with special reference to their photic orientation. J. Exp. Zool. 34, 149-187.

Menegas W, Bergan JF, Ogawa SK, Isogai Y, Umadevi Venkataraju K, Osten P, Uchida N, Watabe-Uchida M. Dopamine neurons projecting to the posterior striatum form an anatomically distinct subclass. Elife. 2015 Aug 31;4:e10032.

Mickelsen LE, Bolisetty M, Chimileski BR, Fujita A, Beltrami EJ, Costanzo JT, Naparstek JR, Robson P, Jackson AC. Single-cell transcriptomic analysis of the lateral hypothalamic area reveals molecularly distinct populations of inhibitory and excitatory neurons. Nat Neurosci. 2019 Apr;22(4):642-656. 

Nieh EH, Vander Weele CM, Matthews GA, Presbrey KN, Wichmann R, Leppla CA, Izadmehr EM, Tye KM. Inhibitory Input from the Lateral Hypothalamus to the Ventral Tegmental Area Disinhibits Dopamine Neurons and Promotes Behavioral Activation. Neuron. 2016 Jun 15;90(6):1286-1298. 

Okamoto H, Cherng BW, Nakajo H, Chou MY, Kinoshita M. Habenula as the experience-dependent controlling switchboard of behavior and attention in social conflict and learning. Curr Opin Neurobiol. 2021 Jun;68:36-43. doi: 10.1016/j.conb.2020.12.005. Epub 2021 Jan 6. PMID: 33421772.

Palieri V, Paoli E, Wu YK, Haesemeyer M, Grunwald Kadow IC, Portugues R. The preoptic area and dorsal habenula jointly support homeostatic navigation in larval zebrafish. Curr Biol. 2024 Feb 5;34(3):489-504.e7.

Pan WX, McNaughton N. The supramammillary area: its organization, functions and relationship to the hippocampus. Prog Neurobiol. 2004 Oct;74(3):127-66. 

Park SG, Jeong YC, Kim DG, Lee MH, Shin A, Park G, Ryoo J, Hong J, Bae S, Kim CH, Lee PS, Kim D. Medial preoptic circuit induces hunting-like actions to target objects and prey. Nat Neurosci. 2018 Mar;21(3):364-372. doi: 10.1038/s41593-018-0072-x. Epub 2018 Jan 29. 

Pose-Méndez S, Schramm P, Valishetti K, Köster RW. Development, circuitry, and function of the zebrafish cerebellum. Cell Mol Life Sci. 2023 Jul 25;80(8):227.

Pottin K, Hyacinthe C, Rétaux S. Conservation, development, and function of a cement gland-like structure in the fish Astyanax mexicanus. Proc Natl Acad Sci U S A. 2010 Oct 5;107(40):17256-61.

Qin H, Fu L, Jian T, Jin W, Liang M, Li J, Chen Q, Yang X, Du H, Liao X, Zhang K, Wang R, Liang S, Yao J, Hu B, Ren S, Zhang C, Wang Y, Hu Z, Jia H, Konnerth A, Chen X. REM sleep-active hypothalamic neurons may contribute to hippocampal social-memory consolidation. Neuron. 2022 Dec 7;110(23):4000-4014.e6. 

Quina LA, Harris J, Zeng H, Turner EE. Specific connections of the interpeduncular subnuclei reveal distinct components of the habenulopeduncular pathway. J Comp Neurol. 2017 Aug 15;525(12):2632-2656. 

Randel N, Jékely G. Phototaxis and the origin of visual eyes. Philos Trans R Soc Lond B Biol Sci. 2016 Jan 5;371(1685):20150042. 

Rétaux S, Pottin K. A question of homology for chordate adhesive organs. Commun Integr Biol. 2011 Jan;4(1):75-7.

Roussigné M, Bianco IH, Wilson SW, Blader P. Nodal signalling imposes left-right asymmetry upon neurogenesis in the habenular nuclei. Development. 2009 May;136(9):1549-57.

Ryan K, Lu Z, Meinertzhagen IA. The CNS connectome of a tadpole larva of Ciona intestinalis (L.) highlights sidedness in the brain of a chordate sibling. Elife. 2016 Dec 6;5:e16962. doi: 10.7554/eLife.16962.

Ryczko D, Grätsch S, Schläger L, Keuyalian A, Boukhatem Z, Garcia C, Auclair F, Büschges A, Dubuc R. Nigral Glutamatergic Neurons Control the Speed of Locomotion. J Neurosci. 2017 Oct 4;37(40):9759-9770. 

Salas P, Vinaithirthan V, Newman-Smith E, Kourakis MJ, Smith WC. Photoreceptor specialization and the visuomotor repertoire of the primitive chordate Ciona. J Exp Biol. 2018 Apr 11;221(Pt 7):jeb177972.

Shin A, Ryoo J, Shin K, Lee J, Bae S, Kim DG, Park SG, Kim D. Exploration driven by a medial preoptic circuit facilitates fear extinction in mice. Commun Biol. 2023 Jan 27;6(1):106.

Stamatakis AM, Van Swieten M, Basiri ML, Blair GA, Kantak P, Stuber GD. Lateral Hypothalamic Area Glutamatergic Neurons and Their Projections to the Lateral Habenula Regulate Feeding and Reward. J Neurosci. 2016 Jan 13;36(2):302-11.

Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A. 2012 Jan 17;109(3):E164-73.

Stolfi, A., & Brown, F. D. (2015). Tunicata. Evolutionary developmental biology of invertebrates 6: Deuterostomia, 135-204.

Szőnyi A, Zichó K, Barth AM, Gönczi RT, Schlingloff D, Török B, Sipos E, Major A, Bardóczi Z, Sos KE, Gulyás AI, Varga V, Zelena D, Freund TF, Nyiri G. Median raphe controls acquisition of negative experience in the mouse. Science. 2019 Nov 29;366(6469):eaay8746. 

Takahashi J, Yamada D, Nagano W, Sano Y, Furuichi T, Saitoh A. Oxytocinergic projection from the hypothalamus to supramammillary nucleus drives recognition memory in mice. PLoS One. 2023 Nov 16;18(11):e0294113.

Taylor SR, Badurek S, Dileone RJ, Nashmi R, Minichiello L, Picciotto MR. GABAergic and glutamatergic efferents of the mouse ventral tegmental area. J Comp Neurol. 2014 Oct 1;522(14):3308-34.

Temizer I, Donovan JC, Baier H, Semmelhack JL. A Visual Pathway for Looming-Evoked Escape in Larval Zebrafish. Curr Biol. 2015 Jul 20;25(14):1823-34. 

Tosches, Maria Antonietta, and Detlev Arendt. The bilaterian forebrain: an evolutionary chimaera. Current opinion in neurobiology 23.6 (2013): 1080-1089.

Wagle M, Zarei M, Lovett-Barron M, Poston KT, Xu J, Ramey V, Pollard KS, Prober DA, Schulkin J, Deisseroth K, Guo S. Brain-wide perception of the emotional valence of light is regulated by distinct hypothalamic neurons. Mol Psychiatry. 2022 Sep;27(9):3777-3793.

Wang W, Schuette PJ, La-Vu MQ, Torossian A, Tobias BC, Ceko M, Kragel PA, Reis FM, Ji S, Sehgal M, Maesta-Pereira S, Chakerian M, Silva AJ, Canteras NS, Wager T, Kao JC, Adhikari A. Dorsal premammillary projection to periaqueductal gray controls escape vigor from innate and conditioned threats. Elife. 2021 Sep 1;10:e69178.

Yamamoto K, Vernier P. The evolution of dopamine systems in chordates. Front Neuroanat. 2011 Mar 29;5:21.

Yetnikoff L, Lavezzi HN, Reichard RA, Zahm DS. An update on the connections of the ventral mesencephalic dopaminergic complex. Neuroscience. 2014 Dec 12;282:23-48. 

Yoshizawa M, Jeffery WR. Shadow response in the blind cavefish Astyanax reveals conservation of a functional pineal eye. J Exp Biol. 2008 Feb;211(Pt 3):292-9. 

Zega, G., Thorndyke, M. C., & Brown, E. R. (2006). Development of swimming behaviour in the larva of the ascidian Ciona intestinalis. Journal of experimental biology, 209(17), 3405-3412.

Zhang BB, Yao YY, Zhang HF, Kawakami K, Du JL. Left Habenula Mediates Light-Preference Behavior in Zebrafish via an Asymmetrical Visual Pathway. Neuron. 2017 Feb 22;93(4):914-928.e4. 

Zhao P, Jiang T, Wang H, Jia X, Li A, Gong H, Li X. Upper brainstem cholinergic neurons project to ascending and descending circuits. BMC Biol. 2023 Jun 6;21(1):135. 

Zhou Z, Liu X, Chen S, Zhang Z, Liu Y, Montardy Q, Tang Y, Wei P, Liu N, Li L, Song R, Lai J, He X, Chen C, Bi G, Feng G, Xu F, Wang L. A VTA GABAergic Neural Circuit Mediates Visually Evoked Innate Defensive Responses. Neuron. 2019 Aug 7;103(3):473-488.e6.

Zwaka H, McGinnis OJ, Pflitsch P, Prabha S, Mansinghka V, Engert F, Bolton AD. Visual object detection biases escape trajectories following acoustic startle in larval zebrafish. Curr Biol. 2022 Dec 5;32(23):5116-5125.e3.

Essay 24: phototaxis problems

The simple phototaxis implementation exposes a few problem with the simulation, both from running it and from reviewing neuroscience to critique it.

Interrupts

The essay doesn’t currently implement any interrupt mechanism. When running into darkness, the animal turns around and starts an area restricted search (ARS), but if the animal is in the middle of a long Levy path, it will cross the border and the search will not find the border.

Long initial paths breaks the phototaxis algorithm.

The problem here is that the ARS starts too late because the animal doesn’t interrupt the current behavior when encountering the border.

One solution is to create an interrupt (orientation) system, which exists in the vertebrate brain in V.ppt (peduncular pontine nucleus), and uses ACh (acetylcholine) to interrupt the current behavior. A natural location for the interrupt is V.ppt for the signal and the stratum as the plan representation, interruptible via ACh interrupts to the striatum.

Another solution is to avoid the uninterruptible behavior entirely, where the problem is the essay’s Levy walk implementation. The essay pre-computes the length of a run instead of continuously creating extensions. In contrast the zebrafish larva swims in bouts, but longer runs are made of multiple forward bouts.

Zebrafish random walk (ARTR area)

The essay’s random walk does not match actual zebrafish search behavior. The essay uses a turn-and-run model where the turn and run length are computed randomly. The zebrafish has a hindbrain oscillator, the ARTR (anterior rhombencephalic turning region) which selects left and right turns [Karpenko et al 2020].

Speculative directed random walk with the zebrafish ARTR. The isthmus is the midbrain-hindbrain boundary (MHB). B.artr anterior rhombencephalic turning region, B.rs reticulospinal motor command, Hb.m medial habenula, M.ip interpeduncular nucleus.

In zebrafish, turns and runs are selected independently and can be chained differently. Instead of turn-run-turn-run as in the essay, the zebrafish can have turn-turn or run-run patters. Zebrafish turn direction is also correlated, as opposed to the random walk’s turn independence. A zebrafish left turn is more likely to follow a left turn.

When encountering darkness, the same-direction turns increase. When encountering light, alternating turns increase. Together with the sharp turn (O-bend) followed b shallower turns, this behavior should create a spiral-like search for the light area.

Note: this specialized circuitry in the hindbrain suggests that random search is a primitive behavior. Although the essay put the Levy walk logic in the midbrain, it belongs in the more primitive hindbrain.

Head direction

[Petrucco et al 2023] report that M.ip is highly connected with head direction axons from B.dtg (dorsal tegmental area of Gudden). This head direction does not receive vestibular input, but is likely derived from motor efferent copies. Since both M.ip and B.dtg are r1-derived regions and possibly ante-vestibular, this head-direction and M.ip connection may be ancient.

Speculative M.ip circuit following the fruit fly fan-shaped body. B.dtg dorsal tegmental nucleus of Gudde, B.rs reticulospinal motor command, Hb.m medial habenula, M.ip interpeduncular nucleus.

This organization is strikingly similar to the fruit fly’s ellipsoid body (EB), protocerebral bridge (PB), and fan-shaped body (FB) in the central complex (CX) [Hulse et al 2021]. EB and PB calculate head direction. The fan-shaped body merges head direction with goal direction to produce motor commands. In this diagram, M.ip represented as if it resembles the fan-shaped body.

If the M.ip functionality is similar to the fan-shaped body, it’s highly likely to be convergent evolution, not homology because amphioxus lacks any similar structure.

Dark search

When zebrafish are plunged into darkness, they initiate a search that continues for about five minutes. The darkness behavior increases speed and straight behavior [Horstick et al 2017]. In other words, phototaxis is not just gradient behavior but also has steady-state darkness behavior. Because zebrafish require light to hunt, darkness in itself is is an area to avoid.

The essay is purely gradient based and has no speed changes. Photokinesis is moving faster in darkness and slower in light, which will bias the time spent in the light area.

References

Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D., Takemura, S. Y., Wolff, T., … & Jayaraman, V. (2021). A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection. Elife, 10.

Horstick EJ, Mueller T, Burgess HA. Motivated state control in larval zebrafish: behavioral paradigms and anatomical substrates. J Neurogenet. 2016 Jun;30(2):122-32.

Karpenko S, Wolf S, Lafaye J, Le Goc G, Panier T, Bormuth V, Candelier R, Debrégeas G. From behavior to circuit modeling of light-seeking navigation in zebrafish larvae. Elife. 2020 Jan 2;9:e52882. 

Petrucco L, Lavian H, Wu YK, Svara F, Štih V, Portugues R. Neural dynamics and architecture of the heading direction circuit in zebrafish. Nat Neurosci. 2023 May;26(5):765-773. doi: 10.1038/s41593-023-01308-5. 

Essay 24: Phototaxis – apical locomotion

Although the previous essays have focused on bilateral locomotion in the style of Braitenberg machines, the chimaera brain hypothesis [Tosches and Adrendt 2013] suggests a distinct apical form of locomotion. The chimaera brain hypothesis suggests that bilaterian brains are the merger of an apical nervous system from the ancestral zooplankton larva state and a blastoporal (bilateral) nervous system from paired muscles along the spinal cord. The apical area contains unpaired light and chemical sensors and the blastoporal area contains bilateral, topographic somatic sense like touch. Apical navigation require a temporal gradient, calculated by sequential sampling because the apical senses are non-directional.

Apical unpaired light sensors and bilateral paired touch sensors in the chimaera brain.

The essays’ simulation scenario is a temporal phototaxis based on the real-time place preference (RTPP) experiments of [Chen et al 2014], where a zebrafish stayed inside a virtual light circle, avoiding surrounding dark area. Temporal phototaxis is gradient-based locomotion, heading toward light and away from darkness by comparing light samples at different times.

Chimaera locomotor

The vertebrate paired eye and paired olfaction are late vertebrate developments. The pre-vertebrate animal amphioxus has only a single frontal eye. Since pre-paired sense animals needed to navigate toward opportunities and away from threats, it’s conceivable that apical random-walk navigation developed before visual navigation.

Dual navigation system based on both temporal gradient-based random walks and bilateral spatial gradient navigation.

Apical gradient

The apical area contains undirected light and chemical sensors. The apical area is based on the zooplankton larval state as shown below, while the bilateral area is based on bilateral worm-like adults structured like the spinal cord of paired muscles and neurons.

Apical zooplankton with cilia navigation.
Apical zooplankton larva. Note the single sensor on top.

Apical navigation requires following a temporal gradient, calculated by sequential sampling. While bilateral areas can compare left and right senses to calculate a spatial gradient, the single apical sense is restricted to a temporal gradient.

Bacteria tumble and run

Even simple bacteria can follow gradients using a directed random walk strategy called tumble and run [Segall et al 1986]. The bacteria’s flagella have two modes: tumble, turning without moving, and run, moving forward without turning. By alternating tumble with run, the bacteria can search with a random walk. By extending the run phase when the gradient improves, the bacteria can move toward the target.

Importantly, a temporal gradient calculation needs some sort of memory, accumulator or integrator to compare the current value to recent values. In bacteria, tis accumulator is an internal chemical quantity.

Different turning behavior depending on the gradient. Sharp turns moving into darkness and straight movement into light.

Apical and bilateral sensors

Amphioxus is a pre-vertebrate chordate that’s studied to understand vertebrate evolution. Amphioxus does not have a paired eye, instead it has a single frontal eye that amphioxus uses to orient vertically, and also a pineal-like photoreceptor [Lacalli 2020].

Chimera sense. Paired bilateral touch and unpaired apical photosensors.

The pineal region is near the vertebrate habenula. Amphioxus does not have a habenula, but it does have a nearby motor control neuron, LPN3, with similar genetic markers [Bozzo et al 2023]. Modern vertebrate medial habenula receives undirected light input from the retina, but it seems plausible that an early habenula used the pineal photosensor because both are part of the same epithalamus complex, and only later connected to the newly-paired retina when it developed.

Multiple apical regions

Before diving into the vertebrate areas for apical locomotion, I need to explain why widespread areas can all be apical, including midbrain and hindbrain areas. Vertebrates had two rounds of whole genome duplication [Dehal and Moore 2005], which gives an easy evolutionary opportunity for four apical areas from the genome duplication, in addition to other possible duplications. The xenobot experiments [Blackiston et al 2023] shows that biology can mix multiple copies like the split apical area into a coherent animal: development can be flexible.

Functional vertebrate brain model showing apical areas as marked by fgf8 development transcription factor.

The diagram above is a functional representation of the vertebrate brain with possible apical areas highlighted in blue. Fgf8 is a development growth factor associated with the apical area [Marlow et al 2014]. The four (or five) possible apical area are as follows:

  • Prefrontal cortex and olfactory bulb.
  • The caudal isthmus area (r1) at the midbrain-hindbrain boundary, including cerebellum (CB), interpeduncular nucleus (M.ip), midbrain locomotor (MLR, M.ppt, M.ldt), head direction (B.dtg), parabrachial (B.pb), and part of the substantia nigra (Snr).
  • Habenula (Hb) and pre-thalamic eminence area (P.em) near ZLI. Also, between the septum-diagonal band (P.msdb) and preoptic area (Poa) near the optic (retina) region (R).
  • The mammilary and supramammilary area of the hypothalamus (H.mb and H.sum).

I’ve listed four regions instead of the five blue areas because the Hb-P.em-P.msdb area are physical closer than the diagram suggests, are split more by the alar/basal division than distance, and is complicated by distortions from the paired optic region.

This essay uses functions from the r1 isthmus area (M.ip and MLR.α / M.ldt), and from the habenula / retinal area (Hb.m, P.em, pineal, and retina). The logic behind their connectivity is a function split-and-pull like taffy or continental drift from a single pre-duplication area, for example, the isthmus apical area duplicating from an original pre-hypothalamus / retinal apical area.

As a note, the supramammilary area (H.sum) is highly connected with the area in this essay, but I’m postponing exploring its functionality for now.

Vertebrate apical and bilateral locomotor

Previously the essays used the bilateral locomotor path, going through the Vta (posterior tuberculum), tectum (OT), and midbrain locomotive region (MLR). The apical path runs through the medial habenula (Hb.m) and the interpeduncular nucleus (M.ip) before reaching the motor neurons.

Bilateral and apical locomotive paths. B.ll lateral line, B.rs reticulospinal motor neurons, B.ss somatosensory, Hb.m medial habenula, M.ip interpeduncular nucleus, MLR midbrain locomotive region, OT optic tectum, V.mr median raphe, 5HT serotonin.

The lamprey’s Hb.m supports locomotion for light, odor, and the lateral line [Stephenson-Jones et al 2012]. The lateral line is an aquatic sense for water flow, which allows fish to sense nearby objects. Although the exact functional division of phototaxis isn’t known, Hb.m, M.ip and the serotonin raphe nuclei (V.mr – 5HT) are all required [Cheng et al 2016].

For the essay’s simulation, I’m asking the integration and running average to the V.mr and 5HT, but this is something of a guess, because phototaxis integration hasn’t been measured. In the essay’s model, M.ip translates the light data and 5HT average into a gradient and into action.

Phototaxis actions

When zebrafish enter darkness from light, they immediately produce a large turn (O-bend) and start an area restricted search (ARS) [Fernandes et al 2012]. Later turns are smaller [Chen and Engert 2014].

For the essay, phototaxis gradient modifies the standard random walk. When entering darkness, M.ip increases the turn angle. When entering light, M.ip increases forward movement, extending the run.

Essay simulation showing the animal returning to light from darkness. The graph shows the gradient change when crossing the darkness boundary.

The above screenshot shows the animal crossing into darkness and returning to light. In the graph, “light” is the current photosensor value, “avg” is the running average measured by serotonin neurons, and “grad” is the different between the two. A gradient drop triggers high angle turns. A gradient rise triggers straight movement.

As the heat map in the right shows, this simple system produces real-time place avoidance (RTPA) of darkness. Since the system has no learning, there’s no conditioned place aversion (CPA).

Prethalamic eminence

The full phototaxis circuit in vertebrates is a bit more complicated because light input does through an intermediate area called the pre-thalamic eminence (P.em), which is between the habenula, hypothalamus and thalamus, and it one of the apical areas. Although P.em is not cortical, it provides neurons necessary for cortical development (Cajal-Retzius neurons for L1 patterning) [Marin-Padilla 2015] and neurons for habenula input, the habenula-projecting pallidum (P.hb) [Stephenson-Jones 2016].

Apical navigation paths, simplified in lamprey and extended in mammals. E.hc hippocampus, Hb.m medial habenula, M.ip interpeduncular nucleus, MLR midbrain locomotive region, Ob olfactory bulb, P.em pre-thalamic eminence, P.hb habenula projecting pallidum, R.gc retina ganglion cells.

Retina input goes through P.em to Hb.m for phototaxis. Interestingly, the main input for Hb.m in mammals is via cells that migrate from P.em and become the posterior septum (P.ps) [Watanabe et al 2018], which receives almost all of its input from the hippocampus (E.hc). If the hippocampus is an odor-processing system, then the olfactory bulb (Ob) to E.hc to Hb.m path is a chemotaxis path matching the retina’s phototaxis path.

Note that the olfactory placed develops from the lens placed and is differentiated by fgf8 [Bailey et al 2006]. So, it’s pleasing that the similar olfactory and hippocampal paths to Hb.m is a are chemotaxis and phototaxis paths split from a common ancestor.

Speculation

Although the lateral and medial habenula are chemically, connectional, and developmentally distinct, their broad similarity is interesting. If the medial habenula supports direct, concrete sensory navigation by gradient descent, perhaps the medial habenula supports more abstract value-based navigation for more abstract goals.

References

Alonso A, Trujillo CM, Puelles L. Quail-chick grafting experiments corroborate that Tbr1-positive eminential prethalamic neurons migrate along three streams into hypothalamus, subpallium and septocommissural areas. Brain Struct Funct. 2021 Apr;226(3):759-785.

Bailey AP, Bhattacharyya S, Bronner-Fraser M, Streit A. Lens specification is the ground state of all sensory placodes, from which FGF promotes olfactory identity. Dev Cell. 2006 Oct;11(4):505-17. 

Blackiston D, Kriegman S, Bongard J, Levin M. Biological Robots: Perspectives on an Emerging Interdisciplinary Field. Soft Robot. 2023 Aug;10(4):674-686. 

Bozzo M, Bellitto D, Amaroli A, Ferrando S, Schubert M, Candiani S. Retinoic Acid and POU Genes in Developing Amphioxus: A Focus on Neural Development. Cells. 2023 Feb 14;12(4):614.

Chen X, Engert F. Navigational strategies underlying phototaxis in larval zebrafish. Front Syst Neurosci. 2014 Mar 25;8:39.

Cheng RK, Krishnan S, Jesuthasan S. Activation and inhibition of tph2 serotonergic neurons operate in tandem to influence larval zebrafish preference for light over darkness. Sci Rep. 2016 Feb 12;6:20788. 

Dehal P, Boore JL. Two rounds of whole genome duplication in the ancestral vertebrate. PLoS Biol. 2005 Oct;3(10):e314. 

Fernandes A. M., Fero K., Arrenberg A. B., Bergeron S. A., Driever W., Burgess H. A. (2012). Deep brain photoreceptors control light-seeking behavior in zebrafish larvae. Curr. Biol. 22, 2042–2047

Lacalli Thurston 2022 An evolutionary perspective on chordate brain organization and function: insights from amphioxus, and the problem of sentience Phil. Trans. R. Soc.

Marín-Padilla M. Human cerebral cortex Cajal-Retzius neuron: development, structure and function. A Golgi study. Front Neuroanat. 2015 Feb 27;9:21.

Marlow, Heather, et al. “Larval body patterning and apical organs are conserved in animal evolution.” BMC biology 12.1 (2014): 1-17.

Segall J. E., Block S. M., Berg H. C. (1986). Temporal comparisons in bacterial chemotaxis. Proc. Natl. Acad. Sci. U.S.A. 83, 8987–8991

Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A. 2012 Jan 17;109(3):E164-73.

Stephenson-Jones M, Yu K, Ahrens S, Tucciarone JM, van Huijstee AN, Mejia LA, Penzo MA, Tai LH, Wilbrecht L, Li B. A basal ganglia circuit for evaluating action outcomes. Nature. 2016 Nov 10;539(7628):289-293. 

Tosches, Maria Antonietta, and Detlev Arendt. “The bilaterian forebrain: an evolutionary chimaera.” Current opinion in neurobiology 23.6 (2013): 1080-1089.

Watanabe K, Irie K, Hanashima C, Takebayashi H, Sato N. Diencephalic progenitors contribute to the posterior septum through rostral migration along the hippocampal axonal pathway. Sci Rep. 2018 Aug 6;8(1):11728. 

Wolf S, Dubreuil AM, Bertoni T, Böhm UL, Bormuth V, Candelier R, Karpenko S, Hildebrand DGC, Bianco IH, Monasson R, Debrégeas G. Sensorimotor computation underlying phototaxis in zebrafish. Nat Commun. 2017 Sep 21;8(1):651. 

Zhang BB, Yao YY, Zhang HF, Kawakami K, Du JL. Left Habenula mediates light-preference behavior in Zebrafish via an asymmetrical visual pathway. Neuron. 2017;93:914–28.

Essay 20: Olfactory avoidance

Although the essays have implemented obstacle avoidance, they haven’t yet explored olfactory avoidance. Olfactory avoidance is distinct from obstacles, not just because obstacles have higher priority, but because the olfactory system is from an entirely different nervous system than the sensorimotor system. In the chimaeral brain theory [Tosches and Arendt 2013], bilaterian brains are composed of an apical nervous system (ANS) focused on chemo senses (olfactory external and hypothalamic internal), and a blastoporal nervous system (BNS) focused on sensorimotor control like obstacle avoidance.

Olfactory path

The paths for olfactory motion compared with obstacle motion shows the value of the chimaeral theory in making sense of the brain. Working backward from the midbrain locomotive region (MLR), the acetylcholine (ACh) MLR nuclei specialize: the pedunculopontine nucleus (M.ppt) supports the sensorimotor BNS, and the laterodorsal tegmental nucleus (M.ldt) supports the chemosensory ANS.

Sensor-locomotion paths: olfactory on top and somatosensory on bottom. B.ll lateral line, B.rs reticulospinal motor command, B.ss somatosensory, Hb.m medial habenula, M.ldt laterodorsal tegmental nucleus, M.ppt pedunculopontine nucleus, Ob.m medial olfactory bulb, OT tectum, R.vis visual input, ,Vta ventral tegmental area.

In the above diagram, food odors and warning odors use distinct paths to the MLR. Food odors from the olfactory bulb (Ob) pass through the ventral tegmental area (Vta – posterior tuberculum in zebrafish) to the MLR [Derjean et al. 2010]. Aversive odors like cadaverine pass through the medial habenula (Hb.m) to the M.ldt portion of the MLR [Stephenson-Jones et al. 2012]. The food and avoidance paths are distinct because hunger and satiety from the hypothalamus modulate the food path, while the avoidance path can pass through unmodulated. These olfactory locomotion paths correspond to the ANS.

Lamprey medial habenula path

All vertebrates share this basic architecture, including the lamprey, one of the most evolutionary-distant vertebrates. [Stephenson-Jones et al. 2012] traced the Hb.m circuit, showing that Hb.m inputs are from the olfactory path, the parapineal (light attraction), and an electron-sensory alarm to the interpeduncular nucleus (M.ip).

Lamprey olfactory warning path through the habenula to the MLR. M.ip interpeduncular nucleus.

The above diagram fills out the olfactory warning path. The interpeduncular nucleus is a key node in the avoidance circuit, and also key to locomotor-induced theta, and one of the two serotonin nodes. Mip has a major output to the serotonin areas: dorsal raphe (V.dr) and medial raphe (V.mr) and to the central grey (M.pag) [Quina et al. 2017] and M.ldt as well as structures associated with hippocampal (E.hc) theta [Lima et al. 2017].

Medial habenula behavior

In larval zebrafish, Hb.m supports olfactory avoidance [Choi et al. 2017], [Jeong et al. 2021], and light seeking [Zhang et al. 2017]. At least one study indicates that it may also affect food seeking [Chen et al. 2019]. The non-Ob input to Hb.m — the posterior septum (P.ps) — produce locomotion when stimulated [Ostu et al. 2018], suggesting that later evolved functionality maintains the original basal function.

In zebrafish, M.ip only projects to serotonin areas (V.dr and V.mr), not to dopamine or MLR areas. The lamprey connectivity suggests that the M.ip to M.ldt connection was lost in fish.

The Hb.m to M.ip connection is affected by nicotine. An interesting property is that low stimulation and high stimulation have opposite effects. Low stimulation uses glutamate connections and is attractive while high stimulation adds ACh and is aversive [Krishnan et al. 2014].

Developmental genetic notes

As an interesting aside, both Hb.m and avoidant layers of OT shared a genetic marker Brn3a (aka pou4f1) [Quina et al. 2009], [Fedtsova et al. 2008]. That marker also appears in the cerebellum’s inferior olive, trigeminal sensory areas, and the amphioxus motor LPN3 neuron [Bozzo et al. 2023].

M.ldt and M.ppt are sibling areas, deriving from the r1 rhombic lip [Machold et al. 2011].

Glutamate and GABA neurons in M.ip, Vta, and M.ldt all derive from r1 basal neurons [Lahti et al. 2016].

Locomotion switchboard

The addition of olfactory avoidance further complicates the switchboard combining the various locomotor streams, especially if the olfactory path uses serotonin as a modulator as opposed to a straight glutamate connection. Although I’ll probably use a fixed priority for essay 20, and as [Cisek 2022] notes, avoidance can be combined additively, at some point the switchboard will need more control, especially when essays add vision and consummatory actions.

References

Bozzo M, Bellitto D, Amaroli A, Ferrando S, Schubert M, Candiani S. Retinoic Acid and POU Genes in Developing Amphioxus: A Focus on Neural Development. Cells. 2023 Feb 14

Chen W-Y, Peng X-L, Deng Q-S, Chen M-J, Du J-L, Zhang B-B. Role of Olfactorily Responsive Neurons in the Right Dorsal Habenula-Ventral Interpeduncular Nucleus Pathway in Food-Seeking Behaviors of Larval Zebrafish. Neuroscience. 2019

Choi JH, Duboue ER, Macurak M, Chanchu JM, Halpern ME. Specialized neurons in the right habenula mediate response to aversive olfactory cues. Elife. 2021 Dec 8

Cisek P. Evolution of behavioural control from chordates to primates. Philos Trans R Soc Lond B Biol Sci. 2022 Feb 14

Derjean D, Moussaddy A, Atallah E, St-Pierre M, Auclair F, Chang S, Ren X, Zielinski B, Dubuc R. A novel neural substrate for the transformation of olfactory inputs into motor output. PLoS Biol. 2010 Dec 21

Fedtsova N, Quina LA, Wang S, Turner EE. Regulation of the development of tectal neurons and their projections by transcription factors Brn3a and Pax7. Dev Biol. 2008 Apr 1

Jeong YM, Choi TI, Hwang KS, Lee JS, Gerlai R, Kim CH. Optogenetic Manipulation of Olfactory Responses in Transgenic Zebrafish: A Neurobiological and Behavioral Study. Int J Mol Sci. 2021 Jul 3

Krishnan S, Mathuru AS, Kibat C, Rahman M, Lupton CE, Stewart J, Claridge-Chang A, Yen SC, Jesuthasan S. The right dorsal habenula limits attraction to an odor in zebrafish. Current Biology. 2014

Lahti L, Haugas M, Tikker L, Airavaara M, Voutilainen MH, Anttila J, Kumar S, Inkinen C, Salminen M, Partanen J. Differentiation and molecular heterogeneity of inhibitory and excitatory neurons associated with midbrain dopaminergic nuclei. Development. 2016 Feb 1

Lima LB, Bueno D, Leite F, Souza S, Gonçalves L, Furigo IC, Donato J Jr, Metzger M. Afferent and efferent connections of the interpeduncular nucleus with special reference to circuits involving the habenula and raphe nuclei. J Comp Neurol. 2017 Jul 1

Machold R, Klein C, Fishell G. Genes expressed in Atoh1 neuronal lineages arising from the r1/isthmus rhombic lip. Gene Expr Patterns. 2011 Jun-Jul

Otsu Y, Lecca S, Pietrajtis K, Rousseau CV, Marcaggi P, Dugué GP, Mailhes-Hamon C, Mameli M, Diana MA. Functional Principles of Posterior Septal Inputs to the Medial Habenula. Cell Rep. 2018 Jan 16

Quina LA, Wang S, Ng L, Turner EE. Brn3a and Nurr1 mediate a gene regulatory pathway for habenula development. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience. 2009

Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A. 2012 Jan 17

Tosches, Maria Antonietta, and Detlev Arendt. “The bilaterian forebrain: an evolutionary chimaera.” Current opinion in neurobiology 23.6 (2013): 1080-1089.

Zhang BB, Yao YY, Zhang HF, Kawakami K, Du JL. Left Habenula Mediates Light-Preference Behavior in Zebrafish via an Asymmetrical Visual Pathway. Neuron. 2017 Feb 22

17: Issues on vertebrate seek

While implementing the basic model, some issues came up, including issues already solved in earlier essays.

What controls “give-up”?

The foraging task needs to give-up on a non-promising odor, ignore it, leave from the current place, and explore for a new odor. In an earlier essay, odor habituation implemented give-up. If the seek didn’t find the food within the habituation time, the sense would disappear, disabling the seek action.

Animal circling food with no ability to break free.

The perseveration problem can be solved in many ways, including the goal give-up circuit in essay 17 and the odor habituation in an earlier essay. One approach cuts the sensor; the other disables the action. But two solutions raises the question of more possible solutions, any or all of which might affect the animal.

  • Sense habituation (cutting sensor)
  • Habenula give-up (inhibit action)
  • Motivational state – hypothalamus hunger/satiety
  • Circadian rhythm – foraging at twilight
  • Global periodic reset – rest / sleep

Give-up or leave?

The distinction between giving-up and leaving is between abandoning the current action and switching to a new, overriding action. Although the effect is similar, the implementing circuit differs. In a leave circuit, after the give-up time, the animal would actively leave the current area (place avoidance). Assuming the leave action has a higher priority than seeking, then lateral inhibition would disable the seek action. In foraging vocabulary, does failure inhibit exploitation or does it encourage exploration?

Distinct circuits for give-up and leave to curtail a failed odor approach.

As the diagram above shows, this distinction isn’t a semantic quibble, but represents different circuits. In the give-up circuit, the quit decision either inhibits the olfactory seek input and/or inhibits the seek action. With seek disable, the default action moves the animal away from the failed odor. In the leave circuit, the quit decision activates a leave action, which moves the animal away from the failed place, inhibiting the seek action laterally.

Leave or avoid?

Leaving an area is a primitive action and is a requirement for foraging. However, neuroscience papers don’t generally study foraging, they study place avoidance from aversive stimuli, which raises a question. Since the physical action of leaving and aversive place avoidance is identical, do the two actions share circuits or are they distinct?

Distinct leave and avoid actions compared to shared locomotion.

In the avoid circuit, danger avoidance is distinct from food-seeking, only sharing at the lowest motor layers. In the leave circuit, exploration leaving and place avoidance share the same mid-locomotor action.

Slow and fast twitch swimming

[Lacalli 2012] explores the evolution of chordate swimming, inspired by a discovery of mid-Cambrian fossils, which suggest that fast-twitch muscles are a later addition to a more basal chordate swimming, possibly to escape from new Cambrian predators. The paper explores the non-vertebrate Amphioxus motor circuitry in like of the fossil, suggesting two distinct motor circuits: normal swimming and escape.

Slow and fast paths for normal swimming and fast predator escape.

In this model, higher layers are independent paths that only resolve at the lowest motor command neuron level (such as B.rs). For the foraging tasks, this model that leaving an explored area would use a different system from leaving a noxious area (place aversion), despite being the same underlying motion.

Serotonin as muscle gain-control

In the zebrafish, [Wei et al. 2014] studied serotonin in V.dr (dorsal raphe) as gain-control for muscle output, amplifying the effect of glutamate signals. When they inhibited 5HT (serotonin), the muscle only produced 40% of its maximal strength. Serotonin acted as a gain-control, a multiplicative signal that amplified glutamate signals, allowing for a broader dynamic range.

[Kawashima et al. 2016] investigated 5HT in the context of task-learning for muscle effort, where 5HT caches the real-time adjustment by the cerebellum and pretectal areas. When 5HT is disabled, the real-time system still adjusts the muscle effort, but it doesn’t remember the adjustment for future bouts. That study considers the 5HT neurons as leaky integrators of motor-gated visual feedback, where zebrafish gauge the success of swimming effort by visual motion. Notably, the neurons only store visual information when the fish is actively swimming, as an action-outcome integrator.

The two studies focused on opposite muscle effects, both increasing effort and decreasing effort. 5HT can either inhibit or excite depending on the receptor type, suggesting that 5HT shouldn’t be interpreted as representing a specific value, either positive or negative, but instead possibly carrying either value.

Taking these studies as analogies, it seem reasonable to consider V.dr as an action-outcome accumulator for future effort in the 10-30 seconds range, not specific to either positive or negative amplification. Of course, because serotonin has diverse effects in multiple circuits, reality is likely more complicated.

Serotonin zooplankton dispersal and learning

Many aquatic animals have a larval zooplankton stage, where the larva disperses from its spawn point for several days or weeks, then descends to the sea floor for its adult life. A small number of serotonin neurons signal the switch to descend. Essentially, this is a single explore/exploit pair.

Larva exploring in a dispersal stage, switching to descend to the sea floor for adult life.

Habenula function circuit

Essay 17 is running with the model of the habenula as central to the give-up/move-on circuit. The following is a straw man model of the habenula based on the above discussion of quitting, leaving and avoiding circuits. Because essay 17 has no learning or higher areas like the striatum, the diagram ignores any learning functionality. This diagram is for a hypothetical pre-stratal habenular function.

Odor-based locomotion using the habenula.

Note, this locomotion only includes odor-based navigation. The audio-visual-touch locomotion uses a different system based on the optic tectum. This dual-locomotive system may be the result of a bilaterian chimaera brain [Tosches and Arendt 2013].

The habenula connectivity and avoidance path is loosely based on [Stephenson-Jones et al. 2012] on the lamprey habenula connectivity. The seek path is loosely based on [Derjean et al. 2010] for the zebrafish.

In this model, Hb.m (medial habenula) is primarily a danger-avoidance circuit, and M.ipn (interpeduncular nucleus) is a place avoidance locomotive region. Hb.l (lateral habenula) is a give-up circuit that both inhibits the seek function (giving up) and excites the shared leave locomotor region, implementing the foraging exploit to explore decision. Here, place avoidance and exploratory leaving are treated as equivalent. As mentioned above, this diagram is mean to be a straw man or a thought experiment, because it’s easier to work with a concrete model.

References

Derjean D, Moussaddy A, Atallah E, St-Pierre M, Auclair F, Chang S, Ren X, Zielinski B, Dubuc R. A novel neural substrate for the transformation of olfactory inputs into motor output. PLoS Biol. 2010 Dec 21

Kawashima T, Zwart MF, Yang CT, Mensh BD, Ahrens MB. The Serotonergic System Tracks the Outcomes of Actions to Mediate Short-Term Motor Learning. Cell. 2016 Nov 3

Lacalli, T. (2012). The Middle Cambrian fossil Pikaia and the evolution of chordate swimming. EvoDevo, 3(1), 1-6.

Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A. 2012 Jan 17

Tosches, Maria Antonietta, and Detlev Arendt. The bilaterian forebrain: an evolutionary chimaera. Current opinion in neurobiology 23.6 (2013): 1080-1089.

Wei, K., Glaser, J.I., Deng, L., Thompson, C.K., Stevenson, I.H., Wang, Q., Hornby, T.G., Heckman, C.J., and Kording, K.P. (2014). Serotonin affects movement gain control in the spinal cord. J. Neurosci. 34

Essay 17: Proto-Vertebrate Locomotion

The locomotive model in essays 14 to 16 were non-vertebrate. Essay 17 takes the same problems, avoiding obstacles and seeking food, and with a model based on the vertebrate brain. Since these models are still Precambrian or early Cambrian, they don’t include the full vertebrate architecture, but try to find core components that might have been a basis for later vertebrate developments.

The animal is a slug-like creature with mucociliary forward movement, where propulsion is cilia or cilia-like and steering is muscular. This combination of slug-like motion and vertebrate brain is probably not evolutionary accurate, but it allows touch-based obstacle avoidance without the complications of vision of lateral-line senses.

The animal seeks food by following odor plumes, and avoids obstacles by turning away when touching them. The locomotion model includes the following components:

  • [Braitenberg 1984] navigation (simple crossed vs uncrossed signals for approach and avoid).
  • Obstacle avoidance with a direct touch-to-muscle circuit.
  • Odor-seeking with distinct “what” and “where” paths.
  • Perseveration fix with an explicit give-up circuit.
  • Motivation-state (satiety) control of odor-seeking (“why” path [Verschure et al. 2014])

Proto-vertebrate model

A diagram of the proto-vertebrate model, including analogous brain regions follows:

Proto-vertebrate locomotive model. Key: B.sp spinal motor, B.rs reticulospinal motor command (medial and lateral), B.ss spinal somatosensory, H.l lateral hypothalamus, Hb.l lateral habenula, M.lr midbrain locomotive region (M.ppt), Ob olfactory bulb, Snc substantia nigra pars compacta. DA dopamine, ACh acetylcholine.

For the sake of readability, the model simplifies the actual vertebrate midline crossing patterns, leaving only a single cross between B.rs (reticulospinal) and B.sp (spinal), which represents Braitenberg navigation.

In this model, obstacle avoidance is reflexive between B.ss (somatosensory touch) and B.rs. Odor navigation (“where”) flows through Snc (substantia nigra pars compacta) to M.lr (midbrain locomotive region). In the zebrafish, the Snc area is the posterior tuberculum, and the M.lr like represents M.ppn (pedunculopontine tegmental nucleus). The motivation-state (hunger or satiety) and “what” (food odor vs non-food) flow through H.l (lateral hypothalamus). The give-up circuit flows through Hb.l (lateral habenula).

Olfactory navigation path

[Derjean et al. 2010] traced a path in zebrafish from Ob (olfactory bulb) to the posterior tuberculum (mammal Snc) to the midbrain locomotive region (likely M.ppn), to the reticulospinal motor command neurons.

Zebrafish olfactory to motor path in [Derjean 2010].

A similar olfactory to motor path has been traced in lamprey by [Suryanarayana et al. 2021] and [Beausejour et al. 2021].

I’ve labeled this path as a “where” path, based on simulation requirements, but as far as I know, that label has no scientific basis.

The Snc / posterior tubuculum area includes descending glutamate and dopamine (DA) neurons, although the Snc is better known for its ascending dopamine path. Since [Ryczko et al. 2016] reports a mammalian descending glutamate and DA path from Snc to M.ppn, portions of this descending path appears to be evolutionarily conserved. The DA appears to be an effort boost, increasing downstream activity, but most of the activity is glutamate.

Braitenberg navigation

[Braitenberg 1986] vehicles are a thought experiment for simple circuits to implement approach and avoid navigation. In the original, the vehicles have two light-detection sensors connected to drive wheels. Depending on the connection topology, sign and thresholds, the simple circuits can implement multiple behaviors.

Braitenberg vehicles for approach and escape
Braitenberg circuits for approach and escape.

A circuit that combines the output of approach and avoid circuits with some lateral inhibition can implement both approach and avoidance with avoidance taking priority. In the essay simulation, if the animal touches a wall, it will turn away from the obstacle, temporarily ignoring any odor it might be following.

Circuit for obstacle avoidance and food approach for simulated slug.
Circuit for combined odor approach and touch obstacle avoidance.

Mammalian locomotion appears to use a similar circuit between the superior colliculus (OT – optic tectum) and the motor driving B.rs neurons [Isa et al. 2021]. This circuit pattern implies that approach and avoidance are separate behaviors, only reconciled at the end. For example, a punishing reinforces that increases avoidance is not simply the mirror image of a non-reward that decreases approach. The two reinforcers modify different circuits.

“What” path vs “where” path

The mammalian visual system has separate “what” and “where” paths. One path detects what object is in focus, and one path keeps track of where the object location is. This division between object decision and navigation has been useful in the simulation, because navigation details are quickly lost in the circuit when deciding what to do with an odor.

“What” and “where” paths as configuring a switchboard.

When an animal senses an odor, say a food odor, the animal needs to identify it as a food odor, decide if the animal is hungry or sated, and decide if there’s a higher-priority task. All that processing and decision can lost the fine timing phase and amplitude details needed for precise navigation. Gradient following, for example, needs fine differences in timing or amplitude to decide whether to turn left or right. By splitting the long, complicated “what” decision from the short, simple “where” location, the circuit can benefit from both.

[Cohn 2015] describes the fruit fly mushroom body as a switchboard, where dopamine neurons configure the path for olfactory senses to travel. In the context of “what” and “where”, the “what” path configures the switchboard and the “where” path follows the connected circuit.

Some odor-based navigation has a more extreme division between “what” and “where.” Following odor in water isn’t always gradient-based navigation, because odors form clumps instead of gradient plumes. Instead of following a gradient, the animal moves against the current toward the odor source. In that latter situation, the “where” path uses entirely different senses for navigation, using water flow mechanosensors, not olfactory sensors [Steele et al. 2023].

Navigation against current toward an odor plume.

The diagram above illustrates a food-searching strategy for some animals in a current, both water and air. In water, the current is more reliable for navigation than an odor gradient. When there’s no scent, the animal swims back and forth across the current. When it detects a food odor, it swims against the current. If it loses the odor, it will return to back and forth swimming. In this navigation type, entirely different senses drive the “what” and “where” paths.

Foraging and give-up time

Giving up is an essential part of goal-directed behavior. If an animal cannot ever give up, it will be stuck on the goal without escaping. In the context of foraging, the give-up time is optimized with the marginal value theorem [Charnov 1976], suggesting that an animal should move to another patch when its current reward-gaining rate drops below the average rate for the environment. Animal behavior researchers like [Kacelnik and Brunner 2002] have observed animals roughly following this theorem, although using simpler heuristics.

In more complex animals, the failure to give up can be pathological, such as psychological perseveration.

Odor-following state diagram including give-up timer.
Foraging state diagram illustrating the give-up timer

The give-up circuit needs some kind of internal timer or cost integrator, and a way to cancel the task. In this essay’s model, the lateral habenula (Hb.l) computes the give-up time or integrates the cost, and it cancels the task by suppressing the locomotive signal through Snc.

Habenula as a give-up circuit

Hb.l is positioned to act as a give-up circuit. It receives cost signals as non-rewarded bouts or as aversive events. [Stephenson-Jones et al. 2016] interprets the Hb.l input, P.hb (habenular-projecting pallidum), as evaluating action outcome. Hb.l can suppress both the midbrain dopamine and midbrain serotonin areas. In learned helplessness situations or depression, Hb.l is hyperactive [Webster et al. 2020], causing reduced activity.

Habenula circuit as a give-up mode in a locomotive circuit.

[Hikosaka 2012] suggests the habenula’s role as suppressing motor activity under aversive conditions, a role evolved from its close relationship to the pineal gland’s circadian scheduling.

In a review article, [Hu 2020] discusses the suppressive effects of the habenula, also remarking on its role as a reward-prediction error. In particular, noting that H.l (lateral hypothalamus) to Hb.l is aversive. The Hu article also notes that Hb.l knock-out abolishes the error signal from reward omission, not an error signal from aversive (shock or obstacles).

Once the threshold is crossed, the Hb.l to Snc signal produces behavioral avoidance, reduced effort and depressive-like behavior from learned helplessness. The Hb.l is the only brain area consistently hyperactive in animal models of depression.

Note, since this essay’s simulation is a non-learning behavioral model, the only “prediction” possible is an evolutionary intrinsically-attractive odor, and the only role for an error is giving up the current behavior. Here, I’m interpreting the H.l to Hb.l signal as a cost signal, integrated by Hb.l, that gives up when it crosses a threshold.

Vertebrate reference

For reference, here’s a functional model of the vertebrate brain.

Functional model of vertebrate brain.

The areas in this model cluster around the hindbrain isthmus divider. B.rs are hindbrain neurons near the isthmus. M.lr (M.ppn) are midbrain neurons that migrate from the hindbrain (r1) to the midbrain. Snc is the midbrain tegmental area (the V – value area), near the isthmus, and contiguous with M.ppn. Similarly the H.l area that projects to Snc is contiguous with it. The habenula is the most distant area, located above the thalamus near the pineal gland (not in the diagram as a simplification, but associated with the pallidum areas.) So, the areas discussed here are a small part of the entire brain, but interestingly clustered around the isthmus divider near the cerebellum.

Minimal viable straw man

I think it’s important to remember that the essay simulations are an engineering project not a scientific one. One difference is that the simulations necessary require decisions beyond science. Another difference is that the project needs a simple core that may not correspond to any evolutionary animal. For example, even simple animals have some rudimentary vision, if only two or three pigment spots. For another, learning centers like the mushroom body. And dealing with internal biological issues like breathing and blood pressure with motion.

This model in particular is more of a straw man or minimal viable product than an actual proposal for an ancestral proto-vertebrate mind. The model is intended to be a straw man, a target that might give a base framework to criticize or build on.

Alternative olfactory paths

Another potential “what” path for innate behavior goes through the medial habenula, which is responsive to odors and produces place avoidance [Amo et al. 2014], but [Chen et al. 2019] suggests it also supports attraction for food odors.

Olfactory innate path through habenula. Key: A.co cortical amygdala, H.l lateral hypothalamus, Hb habenula (medial and lateral), IPN interpeduncular nucleus, M.pag periaqueductal gray, Ob olfactory bulb.

In mammals, the olfactory path to H.l goes through the cortical amygdala (A.co) [Cádiz-Moretti et al. 2017]. While this essay is deliberately omitting the cortex, in the lamprey the olfactory path goes through the lateral pallium (LPa, corresponding to mammalian O.pir piriform cortex) to the posterior tubercular (Snc in mammals.)

For this essay, I’ve picked the Ob to Snc path instead of the alternatives for simplicity. The habenula path is very tempting, but would require exploring the IPN and serotonin (5HT) paths to the MLR, which is more complicated than a “what” path through H.l

Subthalamic nucleus as give-up circuit

The sub thalamic nucleus (H.stn) is associated with a “stop” action, stopping downstream motor actions, either because of a new, surprising stimulus, or from higher-level commands. Since a give-up signal stops the seek goal, the stop action from H.stn might play a part in the control

H.stn stop is in parallel to habenular give-up. Key: H.l lateral hypothalamus, H.stn subthalamic nucleus, Hb.l lateral habenula, M.lr midbrain locomotor region, Snc substantia nigra pars compacta, Snr substantia nigra part reticulata.

H.stn is believed to have a role in patience in decision making [Frank 2006] and in encoding reward and cost [Zénon et al. 2016], which is very similar to the role of the habenula, and H.stn projects to Hb.l via P.hb habenula-projecting pallidum.

However, the H.stn’s patience is more related to holding off (stopping) action before making a decision, related to impulsiveness, while the give-up circuit is more related to persistence, continuing an action. So, while the two capabilities are related, they’re different functions. Since current essay simulation does not have patience-related behavior arrest but does need a give-up time, the habenula seems a better fit.

Serotonin inhibition path

In zebrafish, the habenula inhibits the dorsal raphe (V.dr, serotonin neurons) but not Snc or dopamine [Okamoto et al. 2021]. The inhibition works through V.dr to the Snc/posterior tubuculum to the locomotive regions.

As with the alternative olfactory paths, this serotonin inhibition path may be more evolutionary primitive, but would add complexity to the essay’s model, so will be held off for later exploration.

Conclusions

As mentioned above, the purpose of this model is a basis for the current essay’s simulation, and as a straw man to focus alternatives to see if there might be a better minimal model.

References

Amo, Ryunosuke, et al. “The habenulo-raphe serotonergic circuit encodes an aversive expectation value essential for adaptive active avoidance of danger.” Neuron 84.5 (2014): 1034-1048.

Beauséjour PA, Zielinski B, Dubuc R. Olfactory-induced locomotion in lampreys. Cell Tissue Res. 2022 Jan

Braitenberg, V. (1984). Vehicles: Experiments in synthetic psychology. Cambridge, MA: MIT Press. “Vehicles – the MIT Press”

Cádiz-Moretti B, Abellán-Álvaro M, Pardo-Bellver C, Martínez-García F, Lanuza E. Afferent and efferent projections of the anterior cortical amygdaloid nucleus in the mouse. J Comp Neurol. 2017 

Charnov, Eric L. “Optimal foraging, the marginal value theorem.” Theoretical population biology 9.2 (1976): 129-136.

Chen, Wei-yu, et al. “Role of olfactorily responsive neurons in the right dorsal habenula–ventral interpeduncular nucleus pathway in food-seeking behaviors of larval zebrafish.” Neuroscience 404 (2019): 259-267.

Cohn R, Morantte I, Ruta V. Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila. Cell. 2015 Dec 17

Derjean D, Moussaddy A, Atallah E, St-Pierre M, Auclair F, Chang S, Ren X, Zielinski B, Dubuc R. A novel neural substrate for the transformation of olfactory inputs into motor output. PLoS Biol. 2010 Dec 21

Frank, Michael J. “Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making.” Neural networks 19.8 (2006): 1120-1136.

Hikosaka, Okihide. The habenula: from stress evasion to value-based decision-making. Nature reviews neuroscience 11.7 (2010): 503-513.

Hu, Hailan, Yihui Cui, and Yan Yang. “Circuits and functions of the lateral habenula in health and in disease.” Nature Reviews Neuroscience 21.5 (2020): 277-295.

Isa, Tadashi, et al. “The tectum/superior colliculus as the vertebrate solution for spatial sensory integration and action.” Current Biology 31.11 (2021)

Kacelnik, Alex, and Dani Brunner. “Timing and foraging: Gibbon’s scalar expectancy theory and optimal patch exploitation.” Learning and Motivation 33.1 (2002): 177-195.

Okamoto H, Cherng BW, Nakajo H, Chou MY, Kinoshita M. Habenula as the experience-dependent controlling switchboard of behavior and attention in social conflict and learning. Curr Opin Neurobiol. 2021 Jun;68:36-43. doi: 10.1016/j.conb.2020.12.005. Epub 2021 Jan 6. PMID: 33421772.

Ryczko D, Cone JJ, Alpert MH, Goetz L, Auclair F, Dubé C, Parent M, Roitman MF, Alford S, Dubuc R. A descending dopamine pathway conserved from basal vertebrates to mammals. Proc Natl Acad Sci U S A. 2016 Apr 26

Steele TJ, Lanz AJ, Nagel KI. Olfactory navigation in arthropods. J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 2023

Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A. 2012 Jan 17;109(3)

Stephenson-Jones M, Yu K, Ahrens S, Tucciarone JM, van Huijstee AN, Mejia LA, Penzo MA, Tai LH, Wilbrecht L, Li B. A basal ganglia circuit for evaluating action outcomes. Nature. 2016 Nov 10

Suryanarayana SM, Pérez-Fernández J, Robertson B, Grillner S. Olfaction in Lamprey Pallium Revisited-Dual Projections of Mitral and Tufted Cells. Cell Rep. 2021 Jan 5

Verschure PF, Pennartz CM, Pezzulo G. The why, what, where, when and how of goal-directed choice: neuronal and computational principles. Philos Trans R Soc Lond B Biol Sci. 2014 Nov 5

Webster JF, Vroman R, Balueva K, Wulff P, Sakata S, Wozny C. Disentangling neuronal inhibition and inhibitory pathways in the lateral habenula. Sci Rep. 2020 May 22

Zénon A, Duclos Y, Carron R, Witjas T, Baunez C, Régis J, Azulay JP, Brown P, Eusebio A. The human subthalamic nucleus encodes the subjective value of reward and the cost of effort during decision-making. Brain. 2016 Jun;139(Pt 6):1830-43.

Braitenberg Slug

I’m considering exploring Braitenberg’s vehicles [Braitenberg 1984] for essay 14 in combination with the ideas from the archaoslug. The vehicles are a simple almost trivial design with surprisingly useful behavior. Each vehicle has a combination of sensor-motor pairs, taking advantage of the physical layout for the motor and sensor behavior.

Here, the sensors detect light and directly drive the motor wheels. Vehicles with crossed signals approach the light, while vehicles with uncrossed signals avoid the light. Braitenberg also explores negative signals where the signals inhibit the motors, and additional signal-motor pairs for different senses. The value of the Braitenberg vehicles is showing how simple control circuits can form the basics of behavior.

Optic tectum as an example

The optic tectum uses this dual-circuit architecture for approach and escape [Isa 2021]. The optic tectum is a midbrain optical and motor area responsible for much of vision in non-mammalian vertebrates and an understudied component of mammalian vision. In the OT, escape signals connect to ipsilateral (same side) motor neurons, and approach signals connect to a different set of motor neurons but crossing sides.

In the diagram, B.rs are reticulospinal motor neurons in the brainstem. OT.d.m is the medial optic tectum in the deep layers, and OT.d.l is the corresponding lateral. The OT shallow layers process optical information, and the deep layers drive motor actions. Stimulating the medial OT makes the animal escape and stimulating the lateral OT encourages approach. As a mnemonic, since approaching needs to aim at the target, its sensors need to be spread out (lateral), but escaping needs less precision and can rely on closer or merged (medial) sensors.

Because the Braitenberg architecture is so simple, I think it’s reasonable to imaging that primitive animals would quickly develop a similar pair of crossed and uncrossed systems as soon as neurons with specific connectivity were available, after the initial broadcast repeater nerved nets like in sea anemones (cnidaria). The dual systems mirrors the dual chemosensory and mechanosensory cell families in the archaoslug, which might have also encouraged split control.

Essay 14 pre-design

As a bilateral enhancement to the amoeboid archaoslug, I’m thinking of trying a ciliomotor slug with primitive obstacle avoidance but without any directed approach. Avoidance is a smaller evolutionary step because it can reuse the mechanosensory and nerve nets of the archaoslug, only adding a single crossed-pair of long-range neurons. After hitting an obstacle, muscle contractions turn the animal away from the obstacle.

The mucociliary sole remains the main locomotion and food detection. The slug still searches for food by grazing randomly on algae or bacterial mats, relying on browning motion to find food. There’s no tracking or approach system.

As mentioned above, the control systems for grazing locomotion and for obstacle avoidance are independent. Cilia locomotion is automatic with no neural control until the slug detects that it’s above food, when it stops. The locomotion direction is semi-random.

If the slug hits a wall, it contracts the side opposite the touch. This circuit is flipped from the Braitenberg vehicle, which has uncrossed signals for avoidance. The touch sensor activates the contralateral nerve net to contract the side muscle, and the slug turns toward the contracted side, away from the obstacle.

On motivation

Even in this trivial example, I think it’s useful to consider motivation in contrast with stimulus/response behavior. Since the basis of the word motivation is “to move,” it’s reasonable to use motivation as meaning moving force. So, motivation is a source of action without needing external stimulus. In the Braitenberg slug, the motivation is in the mucociliary sole itself, because it moves without external stimulus. If so, the motivation isn’t even neural; it’s just started by evolution.

The distinction of motivated vs non-motivated action is important in understanding the system. Knowing the sources of intrinsic motivation allows for tracing action from the source to its final result. As a design principle, adding self-motivation is more stable, because the animal is less likely to get stuck waiting for external stimuli to get started.

References

Braitenberg, V. (1984). Vehicles: Experiments in synthetic psychology. Cambridge, MA: MIT Press. “Vehicles – the MIT Press”

Isa, Tadashi, et al. “The tectum/superior colliculus as the vertebrate solution for spatial sensory integration and action.” Current Biology 31.11 (2021): R741-R762. https://doi.org/10.1016/j.cub.2021.04.001

Archaoslug

[Arendt 2015] examines the fundamental divisions of the nervous system by looking at ancestral cell divisions in some of the earliest animals, specifically a multicellular amoeboid bottom-feeder that glides on a mucus foot like a slug. The archaoslug moves like an amoeba instead of a true slug because it’s body isn’t symmetrical bilateral: there’s no front or side. The Adrent study is interesting for the essays because it fundamentally splits chemosensory control (hypothalamic and olfactory) split from mechanosensory / optosensory sense and muscle brain at the cell type and developmental level.

In this proto-slug, cells have specialized into three major classes:

  • External skin with mechanosensory and optosensory cells
  • Internal digestive gut
  • Mucociliary sole with chemosensory and locomotion cells

The mucociliary sole moves with cilia gliding over mucus. Chemical sensors that detect food choose when to stop. A similar locomotive strategy is described in [Smith 2015] and [Senatore 2017] for the existing algae-grazing, disc-shaped animal Trichoplax, which lacks any nerves at all and only has six cells in total [Smith 2014].

Locomotion and food searching for the archaoslug is simple: stop when the chemosensors detects food (algae), and move in a random brownian direction when no food is available. A simple chemical sensor and a peptide-based broadcast system would suffice, as in Trichoplax. Because the bacterial mats may have dominated the Precambrian environment, the brownian motion pausing for food could work.

The ventral skin specialized into mechanosensory cells, optosensory cells, and contractile cells which developed into the first neurons and muscles. The animal can avoid obstacles and threats using nerve nets that broadcast and repeat signals, like the repeating nerve nets in cnidaria (jellyfish, sea anemone, and corals) [Seipel 2005]. Note, though, the control circuits for between locomotion (mucociliary sole) and muscles (skin/body contractions) are distinct, and don’t even coordinate. A sea anemone or a slug will contract when touched, but the sea anemone has no locomotion and the slug’s contraction isn’t its primary locomotion. Similarly, an archeoslug with primitive muscles might only use the muscles to avoid obstacles, contracting when it runs into something, but its primary motion remains the ciliary, non-muscular sole. Meaning, the locomotive drive (arrest, approach, avoid) is controlled independently from navigation (spatial obstacle avoidance.)

This division into three types influences all later cell development, because the initial decisions shape the later evolved cell types. Genetic signaling to choose between the three might have created a path dependent split between three types.

Discussion

This split between chemosensory sole and mechano- and opto-sensory skin and muscle obviously mirrors the vertebrate split between the limbic system (olfactory and hypothalamic) and optic tectum system, but with a different spin. The limbic system is generally described as a motivational and emotional center. The root word for both motivation and emotion is the Latin movere, to move, which has less baggage than either word. The mucociliary sole area does move and control movement, but it’s hardly an emotional center. But the mucociliary sole area isn’t unique in its control of motion, because the unrelated skin/muscle area controls navigation.

Treating the mind as independent, conflicting centers resembles Dawkins’ descriptions of genes in The Selfish Gene, where each gene works independently and in competition with others, and coordination only occurs for mutual benefit. The general idea of competing mental centers is also in Minsky’s Society of mind, and the idea is older than either. So, the value of the archaeoslug isn’t the general idea of a divided mind, but the specific division that occurred in evolution.

References

Arendt D, Benito-Gutierrez E, Brunet T, Marlow H. Gastric pouches and the mucociliary sole: setting the stage for nervous system evolution. Philos Trans R Soc Lond B Biol Sci. 2015 Dec 19;370(1684):20150286. doi: 10.1098/rstb.2015.0286. PMID: 26554050; PMCID: PMC4650134.

Dawkins, Richard. The Selfish Gene. Oxford University Press, 2006.

Minsky, Marvin. Society of mind. Simon and Schuster, 1988.

Senatore A, Reese TS, Smith CL. Neuropeptidergic integration of behavior in Trichoplax adhaerens, an animal without synapses. J Exp Biol. 2017 Sep 15;220(Pt 18):3381-3390. doi: 10.1242/jeb.162396. PMID: 28931721; PMCID: PMC5612019

Smith CL, Pivovarova N, Reese TS. Coordinated Feeding Behavior in Trichoplax, an Animal without Synapses. PLoS One. 2015 Sep 2;10(9):e0136098. doi: 10.1371/journal.pone.0136098. PMID: 26333190; PMCID: PMC4558020.

Smith CL, Varoqueaux F, Kittelmann M, Azzam RN, Cooper B, Winters CA, Eitel M, Fasshauer D, Reese TS. Novel cell types, neurosecretory cells, and body plan of the early-diverging metazoan Trichoplax adhaerens. Curr Biol. 2014 Jul 21;24(14):1565-1572. doi: 10.1016/j.cub.2014.05.046. Epub 2014 Jun 19. PMID: 24954051; PMCID: PMC4128346.

Powered by WordPress & Theme by Anders Norén