Interactions between individuals and the structure of their environment play a crucial role in shaping self-organized collective behaviors. Recent studies have shown that ants crossing asymmetrical bifurcations in a network of galleries tend to follow the branch that deviates the least from their incoming direction. At the collective level, the combination of this tendency and the pheromone-based recruitment results in a greater likelihood of selecting the shortest path between the colony's nest and a food source in a network containing asymmetrical bifurcations. It was not clear however what the origin of this behavioral bias is. Here we propose that it results from a simple interaction between the behavior of the ants and the geometry of the network, and that it does not require the ability to measure the angle of the bifurcation. We tested this hypothesis using groups of ant-like robots whose perceptual and cognitive abilities can be fully specified. We programmed them only to lay down and follow light trails, avoid obstacles and move according to a correlated random walk, but not to use more sophisticated orientation methods. We recorded the behavior of the robots in networks of galleries presenting either only symmetrical bifurcations or a combination of symmetrical and asymmetrical bifurcations. Individual robots displayed the same pattern of branch choice as individual ants when crossing a bifurcation, suggesting that ants do not actually measure the geometry of the bifurcations when travelling along a pheromone trail. Finally at the collective level, the group of robots was more likely to select one of the possible shorter paths between two designated areas when moving in an asymmetrical network, as observed in ants. This study reveals the importance of the shape of trail networks for foraging in ants and emphasizes the underestimated role of the geometrical properties of transportation networks in general.
Most ant species form transportation networks, be they foraging trails linking food sources to the main colony or underground galleries connecting the different parts of the nest. As for human transportation networks (roads, airlines, etc.), the design and the placement of the connecting points (or nodes) dramatically affects the movement of individuals and hence the exchanges of material and information. In a previous study, we have shown that the geometrical configuration of these nodes (i.e., the angles between the different exiting branches) can affect the route followed by an ant in a network of galleries and, as a consequence, the efficiency of the pheromone-based recruitment toward a food source. Here we show that we can reproduce these results using ant-like robots with minimal perceptual and cognitive capabilities. We demonstrate that the simple interaction between the displacement of an ant and the geometrical configuration of the gallery network can greatly affect the foraging performances of the colony. This result increases our understanding of how workers move through structures built by ant colonies and more generally points toward possible improvements for the design of man-made transportation networks.
Citation: Garnier S, Combe M, Jost C, Theraulaz G (2013) Do Ants Need to Estimate the Geometrical Properties of Trail Bifurcations to Find an Efficient Route? A Swarm Robotics Test Bed. PLoS Comput Biol 9(3): e1002903. doi:10.1371/journal.pcbi.1002903
Editor: Dario Floreano, Ecole Polytechnique Fe´de´rale de Lausanne EPFL, Switzerland
Received: July 5, 2011; Accepted: December 6, 2012; Published: March 28, 2013
Copyright: © 2013 Garnier et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was partly supported by the Programme Cognitique from the French Ministry of Scientific Research. Simon Garnier was supported by a research grant from the French Ministry of Education, Research and Technology, and by an ATUPS grant from the University Paul Sabatier. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Various ant species build networks of trails that link together nesting sites and exploited resources . These networks are generally formed by one or several dendritic trees originating from the nest of the colony. They can stretch over large distances and display very intricate patterns. For instance, the harvester ant Messor barbarus forms trails that persist over several consecutive days and can extend up to 25 meters from the nest entrance . The wood ant Formica aquilonia, whose body length is just 5–6 millimeters, can form networks where trails reach 200 meters in length, with up to nine successive branching points per trail . As a last example, the trail system in a colony of leafcutter ants Atta colombica can cover an area larger than 1 hectare, with trails extending up to 250 meters from the nest .
One major challenge for ant workers is to orient themselves inside such labyrinths and in particular to keep track of the direction of their nest. To do so, they use at least four different, but non-exclusive, types of information. First, they can rely on visual information. Some species use forest canopy  or sun position  to estimate the direction toward their nest. Others memorize environmental landmarks along their path . Second, they can also use proprioceptive information. Certain ant species approximate the direction toward their nest by summing their successive vectors of movements, measured as step numbers and body rotations –. Third, they can exploit social information, such as the food load of encountered workers. In ants carrying their food (such as seeds or leaf fragments) on surface trails, the proportion of laden ants is higher in the returning flow. Some ants use this difference to correctly reorient themselves on a trail .
The last type of information that ants can use to find the direction of their nest lies in the structure of the trail network itself. In several ant species, these networks display a particular property: the mean angle between trails as they branch out symmetrically from the nest lies around 60°, in the range 50°–100° depending on the species (Leptogenys processionalis ; Atta sexdens, A. capiguara, A. laevigata and Messor Barbarus ; Monomorium pharaonis ; Formica aquilonia ; Linepithema humile, unpublished data). Therefore, an ant exiting the nest and moving toward the periphery of the network generally faces symmetrical bifurcations, i.e. the two trails that follow a bifurcation deviate by approximately 30° from the original direction of the ant. Conversely, an ant coming back to its nest faces asymmetrical bifurcations: the trail heading toward the nest after a bifurcation deviates less (~30°) from the ant's original direction than the other trail (~120°) which leads away from the nest. In this last situation, and in absence of any other information, ants preferentially follow the least deviating trail, as demonstrated in our recent study with the Argentine ant L. humile , . We also showed that this behavioral bias, associated with the pheromone recruitment of this ant species, led to a significant improvement of the colony's ability to select the shortest route between its nest and a newly discovered food source  and depends critically on the branching angle .
A question that remains to be elucidated is whether ants reaching a bifurcation actually use its geometry as an orientation cue to decide which trail to follow next, or whether their individual and collective behaviors are in fact the product of a passive interaction with the geometrical structure of the trail network. The answer to this question depends on, for the moment, rare behavioral observations whose conclusions differ according to the experimental procedure and species studied , .
In order to gain new insight into the role of the trail geometry, we studied the behavior of robotics models of ants, whose perception abilities are known and whose behaviors can be specified. During the last fifteen years, the use of robots to investigate animal behavior has been increasingly popular (see – for a review and examples) and has led to the development of innovative control algorithms , . Several attempts have been made to produce ant-like robots that are able to lay and follow pheromone-like trails using heat trails , chemical trails , glow paint trails , virtual trails  or light trails , . Such trail systems are a promising way of guiding and organizing the activities of robotics swarms in space, particularly in unknown environments. From a biological point of view, these robotic models also offer the possibility of investigating questions related to the influence of the perceptual/cognitive abilities of individual ants on the collective behavior of the colony.
Here we present the results of an experiment where a group of ant-like robots had to establish a route between a starting area and a target area in a network of corridors, mimicking the experiments we performed with ants in our previous studies , . For technical convenience pheromone trails were replaced by light trails projected along the paths followed by the robots by a video projector (as proposed in ,  and implemented in ). Robots can detect and follow these light trails thanks to two photoreceptors that mimic the antennae of the ants. The robots were tested in two types of networks, one type made only of symmetrical bifurcations and the other type containing asymmetrical bifurcations, as in natural ant networks. Their behavior was kept as minimal as possible to observe just the interaction between the displacement of the ants, their trail laying/following behavior and the structure of the environment. In particular and in contrast to previous simulation work , , they were not given the capability to measure the angle between the corridors when reaching a bifurcation and therefore they could not make a change of direction based on this information. A comparison between the behavior of the robots and the behavior of ants in our previous experiments demonstrates that simple individual behavioral rules are sufficient to explain the efficient pattern of network exploitation observed in ants. It also helps us to better understand how the physical structure of the environment can affect individual and collective activities in social insects.
Materials and Methods
The experimental setup was a scaled-up, simplified version of the setup used in  to study the behavior of Argentine ants. The behavior of the ant workers was tested in a maze of corridors carved in a PVC (polyvinyl chloride) board (5 mm wide, about 4–5 times the width of an ant). These corridors mimicked permanent trails that are found in ant species that remove vegetation and debris to form physical routes toward long-lasting food sources , . The experimental setup used with the robots was a network of corridors (9 cm width, 4.5 times the width of a robot) built with white cardboard (5 mm thick, wall height of 2.5 cm). In ants, the network was made of four interconnected diamond-shaped loops connecting a starting area (corresponding to the nest of ants) on one end and a target area (corresponding to a food source for instance) on the other end. In robots, the network was made of only three interconnected diamond-shaped loops (see Fig. 1) in order to keep its dimensions within the space allowed by the pheromone deposit device (140×105 cm) while scaling up the length of the diamond-shaped loops by four (robots move 4 times faster than the ants). The starting and target areas were hexagons of the same dimensions (22.5 cm diameter). In this network there were 7 (vs 14 for the ants) possible paths of different lengths (shorter path: 86 cm; longer path: 178 cm) that robots could use to go from the starting area to the target area, without using the same segment of the network twice (a corridor between two bifurcations).
Figure 1. Schematic description of the experimental networks.
The left column corresponds to three-loop networks used in our robotic experiments, the right column to four-loop networks used in ant experiments in . The top row corresponds to the symmetrical (S) configuration of each network, the bottom row to their asymmetrical (A) configuration. S marks the starting area, T the target area.doi:10.1371/journal.pcbi.1002903.g001
Two network configurations were used. In configuration S (for “symmetrical”), each diamond-shaped loop of the network was perfectly symmetrical. As a consequence, all bifurcations of the network were also symmetrical: whatever incoming branch was at a bifurcation, the two other branches deviated by an angle of 60° on the left or on the right. In configuration A (for “asymmetrical”), each diamond-shaped loop of the network was flattened along one of its axes (the same for each loop). As a consequence, the network bifurcations were not always symmetrical anymore: depending on the incoming branch at a bifurcation, the two other branches both deviated by an angle of 30° on the left or on the right (symmetrical side of the bifurcation), or one branch deviated by an angle of 30° in one direction while the other branch deviated by an angle of 120° in the other direction (asymmetrical side of the bifurcation). Except for this difference in the geometry of the bifurcations, configurations S and A were identical: they presented the same topology, had segments of the same length and had the same total length. 15 experimental replicates with 10 robots were performed with each network configuration. Each experimental replicate lasted 60 minutes.
The micro-robots Alice (see Fig. 2) were designed at the EPFL (Lausanne, Switzerland ). They were very small robots (22 mm×21 mm×20 mm) equipped with two watch motors with wheels and tires, with a maximum speed of 40 mm s−1. Four infrared (IR) sensors and transmitters were used for detection of the starting and target areas, and for obstacle detection. The front left and front right sensors were oriented 45° toward the left and the right of the robots' moving direction respectively; the front and back sensors were oriented directly ahead and behind of the robots' moving direction respectively. Obstacles could be detected at a maximum distance of 3 centimeters . An add-on module equipped with two photodiodes on each side of the robot and pointing upwards allowed the detection of light gradients. It also carried a red LED (Light Emitting Diode) to permit an easy and reliable tracking in conditions of changing background brightness. A NiMH rechargeable battery provided energy for about 3.5 hours in our experimental conditions. The robots had a microcontroller PIC16LF877 with 8K Flash EPROM memory, 368 bytes RAM and no built-in float operations. Programming was done with the IDE of the CCS-C compiler, and the compiled programs were downloaded in the Alice memory with the PIC-downloader software (EHL elektronika).
Figure 2. Pictures of the experimental setup.
(a) Two Alice robots facing each other, with (left) and without (right) the additional module for light detection. (b) Three Alice robots pursuing a light trail. (c) Typical time course of an experiment with three loops (access to a fourth loop that is visible had been blocked) and symmetrical bifurcations. The letter S indicates the starting area of the network where the robots are placed at the beginning of the experiment. The letter T indicates the target area. The top three pictures represent 3 snapshots of an experiment where a group of 10 robots selects the shortest path.doi:10.1371/journal.pcbi.1002903.g002
Pheromone deposit device
A firewire digital video camera Unibrain Fire-i400 (resolution 640×480 pixels) was hung about 1.5 m above the robots. It transmitted videos to a Dell Latitude D810 laptop computer via a 1394a PCMCIA card. Image acquisition on the computer was done with the open source CMU 1394 Digital Camera Driver (Robotics Institute, Carnegie Mellon University) and image treatment was done with the open source OpenCV library (Intel Corporation). RGB (Red Green Blue) images were converted into HSV (Hue Saturation Value) space. The rest of the treatment was done on the H channel of the HSV space. This allowed the isolation of a given color in the images (here the red LED carried by robots) regardless of its intensity. White noise was removed thanks to a morphological opening (erosion followed by dilatation) with a 3×3 matrix . The images were then converted to binary images by applying a min-max threshold to isolate the red portion of the H channel. The resulting blobs of pixels were fitted with an ellipse function whose center position provided the position of each robot. Positions were corrected with respect to camera lens distortion, position and angle using the Matlab Camera Calibration Toolbox (Computer Vision Research Group, California Institute of Technology).
Robot positions were used to produce an image (800×600 pixels) where uniform light discs of fixed blue intensity (Red = 0, Green = 0, Blue = 7) marked trail pheromone spots. Each disc was centered on the trajectory traced by a robot and did not overlap with the previous disc drawn along the same trajectory. Discs pertaining to different trajectories or that were not directly following each other on the same trajectory could overlap. In overlapping regions, pixel intensity corresponded to the sum over time of all the overlapping discs (up to a maximum blue intensity of 255). Finally, the light intensity (I) decreased following an exponential decay to simulate pheromone evaporation:
where corresponded to the current time, to the period between two evaporation time-steps and to the characteristic evaporation time (1800 sec). To lower the processing charge, evaporation was triggered every 5 seconds only . The tracking and trail laying software performed all computations at an effective speed of about 5 images per second. Given the robot speed of two body lengths per second and the maze dimensions this fulfilled our needs.
The final image was projected with a video-projector suspended about 3 m above the robots. Misalignment between the camera and the beamer was corrected using the Matlab Camera Calibration Toolbox. The projected image covered a surface of approximately 140×105 cm. The size of the blue disc after projection was fixed to 6 cm. This allowed the formation of light trails large enough for two robots to cross without being pushed outside the trail. These parameter values that produce consistent trail laying and trail following behaviors with these robots were established in a previous study .
The behavioral model was a generic model of trail laying and trail following behaviors in ants. Its purpose was to capture the essential features needed to achieve a path selection as it is observed in ant colonies . In the absence of light pheromones, a robot (laying a trail or not) moved according to a correlated random walk, which is a random walk with a directional persistence, as is commonly found in insects . This behavior is called “exploratory behavior”. If the robot detected an obstacle (with its built-in infrared detectors ), it tried to avoid it by turning away from the obstacle. This behavior was called “avoidance behavior.” If the robot detected a luminous trail with its photoreceptors, it tried to turn towards the brighter trail. This behavior was called “trail following behavior.”
Each of these behaviors triggered the computation of a movement vector. The exploratory vector was a unit vector that initially points straight ahead of the robot and is modified at random time intervals. The new direction was chosen by drawing a random angle from a uniform distribution (using the Quick & Dirty algorithm ) between −30° and +30° and adding it to the current direction. The time intervals between each direction change were drawn from a decreasing exponential distribution with characteristic time being 3 seconds (i.e., an exponent of −1/3 second−1). Exponential random numbers were created from a uniform random number transformed to with an algorithm using only integers (see Ahrens and Dieter  for the algorithm).
The avoidance vector was the sum of four vectors (, , , ), each of them pointing in the opposite direction of one of the four proximity IR sensors of the robot (). The intensity of each of the four vectors increased proportionally with the inverse of the distance between an obstacle and the corresponding sensor. Each sensor regularly and frequently emitted an IR signal that was reverberated by obstacles. The intensity of the reverberation perceived by the IR sensor was used as a proxy of the distance to the obstacle. This intensity diminished with the distance approximately following a sigmoid curve (0: the closest obstacle from the sensor is at least 3 cm away from it; 1: the obstacle is touching the sensor) .
The trail following vector was the sum of two vectors pointing either to the right () or to the left () of the robots' current direction (). The intensity of and was controlled by the light intensities perceived by the right and left photoreceptor (0: no light perceived; 1: photoreceptor maximally stimulated).
The robot then adjusted the direction and speed of the rotation of two independently driven wheels to achieve the new direction during the next step of its internal clock (50 ms).
Finally, the starting and the target areas in the experimental setup described above were equipped with two infrared transmitters that continuously emitted a signal. This signal was different for each area and the robots could detect it with their IR sensors. Each time a robot entered either the starting or the target area, it switched off its red LED, becoming invisible to the tracking software. As a consequence, it also stopped laying a light trail. This prevented robots from marking these areas while continuing their exploratory and obstacle avoidance walks. The red LED was switched on again as soon as the robot left the starting or the target area.
Data collection and analysis
All data processing and statistical analysis were performed with R version 2.7.0 .
In order to quantify the impact of the bifurcation structure on the individual displacement of the robots, we first analyzed their individual behavior when crossing an asymmetrical bifurcation. We tested whether their choice to follow the most direct branch resembled the choice observed in ant experiments .
During the first 2 minutes of each experimental replicate with network configuration A, we measured the proportion of robots crossing an asymmetric bifurcation and choosing to enter the most direct branch, i.e. the branch deviating by an angle of 30° from the original direction of the robot. Choices influenced by the contact with another robot at the bifurcation were excluded from this measure to be comparable to the individual choice data in  that had been obtained from isolated ants without direct interaction with a conspecific.
Deviation from a random choice was tested using a test for given probabilities. Comparisons with actual ant behavior at asymmetrical bifurcations (data taken from ) were performed with a Fisher's exact test for count data. Significant differences between robot and ant behaviors would suggest that the ants' choice is not simply dictated by the inertia of their movement.
In order to quantify path selection efficiency in the different network configurations we had to assess (a) whether robots created a pheromone trail between source and target area and at what speed, (b) the length of this path and (c) the persistence of this trail. Efficient robots should find short paths quickly, short paths should persist longer than long paths, and there should be less changes in path selections.
We divided the network into segments, each of them corresponding to a corridor between two bifurcations. For each type of network, we computed the total pheromone intensity every second on each segment of the maze using data coming directly from the pheromone deposit device. This total intensity was obtained as the sum of all pixel values in one segment. A segment was considered as used when the total intensity was above a threshold of 50,000. This threshold roughly corresponds to the amount of light pheromone that 2 robots would deposit in a segment of the maze if they were following each other closely. Distributed over the entire segment, it also corresponds approximately to the minimum amount of light necessary to activate the trail-following behavior of a robot.
We determined the path selected by robots as follows. From the starting area, we followed the segment with the highest total pheromone intensity until we reached either a bifurcation followed by two empty segments (total intensity inferior to 50,000), a previously visited bifurcation or the target area. If we reached a bifurcation followed by two empty segments we counted this path in the “no path” category. If we reached a previously visited bifurcation we counted this path in the “loop” category. Finally, if we reached the target area we counted this path in a category named by its segment length. There were 7 different paths that connected the starting and the target areas without using the same segment twice, and these 7 paths belonged to 4 length categories: 4, 6, 8 and 10 segments.
By repeating this process every second of each experimental replicate, we obtained the time sequences of path selection events (see Fig. 3 for an example). We grouped all consecutive frames that showed the same path category into a single event, called a selection event. We then computed the number of selection events and the durations of selection events for each selected path category for each experimental replicate.
Figure 3. Example of a time sequence showing 6 different path selection events (numbered 1 to 6) at the beginning of an experiment.
The x-axis represents the time from the beginning of the experiment. The y-axis represents the length of the path most used by the robots at a given time during the experiment. It is of 4, 6, 8 or 10 segments when the path is connected to the starting and the target areas; L when the path is connected to the starting or the target area only and forms a loop; N when the path is only connected to the starting or the target area and does not form a loop. In this example, there was no path selected during the first 60 seconds of the experiment (event 1), and then the group used a path with 8 segments until about 200 seconds (event 2), etc.doi:10.1371/journal.pcbi.1002903.g003
Comparisons of the number of selection events between network configurations were performed using unilateral two sample Wilcoxon rank sum tests with continuity correction. Comparisons of the durations of selection events between path categories and between network configurations were performed using two-way ANOVAs and multiple pairwise comparisons were performed with a Tukey HSD test.
In order to investigate further the respective role of pheromone and network geometry on the overall foraging efficiency, we used a computer model of our system directly inspired from the one introduced in  for Argentine ants, but modified to account for the robots' specificities.
In the starting and target areas, robots perform a random walk (no pheromone) with obstacle avoidance. As a consequence their probability per unit of time of leaving the starting area, , and the target area, , can be considered constant and equal (both areas have the same shape and dimensions). Once a robot has entered a segment of the network, the time required to travel the segment is computed as follows: , with the length of the segment in centimeters and the speed of the robot (40 mm s−1).
At each symmetrical intersection, a robot has to choose between two segment and . The probability for an ant to choose the segment and to choose the segment at a symmetrical bifurcation are modeled as follows:
with the intrinsic attractivity of segment and , and the quantity of pheromone on segment and , respectively, and the degree of nonlinearity of the choice.
At an asymmetrical bifurcation, about 2/3 of the robots choose the segment deviating less from their incoming direction when the quantity of pheromone is equal on both segment. We computed the probability to select the segment and to select the segment at an asymmetrical bifurcation as follows:
corresponds to the tendency of a robot to move forward and chose the segment deviating less from its incoming direction. It is positive if segment deviates by a 30° angle from the robot's incoming direction and negative if it deviates by a 120° angle. When is equal to 0.5 (i.e., ), then is equal to , i.e. the robot's choice is influenced only by the geometry of the bifurcation because the two segments are equally marked with pheromone. Conversely, when one of the two segments becomes more marked with pheromone, then the robot's choice becomes influenced by the trail and we assume that the influence of the bifurcation geometry progressively decreases as the difference in pheromone concentration between the two segments increases. Therefore, when or tend to (i.e., when or ), tends to 0.
Finally robots add a quantity of pheromone on each segment they visit. At each time step, the pheromone intensity () decreased following an exponential decay:
where corresponded to the current time, to the period between two time steps and to the characteristic evaporation time (1800 sec).
A good match between the experimental data and the model is found for the following parameters values: ; ; ; in configuration S, or in configuration A; when pheromone deposition is allowed, or when it is not; .
Individual choice at asymmetrical bifurcations
Results related to the individual behavior of ants (taken from ) and robots at asymmetrical bifurcations are summarized in Fig. 4. The figure shows how the proportion of individuals following a given branch is influenced by the angle this branch makes with the originating branch of the individual, in the absence of other information such as recruiting pheromone.
Figure 4. Comparison with the behavior of ants.
In white, proportion of robots (with confidence intervals) selecting the most direct branch when reaching an asymmetrical bifurcation. In gray, proportion of ants selecting the most direct branch (data from ).doi:10.1371/journal.pcbi.1002903.g004
When reaching an asymmetrical bifurcation (configuration A, Fig. 4), both ants and robots chose more often to enter the branch deviating by an angle of 30° (126 observations in ants and 107 observations in robots) than the branch deviating by an angle of 120° (66 observations in ants, , df = 1, p<0.001; 38 observations in robots, , df = 1, p<0.001). Additionally, the proportion of robots entering the most direct branch was not significantly different from the one observed in ants (107/145 = 74% for robots vs. 126/192 = 66% for ants, Fisher's exact test, p = 0.122).
As shown by these results, the choice behavior of the robots at an asymmetrical bifurcation is similar to the one of the ants. In this initial phase of the experiment, branches do not bear yet any pheromone marking but the robot's simple correlated random walk leads them to “choose” the branch that deviate less from their current trajectory. This shows that no complex orientation strategy is required to reproduce the individual choice behavior of the ants with the robots.
Collective choice in symmetrical and asymmetrical networks
Results from the collective path selection experiments are summarized in Fig. 5. The typical time course of an experimental replicate is shown in Fig. 2c and Video S1. As observed in ants (see ), robots dispersed in the network during the first minutes of the experimental replicate, before limiting their displacement to a single path connecting the starting and the target areas. This path was the shortest possible path at the end of all 15 experimental replicates in both configurations A and S.
Figure 5. Collective path selection results for the three-loop networks.
The top row (a–c) corresponds to the robotics experiments (15 experimental replicates with each network configuration) with a three-loop network presented in this article. The bottom row (d–f) corresponds to the experiments (10 experimental replicates with each network configuration) performed with ant colonies in  with a four-loop network and is reproduced here for purpose of qualitative comparison. (a & d) Number of network segments used by robots/ants as a function of time. The black line represents the mean value with its standard error area band (light gray for configuration S, dark gray for configuration A). Note the different time scales between robot and ant experiments. (b & e) Number of selection events observed over the course of the experiments. Each bar represents the boxplot for each network configuration. (c & f) Duration of selection events by path category and by network configuration. The dashed line represents mean values (+/− sem) obtained with the network in configuration S, the continuous line represents mean values (+/− sem) obtained with the network in configuration A. On the x axis, numbers represent the length of the selected path.doi:10.1371/journal.pcbi.1002903.g005
The number of network segments used by the robots increased rapidly during the first 500 seconds of an experimental replicate (see Fig. 5a), which corresponded to the initial dispersion of the individuals inside the maze. It reached a plateau value around which it oscillated during the rest of the experimental replicate. This plateau value was different between the two configurations, with a mean number of segments used at around 7 for configuration S and around 5 for configuration A. While the ant and robot experiments differed in population and maze size, the dynamics of the number of segments used in both cases were qualitatively similar (see Fig. 5a vs. d) and indicated a more important dispersion of the individuals in configuration S of the network. Although both ants and robots tend to find the shortest path in both configurations, there is more dispersion away from this path in configuration S.
In order to determine if the robots preferentially used one particular path category, we computed the mean duration of the observed selection events for each path category, which is the mean time during which the robot colony preferentially used a path category before switching to another path category (see Fig. 5c). This duration varied significantly among the different path categories (see Fig. 5c, 2 way ANOVA, F = 29.27, df = (4,94), p<0.001), with the shortest path category being selected for the longest time in both network configurations (Tukey HSD, p<0.001 when comparing the 4-segment category with the other path categories; comparisons with 8- and 10-segment categories was not possible since they were selected respectively 1 and 0 times only during all the experimental replicates). Moreover, the mean duration of observed selection events was significantly longer in configuration A (2 way ANOVA, F = 10.31, df = (1,94), p = 0.002), as was the mean duration of selection events for the shortest path category (Tukey HSD, p<0.001). These results are qualitatively similar to those observed in ants (see Fig. 5c vs f) that also preferentially used the shorter path category in both configurations of the network, and used it more consistently in configuration A than in configuration S.
The previous observation was corroborated by the analysis of the number of switches between the different path categories during an experimental replicate. Robots that started using one path category could switch to another one several times during an experimental replicate, but the number of observed selection events was significantly smaller when the network was in configuration A than when it was in configuration S (see Fig. 5b, W = 72, p = 0.024). A similar result was also observed in ants (see Fig. 5b vs. e and  for its statistical analysis).
Respective role of pheromone and network geometry
We ran the computer model under four different conditions - configuration S with and without pheromone deposition, and configuration A with and without pheromone deposition - and we compared the ability of the robotic group to complete successful trips between the starting and target areas.
For each of the four conditions, we ran 1000 simulation runs. The foraging efficiency of the robotic group under each condition is summarized in Fig. 6. The foraging efficiency is expressed as the number of successful trips performed by the robots, i.e. the number of times a robot has returned to the starting area after visiting the target area.
Figure 6. Foraging efficiency of the robots as given by simulations of our model.
The foraging efficiency is measured as the number of successful trips, i.e. the number of times a robot has returned to the starting area after visiting the target area. Each boxplot represents the values for 1000 simulation runs. The black horizontal bar in each boxplot represents the median; the notches around the median represent the confidence interval of the median. The four tested conditions were: configuration S without pheromone deposition (S-P); configuration A without pheromone deposition (A-P); configuration S with pheromone deposition (S+P); configuration A with pheromone deposition (A+P).doi:10.1371/journal.pcbi.1002903.g006
In absence of pheromone (S-NP and A-NP in Fig. 6), robots placed in a network with configuration A performed significantly better than those placed in a network with configuration S (Wilcoxon rank sum test, W = 193972, p<0.0001). However the amplitude of the improvement was small: the robots in configuration A completed only 1.05 times more successful trips than those in configuration S (measured as the ratio between the median number of successful trips in both conditions).
The addition of pheromone in the model led to a significant increase in the number of successful trips when the robots were in configuration S (W = 16538.5, p<0.0001) and configuration A (W = 171869, p<0.0001). In configuration S, robots completed 1.3 times more successful trips when pheromone was added to the model than when it was absent. This ratio grows to 1.8 in configuration A. Finally robots completed 1.46 times more successful trips in configuration A than in configuration S in the presence of pheromone.
In conclusion our simulations show that the geometry of the network has an influence on the foraging efficiency of the robots, but this influence is small compared to the one of the pheromone (compare 1.05 with 1.3). When combined they result in a nonlinear increase in the foraging efficiency (compare 1.05 and 1.3 with 1.8).
In numerous ant species, pheromone trails play an essential role during foraging tasks by guiding workers toward previously discovered resources or helping them finding their way back to their nest . In certain species these trails form an intricate network, thus challenging the navigation abilities of ants . Recent studies have shown that the geometrical structure of the trail network directly affects the choice of which path to follow when an ant crosses a bifurcation, and thus modifies the foraging efficiency of the colony –. It was less clear however whether or not individual workers were actively considering the geometry of a bifurcation when choosing a path to follow, though this feature was used in previous simulation work , .
Using a robotic model, we have shown that no representation or even simple detection of the presence of a bifurcation was necessary to explain the individual ant behavior. The robots were not explicitly programmed to identify the presence of a bifurcation or to estimate its geometrical configuration. Instead they were programmed only to move according to a correlated random walk and to avoid obstacles indifferently of their nature, be they gallery walls or other robots. Yet their behavior when crossing a symmetrical or an asymmetrical bifurcation was comparable to the behavior of Argentine ants in similar situations, suggesting that the individual decisions of Argentine ants at bifurcations are affected by the physical structure of the environment in a passive way (i.e., without the formation of a representation of the bifurcation prior to the decision). Considering the poor performance of the Argentine ants' visual system  and the high tempo of the workers along the trail (up to 2.5 cm s−1 for an average body length of 3 mm, personal observation), it is unlikely that Argentine ants would have the time and capacity to evaluate the geometry of a bifurcation that they would cross in less than half of a second (the length of a bifurcation in ,  is about 1 cm from the entrance to one of the two possible exits). Our results show that such a complex cognitive process is not necessary to explain the ants' behavior.
At the collective level, the interaction between the pheromone-based recruitment process and the tendency to move into the least deviating branch of the bifurcation created a significant difference in the pattern of network use between symmetrical and asymmetrical networks. While the robots tended to more intensely use the shorter path between the starting and target areas in both configurations, robots collectively more consistently selected the shorter path and tended to spread less in the asymmetrical network. This result was qualitatively very similar to what was observed in ants, though a quantitative comparison was not possible because of the large-scale differences between the two systems (differences in relative speed or quantity of pheromone deposited for instance). Experiments with ants were also performed with colonies of 500 workers , while only 10 robots were used in each of our experiments. This resulted in a larger dispersion of the individuals in the ant experiments as shown by the greater number of selection events (see Fig. 5e). This increased dispersion is probably caused by overcrowding on the trail that favors the use of alternative routes , . Argentine ants are also known to perform more U-turns with increasing deviations from their initial trajectories , . However this behavior does not seem to affect the collective ability of the colony to select the shortest path in the network, as shown by simulations in . Our results support this observation as robots in our experiments were not explicitly programmed to perform U-turns (though collisions with other robots can lead to such U-turns) and yet their collective behavior was similar to that of ants. Note that pheromone marking is essential for the path selection to occur. Without pheromones, robots would simply diffuse in the network according to their correlated random walk and approximately reflective obstacle avoidance behavior. Assuming quasi-instantaneous direction changes (relative to the moving speed of the robots, rotation time is negligible here), standard diffusion theory  predicts a completely homogeneous distribution of the robots in the network at stationary state (reached in our system within 10 minutes, see Fig. 5a). Even moderate deviations from these assumptions could not lead to the preferential use of the shorter path by the robots.
Finding the shortest path between two nodes in a network requires solving a series of binary choices at each bifurcation. Following the wrong path at one bifurcation can propagate over the following decisions because of the persistent nature of the attractive pheromone, therefore decreasing the chances of finding the best solution, or even locking the system in a loop. This study shows that the coupling of a particular geometrical configuration of trail networks and the forward oriented movement of ants reduces the chances of a bad choice and favors the selection of one of the shorter paths between the nest and the food source. It has an effect similar to the heuristic information in Ant Colony Optimization (ACO) algorithms –. Both provide a general axis for the information to propagate and therefore reduce the probability that ants (virtual and natural) get trapped in loops or less efficient solutions , .
This last remark raises the question of the origin of the particular geometry of the trail networks built by several ant species. In their work about foraging trails in the ant L. processionalis, Ganeshaiah and Veena (see  and references therein) mention that a branching pattern is a good trade-off in minimizing both the total length of the network and the average distance between two endpoints (where food can be localized for instance). They also note that bifurcation angles that minimize the resistance to the movement of the ants in such networks should be around 70°–80°, which is close to what has been found afterward in several ant species , , . This last point suggests that the formation of a bifurcation may be strongly influenced by the movement of ants along a trail, and that the formation of specific geometrical configurations may not require complex cognitive abilities. One possible scenario to explain the emergence of these particular angle values could be the following. A first phase of random exploration around the nest or the endpoint of an existing trail would result in a random network of weak trails. Then the passage of ants along these trails combined with their forward oriented walk would reinforce bifurcation branches that deviate from the originating direction of the ants by no more than a threshold angle (possibly 30°–40° from the originating direction of the ant, i.e. an angle of 60°–80° between the two branches). Largely deviating branches would be therefore abandoned little by little. Furthermore, at bifurcations where the branches would be very close to each other, the natural diffusion of the pheromone and its imperfect detection by ants would eventually lead to the fusion of the two branches into one trail only, thus preventing the maintenance of smaller angles between the two branches of a bifurcation. A recent model of trail formation introduced in  confirms part of this scenario.
Finally, our findings emphasize the interplay between the behavior of a swarm system and the configuration of the environment into which the swarm system moves. While most studies of ant-made networks focus on the efficiency of their topological properties (see for instance , , ), we show here that their geometrical configurations also affect the spatial distribution of individuals, and hence the foraging efficiency of the colony . On a related note, Batty  suggested that the configuration of a building could explain why a human crowd would favor certain spaces and routes more than others. We also suspect that within an ant nest, local geometrical constraints might favor the formation of preferred paths channeling the motion of ant workers. Similarly, several swarm robotics studies have shown that the shape of interacting robots could be responsible for the emergence of collective patterns –. In all these cases, the physical configuration of the environment (the structure of the network, the organization of the rooms or the shape of the other individuals) directly influences the collective outcome and can potentially modify the pattern of interaction and information exchange between individuals. Understanding the constraints applied by the environment on the behavior of individuals should make it possible to use them appropriately to improve the design of crowded areas or to favor the emergence of certain desirable behaviors in a swarm of robots.
Typical time course of an experiment (1 hour). The starting area is in the top right corner, the target area in the bottom left corner.
We thank Roland Siegwart, Fabien Tâche, Peter Siegrist, Céline Ramoni and all the members of the Autonomous Systems Lab for their help with the development of the robotics setup. We also thank Vincent Fourcassié, Jacques Gautrais and the members of the DYNACTOM group for useful discussions and comments. We also thank two anonymous reviewers for their critical and constructive comments.
Participated in the revision of the manuscript: CJ GT. Conceived and designed the experiments: SG CJ GT. Performed the experiments: SG. Analyzed the data: SG. Contributed reagents/materials/analysis tools: MC. Wrote the paper: SG.
- 1. Hölldobler B, Wilson EO (1990) The Ants. 1st ed. Cambridge, MA: Harvard University Press. 732 p.
- 2. Detrain C, Tasse O, Versaen M, Pasteels JM (2000) A field assessment of optimal foraging in ants: trail patterns and seed retrieval by the European harvester ant Messor barbarus. Insectes Sociaux 47: 56–62 doi:10.1007/s000400050009.
- 3. Buhl J, Hicks K, Miller ER, Persey S, Alinvi O, et al. (2008) Shape and efficiency of wood ant foraging networks. Behavioral Ecology and Sociobiology 63: 451–460 doi:10.1007/s00265-008-0680-7.
- 4. Wirth R, Herz H, Ryel RJ, Beyschlag W, Hölldobler B (2003) Herbivory of Leaf-Cutting Ants - A Case Study on Atta colombica in the Tropical Rainforest of Panama. Springer 233. doi: 10.1007/978-3-662-05259-4
- 5. Hölldobler B (1980) Canopy orientation: a new kind of orientation in ants. Science 210: 86–8 doi:10.1126/science.210.4465.86.
- 6. Wehner R, Menzel R (1969) Homing in the ant Cataglyphis bicolor. Science 164: 192–4. doi: 10.1126/science.164.3876.192
- 7. Chameron S, Schatz B, Pastergue-Ruiz I, Beugnon G, Collett TS (1998) The learning of a sequence of visual patterns by the ant Cataglyphis cursor. Proceedings of the Royal Society B: Biological Sciences 265: 2309–2313 doi:10.1098/rspb.1998.0576.
- 8. Grüter C, Czaczkes TJ, Ratnieks FLW (2010) Decision making in ant foragers (Lasius niger) facing conflicting private and social information. Behavioral Ecology and Sociobiology 65: 141–148 doi:10.1007/s00265-010-1020-2.
- 9. Wittlinger M, Wehner R, Wolf H (2006) The ant odometer: stepping on stilts and stumps. Science 312: 1965–7 doi:10.1126/science.1126912.
- 10. Collett M, Collett TS (2000) How do insects use path integration for their navigation? Biological Cybernetics 83: 245–259 doi:10.1007/s004220000168.
- 11. Moffett MW (1987) Ants that go with the flow: a new method of orientation by mass communication. Naturwissenschaften 74: 551–553 doi:10.1007/BF00367078.
- 12. Ganeshaiahl KN, Veena T (1991) Topology of the foraging trails of Leptogenys processionalis? Why are they branched? Behavioral Ecology and Sociobiology 29: 263–270 doi:10.1007/BF00163983.
- 13. Acosta FJ, López F, Serrano JM (1993) Branching Angles of Ant Trunk Trails as an Optimization Cue. Journal of Theoretical Biology 160: 297–310 doi:10.1006/jtbi.1993.1020.
- 14. Jackson DE, Holcombe M, Ratnieks FLW (2004) Trail geometry gives polarity to ant foraging networks. Nature 432: 907–9 doi:10.1038/nature03105.
- 15. Gerbier G, Garnier S, Rieu C, Theraulaz G, Fourcassié V (2008) Are ants sensitive to the geometry of tunnel bifurcation? Animal Cognition 11: 637–42 doi:10.1007/s10071-008-0153-4.
- 16. Garnier S, Guérécheau A, Combe M, Fourcassié V, Theraulaz G (2009) Path selection and foraging efficiency in Argentine ant transport networks. Behavioral Ecology and Sociobiology 63: 1167–1179 doi:10.1007/s00265-009-0741-6.
- 17. Vittori K, Talbot G, Gautrais J, Fourcassié V, Araújo AFR, et al. (2006) Path efficiency of ant foraging trails in an artificial network. Journal of Theoretical Biology 239: 507–15 doi:10.1016/j.jtbi.2005.08.017.
- 18. Webb B (2002) Can robots make good models of biological behaviour? Behavioral and Brain Sciences 24: 1033–1050 doi:10.1017/S0140525X01000127.
- 19. Webb B (2008) Using robots to understand animal behavior. Advances in the Study of Behavior 38: 1–58 doi:10.1016/S0065-3454(08)00001-6.
- 20. Garnier S (2011) From Ants to Robots and Back?: How Robotics Can Contribute to the Study of Collective Animal Behavior. Bio-Inspired Self-Organizing Robotic Systems 355: 105–120 doi:10.1007/978-3-642-20760-0_5.
- 21. Beer RD, Chiel HJ, Quinn RD, Ritzmann RE (1998) Biorobotic approaches to the study of motor systems. Current Opinion in Neurobiology 8: 777–782 doi:10.1016/S0959-4388(98)80121-9.
- 22. Pfeifer R, Lungarella M, Iida F (2007) Self-organization, embodiment, and biologically inspired robotics. Science 318: 1088–93 doi:10.1126/science.1145803.
- 23. Russell RA (1997) Heat trails as short-lived navigational markers for mobile robots. Proceedings of International Conference on Robotics and Automation. IEEE Vol. 4: 3534–3539 doi:10.1109/ROBOT.1997.606882.
- 24. Russell RA (1999) Ant trails - an example for robots to follow? Proceedings of IEEE International Conference on Robotics and Automation 4: 2698–2703 doi:10.1109/ROBOT.1999.774005.
- 25. Blow M (2005) “Stigmergy”: Biologically-inspired robotic art. In: Proceedings of the Symposium on Robotics, Mechatronics and Animatronics in the Creative and Entertainment Industries and Arts. 12–15 April 2005; Hatfield UK. SSAISB 2005. The Society for the Study of Artificial Intelligence and the Simulation of Behaviour.
- 26. Payton D, Estkowski R, Howard M (2005) Pheromone Robotics and the Logic of Virtual Pheromones. Swarm Robotics. Springer Berlin Heidelberg 45–57 doi:10.1007/978-3-540-30552-1_5.
- 27. Sugawara K, Kazama T, Watanabe T (2004) Foraging behavior of interacting robots with virtual pheromone. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems; 28 Sep - 01 Oct 2004; Sendai, Japan. IROS 2004. IEEE, Vol. 3: . pp. 3074–3079. doi:10.1109/IROS.2004.1389878.
- 28. Garnier S, Tache F, Combe M, Grimal A, Theraulaz G (2007) Alice in Pheromone Land: An Experimental Setup for the Study of Ant-like Robots. In: 2007 IEEE Swarm Intelligence Symposium; 1–5 April 2007; Honolulu, Hawaii, United States. IEEE. pp. 37–44. doi:10.1109/SIS.2007.368024.
- 29. Siegrist P (2005) Simulation of Ant's Pheromone Deposition with Alice Robot. Lausanne, Switzerland: Ecole Polytechnique Fédérale de Lausanne. 77 p.
- 30. Jackson DE, Martin SJ, Holcombe M, Ratnieks FLW (2006) Longevity and detection of persistent foraging trails in Pharaoh's ants, Monomorium pharaonis (L.). Animal Behaviour 71: 351–359 doi:10.1016/j.anbehav.2005.04.018.
- 31. Caprari G, Estier T, Siegwart R (2001) Fascination of down scaling — Alice the sugar cube robot. Journal of Micromechatronics 1: 177–189 doi:10.1163/156856301760132097.
- 32. Dougherty ER (1992) An introduction to morphological image processing. SPIE Optical Engineering Press. 161 p.
- 33. Goss S, Aron S, Deneubourg JL, Pasteels JM (1989) Self-organized shortcuts in the Argentine ant. Naturwissenschaften 76: 579–581 doi:10.1007/BF00462870.
- 34. Kareiva PM, Shigesada N (1983) Analyzing insect movement as a correlated random walk. Oecologia 56: 234–238 doi:10.1007/BF00379695.
- 35. Press WH, Teukolsky SA, Vetterling WT, Flannery BP (1992) Numerical Recipes in C: The Art of Scientific Computing. 2nd ed. Cambridge, UK: Cambridge University Press. 1256 p.
- 36. Ahrens JH, Dieter U (1972) Computer methods for sampling from the exponential and normal distributions. Communications of the ACM 15: 873–882 doi:10.1145/355604.361593.
- 37. Caprari G (2003) Autonomous micro-robots: Applications and limitations. Lausanne, Switzerland: Ecole Polytechnique Fédérale de Lausanne. 132 p.
- 38. R Core Team (2011) R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. 409 p.
- 39. Aron S, Beckers R, Deneubourg JL, Pasteels JM (1993) Memory and chemical communication in the orientation of two mass-recruiting ant species. Insectes Sociaux 40: 369–380 doi:10.1007/BF01253900.
- 40. Dussutour A, Fourcassié V, Helbing D, Deneubourg J-L (2004) Optimal traffic organization in ants under crowded conditions. Nature 428: 70–3 doi:10.1038/nature02345.
- 41. Case KM, Zweifel PF (1967) Linear transport theory. Reading, MA: Addison-Wesley Pub. Co. 342 p.
- 42. Bonabeau E, Dorigo M, Theraulaz G (1999) Swarm Intelligence From Natural to Artificial Systems. Oxford, UK: Oxford University Press. 320 p.
- 43. Schoonderwoerd R, Holland OE, Bruten JL, Rothkrantz LJM (1997) Ant-Based Load Balancing in Telecommunications Networks. Adaptive Behavior 5: 169–207 doi:10.1177/105971239700500203.
- 44. Dorigo M, Maniezzo V, Colorni a (1996) Ant system: optimization by a colony of cooperating agents. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics?: a publication of the IEEE Systems, Man, and Cybernetics Society 26: : 29–41. doi:10.1109/3477.484436.
- 45. Dorigo M, Stützle T (2004) Ant Colony Optimization. Cambridge, MA: MIT Press. 305 p.
- 46. Perna A, Granovskiy B, Garnier S, Nicolis SC, Labédan M, et al. (2012) Individual rules for trail pattern formation in Argentine ants (Linepithema humile). PLoS Computational Biology 8: e1002592 doi:10.1371/journal.pcbi.1002592.
- 47. Buhl J, Gautrais J, Solé R V, Kuntz P, Valverde S, et al. (2004) Efficiency and robustness in ant networks of galleries. The European Physical Journal B 42: 123–129 doi:10.1140/epjb/e2004-00364-9.
- 48. Buhl J, Gautrais J, Louis Deneubourg J, Kuntz P, Theraulaz G (2006) The growth and form of tunnelling networks in ants. Journal of Theoretical Biology 243: 287–98 doi:10.1016/j.jtbi.2006.06.018.
- 49. Batty M (1997) Predicting where we walk. Nature 388: 19–20 doi:10.1038/40266.
- 50. Gaussier P, Zrehen S (1994) Avoiding the world model trap: An acting robot does not need to be so smart!. Robotics and Computer-Integrated Manufacturing 11: 279–286 doi:10.1016/0736-5845(95)00004-6.
- 51. Maris M, Boeckhorst R (1996) Exploiting physical constraints: heap formation through behavioral error in a group of robots. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, Vol. 3: . pp. 1655–1660. doi:10.1109/IROS.1996.569034.
- 52. Schank JC (2004) A Biorobotic Investigation of Norway Rat Pups (Rattus norvegicus) in an Arena. Adaptive Behavior 12: 161–173 doi:10.1177/105971230401200303.