Remote control system of disaster response robot with passive sub-crawlers considering falling down avoidance
© Suzuki et al.; licensee Springer. 2014
Received: 15 January 2014
Accepted: 23 May 2014
Published: 30 November 2014
This paper describes a remote control system for a crawler-type mobile robot with passive sub-crawlers. This system has a great advantage because it utilizes an essential compliant mechanism that allows the angle of the sub-crawlers to be adapted to the shape of the road surface. Its operation is extremely simple, and it is only necessary to control the movement direction and driving speed in comparison with the case of controlling active sub-crawlers. However, a robot with passive sub-crawlers cannot recover from a situation in which it is stuck. The operator must select a traversable route for unknown rough terrain using only the information obtained from camera images and some sensor data from the robot. In this study, a remote control system for a crawler robot with passive sub-crawlers was developed based on a warning system. This system evaluates the currently selected route by calculating the stabilization for the robot when falling down in the roll and pitch directions. Experimental results obtained using a prototype crawler robot with passive sub-crawlers demonstrated the effectiveness of the proposed system.
Remote-controlled mobile robots are useful for searching around and inside buildings that have collapsed in a disaster. In a disaster area, to avoid the risk of secondary disasters, it is preferable to immediately deploy remote-controlled mobile robots instead of waiting for first responders such as firefighters. Disaster response robots should have high mobility on rough terrain. The movement mechanism of a crawler-type robot with sub-crawlers has been applied to many disaster response robots in order to realize high mobility . However, its use complicates robot operation because the operator must actively control each sub-crawler by estimating the attitude or state of the robot based on camera images and sensor information. Therefore, because of the multiple degrees of freedom involved, operators must be well trained to achieve high mobility by using remote control. A semi-autonomous control system for crawler robots has been studied to realize both high mobility and simple operation ,. This study focused on a crawler robot with passive sub-crawlers to realize simple operation with multiple degrees of freedom. Passive sub-crawlers can adapt to unknown rough terrain. We developed a crawler-type mobile robot for conducting search operations around a disaster area. Passive sub-crawlers called “Scotta I” were adopted for this robot. In a crawler robot with passive sub-crawlers, it is only necessary to control the movement direction and driving speed, unlike in the case of controlling active sub-crawlers. However, posture control is impossible in passive sub-crawlers because the operator cannot actively control each sub-crawler, and a robot with passive sub-crawlers cannot recover from a situation in which it is stuck. A robot with passive sub-crawlers is extremely simple, but it is essential for the operator to possess considerable skill when selecting a route. The operator must select a traversable route for unknown rough terrain using only the information obtained from camera images and sensor data from the robot.
In this paper, we propose a warning system, not a semi-autonomous control system, for a remote-controlled disaster response robot, because the operator should have the authority to make the final decision in order to realize flexible operation at all times. By evaluating the stability margin, a remote control system for a crawler robot with passive sub-crawlers is proposed that adopts the warning system with a dynamic threshold. The current route selected by the operator is evaluated by calculating the stabilization for the robot while falling down in the roll and pitch directions. An operator can prevent the robot from falling down based on the sound and signals from the warning system when the evaluation value for the stability margin is less than the threshold. The proposed system will be able to prompt the operator to select another route. A method of compensating for the disadvantages of a crawler robot with passive sub-crawlers will be proposed in this paper. This paper describes a method for evaluating the potential for falling down by using a predictive falling down margin time based on the normalized energy (NE) stability margin. The results of experiments demonstrated the effectiveness of the proposed system.
Disaster response robot “Scott I”
Specifications of Scott 1
Dim. of the robot [mm]
Length × Width × Height
720 × 390 × 145
370 × 290 × 100
Timing pulley dia. [mm]
Belt width [mm]
Max. speed [m/s]
The operation of a robot with active sub-crawlers is complicated because the operator should control not only the main body but also each sub-crawler. A semi- autonomous control system has been considered to overcome the disadvantage of a crawler-type robot with active sub-crawlers. We do not intend to deny the approach for a semi-autonomous control system. A crawler-type robot with passive sub-crawlers is known to have a great advantage because it has an essential compliant mechanism that allows the angle of the sub-crawlers to be adapted to the shape of the road surface ,. The operator only needs to control the movement direction and driving speed. The effectiveness of passive sub-crawlers has been confirmed by simulations and experiments, and the mobility performance of Scott I was appreciated in RoboCup Japan Open Rescue Robot League 2013 and in the evaluation field at IRS (International Rescue System Institute in Japan). On the other hand, it is necessary to restrict the rotational angle of a sub-crawler to avoid a singular configuration when moving over a step, and numerical simulations and experiments show that the restricting angle differs with the step height and road shape. Scott I can change the restriction angle of the sub-crawlers by adjusting the length of the belt and stopper member. However, the restriction angle cannot be changed in real time. Therefore, a subject for future work will be a control method to set a suitable restriction angle based on the step height and road-surface shape.
Principle of traversing on simple step for crawler-type robot with passive sub-crawlers
The principle of traversing a simple step for a crawler-type robot with passive sub-crawlers is described. If the diameters of the pulleys for the sub-crawlers are the same, only a forward driving force is generated. Therefore, no upward power is generated, and the center of gravity of the main body of the robot cannot be moved above the obstacle. On the other hand, after the tip of a sub-crawler makes contact with an obstacle, a vertical force acts, and the sub-crawler is rotated upward by the larger pulley of the contact side. The robot will begin to traverse the step by increasing the driving force to a value greater than the weight of the robot itself.
The force acts vertically.
The front sub-crawlers press against the surface of the step and rotate upward.
The attitude angle of the main crawler increases.
The height of the center of gravity is higher than the objective step and moves forward from the rotational center of the rear sub-crawlers’ joint.
The front sub-crawlers and main body move over the step.
The entire robot moves over the step.
The front sub-crawlers rotate downward.
The front sub-crawlers make contact with the ground.
The rear sub-crawlers make contact with the ground, and the robot finishes moving over the step.
Necessity of warning system
Derivation of normalization energy stability margin
The length of the main crawler is l m [mm], length of the sub-crawlers is l s [mm], and radius of the pulley is r [mm].
Verification of estimated center of gravity
Examination of threshold for warning system
The timing of a warning is generated using the threshold of the NE stability margin E n (t). It is possible to prevent the robot from falling down if the operator takes appropriate action in response to the warning.
T r is defined as the reaction time of the operator and T e is defined as the reflection time for the operator’s control. The timing to give the warning should be decided in consideration of T m and the reaction time of the operator T r . The reaction time is estimated as T r =0.4 sec based on reference . The reflection time is estimated to be T e =0.1 sec in consideration of the time delay for system execution. The threshold time is determined to be T m =0.5 sec in this paper. In addition, a notice will be displayed 0.4 sec before the warning. The attention time is assigned while 0.5<T m <1.0.
Method for operation support
In the case of a robot with active sub-crawlers, the operator must appropriately control each sub-crawler’s angle in every sequence. A robot may fall down if the operator lacks adequate skill even if it is a traversable step. In addition, the difference between the traveling sequences of active and passive sub-crawlers lies in the manner in which the rear sub-crawlers are utilized. Passive sub-crawlers can only rotate using gravity; consequently, no downward power to lift the robot body is generated. Adopting passive sub-crawlers has many advantages. It can reduce the number of high-torque motors, reduce the robot weight, and save energy. The relationship between the traversing condition and the sub-crawlers’ restricting angle is reported in another paper.
Experimental operation verification using Scott I
Experimental evaluation and consideration
Each subject performed the operation nine times for these experimental cases.
In the case where the step to be traversed had an untraversable height ()we defined a misjudgment as the situation in which the robot fell down even though the subject could traverse the objective step and the robot could continue to move forward. We also defined a misjudgment as the situation in which the subject operated the robot backward upon understanding that the step to be traversed had an untraversable height.
However, the same number of experiments was performed for each step height condition. The experiments were only performed in the pitch direction at a controllable constant speed (350 mm/sec) for a sampling period of 0.1 sec.
Standard deviations for misjudgment rate
Results and discussion
First, the results for the beginners are shown in Figure 12(a). In the case of , the appropriate judgment is “move backward” because of the untraversable step height. When using only the images from the front camera (Case 1) or those from the overlooking camera (Case 2), the value of R w was high. From these results, we confirmed that when only using camera images, it is difficult for operators to respond appropriately to prevent the robot from falling down. The obstacle moves out of the camera frame whenever a robot traverses the step because the attitude angle of the robot increases. Therefore, the judgment depends on the experience of the operator. In the case of , we frequently observed the tendency of the cautious judgment to “move backward”. As a result, the misjudgment rate in the case of was smaller than the case of .
On the other hand, when using the warning system (Case 3), the value of R w was the smallest for the untraversable step height . The operators could appropriately control the robot to prevent it from falling down.
Second, in the case of , the value of R w was high under all of the experimental conditions. The “move backward” choice was considered a misjudgment because of the traversable step height. The reasons for Case 1 and Case 2 were similar in the case of . Hence, rash operations and falling down were frequently observed. The reasons for Case 3 was different. The judgment of almost all of the subjects was to “move backward,” particularly when using the proposed system. By adopting the proposed warning system, the cautious judgments increased, but rash judgments decreased. The proposed system attached importance to the capability to avoid falling down. When observing the experiments for , it seemed that some subjects were confused because the driving speed of the robot had to be controlled in the case of the limit of the traversable step . This was confirmed by the standard deviation results (, Case 3, Beginner) as listed in Table 2. The driving speed will need be considered in future work.
Finally, for the traversable step height , because the operators only had to select the simple command “Forward” in all cases, the robot was able to traverse the step. The misjudgments of the subjects were almost always “move backward” when using only images from the overlooking camera (Case 2). This result shows that increasing the information to the operator will result in more cautious judgments.
Figure 12(b) shows the experimental results for the misjudgment rate of the expert operators. This rate was smaller than that for the beginners overall. Furthermore, the value of the standard deviation is also small in the case of an expert. We confirmed that the expert operators could perform an appropriate judgments. In the case of , when using only a images from the overlooking camera (Case 2), all of the subjects avoided falling down. The subjects chose the more cautious judgment based on the experience gained in the previous experiments because Case 2 was the last to be performed. In the case of the warning system, we observed that a relatively inexperienced operator let the robot fall down.
In the case of , all of the subjects made wrong judgments for Case 2. The reason was similar to that for the beginner operators. Hence, for Case 1, the misjudgment rate for the expert operators was smaller than the case of because the obstacle did not frequently move out of the camera frame. When using the proposed system, because it was possible to adjust the movement speed, we confirmed that the high success rate was achieved by repeated stops and starts.
This paper describes a warning system for a crawler robot with passive sub-crawlers. The proposed support system for the operator could display an evaluation index for the selected route based on the NE stability margin of the robot. Experiments were performed by using Scott I to verify the proposed system. We compared the misjudgment rates between the beginner and expert operators under different experimental conditions. The experimental results demonstrated the effectiveness of the proposed system in all cases. We confirmed that the proposed system was able to stimulate a cautious judgment. Based on the experimental results, we found that it was necessary to provide suitable support based on the skill of the operator. For expert operators, it would be best for the system to provide only assistance. On the other hand, because of their lack of skill, beginner operators cannot react quickly enough to prevent the robot from falling down. Hence, in order to support a beginner operator, we think that it would be best for the system to interrupt their actions, such as through a speed-controlled system. In future work, an experiment will be performed in a real environment by using an improved system to evaluate the effectiveness of the proposed method for expert or beginner operators.
a Abbreviation for “Scouting Crawler Robot Technology”.
The authors would like to thank Sanritz Automation Co. Ltd. for the development of the computer, “TPIP”. This work was supported by a JSPS KAKENHI Grant-in-Aid for Scientific Research (B), No. 23310116.
- Koyanagi E: Rescue robot with active sub crawlers. J Robot Soc Japan 2010,28(2):147–150. 10.7210/jrsj.28.147MathSciNetView ArticleGoogle Scholar
- Ohno K, Morimura S, Tadokoro S, Koyanagi E, Yoshida T (2007) Semi-autonomous control system of rescue crawler robot having flippers for getting over unknown-steps In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems 2007, 3012–3018.Google Scholar
- Okada Y, Nagatani K, Yoshida K, Yoshida T, Koyanagi E (2010) Shared autonomy system for tracked vehicles to traverse rough terrain based on continuous three-dimensional terrain scanning In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems 2010, 357–362.Google Scholar
- Yuuki K, Ikarashi T, Oogane K (2010) Validity of passivity mechanism with rescue robots In: Proceedings of annual conference of robotics society of Japan 2010, 3–14.Google Scholar
- Kang S, Lee W, Kim M, Shin K (2005) Robhaz-rescue: Rough-terrain negotiable teleoperated mobile robot for rescue mission In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems 2010, 105–110.Google Scholar
- Teichner WH, Krebs MJ: Laws of visual choice reaction time. Psychol Rev 1974,81(1):75–98. 10.1037/h0035867View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.