Friction and noise suppression for force control system based on integration of observer and force sensor information

Measuring and controlling external force from the environment and human beings are essential to realize the future application of the robot systems for medical, nursing, and personal support systems. This paper proposes a friction and noise suppression for force control system based on the integration of the reaction torque observer and force (torque) sensor information. The proposed method performs external force estimation by integrating the lowfrequency component information of the force sensor and the high-frequency component of the force information estimated by reaction torque observer (RTOB). By using the low-frequency component of the force sensor, the effect of static friction can be suppressed, and the high-frequency part of RTOB can be used to attenuate the noise component. As a result, the performance of the force control system can be enhanced. The proposed method is evaluated through the experiments of the force control and bilateral control as a position/force hybrid control.


Introduction
Recently, torque/force control systems used for the realization of contact motions have been widely researched [1][2][3]. Measuring and controlling external force from the environment and human beings are essential to realize the future application of the robot systems for medical, nursing, and personal support systems. The reaction torque/force control is required for precise control, when contacting delicate objects, and to interact with human beings in open environments. In particular, robust torque/force control systems based on acceleration controllers that use disturbance observers (DOBs) [4,5] have been developed as effective controllers [6,7]. Additionally, senseless torque/force control can be achieved by combining these with reaction force observers (RTOBs) [8][9][10]. The superiority of the observer-based force control system over the force sensor-based system is reported by [11]. Acceleration-based reaction torque control can be applied to many control systems, such as bilateral teleoperation systems [12] and human motion imitation, by using a motion-copying system [13,14]. However, RTOB requires a modeling and compensation of friction torque to estimate the external force [5,8,9]. Compensation for friction torque is a general problem in force control, not limited to RTOB-based techniques [15][16][17]. The modeling and identification methods have been proposed in the literature [18][19][20]. However, the detailed and accurate modeling and identification of the friction torque, especially Coulomb friction, is challenging to achieve. Although compensation methods have been reported to reduce the influence of friction by introducing a mechanism such as a twin drive system [21] or a non-contact magnetic gear [22], it leads to an increase in size and complexity of the system. Although the utilization of a direct drive (DD) motor is conceivable to avoid friction due to the reduction gear, the output torque of the DD motor is usually smaller than that of the geared motor. The utilization of force sensors, however, is sensitive to noise and limit the bandwidth of the force control system by implementing a low-pass filter to suppress the noise. As described above, the RTOB-based force control has a problem due to friction. Also, the force sensor-based method has a problem in bandwidth limitation of force sensing due to noise.
Therefore, the purpose of this paper is to suppress both the friction of the geared motor and the noise of the force sensor, simultaneously. To achieve this purpose, this paper proposes a method for estimating external force by taking advantage of both RTOB and force sensor. The proposed method uses the low-frequency component of the force sensor to suppress the effect of friction and uses the high-frequency component of the estimated external force by RTOB to suppress the effect of noise of the sensor. This paper also proposes a force control system using the force estimation method integrating these two force information. The proposed force control system is also applied to bilateral control, which is a position/force hybrid control. The proposed method improves the disturbance (friction) suppression characteristics compared to the RTOB-based method and improves the noise sensitivity compared to the force sensor-based method.

Related work and the proposed method
This section describes much more detailed technical aspects with the conventional work for the external force estimation/measurement and the proposed method.

Force control with force sensor
Force sensors are used to measure the external force information. The force sensor can measure only the external force of the contacting part. A DOB-based force control system combined with a force sensor can be constructed [23,24]. The force sensor-based force control system has a problem of deterioration of the performance due to sensor-noise [7]. If a low-pass filter is used to suppress the noise of force sensor, however, the limited force measurement bandwidth leads to deterioration of the control performance. The phase lag due to the LPF also leads to deterioration of the stability [7]. Force measurement methods combined with Kalman filter techniques have been developed to reduce the noise effect. To address reducing a noise effect, force-measurement methods combined with Kalman filter techniques have been developed [25][26][27]. However, Kalman filter-based methods require a precise control plant model and analysis for noise characteristics.

Force control with external torque estimation by RTOB
The RTOB have been developed to realize force sensor-less force control system. The RTOB estimate the external torque by using an actuator torque, an angular acceleration information, and an modelled (identified) friction torque [5,8,9]. If the resolution of the position encoder of the actuator is sufficiently high, the noiseeffect appears in the estimated force is can be neglected because the angular acceleration information is calculated from the position information. If the RTOB applied to the geared motor, friction torque due to the reduction gear should be considered. Modeling and identification of the friction torque are necessary to subtract the friction torque component from the total disturbance torque. Friction torque is usually modeled as viscous friction and Coulomb friction [8,9]. However, it is difficult to model and identify accurate friction, especially in the low-speed region. On the other hand, much more detailed friction models considering the sigmoid function and Stribeck friction have been proposed [18,28]. Also, a method has been proposed to identify the friction torque by using an simulated annealing method [29] or an on-line least mean square error algorithm (RLMS) [9]. However, if a detailed model is constructed, the number of parameters to be identified increases, and the design procedure becomes complicated. Also, It is challenging to know the actual friction torque information, no matter how detailed the model is. The identification error of the friction directly acts as a disturbance in the force control system. For example, the identification error of the Coulomb friction acts on the system as a step disturbance as follows: Here, τ coul , τ coul , and �τ coul represent the actual Coulomb friction, the identified Coulomb friction, and the identification error of Coulomb friction, respectively, which are all constants. Further, although no external force is received, the identification error of the frictional force is erroneously detected as the external force. Also, if a human operates an actuator as in bilateral control, the identification error of the frictional force appears as an operating force. Therefore, the friction force degrades the operability (back drivability) of the system.

Overview of the proposed external force estimation
As described above, the force sensor-based force control system is affected by force-sensor noise. On the other hand, the RTOB-based force control system has difficulties in compensating the friction force. In order to address these problems, this paper proposes a novel external force estimation method utilizing the both advantages of the force sensor and RTOB. The conceptual figure of the proposed method is shown in Fig. 1. The proposed external force estimation method is composed of two elements: a low-frequency component of the force information measured by a force sensor and a (1) τ coul −τ coul = �τ coul high-frequency component of the force information estimated by RTOB. The proposed method requires only the viscous friction model and its identified value. By using the low-frequency component of the force information, the proposed method can estimate the accurate external force information with suppressing noise. Also, the proposed method can obtain the external force information in the high-frequency domain by RTOB with suppressing Coulomb friction because the Coulomb friction can be regarded as a step disturbance. As a result, the proposed method realizes friction and noise suppression simultaneously.
As an application of the proposed method, accurate and high-output force control by geared motors is considered. Also, the proposed method can be applied to the bilateral control system composed of geared actuators with high-output force and high back-drivability.
Here, the assumptions and limitations of the proposed method in this paper are described below. This paper assumes that only the friction torque and external torque are considered as the disturbance torque (force) added to actuators for the simplicity. The disturbance torque due to the modeling errors of the torque coefficient and motor inertia, and gravitational torque is assumed to be negligibly small. As a limitation of the proposed method, the resolution of the position encoder needs to be sufficiently high. This is because external force estimation requires acceleration information obtained by differentiating position information. Unless the noise level due to the RTOB is lower than the noise level of the force sensor, the effect of the proposed method will be little. However, since a high encoder resolution is required for accurate disturbance estimation as well as external force estimation, it is not the particular case that a high-resolution encoder is implemented to the proposed method. Further, by equipping a reduction gear, it is possible to improve the equivalent position-resolution of the output axis, which is suitable as an application of the proposed method.

Force control system based on DOB
This section describes force control systems based on DOB [4,[6][7][8]. First, an acceleration controller to realize robust control system by using DOB is explained. Next, a force control system using a disturbance observer and force sensor is described. The force control system using DOB and RTOB is also explained.

Acceleration controller based on DOB
The motion equation of the force control system with a geared motor is represented as follows: where q, ω , τ , I, J G K tG , D G , superscript ref, load, ext and coul represent the angle, angular velocity, torque, current, inertia, torque constant, viscous coefficient, reference value, load torque, external torque, and Coulomb friction, respectively. The inertia, torque constant and viscous coefficient represent values converted from the motor side values (J, K t and D) to the output side by using gear ratio as J G = G 2 r J , K tG = G r K t and D G = G 2 r D . The external torque is modeled below.
In (4), s, Z e (s) , D e , and K e represent a Laplace operator, environmental impedance, viscous coefficient and spring constant of the environment. Eq. (2) is rewritten by considering modeling error with respect to the variation from the nominal value as follows: where represents a modeling error. From (6), the disturbance torque is defined by including the torque caused by the modeling error in the load torque shown in Eq. (3) as follows: By using the disturbance torque, (6) is rewritten below. Equation (9) means that the disturbance torque can be calculated by using reference torque and angular acceleration information. From (9), the disturbance torque is estimated by inserting a Low-pass filter to suppress noise in the high-frequency domain, as follows [6][7][8]: where • , G dis l (s) , g dis l , g pd l , and subscript n represent an estimated value, low-pass filter (LPF), cut-off frequency of DOB and pseudo differentiation, and a nominal value, respectively. The motion Eq. (8) is rewritten by adding the estimated disturbance τ dis in reference torque for canceling disturbance as follows: where a ref and subscript h represent an acceleration reference and a high-pass filter, respectively. From Eq. (15), the following equation is obtained if the bandwidth of the DOB is sufficiently high.
As shown in (18), the acceleration response coincides with the acceleration reference, and the robust acceleration controller is realized.

Force control based on force sensor
Based on (18), the force control system based on force sensor/RTOB is described in the following part.
The acceleration reference of the force sensor-based force control is described as follows: where J f , w, G ext l (s) , superscripts sen and cmd represent a virtual inertia (an inverse of force control gain), sensor noise, LPF for force sensing, sensor value, and command value, respectively. As shown in the above equations, the force sensor based force control system is affected by the force sensor noise. The noise can be suppressed by setting the bandwidth of the LPF lower value. However, the performance and stability of the force control system are deteriorated if the bandwidth of LPF is reduced [7].

Force control based on RTOB
The external torque can be estimated by applying the structure of the DOB. The external torque is estimated by subtracting the identified friction torque element from (10), as follows: In this paper, the modeling error of the inertia and the torque constant are assumed to be negligibly small. Additionally, the noise caused by differentiation of position information, including quantization error, is also assumed to be negligibly small. By using the estimated external torque, the motion equation and external torque response of the RTOB-based force control with DOB are described as follows: As shown in (26), the force control system based on RTOB is affected by modeling error of the coulomb friction and viscous friction. Especially, the precise modeling of the coulomb friction is difficult.

Proposed external torque system based on integration of the force sensor and RTOB
As shown in the last section, the force control system is affected by the force sensor noise or modeling error of the friction torque. This section describes the proposed force control system based on the integration of the force sensor and RTOB. The proposed method can simultaneously achieve suppressing the force sensor noise and reducing the effect of modeling error of friction torque.

Structure of the proposed external torque estimation
The Coulomb friction can be assumed to exist in the lower frequency domain, and the sensor noise can be considered to exist in the higher frequency domain. Therefore, the proposed method effectively uses the high-frequency component of RTOB and the low-frequency component of the force sensor.
The higher frequency domain of the external torque is extracted by using RTOB-based structure as follows: where G I h (s) and g I represent the high-pass filter and its bandwidth for the integration of the force sensor and RTOB information. As shown in (27), the proposed method uses only the model of the viscous coefficient as the model of friction.
On the other hand, the low-frequency component of the external torque is obtained by using LPF G I l (s) described below.
A summation of Eqs. (28) and (30) are shown below: From Eq. 33, the external torque can be estimated through LPF G ext l (s) as follows: Figure 2 shows the block diagram of the proposed method based on (34). As shown in (35), the friction torque in RTOB information and force sensor noise are suppressed by G ext l (s)G I h (s) and G ext l (s)G I l (s) , respectively. As a result, the external torque is estimated through the LPF G ext l (s) . Figure 3 shows the bode diagrams of the external torque estimation with respect to proposed method G ext l (s) , information from RTOB G ext l (s)G I h (s) , and force sensor information G ext l (s)G I l (s).
Application to force control system Figure 4 shows the force control system based on the proposed method. From Fig. 4 the motion equation of the proposed method is described below.
From (36), the response of the external torque is derived as follows: Because the friction torque and sensor noise are suppressed by the G ext l (s)G I h (s) and G ext h (s)G I l (s) and the inertia torque J f s 2 q converges to zero in a steady-state, the external torque response converges to the command torque as follows: As a result, the performance of the force control system is improved by the proposed method.

Application to the bilateral control system
The proposed external torque estimation is applied to the bilateral control system as one of the position/ force hybrid control [12][13][14]. By applying the proposed (36) method, the operability of the bilateral control system can be improved because friction torque which behaves as an operational torque can be compensated. The control goals of bilateral control are described as follows: where subscripts m, s, X, and F represent a master system, a slave system, variables of the position control, and the force control, respectively. The control goal of force control represents the realization of the law of action and reaction. On the other hand, the control goal of the position control represents the synchronization of master and slave position. The acceleration reference vector a ref for the bilateral control system is obtained by using the inverse transformation matrix of T as follows [12][13][14]: where C p (s) = K v s + K p represents a PD controller of position control system. Figure 5 shows the block diagram of the bilateral control system with the proposed method.

Analysis
This section describes the performance and stability analysis of the proposed method. The frequency characteristics of the response characteristics, the disturbance suppression performance, and the noise sensitivity are analyzed. Additionally, the stability with the variation of design parameters is analyzed from the viewpoint of root locus. Table 1 lists the parameters used in the analysis.
(41)   Fig. 6 Bode diagram of the transfer functions from command torque to output external torque sensor-based method with the same LPF for the torque sensor as the proposed method ( G ext l (s)G I l (s) ). As shown by the figure, the bandwidths of these methods are almost same. However, the peak value in the gain diagram of the proposed method is smaller than that of the force sensorbased methods. Additionally, it can be found that the proposed method and the RTOB-based method show similar response characteristics in both gain and phase characteristics. Figure 7 shows the bode diagram of the transfer functions from load torque to output torque. It is found that the RTOB-based method cannot attenuate the lowerfrequency component of the load torque. Therefore, the friction torque should be identified precisely. Conversely, Fig. 7 shows that the proposed method can suppress the lower-frequency component of the load torque including the friction torque without its identification. However, the force sensor-based method does not use the highfrequency components of the RTOB, so that the disturbance suppression characteristics are higher than that of the proposed method. However, the force sensor-based method also has a peak value in the disturbance response characteristics. Also, it is found that disturbance beyond the band of external force estimation (1200 rad/s in this case) is suppressed. Figure 8 shows the bode diagram of noise sensitivity with respect to the force sensor-based methods and the proposed method. As shown in the figure, the noise suppression performance of the proposed method is better than that of the force sensor-based method. On the other hand, the force sensor-based method with the same LPF as the proposed method ( G ext l (s)G I l (s) ) also improves the noise suppression performance. However, the response characteristics of this method deteriorate compared to the proposed method as shown in Fig. 6. Figure 9a shows the bode diagram of the response characteristics in the proposed method with the variation of g I from 100 to 1100 rad/s. This figure shows that the bandwidth variation for sensor and RTOB integration has almost no effect on the bandwidth of response characteristics, though the peak value of the gain diagram is increased. Figure 9b shows the bode diagram of the disturbance suppression characteristics with the variation of g I . From Fig. 9b, it can be confirmed that the disturbance suppression characteristics improve as g I increases. In contrast, Fig. 9c shows that noise sensitivity increases as g I increases. From these results, there is a trade-off between the load torque (friction torque) suppression and noise sensitivity in the proposed method.
The above performance comparison is summarized as follows: • The proposed method not only has the same response characteristics as the RTOB-based method but also can compensate for the Coulomb friction torque without identification. • The noise suppression characteristics of the proposed method are superior to the force sensorbased method. • There is a trade-off between the noise suppression performance due to the force sensor and the friction-torque suppression performance, depending on the bandwidth g I .
From the above, the proposed method can suppress the effects of friction torques while suppressing noise due to the force sensor if the noise due to the reaction force estimation using the position information is sufficiently  Figures 10 and 11 show the root locus for variation of sensor and RTOB information integration bandwidth g I and the root locus for variation of sensor and RTOB bandwidth g ext . These figures represent that g I and g ext do not affect the stability. Figure 12 shows the root locus for variation of the bandwidth of DOB g dis . As shown in the figure, the proposed system becomes unstable if the g dis is set larger than 13,000 rad/s. In practical cases, however, the acceleration control system works well even if g dis is set to a lower value than that value.   Figure 13 shows the root locus for variation of the modeling error about viscous coefficient of the actuator. The modeling error is expressed by error ratio α as D n = αD ( α > 0 ). As shown in the figure, the proposed system becomes unstable if the α is larger than about 6.6. From this result, it is found that the nominal value should be set a smaller if the model of the viscosity is uncertain.

Experiments
This section describes the experiments for the evaluation of the proposed method. The proposed method, force sensor-based method, and RTOB based method are compared in the force control system and bilateral control system. Figure 14 shows the experimental setup. The single DOF geared motor shown in Fig. 14a is used for experiments of the force control, and for the slave system in bilateral control. The  Fig. 14b is used for the master system in the bilateral control experiment. In this experiment, the friction inside of the DD motors is assumed to be negligibly small. Therefore, external torque added to the master system is estimated only by using an RTOB. The parameter variation of the motor inertia and torque constant from nominal value also assumed to be negligible in this experiment.

Experimental setup
The actuators are controlled by a desktop computer with Linux both in the force control and bilateral control experiments. The angle information of the actuators is measured by the position encoder and obtained through a pulse counter. The q-axis current references are calculated in the computer and the reference value is inputted to servo drivers for the DD motors through a DA converter.
A six-axis force sensor (PFS055YA251G6, Leptrino Inc.) with an amplifier module is mounted at the tip of the arm in the geared motor shown in Fig. 14a. The rated force of the sensor is ± 250 N and its resolution is 1/2000. The output voltage of the force sensor is taken into the computer via an AD converter and converted into a force dimension. The value of the external torque is obtained by multiplying the value of one axis of the force sensor by the length of the slave arm l s as τ sen = l s G ext l (s)F ext . In this paper, the only one-degree-of-freedom operation is dealt with for simplicity. However, the proposed method can be applied without problems to a multi-degree-of-freedom system by considering the Jacobian matrix and homogeneous transformation matrix of the manipulator. As for the case of multi-degree-of-freedom manipulator control in the workspace, the proposed method is applied by integrating the force information converted from the external torque estimated by RTOB in the joint space into the workspace and the information of the force sensor.
A box which is shown in Fig. 14a is used as an environment. The geared motor performs contact motions with the environment both in the experiments of force control and bilateral control. In the bilateral control experiment, a human operator moves the master arm and performs free motions and contact motions.
This part also explains the procedures for obtaining the friction characteristics. In this paper, the viscous coefficient and Coulomb friction are assumed to be constant values. From (2) and (3), if the step current I ss signal is inputted to the actuator, the response of the motor side of the actuator in a steady state is described below.
(43) where superscript ss and subscript M represent a steady-state variable and a motor-side variable, respectively. From (43), the relationship between the motor torque, motor angular velocity, and Coulomb friction is expressed as follows: From (44), the viscous coefficient and coulomb friction modeled as constant values are obtained by the leastsquares method using the step motor torque (current) and the angular velocity information. Figure 15 shows the identification result of the friction torque. The friction is identified by using the data represented by the filled circles in Fig. 15. As for the angular-velocity information, average values for 2.5 s are used as a steady-state value. The identified friction torque is described as follows: Table 2 lists the parameters used in the experiments. The other parameters are the same as those listed in Table 1. Figure 16a shows the experimental result of the forcesensor based force control. As shown in the figure, a hunting phenomenon is observed in the transient state. This figure represents that the force sensor-based force controller is difficult to achieve stable contact motions in this condition. Figure 16b shows the experimental result of the RTOBbased force control. As shown in the figure, the reason why the output of RTOB is generated even though the value of the force sensor is almost zero is that the value of the friction torque is outputted. These results show that the RTOB-based method cannot move because of the influence of friction.

Experimental results of force control
Conversely, Fig. 16c represents that the proposed method achieves noise suppression and friction compensation simultaneously. As a result, the proposed method can achieve stable contact motions. The shaded area in Fig. 16c shows the step-wisely response. The indicated torque corresponds to the friction torque that could not be compensated because the bandwidth of the sensor and observer integration g I is finite. If the band for the integration can be increased, the remained friction torque can be compensated. Also, if the command torque has a larger value, the effect of remained friction torque becomes relatively small. However, increasing this bandwidth means that the influence of the noise from the force sensor also increases. This is because of the tradeoff relationship shown in Fig. 9b, c.

Experimental results of bilateral control
Figure 17a-c show the experimental results of bilateral control system based on RTOB, force sensor, and the proposed method, respectively. In order to make the results easier to see, the external torque on the master side is inverted and displayed in these figures. Figure 17a shows that the human operator cannot perform both of the free motions and contact motions due to the large operational torque caused by the identification error of the friction torque.
On the other hand, the force sensor-based method and the proposed method achieves both of the free motions and contact motions with realizing the law of action and reaction as shown in Fig. 17b, c. As suggested in Fig. 7, the operational torque generated during free motion due to the frictional torque is larger in the proposed method than in the force sensor-based method. However, it is clear that the proposed method attenuates the friction torque much more than the RTOB-based method.
As shown in Fig. 18a, the torque response of force sensor-based method is oscillating due to the sensor noise and the resulting position response is also vibrating.   Conversely, Fig. 18b shows that the proposed method achieves noise suppression and stable contact motions compared with the force sensor-based method. The above results show the validity of the effectiveness of the proposed method.

Conclusion
This paper proposed a force control system by using an external-force estimation method based on the integration of RTOB and force sensor information. The conventional force control system by using a force sensor has difficulty in extending control bandwidth due to forcesensor noise. On the other hand, the RTOB-based force control system also has difficulty in the modeling, identification, and compensation of the friction torque (force), especially for the coulomb friction. Conversely, the proposed method achieves improving the friction torque (force) suppression performance and the noise sensitivity compared to the force-sensor based method and RTOB-based method, respectively. The proposed method can improve the friction torque suppression performance by utilizing the low frequency-component of the force sensor. Additionally, the proposed method succeeds in improving the sensitivity to noise from the force sensor by using the high-frequency component of the estimated force by RTOB. The proposed external torque estimation method was applied to a force control system and a bilateral control system. The experimental results showed the validity of the proposed method.
As a future subject, the combination of the proposed estimation method with the Kalman filtering technology should be considered to achieve further improvement of the noise sensitivity in the case with the relatively lowresolution encoder. In addition, a detailed analysis of the relationship between the limitation of the integration bandwidth and the resolution of the position encoder should be addressed, though the integration bandwidth was determined by try and error in this paper.