Skip to content
RobotWorld
Back to Papers

PAPER DEEP DIVE

触觉感知tactile sensingOptiTac

Towards Artificial Nerves: Biomimetic Optical-Fiber Tactile Sensing for Robots

Robotic systems increasingly demand tactile sensing that approaches the adaptability and resolution of human skin to enable dexterous manipulation and safe interaction. OptiTac is a biomimetic tactile sensor that emulates the mechanoreceptor-to-nerve architecture of human touch by pairing each mechanical pin on a soft skin with an optical fiber acting as an artificial nerve. This design demonstrates an architectural principle for routing tactile information away from the sensing surface while preserving high spatial resolution, establishing a practical route toward distributed tactile sensing in future robotic systems. By treating tactile signals as images, simple analytical methods, rather than opaque deep-learning models, are used to infer contact location, size, and shape, providing interpretable and scalable tactile intelligence. This work demonstrates how evolutionary principles from biology can guide the development of artificial nerve systems for robots, offering a pathway toward human-like tactile perception in next-generation robotic platforms. More broadly, OptiTac establishes an artificial nerve-inspired sensing framework for interpretable robotic touch and a scalable route toward future distributed tactile systems.

Laura E. Butcher, Chris J. Ford, Nathan F. Lepora, Efi PsomopoulouJuly 17, 20269 min read
中文

Paper: Towards Artificial Nerves: Biomimetic Optical-Fiber Tactile Sensing for Robots
Authors: Laura E. Butcher, Chris J. Ford, Nathan F. Lepora, Efi Psomopoulou
Affiliation: School of Engineering Mathematics and Technology, University of Bristol, UK
Link: arXiv:2607.15746v1 [cs.RO], July 2026
Code: ❌ No public code released (hardware proof-of-concept paper)

1. Abstract

Robotic systems increasingly demand tactile sensing that approaches the adaptability and resolution of human skin to enable dexterous manipulation and safe interaction. This paper presents OptiTac, a biomimetic tactile sensor that emulates the mechanoreceptor-to-nerve architecture of human touch by pairing each mechanical pin on a soft skin with an optical fiber (OF) acting as an artificial nerve. The design demonstrates an architectural principle for routing tactile information away from the sensing surface while preserving high spatial resolution, establishing a practical route toward distributed tactile sensing in future robotic systems. The key insight: by treating tactile signals as images, simple analytical methods — rather than opaque deep-learning models — are used to infer contact location, size, and shape, providing interpretable and scalable tactile intelligence.

2. Background and Motivation

Human skin is a naturally-evolved tactile sensor that sets the standard for robotic systems. Research estimates approximately 230,000 mechanoreceptors distributed across the skin, with densities of 241, 81, and 58 units/cm² in fingertips, fingers, and palms respectively, compared to only 13 units/cm² in arms. Mechanoreceptors use Merkel cells and Meissner corpuscles as end organs to transduce mechanical tactile information into electrical signals. Nerves transmit tactile information away from the skin to specific spinal cord regions, and projection neurons relay these signals to the somatosensory cortex, where separate regions process information from different skin areas — down to distinct regions for individual fingers.

Pain points in existing tactile sensors:

  • Need for low-cost, soft, distributed tactile sensing;
  • Traditional vision-based tactile sensors (e.g., TacTip) place cameras directly at the sensing surface, making distributed deployment difficult;
  • Deep-learning-based tactile methods are opaque "black boxes," making feature selection unexplainable and hindering calibration, failure analysis, and sensor redesign.

OptiTac's motivation stems from biological evolutionary principles: use an optical fiber array (OFA) to replace biological nerves, physically separating tactile signals from the soft sensing interface to a remote imaging module while preserving TacTip's biomimetic mechanical transduction.

3. Core Method

3.1 Sensor Architecture: Pin-Fiber Biomimetic One-to-One Pairing

OptiTac consists of two physically separated modules:

  • Soft sensing module: Multi-material 3D-printed flat tactile skin (Agilus30 black rubber) with biomimetic pins on the inner surface; white markers on pin tips (VeroWhite). Transparent elastomeric gel (TechsiL RTA27905) injected between skin and acrylic window provides compliance and visible light transmission. An LED ring illuminates the white markers.
  • Remote imaging module: 217 plastic optical fibers (1 mm diameter, 95 mm length) arranged in a hexagonal array, held flush against the acrylic window. Fibers transmit marker-reflected light to a remote camera (3D-printed casing reduces ambient light).

Upon tactile deformation, the skin indents, pins lever, and white markers align/unalign with OFs: alignment yields high intensity output; misalignment yields low intensity. The camera captures all OF endface light intensities, reconstructing high-resolution surface plots.

Figure 1: Concept and biomimetic design of the OptiTac tactile sensor. Pins are paired one-to-one with optical fibers, emulating the mechanoreceptor-to-nerve signal transduction architecture.

3.2 Comparative Design of Three Pin Patterns

To design the optimal signal-transmitting skin, the authors fabricated three pin patterns (constant diameter and length, varying only spacing):

PatternPin Spacing5mm Ball Indent 3mm Depth Response
(i) SparseFewer pins than OFsSurface-wide intensity changes (markers entering/leaving FOV)
(ii) Dense2 mm (>1.5mm OF spacing)More localized but still larger than indenter; complex, non-intuitive pattern
(iii) Aligned one-to-oneEach pin vertically aligned with one OFLocalized negative intensity change, intuitive response

Only the aligned one-to-one pattern produced localized intensity changes — the core design choice of OptiTac, mimicking how Merkel cells/Meissner corpuscles transmit tactile information to mechanoreceptors.

Figure 3: Three pin pattern comparison. Only (iii) aligned one-to-one pattern produces localized, analytically tractable intensity changes.

3.3 Signal Processing Pipeline

Raw camera images are RGB format with large amounts of redundant data. Preprocessing pipeline:

  1. Grayscale conversion: RGB to single-channel grayscale (markers white, skin black; intensity changes only, no color change);
  2. Rotation and cropping: Remove non-OFA image pixels;
  3. OF endface localization: Template matching or brightness peak detection to locate each fiber endface pixel region;
  4. Pixel averaging: Average all pixels within each OF endface to produce a single intensity value, constructing the tactile surface plot.
flowchart LR
    A[Physical Contact
Skin Deformation] --> B[Pin Levering
White Marker Displacement] B --> C[Marker-OF Alignment Change
Light Intensity Modulation] C --> D[217 OFs Transmit Light
to Remote Camera] D --> E[RGB to Grayscale to Crop
OF Endface Localization] E --> F[Pixel Averaging
Generate Tactile Surface Plot] F --> G[Image Moment Method
Location + Width + Shape] G --> H[Calibration Surface Correction
k-d Tree + Gaussian Filter] H --> I[Output: Contact Position/Size/Shape]

3.4 Contact Localization: Image Moments

Using the physically preprocessed tactile image, image moments analytically extract contact location. Ordinary moments:

$$m_{ij}=\sum_{x}\sum_{y}x^{i}y^{j}I(x,y)$$

Contact centroid coordinates:

$$\bar{x}=\frac{m_{10}}{m_{00}}, \quad \bar{y}=\frac{m_{01}}{m_{00}}$$

3.5 Contact Width Estimation: Central Moments and Eigenvalues

Central moments (moments about the distribution mean, location-invariant):

$$\mu_{ij}=\sum_{x}\sum_{y}(x-\bar{x})^{i}(y-\bar{y})^{j}I(x,y)$$

Normalized central moments:

$$\mu_{ij}^{\prime}=\frac{\mu_{ij}}{\mu_{00}}$$

From second-order central moments, contact region eigenvalues:

$$\lambda_{1,2}=\frac{(\mu_{20}^{\prime}+\mu_{02}^{\prime})}{2}\pm\frac{\sqrt{(4\mu_{11}^{\prime 2})+(\mu_{20}^{\prime}-\mu_{02}^{\prime})^{2}}}{2}$$

Assuming Gaussian contact, full width at height $h$ (FWHM):

$$\text{FW}=\text{principle~axes}_{1,2}=2\sqrt{2\ln{h}}\sqrt{\lambda_{1,2}}$$

3.6 Contact Shape Classification: Hu Invariant Moments + GMM

Seven orthogonal invariants (Hu moments) are constructed from second- and third-order central moments for pattern recognition. The paper selects the first three Hu moments as the feature vector:

$$M1=\mu_{20}+\mu_{02}$$

$$M2=(\mu_{20}-\mu_{02})^{2}+4\mu_{11}^{2}$$

$$M3=(\mu_{30}-3\mu_{12})^{2}+(3\mu_{21}-\mu_{03})^{2}$$

After log-transform, a Gaussian Mixture Model (GMM) unsupervised clustering method classifies data points by shape.

3.7 Calibration: k-d Tree + Gaussian Filter

Initial development revealed centroid errors clustered toward the OFA center with larger errors at the periphery. Calibration procedure:

  1. Collect contact data above each OF (5mm cylindrical indenter) to obtain error distribution;
  2. Build a k-d tree indexing measured positions;
  3. Create two 1000×1000 grid meshes for x and y axes (spanning larger than OFA area);
  4. Perform nearest-neighbor search on meshes, assigning error values from nearest measured position;
  5. Apply Gaussian filter with σ=10 to smooth region boundaries and prevent overfitting;
  6. At calibration: round measured centroid to nearest grid value, subtract corresponding error.

Figure 4: Development of the contact centroid localization calibration method. k-d tree + Gaussian filter generates error surface plots, significantly reducing peripheral errors.

4. Key Experiments

4.1 Contact Centroid Localization Accuracy

An ABB IRB 120-3/0.6 robot arm performed indentations at various locations (3mm depth). Two datasets evaluated calibration:

  • "Seen" dataset: Data used to generate calibration surface plots (indentations aligned with each OF)
  • "Unseen" dataset: Incremental indentations between neighboring OFs along x/y axes
DatasetRMSENotes
Seen (calibrated)0.99Reduced by 0.26 mmGaussian filter prevents overfitting
Unseen (calibrated)0.990.4 mm (x/y axes)Validates inter-OF interpolation

Hyperacuity: Centroid measurement precision is more than 3× smaller than the spacing between neighboring pin-OF pairs — sub-millimeter localization, far exceeding the 1.5mm fiber spacing.

4.2 Comparison with Existing OFA Tactile Sensors

SensorOF SpacingMethodx RMSEy RMSE
Baimukashev et al. (2020)3.9 mmMulti-output CNN1.1 mm1.4 mm
Lu et al. (2023)3.9 mmMultiscale ResNet0.03 mm0.02 mm
OptiTac (this work)1.5 mmImage moments (analytical)~1 mm~1 mm

OptiTac achieves sub-millimeter localization with a transparent analytical pipeline, demonstrating that physically structured tactile sensing can approach useful performance without requiring end-to-end deep learning.

Figure 5: Tactile contact characterization. Calibrated centroid localization, repeatability test, and contact width estimation results.

4.3 Repeatability Test

10 indentations at each of 5 locations (5mm flat circular indenter, 3mm depth). Due to hexagonal array causing different x/y OF spacing, axes were analyzed separately:

Average centroid errors at all five locations were less than ±0.71 mm, further demonstrating hyperacuity.

4.4 Contact Width Estimation

Circular indenters from 1.85–20.09 mm diameter (Stratasys F370 printed) indented 3.0mm; major and minor axes measured. Lower bound 1.85mm limited by printer resolution; upper bound 20.09mm ensures local deformation stays within OFA bounds.

4.5 Shape Classification

Using the first three Hu moments (M1, M2, M3) as feature vector, average diagonal element value was 96%. GMM classification results:

ShapeTrue PositiveFalse PositiveF1 Score
Edge1.00
Square100%Non-zero≥0.90
Triangle100%Non-zero≥0.90

All shapes had a minimum F1-score of 0.90. Edge F1=1.00 indicates highly distinctive features. Non-zero false positives for square/triangle arise from GMM statistical clustering overlap when shapes produce similar feature distributions.

Figure 6: Contact shape classification using OptiTac. GMM clusters in Hu moment feature space are clearly separable.

5. Limitations and Future Work

  • OF endface pixel averaging loses spatial information: All pixels within each OF endface are averaged; spatial information mixed within an OF is lost. Deep-learning methods using raw OFA images retain this information.
  • Limited calibration points: Calibration collected only directly above OFs; future work will extend to arbitrary contact distributions and broader operating conditions.
  • Controlled lab conditions: Short fibers, fixed packaging. Future work must quantify robustness under longer fiber routing, repeated bending, packaging tolerances, and environmental variation.
  • Simple feature descriptors: Only Hu moments + GMM; generalizability is limited. More advanced feature descriptors could be considered for broader object generalization.
  • LED ring retained: Inherited from TacTip design for optimal lighting; future designs could remove it to further miniaturize the sensor.

6. Conclusion

OptiTac evolves the standard TacTip design by integrating a biomimetic optical fiber array (OFA), pioneering a sensor architecture that physically separates tactile information from the sensing surface to a remote imaging module. The biomimetic one-to-one pin-OF pairing enables physical pre-processing, allowing simple image moment analytical methods (rather than deep-learning black boxes) to infer contact location, size, and shape. After calibration, the sensor achieves sub-millimeter localization (R²=0.99, RMSE~0.4mm) while retaining hyperacuity; Hu moments + GMM achieve interpretable shape classification (F1≥0.90). This design principle provides a scalable, interpretable path toward future distributed robotic tactile sensing systems — using "artificial nerves" to replace biological nerves and physically decouple sensing from processing.

Tactile intelligence need not depend on opaque deep learning — when the physical structure itself performs signal pre-processing, a simple Gaussian filter and k-d tree can recover a sub-millimeter "tactile map."

Related Papers

Tac4Loco: Learning Spatiotemporal Plantar Pressure Representations for Humanoid Locomotion

Tac4Loco: Learning Spatiotemporal Plantar Pressure Representations for Humanoid Locomotion

Humanoid robots are expected to traverse complex terrains, where the plantar support may vary dramatically due to foot placement errors, ground properties, and transient dynamics. To achieve robust locomotion, the robots are required to adapt to uneven terrain and uncertain foot--ground interactions. Existing locomotion policies rely primarily on proprioception or exteroceptive terrain perception, where the former provides only indirect evidence of plantar support, while the latter predicts contact conditions before touchdown but cannot observe the actual support in real-time. Although some studies incorporate plantar contacts as an auxiliary perception, they rely mainly on summary statistics, overlooking the spatial topology of plantar pressure, which provides a more direct characterization of the realized contact state. To bridge this gap, we present Tac4Loco, a tactile-perceptive framework that incorporates multi-array plantar pressure as direct feedback for humanoid locomotion. We formulate a topology-preserving ordinal representation to map simulated and physical sensor signals into a shared observation space, with a dual-branch encoder for extracting their spatial and temporal representations. Subsequently, the learned spatiotemporal features are integrated with augmented proprioception including terrain estimation cues, and provided to an asymmetric actor-critic architecture for policy learning. Extensive simulation and real-world experiments demonstrate improved tracking performance and support adaptation on terrains with inclined, partial, asymmetric, and changing support. We further demonstrate its zero-shot deployment on unseen compliant and unstructured terrains, including a foam platform and a gravel road. All code and experimental configurations will be released as open-source to facilitate reproducibility.

人形机器人足底压力触觉感知Aug 16, 2026
BayesContact: Uncertain Pose Estimation via Visuo-Tactile Proposals and Simulation-based Inference

BayesContact: Uncertain Pose Estimation via Visuo-Tactile Proposals and Simulation-based Inference

Contact-rich manipulation requires pose estimates that are often more accurate than what depth-only sensing provides. Existing methods, relying on vision and contact, employ costly offline training procedures that need to be retrained for new environments and geometries. We propose BayesContact, a Simulation-Based Inference framework for visuo-tactile pose estimation in peg-in-hole insertion. BayesContact maintains a particle belief over object pose and fuses depth observations with force/torque-derived contact evidence. We employ simulation based forward models to approximate these observation likelihoods. For each pose hypothesis, a renderer predicts depth measurements and a physics simulator predicts contact outcomes under guarded probing actions; both are scored against real observations to update the belief. The resulting multimodal belief also enables information-gain-based probing for active disambiguation. Across simulated geometries and real-robot experiments, BayesContact improves pose observability and insertion success over vision-only inference by 30%

触觉感知tactile姿态估计Jul 17, 2026
VTLoc: Learning-based Tactile Contact Localization in Visual Point Clouds

VTLoc: Learning-based Tactile Contact Localization in Visual Point Clouds

Vision and touch are complementary modalities essential for robotic perception and manipulation. While vision provides global object context, touch offers precise local information at contact points. Integrating these modalities for contact localization, i.e., predicting the location of touch on an object's surface, poses significant challenges due to the need for accurate spatial alignment between tactile data and visual geometry. To address this challenge, we propose VTLoc, a novel visual-tactile framework that localizes contact points from tactile readings using a 3D point cloud as visual input. VTLoc introduces two key components: a geometric multi-modal alignment module, which reconstructs a pseudo-point cloud from fused visual-tactile features and aligns it with the visual point cloud to enforce spatial consistencies across modalities; and an iterative localizing updater, which iteratively refines the predicted contact location using fused visual-tactile features. Evaluated on a new benchmark of 100 real-world objects, VTLoc improves single-touch contact localization by reducing local-to-global correspondence ambiguity.

触觉感知tactile视觉Jul 17, 2026
AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning

AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning

Vision-Language-Action (VLA) models excel at end-to-end robotic manipulation but struggle with out-of-distribution (OOD) generalization when familiar sub-tasks are recombined in unseen configurations. We identify two mutually reinforcing failure modes: \emph{trajectory overfitting}, where models overfit to holistic trajectory patterns rather than compositional sub-skill semantics; and \emph{perceptual shortcut}, where action tokens over-rely on wrist-view textures at the expense of global spatial grounding. To address both, we introduce \textbf{AC-VLA}, a plug-and-play Action Compositional learning framework comprising two architecture-agnostic components: \textbf{(i)} a compositional learning module that uses an LLM-driven instruction decomposer and a proprioceptive trajectory aligner to generate dense sub-task supervision, followed by mixed training on complete demonstrations and decomposed data to endow the model with compositional generalization; and \textbf{(ii)} a state-conditioned asymmetric masking strategy that suppresses wrist-view inputs during closed-gripper phases, enforcing global semantic grounding. All components are architectural modification-free and directly integrable into any VLA backbone. Instantiated on $π_{0.5}$ and evaluated on LIBERO and LIBERO-OOD benchmarks, AC-VLA achieves a ~28% absolute improvement on compositional OOD tasks while maintaining near-perfect in-distribution performance.

触觉感知tactile仿真Jul 17, 2026