Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor.

ABSTRACT: Human skin is capable of sensing various types of forces with high resolution and accuracy. The development of an artificial sense of touch needs to address these properties, while retaining scalability to large surfaces with arbitrary shapes. The vision-based tactile sensor proposed in this article exploits the extremely high resolution of modern image sensors to reconstruct the normal force distribution applied to a soft material, whose deformation is observed on the camera images. By embedding a random pattern within the material, the full resolution of the camera can be exploited. The design and the motivation of the proposed approach are discussed with respect to a simplified elasticity model. An artificial deep neural network is trained on experimental data to perform the tactile sensing task with high accuracy for a specific indenter, and with a spatial resolution and a sensing range comparable to the human fingertip.

SUBMITTER: Sferrazza C

PROVIDER: S-EPMC6412824 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor.

Sferrazza Carmelo C D'Andrea Raffaello R

Sensors (Basel, Switzerland) 20190222 4

Human skin is capable of sensing various types of forces with high resolution and accuracy. The development of an artificial sense of touch needs to address these properties, while retaining scalability to large surfaces with arbitrary shapes. The vision-based tactile sensor proposed in this article exploits the extremely high resolution of modern image sensors to reconstruct the normal force distribution applied to a soft material, whose deformation is observed on the camera images. By embeddin ...[more]

PMID: 30813292

Similar Datasets

Optical-Tactile Sensor for Lump Detection Using Pneumatic Control.

Project description:Soft tactile sensors are an attractive solution when robotic systems must interact with delicate objects in unstructured and obscured environments, such as most medical robotics applications. The soft nature of such a system increases both comfort and safety, while the addition of simultaneous soft active actuation provides additional features and can also improve the sensing range. This paper presents the development of a compact soft tactile sensor which is able to measure the profile of objects and, through an integrated pneumatic system, actuate and change the effective stiffness of its tactile contact surface. We report experimental results which demonstrate the sensor's ability to detect lumps on the surface of objects or embedded within a silicone matrix. These results show the potential of this approach as a versatile method of tactile sensing with potential application in medical diagnosis.

| S-EPMC8281246 | biostudies-literature

Evaluation of Nanopore Sensor Design Using Electrical and Optical Analyses.

Project description:Nanopores are currently utilized as powerful tools for single-molecule protein sensing. The reporting signal typically requires protein analytes to enter the nanopore interior, yet a class of these sensors has emerged that allows targeted detection free in solution. This tactic eliminates the spatial limitation of nanopore confinement. However, probing proteins outside the nanopore implies numerous challenges associated with transducing the physical interactions in the aqueous phase into a reliable electrical signature. Hence, it necessitates extensive engineering and tedious optimization routes. These obstacles have prevented the widespread adoption of these sensors. Here, we provide an experimental strategy by developing and validating single-polypeptide-chain nanopores amenable to single-molecule and bulk-phase protein detection approaches. We utilize protein engineering, as well as nanopore and nanodisc technologies, to create nanopore sensors that can be integrated with an optical platform in addition to traditional electrical recordings. Using the optical modality over an ensemble of detectors accelerates these sensors' optimization process for a specific task. It also provides insights into how the construction of these single-molecule nanopore sensors influences their performance. These outcomes form a basis for evaluating engineered nanopores beyond the fundamental limits of the resistive-pulse technique.

| S-EPMC10278182 | biostudies-literature

Vision-based tactile sensor design using physically based rendering.

Project description:High-resolution tactile sensors are very helpful to robots for fine-grained perception and manipulation tasks, but designing those sensors is challenging. This is because the designs are based on the compact integration of multiple optical elements, and it is difficult to understand the correlation between the element arrangements and the sensor accuracy by trial and error. In this work, we introduce the digital design of vision-based tactile sensors using a physically accurate light simulator. The framework modularizes the design process, parameterizes the sensor components, and contains an evaluation metric to quantify a sensor's performance. We quantify the effects of sensor shape, illumination setting, and sensing surface material on tactile sensor performance using our evaluation metric. The proposed optical simulation framework can replicate the tactile image of the real vision-based tactile sensor prototype without any prior sensor-specific data. Using our approach we can substantially improve the design of a fingertip GelSight sensor. This improved design performs approximately 5 times better than previous state-of-the-art human-expert design at real-world robotic tactile embossed text detection. Our simulation approach can be used with any vision-based tactile sensor to produce a physically accurate tactile image. Overall, our approach enables the automatic design of sensorized soft robots and opens the door for closed-loop co-optimization of controllers and sensors for dexterous manipulation.

| S-EPMC11828998 | biostudies-literature

Machine Learning-Enabled Tactile Sensor Design for Dynamic Touch Decoding.

Project description:Skin-like flexible sensors play vital roles in healthcare and human-machine interactions. However, general goals focus on pursuing intrinsic static and dynamic performance of skin-like sensors themselves accompanied with diverse trial-and-error attempts. Such a forward strategy almost isolates the design of sensors from resulting applications. Here, a machine learning (ML)-guided design of flexible tactile sensor system is reported, enabling a high classification accuracy (≈99.58%) of tactile perception in six dynamic touch modalities. Different from the intuition-driven sensor design, such ML-guided performance optimization is realized by introducing a support vector machine-based ML algorithm along with specific statistical criteria for fabrication parameters selection to excavate features deeply concealed in raw sensing data. This inverse design merges the statistical learning criteria into the design phase of sensing hardware, bridging the gap between the device structures and algorithms. Using the optimized tactile sensor, the high-quality recognizable signals in handwriting applications are obtained. Besides, with the additional data processing, a robot hand assembled with the sensor is able to complete real-time touch-decoding of an 11-digit braille phone number with high accuracy.

| S-EPMC10646241 | biostudies-literature

Design, Fabrication, and Characterization of a Novel Optical Six-Axis Distributed Force and Displacement Tactile Sensor for Dexterous Robotic Manipulation.

Project description:Real-time multi-axis distributed tactile sensing is a critical capability if robots are to perform stable gripping and dexterous manipulation, as it provides crucial information about the sensor-object interface. In this paper, we present an optical-based six-axis tactile sensor designed in a fingertip shape for robotic dexterous manipulation. The distributed sensor can precisely estimate the local XYZ force and displacement at ten distinct locations and provide the global XYZ force and torque measurements. Its compact size, comparable to that of a human thumb, and minimal thickness allow seamless integration onto existing robotic fingers, eliminating the need for complex modifications to the gripper. The proposed sensor design uses a simple, low-cost fabrication method. Moreover, the optical transduction approach uses light angle and intensity sensing to infer force and displacement from deformations of the individual sensing units that form the overall sensor, providing distributed six-axis sensing. The local force precision at each sensing unit in the X, Y, and Z axes is 20.89 mN, 19.19 mN, and 43.22 mN, respectively, over a local force range of approximately ±1.5 N in X and Y and 0 to -2 N in Z. The local displacement precision in the X, Y, and Z axes is 56.70 μm, 50.18 μm, and 13.83 μm, respectively, over a local displacement range of ±2 mm in the XY directions and 0 to -1.5 mm in Z (i.e., compression). Additionally, the sensor can measure global torques, Tx, Ty, and Tz, with a precision of of 1.90 N-mm, 1.54 N-mm, and 1.26 N-mm, respectively. The fabricated design is showcased by integrating it with an OnRobot RG2 gripper and illustrating real-time measurements during in simple demonstration task, which generated changing global forces and torques.

| S-EPMC10748078 | biostudies-literature

Full Soft Capacitive Omnidirectional Tactile Sensor Based on Micro-Spines Electrode and Hemispheric Dielectric Structure.

Project description:Flourishing in recent years, intelligent electronics is desirably pursued in many fields including bio-symbiotic, human physiology regulatory, robot operation, and human-computer interaction. To support this appealing vision, human-like tactile perception is urgently necessary for dexterous object manipulation. In particular, the real-time force perception with strength and orientation simultaneously is critical for intelligent electronic skin. However, it is still very challenging to achieve directional tactile sensing that has eminent properties, and at the same time, has the feasibility for scale expansion. Here, a fully soft capacitive omnidirectional tactile (ODT) sensor was developed based on the structure of MWCNTs coated stripe electrode and Ecoflex hemisphere array dielectric. The theoretical analysis of this structure was conducted for omnidirectional force detection by finite element simulation. Combined with the micro-spine and the hemispheric hills dielectric structure, this sensing structure could achieve omnidirectional detection with high sensitivity (0.306 ± 0.001 kPa-1 under 10 kPa) and a wide response range (2.55 Pa to 160 kPa). Moreover, to overcome the inherent disunity in flexible sensor units due to nano-materials and polymer, machine learning approaches were introduced as a prospective technical routing to recognize various loading angles and finally performed more than 99% recognition accuracy. The practical validity of the design was demonstrated by the detection of human motion, physiological activities, and gripping of a cup, which was evident to have great potential for tactile e-skin for digital medical and soft robotics.

| S-EPMC9313071 | biostudies-literature

Optical Micro/Nanofiber Enabled Multiaxial Force Sensor for Tactile Visualization and Human-Machine Interface.

Project description:Tactile sensors with capability of multiaxial force perception play a vital role in robotics and human-machine interfaces. Flexible optical waveguide sensors have been an emerging paradigm in tactile sensing due to their high sensitivity, fast response, and antielectromagnetic interference. Herein, a flexible multiaxial force sensor enabled by U-shaped optical micro/nanofibers (MNFs) is reported. The MNF is embedded within an elastomer film topped with a dome-shaped protrusion. When the protrusion is subjected to vector forces, the embedded MNF undergoes anisotropic deformations, yielding time-resolved variations in light transmission. Detection of both normal and shear forces is achieved with sensitivities reaching 50.7 dB N-1 (14% kPa-1) and 82.2 dB N-1 (21% kPa-1), respectively. Notably, the structural asymmetry of the MNF induces asymmetrical optical modes, granting the sensor directional responses to four-directional shear forces. As proof-of-concept applications, tactile visualizations for texture and relief pattern recognition are realized with a spatial resolution of 160 µm. Moreover, a dual U-shaped MNF configuration is demonstrated as a human-machine interface for cursor manipulation. This work represents a step towards advanced multiaxial tactile sensing.

| S-EPMC11615745 | biostudies-literature

Behavioral biometric optical tactile sensor for instantaneous decoupling of dynamic touch signals in real time.

Project description:Decoupling dynamic touch signals in the optical tactile sensors is highly desired for behavioral tactile applications yet challenging because typical optical sensors mostly measure only static normal force and use imprecise multi-image averaging for dynamic force sensing. Here, we report a highly sensitive upconversion nanocrystals-based behavioral biometric optical tactile sensor that instantaneously and quantitatively decomposes dynamic touch signals into individual components of vertical normal and lateral shear force from a single image in real-time. By mimicking the sensory architecture of human skin, the unique luminescence signal obtained is axisymmetric for static normal forces and non-axisymmetric for dynamic shear forces. Our sensor demonstrates high spatio-temporal screening of small objects and recognizes fingerprints for authentication with high spatial-temporal resolution. Using a dynamic force discrimination machine learning framework, we realized a Braille-to-Speech translation system and a next-generation dynamic biometric recognition system for handwriting.

| S-EPMC11393463 | biostudies-literature

Computational optical palpation: a finite-element approach to micro-scale tactile imaging using a compliant sensor.

Project description:High-resolution tactile imaging, superior to the sense of touch, has potential for future biomedical applications such as robotic surgery. In this paper, we propose a tactile imaging method, termed computational optical palpation, based on measuring the change in thickness of a thin, compliant layer with optical coherence tomography and calculating tactile stress using finite-element analysis. We demonstrate our method on test targets and on freshly excised human breast fibroadenoma, demonstrating a resolution of up to 15-25 µm and a field of view of up to 7 mm. Our method is open source and readily adaptable to other imaging modalities, such as ultrasonography and confocal microscopy.

| S-EPMC5378127 | biostudies-literature

Sim-to-Real for High-Resolution Optical Tactile Sensing: From Images to Three-Dimensional Contact Force Distributions.

Project description:The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in the images is challenging and often addressed with learning-based approaches, which generally require a large amount of training data. This article proposes a strategy to generate tactile images in simulation for a vision-based tactile sensor based on an internal camera that tracks the motion of spherical particles within a soft material. The deformation of the material is simulated in a finite element environment under a diverse set of contact conditions, and spherical particles are projected to a simulated image. Features extracted from the images are mapped to the three-dimensional contact force distribution, with the ground truth also obtained using finite-element simulations, with an artificial neural network that is therefore entirely trained on synthetic data avoiding the need for real-world data collection. The resulting model exhibits high accuracy when evaluated on real-world tactile images, is transferable across multiple tactile sensors without further training, and is suitable for efficient real-time inference.

| S-EPMC9595648 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data