Keywords
|
Fully embedded, Portable, Less weight, Single Li-ion battery for longer operation, Low power consumption, less hardware, Robust |
INTRODUCTION
|
How frequently do we meet a speechless patient in normal life? How visible are they in offices or behind shop counters? The truth is that there is often little room for these people in the workplaces. In recent years, researchers have been focusing on hand gestures detections and been popular for developing applications in the field of robotics and extended in the area of artificial or prosthetic hands that can mimic the behaviour of a natural human hand. This paper although utilizes a similar approach for the detection of the movement of fingers, however I have tried to extrapolate the idea in a slightly different perspective and have come up with a small yet significant application in the field of bioengineering. This paper is useful for the deaf and dumb, it can also be used for the (speechless) patients with half of their bodies paralysed and who are not able to speak but are able to move their fingers. The aims and objectives of this research work include [1]: |
• Basic object of this paper is to design a portable embedded system |
Developing an economical and simple solution for the detection of finger gestures |
• Cost effective, reliable data acquiring method and signal conditioning |
DATA ACQUISITION METHODS
|
To start with our research, on obtaining a bio-signal from the fingers, which require obtaining a signal proportional to the movement of the fingers? Fingers are able to interpret different hand gestures, research showed that many haptic devices used in prosthesis utilized the conventional method of using EMG signals. |
Following is the list of possible methods which could be used to sense the hand's movements [2]: (discussing each one of them in detail will be beyond the scope of this paper) |
EMG (Electromyography) |
MMG (Mechanomyogram |
Load cell |
Wearable conductive fiber |
Deterioration of fiber optic cable |
Sliding fiber optic cable |
Strain gauge tactile sensor |
Flex Sensor |
After analysing all of the above methods for signal acquisition the best solution to use flex sensor in this paper as it is comparatively reliable and a cost effective solution |
A. FLEX SENSORS
|
|
Fig.2.1. Flex Sensors [1] |
Flex sensors [3] change in resistance depending upon the amount of bend on the sensor as shown in Fig.2.1 They convert the change in bend to electrical resistance - the more the bend, the more will be the resistance value. They are usually in the form of a thin strip from 1 "-5" long that vary in resistance from approximately 10KΩ to 50KΩ. They are frequently used in gloves to sense finger movement. The flex sensors are used as input and are placed inside the glove that is to be worn. The sensor is so flexible that it bends easily even with a small bend. As it is very thin and light weight so it is also very comfortable. |
Inside the flex sensor are carbon resistive elements within a thin flexible substrate. When the substrate is bent the sensor produces a resistance output relative to the bend radius. Pragmatically deflection of 00, 200, 400, 450, 500, 700 and 900 will give 10KΩ, 14.5 KΩ, 18.8 KΩ, 20 KΩ, 21.1 KΩ, 25.5 KΩ and 30 KΩ of resistances respectively. Its relation is shown in Fig. 2.2 |
|
Fig. 2.2 Relation between Bend and Resistance |
SYSTEM MODELLING
|
A. SYSTEM BLOCK DIAGRAM AND FLOWCHART
|
|
|
B. SIGNAL CONDITIONING
|
It has been done by the circuit shown in Fig.3.2.1 Supply voltage is applied on the divider circuit having 51 KΩ resistance in series with flex sensor as load resistance. When it is bent, its resistance increases that causes increase in voltage on it which is an analog voltage change. That is fed to voltage follower; an operational amplifier (LM324, which is recommended by the flex sensor manufacturer) has been used to boost-up the circuit current, which makes it comprehensible for the PIC microcontroller to proceed further. |
|
Fig. 3.2.1 Flex Sensor Signal Conditioning Circuit [1] |
The corresponding values of graph which is output of Fig. 3.2.2 Calculations are as following: Formula for voltage divider circuit: |
|
|
|
Fig. 3.2.2 Signal Conditioning Graph (Deflection vs. Voltage) |
C. PIC18F4620
|
The output of the signal conditioning block is fed to PIC18F4620 (Operating Voltage range 4.2 - 5.5V) on PORTA and PORTE/PORTB that is used as analog input for built-in ADC (Analog to Digital Converter).. It has 10-bit built-in ADC which convert it into digital form i.e. (binary data). Similarly, it takes data from each finger and accumulates all five fingers data in five 8-bit registers, another bit-addressable register is used to store cumulative data in five bits dedicated for five fingers which consequently gives 32 combinations. Every number which is detected by hand gestures that can be seen in Table II has predefined meaning a certain 8-bit code for particular message is sent to aIVR341N block. This block can be seen in Fig. 3.1 |
D. aIVR341N
|
Aplus’ aIVR341N is a 8-bit MCU based Voice chip. It is fabricated with Standard CMOS process with embedded voice storage memory. It can store 341sec voice message with 4-bit ADPCM compression at 6KHz sampling rate. 8- bit PCM is also available as user selectable option to improve sound quality. There are up to fifteen programmable I/O pins. Key trigger and Parallel CPU trigger mode can be configured according to different application requirement. User selectable triggering and output signal options provide maximum flexibility to various applications. Built-in resistor controlled oscillator, 9-bit resolution current mode D/A output and PWM direct speaker driving minimize the number of external components. Volume control for both DAC and VOUT output is available. |
E. SIGNAL AMPLIFICATION
|
The recorded voice output from aIVR341N is not much audible to human ears therefore; it is fed to an amplifier (LM386 Y,1/4 W) that enhances its volume. It is configured at the gain of 200 that makes it quite natural to human ears; an 8Ω speaker is used to get the final output. |
III. GESTURES AND MESSAGES ACCORDINGLY
|
|
So far thirty two messages have been programmed for thirty two gestures; maximum 243 messages can be programmed as we have three bends sequence and it can be applied to five fingers but will be difficult for user to use it precisely. |
CONCLUSIONS
|
1. This paper is a useful tool for speech impaired and partially paralysed patients which fill the communication gap between patients, doctors and relatives. |
2. This paper will give dumb a voice to speak for their needs and to express their gestures. |
3. As it is portable, requires low power operating on a single lithium-ion rechargeable battery and having less weight and robust give patient liberty to carry it anywhere at their will. |
ACKNOWLEDGMENT
|
This investigation was supported by the department of Electronics & Telecommunication Engineering of Vishwabharti Academy`s College Of Engineering, Ahmednagar, University of Pune, India. |
References
|
- B. Ali, S. Munawwar, B. Nadeem, "Electroni Speaking Glove for Speechless Patients", August 2010, Bachelor of Electronic Engineering FYP Report, FEST, HIIT, Hamdard University, Karachi, Pakistan
- N. P. Bhatti, A. Baqai, B. S. Chowdhry, M. A. Unar, "Electronic Hand Glove for Speech Impaired and Paralyzed Patients", EIR Magazine, May 2009, pp. 59-63, Karachi, Pakistan
- B. B. Edin, L. Ascari, L. Beccai, S. Roccella, J. J. Cabibihan, M. C. Carrozza, "Bio-Inspired Sensorization of a Biomechatronic Robot Hand for the Graspand- Lift Task", Brain Research Bulletin, Volume 75, Issue 6, 15 April 2008, pp. 785-795 [CrossRef]
- M. Wald, "Captioning for Deaf and Hard of Hearing People by Editing Automatic Speech Recognition in Real Time", Proceedings of 10th International Conference on Computers Helping People with Special Needs ICCHP 2006, LNCS 4061, pp. 683-690
- L. K. Simone, E. Elovic, U. Kalambur, D. Kamper, "A Low Cost Method to Measure Finger Flexion in Individuals with Reduced Hand and Finger Range of Motion", 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2004 (IEMBS '04), Volume 2, 2004, pp. 4791-4794
- Jingdong Zhao, Li Jiang, Shicai Shi, HegaoCai, Hong Liu, G. Hirzinger, "A Five-fingered Underactuated Prosthetic Hand System", Proceedings of the 2006 IEEE International Conference on Mechatronics and Automation, June 2006, pp. 1453-1458
- Flex Point Inc. USA, "http://www.flexpoint.com", Last Accessed on September 06, 2010
- Magnevation SpeakJet Inc. USA, "http://www.speakjet.com", Last Accessed on September 06, 2010
|