CONTENT COMPREHENSIVE FORENSIC AUDIO ANALYSIS IKAR Lab 3 Tasks solved with IKAR Lab 3 SIS 4 EdiTracker 7 Sound Cleaner 9 Caesar 10 STC - H246 11 Equipping the Modern Audio Forensic Laboratory 12 AUTOMATED VOICE DATABASES AND OPERATIVE SPEAKER SEARCH Methods of biometric features extraction and comparison 15 Voice Net 18 National voice search and information systems 22 Trawl X 24 TRAINING, THEORETICAL AND PRACTICAL SUPPORT Training courses and methodologies 27 AUDIO FORENSIC EXAMINATION AND SPEECH ENHANCEMENT Audio Forensic experience and range of tasks 29 COMPANY OVERVIEW Speech Technology Center (STC) is the world’s leading manufacturer of Audio Forensic Products. STC employs 250 staff with more than 10% having a PhD, 5 audio forensic experts with more than 5 years of practical experience. STC Audio Forensic Achievements include: 2001-2002 Submarine “Kursk” tapes investigation, restoration of more than 120 hours of information. 2003 participation in the investigation of the terrorist phone recordings at the Moscow Trade Center. Over 100 identification cases for different languages. Forensic Audio examinations for USA, Great Britain, Belgium, India, Columbia, Philippines and others. STC experts are members of Scientific Council of the Federal Forensic Expert Center of Russia, Russian Federation Justice Department Expert Group, Audio Engineering Society (AES), International Society of Air Safety Investigators (ISASI), International Speech Communication Association (ISCA), Institute of Electrical and Electronics Engineers (IEEE). Conferences and Exhibitions European Network of Forensic Science Institutes Expert Working Group Forensic Speech and Audio Analysis (ENFSI FSAAWG), International Association for Forensic Phonetics and Acoustics (IAFPA), Intelligence Support Systems (ISS), Audio Engineering Society (AES), CeBIT, SpeechTek, Milipol, Interspeech, DSA, NATIA, Safety&Security Asia. 1 COMPREHENSIVE FORENSIC AUDIO ANALYSIS IKAR Lab Professional hardware and software set for advanced audio/speech signal analysis The unique software and hardware set which ensures comprehensive forensic analysis of analog and digital records. Application Analysis of audio information in specialized laboratories and forensic science centers, research and educational institutions and companies. By Russian Federation Ministry of Justices’ order N156-2004.09.02 Speech Interactive Sys- tem of sound analysis and processing (SiS - core software of IKAR-Lab set) is included in the curriculum of State forensic examiners training. Tasks solved with IKAR Lab: Æ Speaker identification. Æ Authenticity analysis of analog or digital audio recordings. Æ Audio equipment testing and identification. Æ Analysis of noises, diagnosis of the acoustic environment and recording conditions. Æ Speech enhancement and audio restoration. Æ Text transcription of low quality recordings. IKAR-Lab includes: Æ SIS 6.x - sound analysis and editing software application. Æ Sound Cleaner Premium - professional real-time noise suppression and speech enhancement software. Æ EdiTracker - software module for authenticity analysis of audio recording. Æ Transcriber Caesar - software for fast and convenient speech documentation. Æ STC-H246 - external measuring input/output device. Æ Professional microphone and headphones. Æ Connecting cables. 3 з SIS Basic functionality 1. Signal input, segmentation and editing Æ Precise signal input with STC-H246: sampling rate up to 200 kHz, 24 bit. Æ Real-time dynamic spectrum visualization. Æ Visualization of several waveforms in one window. ÆPIC 1 Æ Signal editing functions. Æ Synchronization of several signals by means of their shifting on a definite time interval. Æ Merging of two mono signals in stereo and visa versa. Æ Various segmentations modes: Æ Temporary marks. Æ Unlimited number of permanent marks with text comments. 2. Signal visualization and analysis Æ Real multi-windows interface. Æ Different visualization modes for one or several signals: Æ Waveform. Æ Dynamic spectrogram (sonogram). Æ FFT power spectrum average. Æ Cepstrum. Æ Autocorrelation. ÆPIC 2 4 з ÆSIS Æ Fundamental frequency pitch curve. Æ LPC frequency response (Linear Prediction Coefficients). Æ Histogram. Æ Partial correlation. Æ Zero crossing frequency. Æ Presets for voice and recording channel analysis: Æ Male voice: Tenor; Baritone; Basso; ContrBasso. Æ Female voice: Soprano; MezzoSoprano; Contralto. Æ Child. Æ Microphone or telephone line. Æ Visualization of several speech signal’s characteristics in one window: Æ Dynamic formants tracks, fundamental frequency curve and spectrogram. ÆPIC 3 formants tracks fundamental frequency Æ Cepstrum and fundamental frequency curve. Æ Waveform of several signals with different sampling rates and bits. Æ Manual editing of formant tracks and fundamental frequency curve. Æ Synchronization of several windows with different visualization modes for comparative analysis. Æ Automatic search for comparable sound fragments for instrumental analysis including automatic vowels se- lecting for further formant analysis. ÆPIC 4 5 ÆSIS Æ Automatic comparison of fundamental frequency statistics with results in a text report. ÆPIC 5 3. Noise suppression and signal preprocessing Æ Built-in noise suppression filters and speech records preparation for comparative instrumental analysis. Signal before and after noise suppression: ÆPIC 6 Æ Æ 4. Additional modules (plug-ins) Æ DirectX-plug-ins of side vendors support. Æ EdiTracker module for records authenticity analysis. 6 EdiTracker The unique software for audio authenticity analysis Application Fast analysis of audio authenticity in specialized laboratories and forensic science centers. Functionality Forensic investigation of audio recordings authenticity: Æ Testing and calculating of technical characteristics of the recording device: total harmonic distortion (THD), frequency response, detonation, parasite amplitude modulation. THD calculation parasite modulation calculation ÆPIC 7 Æ Finding the traces of previous digital processing. Digital processing of analog signal leaves the traces in the signal which can be automatically detected by EdiTracker. ÆPIC 8,9 Æ Search for the traces of editing by the harmonic’s phase shift. EdiTracker automatically finds the harmonic components of the signal and investigates the continuity of the harmonics’ phase. Æ Background noise scanning - analysis of the background noise continuity. An unjustified abrupt change of its characteristics can be suggestive of previous editing. Æ Auditory analysis - detailed list of linguistic features of tampering. Æ Final report is generated automatically. 7 ÆEdiTracker Highlights Æ Automation of finding and analysis of “suspicious” spots in the recording. Æ Automation of recording device identification. Æ Visualization of all steps of analysis. Æ Automatic logging of each type of analysis and final protocol composition for the expert’s report. Æ Built-in instructions for each type of analysis. Æ Fastening of authenticity examination procedure and increasing reliability of the expert’s conclusion. Æ Practical recommendations for audio authenticity examination. 8 Sound Cleaner Professional real-time noise suppression and speech enhancement software Award of International forum “Security and Safety Technologies” Application Æ Noise suppression and enhancement of the poor quality recordings. Æ Text decoding (transcription) of the noisy recordings. Æ Audio pre-processing for identification. Æ Noise suppression while getting field data. Functionality Æ Sound input from line output and microphones or from sound files and processing. Æ Saving results in wav format. Æ Real-time noise suppression, changing filtering settings without playback stop. Æ Automatic report on sound processing for expert’s conclusion. Æ Preset schemes of noise suppression for typical cases. Æ Saving filters parameters for further usage. Æ Can be used sound editors of side vendors as a DirectX-plugin. Highlights Æ Patented methods. Æ Efficient suppression of all types of noises and distortions. Æ Adaptive to changing noises. Æ Easy to use, results are immediately hearable. Æ Filers can be combined to process the noisy record simultaneously. Æ Low quality records processing for further instrumental ID analysis: “weak” formants enhancement. Filters Sound Cleaner can be supplied as a separate product or as a part of IKAR-Lab. Æ Sound Cleaner contains 19 different modules of speech processing and enhancement: Æ 2 adaptive filters of broadband noises. Æ Parametric equalizer. Æ Harmonic filter. Æ Adaptive inverse filter. Æ Amplifier. Æ Adaptive filter of tonal noises. Æ Impulse noises filter. Æ Dynamic filter (weak signal amplifying/weakening, strong signal weakening). Æ Anti-reverberation filter. Æ Stereo signal filtering (time and frequency processing). Æ Others. Æ Practical recommendations for noise suppression and text decoding. 9 Caesar Audio transcribing software Application Verbal text transcription and text protocols of forensic audio evidences. Functionality Æ Integration of high-quality digital recorder with text editor. Æ Listening and transcription of speech information form the beginning of downloading without breaking. Æ Automatic spell check. Æ Automatic Gain Control (AGC). Æ Noise suppression mode allows getting rid of constant noises in the room. Æ Sound stretcher helps to get slowing/fastening of speech without pitch distortion. ÆPIC 10 Highlights Æ Transcription speed (compared to any common text editing tool) is significantly increased. Æ Linking audio