blob: bbb4112fc01a5a41d6fd97082c93b0d1c806aac7 [file] [log] [blame] [view]
alessiobec99ebc2017-03-18 09:29:131# Conversational Speech generator tool
alessiobce0290b2017-03-03 15:31:102
alessiobec99ebc2017-03-18 09:29:133Tool to generate multiple-end audio tracks to simulate conversational speech
4with two or more participants.
alessiobce0290b2017-03-03 15:31:105
6The input to the tool is a directory containing a number of audio tracks and
7a text file indicating how to time the sequence of speech turns (see the Example
8section).
9
10Since the timing of the speaking turns is specified by the user, the generated
11tracks may not be suitable for testing scenarios in which there is unpredictable
12network delay (e.g., end-to-end RTC assessment).
13
14Instead, the generated pairs can be used when the delay is constant (obviously
15including the case in which there is no delay).
16For instance, echo cancellation in the APM module can be evaluated using two-end
17audio tracks as input and reverse input.
18
19By indicating negative and positive time offsets, one can reproduce cross-talk
alessiob82f71d62017-06-15 10:49:5720(aka double-talk) and silence in the conversation.
alessiobce0290b2017-03-03 15:31:1021
alessiobec99ebc2017-03-18 09:29:1322### Example
alessiobce0290b2017-03-03 15:31:1023
24For each end, there is a set of audio tracks, e.g., a1, a2 and a3 (speaker A)
25and b1, b2 (speaker B).
26The text file with the timing information may look like this:
alessioba541f842017-03-08 14:12:2327
28```
29A a1 0
30B b1 0
31A a2 100
32B b2 -200
33A a3 0
34A a4 0
35```
36
alessiobce0290b2017-03-03 15:31:1037The first column indicates the speaker name, the second contains the audio track
38file names, and the third the offsets (in milliseconds) used to concatenate the
39chunks.
40
41Assume that all the audio tracks in the example above are 1000 ms long.
42The tool will then generate two tracks (A and B) that look like this:
43
alessioba541f842017-03-08 14:12:2344**Track A**
45```
alessiobce0290b2017-03-03 15:31:1046 a1 (1000 ms)
47 silence (1100 ms)
48 a2 (1000 ms)
49 silence (800 ms)
50 a3 (1000 ms)
alessioba541f842017-03-08 14:12:2351 a4 (1000 ms)
52```
alessiobce0290b2017-03-03 15:31:1053
alessioba541f842017-03-08 14:12:2354**Track B**
55```
alessiobce0290b2017-03-03 15:31:1056 silence (1000 ms)
57 b1 (1000 ms)
58 silence (900 ms)
59 b2 (1000 ms)
alessioba541f842017-03-08 14:12:2360 silence (2000 ms)
61```
alessiobce0290b2017-03-03 15:31:1062
63The two tracks can be also visualized as follows (one characheter represents
64100 ms, "." is silence and "*" is speech).
65
alessioba541f842017-03-08 14:12:2366```
67t: 0 1 2 3 4 5 6 (s)
alessiobce0290b2017-03-03 15:31:1068A: **********...........**********........********************
69B: ..........**********.........**********....................
70 ^ 200 ms cross-talk
alessioba541f842017-03-08 14:12:2371 100 ms silence ^
72```