commit | 986e7451061384222b6fc6ca3110e56cda08597a | [log] [tgz] |
---|---|---|
author | Shyam Sadhwani <shyamsadhwani@fb.com> | Mon Sep 14 17:12:54 2020 |
committer | Commit Bot <commit-bot@chromium.org> | Tue Sep 15 15:54:54 2020 |
tree | 52d7d7918a8c829d1ca0c1e904e4532be78c454b | |
parent | c6dbc5ee80273699789bf384faeffeffe292a59f [diff] |
Fix for unbounded increase in audio delay when no audio packets are flowing in WebRTC’s Audio Video sync can go in unbounded loop and keep on increasing audio delay if audio packets stop coming in. The issue happens, if StreamSynchronization::ComputeDelays has: 1. relative_delay_ms = some positive value which causes avg_diff_ms_ > 30ms 2. current_audio_delay_ms < current_video_delay_ms 3. audio_delay_.extra_ms > 0 and video_delay_.extra_ms = 0 To compensate for relative delay, audio_delay_.extra_ms gets incremented every time StreamSynchronization::ComputeDelays is called by RtpStreamsSynchronizer::Process(), which happens every 1sec RtpStreamsSynchronizer::Process() will try to set the new delay to audio stream by calling syncable_audio_->SetMinimumPlayoutDelay(target_audio_delay_ms); This ends up calling DelayManager::SetMinimumDelay and update minimum_delay_ms_ But this update has no impact on the value returned by NetEqImpl::FilteredCurrentDelayMs (as there are no audio packets flowing in, hence neteq is not running) which is called next time RtpStreamsSynchronizer::Process(), runs and tried to compute the new audio delay (audio_info→current_delay_ms) This causes audio delay to be increased in every iteration and it grows unbounded. I guess it will stop growing above 10sec as that is hardcoded max delay in NetEQ. To avoid this added a check to not adjust delays when no new audio stream has come in. Bug: webrtc:11894 Change-Id: If648f9227e43c351f887d054876cb119cc1a917e Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/183340 Reviewed-by: Åsa Persson <asapersson@webrtc.org> Reviewed-by: Ivo Creusen <ivoc@webrtc.org> Commit-Queue: Shyam Sadhwani <shyamsadhwani@fb.com> Cr-Commit-Position: refs/heads/master@{#32106}
WebRTC is a free, open software project that provides browsers and mobile applications with Real-Time Communications (RTC) capabilities via simple APIs. The WebRTC components have been optimized to best serve this purpose.
Our mission: To enable rich, high-quality RTC applications to be developed for the browser, mobile platforms, and IoT devices, and allow them all to communicate via a common set of protocols.
The WebRTC initiative is a project supported by Google, Mozilla and Opera, amongst others.
See here for instructions on how to get started developing with the native code.
Authoritative list of directories that contain the native API header files.