Update multiplex encoder to support having augmenting data attached to the video

Multiplex encoder is now supporting attaching user-defined data to the video
frame. This data will be sent with the video frame and thus is guaranteed to
be synchronized. This is useful in cases where the data and video frame need
to by synchronized such as sending information about 3D objects or camera
tracking information with the video stream

Multiplex Encoder with data is implemented in a modular way. A new
VideoFrameBuffer type is created with the encoder. AugmentedVideoFrameBuffer
holds the video frame and the data. MultiplexVideoEncoder encodes both
the frame and data.

Change-Id: I23263f70d111f6f1783c070edec70bd11ebb9868
Bug: webrtc:9632
Reviewed-on: https://webrtc-review.googlesource.com/92642
Commit-Queue: Tarek Hefny <tarekh@google.com>
Reviewed-by: Niklas Enbom <niklas.enbom@webrtc.org>
Reviewed-by: Emircan Uysaler <emircan@webrtc.org>
Cr-Commit-Position: refs/heads/master@{#24297}
12 files changed
tree: 3ff4238686471bd142f35dfc9605057ac459cc19
  1. .clang-format
  2. .git-blame-ignore-revs
  3. .gitignore
  4. .gn
  5. .vpython
  6. AUTHORS
  7. BUILD.gn
  8. CODE_OF_CONDUCT.md
  9. DEPS
  10. LICENSE
  11. OWNERS
  12. PATENTS
  13. PRESUBMIT.py
  14. README.chromium
  15. README.md
  16. WATCHLISTS
  17. api/
  18. audio/
  19. build_overrides/
  20. call/
  21. codereview.settings
  22. common_audio/
  23. common_types.h
  24. common_video/
  25. data/
  26. examples/
  27. infra/
  28. license_template.txt
  29. logging/
  30. media/
  31. modules/
  32. native-api.md
  33. ortc/
  34. p2p/
  35. pc/
  36. presubmit_test.py
  37. presubmit_test_mocks.py
  38. pylintrc
  39. resources/
  40. rtc_base/
  41. rtc_tools/
  42. sdk/
  43. stats/
  44. style-guide.md
  45. style-guide/
  46. system_wrappers/
  47. test/
  48. tools_webrtc/
  49. video/
  50. webrtc.gni
  51. whitespace.txt
README.md

WebRTC is a free, open software project that provides browsers and mobile applications with Real-Time Communications (RTC) capabilities via simple APIs. The WebRTC components have been optimized to best serve this purpose.

Our mission: To enable rich, high-quality RTC applications to be developed for the browser, mobile platforms, and IoT devices, and allow them all to communicate via a common set of protocols.

The WebRTC initiative is a project supported by Google, Mozilla and Opera, amongst others.

Development

See http://www.webrtc.org/native-code/development for instructions on how to get started developing with the native code.

Authoritative list of directories that contain the native API header files.

More info