The ESP-WebRTC Communication Solution is Espressif’s real-time communication framework for smart devices. Based on the ESP32 series SoCs, it provides an end-to-end development framework covering on-device audio and video capture, real-time transmission, remote playback, and cloud service integration.

Architecture

ESP-WebRTC
ESP Signaling ESP-Peer Media Stream Data Channel G711A G711U OPUS H.264 MJPEG ESP Signaling ESP-Peer Media Stream Data Channel Reliable Unreliable Ordered Unordered ESP Signaling ESP Peer Media Stream Data Channel G711A OPUS G711U H.264 MJPEG ESP Signaling ESP Peer Media Stream Data Channel Reliable Unreliable Ordered Unordered
ESP-Capture ESP-Capture
AV-Render AV-Render
Video Pipeline Audio Pipeline Pictures Camera Microphone Layer Overlay Video Processing Video Encoder Rate Convert Channel Convert Bit Convert Audio Encoder AV-Render Video Pipeline Audio Pipeline Video Decoder Video Render Audio Decoder Audio Render Display Module Speaker Module Pictures Camera Microphone Video Pipeline Audio Pipeline Layer Overlay Rate Convert Channel Convert Video Processing Bit Convert Video Encoder Audio Encoder AV-Render Video Pipeline Audio Pipeline Video Decoder Audio Decoder Audio Render Video Render Display Module Speaker Module

Key Benefits

Ultra Low Latency

Ultra-Low Latency

Real-time audio, video, and DataChannel transmission for video intercom, remote monitoring, and collaborative device control.

Reliable Connectivity

Reliable Connectivity

Built-in ICE, STUN, TURN, dual ICE roles, and optimized candidate pairing, combined with DTLS-SRTP encryption and integrity protection for secure and reliable connections.

Broad Codec Support

Broad Codec Support

Supports H.264, MJPEG, Opus, G.711A, and G.711U, while carrying application control and event messages alongside media streams.

Lightweight and Efficient

Lightweight and Efficient

Multi-threaded architecture with a deeply optimized protocol stack, balancing performance, stability, code size, and resource efficiency.

Flexible Signaling Integration

Flexible Signaling Integration

Integrate with existing signaling protocols for seamless interoperability with existing systems and devices.

One-Step Integration

One-Step Integration

Unified components for PeerConnection, RTP, SCTP, signaling, media capture, and playback, enabling rapid integration, validation, and production deployment.

Development Resources

Development Resources

ESP-WebRTC SDK

The open-source ESP-WebRTC solution provides a reusable real-time audio and video foundation for smart devices. It delivers a complete real-time communication framework for ESP32 series SoCs, covering media capture, peer-to-peer connectivity, signaling, rendering and playback, and example applications, helping developers quickly complete prototype validation and product integration.

Additional Resources