flutter + webrtc => python + aiortc + opencv

This demo project should help you to get setup sending a video feed from a flutter app to a python backend to allow you to then perform some image processing on the video frames using OpenCV.

Running the server

First install the required packages:

$ cd server

$ pip install -r requirements.txt

When you start the example, it will create an HTTP server that you can connect to from your browser:

$ cd server

$ python main.py

You can then browse to the following page with your browser:

http://localhost:8080

Once you click Start the browser will send the audio and video from its webcam to the server.

The server will play a pre-recorded audio clip and send the received video back to the browser, optionally applying a transform to it.

In parallel to media streams, the browser sends a ‘ping’ message over the data channel, and the server replies with ‘pong’.


Additional options

If you want to enable verbose logging, run:

$ cd server

$ python server.py -v

Running the server in docker

If you have docker setup, run:

$ cd server

$ docker build -t aiortc_server .

$ docker run -p 8080:8080 -it –rm aiortc_server

You can then browse to the following page with your browser:

http://localhost:8080

Setting up flutter

First, install the required packages.

Now you will need to update the /offer path to point to your local python server.


Download Flutter WebRTC source code on GitHub

Flutter WebRTC demo with Python server to perform image processing on video frames using OpenCV
https://github.com/jcrisp88/flutter-webrtc_python-aiortc-opencv
18 forks.
64 stars.
1 open issues.

Recent commits:

• fix: updated readme, John Crisp
• Added demo flutter project, John Crisp
• added example gif of server index page, John Crisp
• added demo server project from aiortc example, John Crisp
• first commit, John Crisp