-
Notifications
You must be signed in to change notification settings - Fork 0
Home
Welcome to the PIP wiki!
Methods of adding Picture-In-Picture interpreters to your video stream. Our goal is to make sure any content can be accessible by the deaf and hard hearing communities. Adding interpreters to a feed in an easy way to achieve this goal. A number of application packages recommended here are open source others are not, but they will be noted as they are documented.
The 2 main types of video content are:
- On-demand: videos that were previously created, edited, saved and consumed indefinitely over time. When adding a PIP video to those, they are processed altogether as files.
- Live: video that is filmed / streamed in real-time. Processing of adding an additional stream, must happen on the fly instead of in advance.
Another category to look at when looking for a PIP processing application is whether to use cloud-based or desktop software. This really depends on a couple factors. If you have a distributed team, cloud software is always best. Specially if you cannot hand files over with a hard drive at a moment's notice. Cloud software always comes with an added cost. It isn't always a large cost, but isn't free. The convenience is generally worth it though the setup can be timely.
A desktop-based setup is sufficient if you are processing on-demand videos and you either are working alone or have a cloud-based system for sharing assets. You should also have a decent internet download / upload bandwidth. It can be used in other instances and this will show you how, but it is not recommended. If you want to use it for live, it is recommended that you get 2nd computer for processing the videos on which you use Open Broadcaster Software (OBS) Studio or ManyCam.
A cloud-based setup is good for almost every situation out there. There are services that handle live video streams and on-demand video solutions exist with Virtual Desktops outlined on the AWS page. An on-demand platform is on its way.
Video chat apps, such as Zoom have the ability to capture streams through custom links. However, it must be done through a publicly-accessible RTMP ingestion server. That means it cannot be captured from a residential internet. However, it can be captured through a cloud service or even a virtual desktop that has been configured with a public IP address.
Green screens are good for allowing interpreters to take up less real estate on the screen over top of the main video. However, they can be unreliable when interpreters do not have a good setup. Most softwares that do green screen use what's called a chroma key and can work with multiple colours other than green. With a good setup, green screens can be very precise and chroma key removal is available in all open source softwares.
There's also a type of background removal called virtual background. This is common on Zoom for a single person, but does not work outside of the single person. It uses smart technology to estimate the lines of the person. It is more reliable than green screen because it does not require having a clean background. However, it is only available in paid software.
A stream deck is a way to switch between multiple video layouts for live video, also known as scenes. A visual stream deck has previews of each scene.
OpenShot is a fantastic Open Source application for video editing. It works on Linux, MacOS, and Windows. It also can remove backgrounds using a chroma key such as a green screen and allows for multiple video channels to be used in any size or position. This makes it customizable for multiple purposes. OpenShot allows for an unlimited number of video channels to be used as long as your computer can handle it.
Adobe Premiere is an incredibly powerful tool for video editing. It is not free, but has great sharing features as it is connected to Adobe Project Cloud. Adobe has decent discounts for non-profits. How to use Premiere. How to use premiere projects.
A paid, cloud-based platform that uploads directly to YouTube or Facebook Live. It works well because it is a calling platform like Zoom where you can invite multiple guests including interpreters and other types of guests. If you use it as an alternative to Zoom, it justifies the price. It has the ability to create multiple RTMP ingestion links. Each guest can be resized and moved around. It has a visual stream deck.
A paid desktop software that creates a virtual webcam for any existing live streaming platform. It has chroma key support and virtual background support. It allows you to create an RTMP video ingestion link and stream from RTMP streaming links. It has a visual stream deck.
An open source desktop software that creates a virtual webcam for any existing live streaming platform. It has chroma key support. It allows you to stream from RTMP streaming links, but for RTMP video ingestion, you'll have to set it up yourself with code. It has a stream deck, but it is a named switcher without preview so you'll need to memorize the scene names. It is a free and open-source cross-platform streaming and recording program built with Qt and maintained by the OBS Project. As of 2016, the software is now referred to as OBS Studio. There are versions of OBS Studio available for Microsoft Windows, macOS, and Linux distributions.