Adding filter to DSLR camera video footage

Tiffany Wick

Snap Lens Network Member Lens Studio Team

September 21, 2021 16:54

Hi is there a way to add a filter to DSLR camera video footage that keeps the quality? I tried adding it by putting the video in the lens studio preview and recording it but the frame rate is terrible. Any ideas? Please thank you!!!

modelsbymike3d
Snap Lens Network Member Lens Studio Team

September 21, 2021 18:47
There is a hacky way to do it using SplitCam. Snap Camera doesn't record great while applying filters, so instead of directly recording with Snap Camera, instead use it as an input to OBS and record from within OBS. Video here -> https://www.youtube.com/watch?v=0zoZ-Ap4FHc

This method does not guarantee that the resulting video will be a frame-by-frame match with the original. If you need the lens applied frame-by-frame then you will need to write some code to control the whole process.
Comment actions Permalink
Tiffany Wick
Snap Lens Network Member Lens Studio Team

September 21, 2021 23:16
@modelsbymike3d omg thank you so much!! Is there a Mac alternative to Split cam? I’m going to try the split cam on my windows pc but it would be great To be able to do it on my light Apple computer. How would I write some code to control the whole process, do you know how or know who’d know how to do that? Thank you so much!!!
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

September 30, 2021 13:48

Edited
I don't know what a Mac alternative would be. The key thing about SplitCam is that you can load in a video and stream it as a webcam. I'm sure there are Mac alternatives out there.

I actually do have a script that goes through frame-by-frame. It does not quite run in real time so things like particles wouldn't look great. And for whatever reason it gets off by one frame (but is consistently off).

I will provide the Python script here, but I cannot provide much help with it. It will probably require some modifications to run on your computer, especially if you are using a Mac vs a PC. It is tricky to get everything setup and working nicely together, even if you already know Python.

I provide the script here as-is.

# This set OBS Virtual Cam for input to SplitCam

# Set SplitCam as input to Snap Camera

# Make sure the resolutions are all correct

import glob

import imageio

import pyvirtualcam

import numpy as np

import cv2

import time

videoCaptureObject = cv2.VideoCapture(1)

videoCaptureObject.set(cv2.CAP_PROP_BUFFERSIZE, 100)

cam = pyvirtualcam.Camera(width=1920, height=1080, fps=30)

print(f'Using virtual camera: {cam.device}')

base_input_path = 'D:\\input'

base_output_path = 'D:\\output'

folder_names = [

    'frames0'

    # 'frames1',

    # 'frames2',

    # 'frames3',

    # 'frames4',

    # 'frames5',

    # 'frames6',

    # 'frames7',

    # 'frames8',

    # 'frames9',

    # 'frames10'

]

has_started = False

for f in folder_names:

    print(f)

    source_directory = base_input_path + f + '\\*.png'

    output_path = base_output_path + f + '\\'

    image_list = glob.glob(source_directory)

    print(str(len(image_list)) + ' files')

    for image_name in image_list:

        image = imageio.imread(image_name)

        filename = image_name.split('\\')[-1]

        print(filename)

        try:

            cam.send(image)

            time.sleep(0.04)

            # cam.sleep_until_next_frame()

            if not has_started:

                input("Press Enter to continue...")

                has_started = True

            ret, filterImage = videoCaptureObject.read()

            time.sleep(0.1)

            cv2.imwrite(output_path + filename, filterImage,

                        [int(cv2.IMWRITE_JPEG_QUALITY), 100])

        except Exception as e:

            print(e)

            cv2.imwrite(output_path + filename, image,

                        [int(cv2.IMWRITE_JPEG_QUALITY), 100])

videoCaptureObject.release()
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

September 30, 2021 14:09
Vincent Tang this script might be interesting to you 👆

Maybe at some point Snap Camera could have an SDK or video editor plugin or something. There is a demand for applying lenses to arbitrary videos and currently the only method to get frame-by-frame control is with multiple virtual cameras and a hacky Python script. I'm okay with not doing this in real time, I just want to be able to update the image in Snap Camera, tell it when to re-render the frame (independent of the video fps), then grab the resulting image.
Comment actions Permalink
Tiffany Wick
Snap Lens Network Member Lens Studio Team

October 07, 2021 20:18
@modelsbymike3d omg!! Thank you so much I appreciate it so much! Do you thinking could video call you and you walk me through installing the script with python on my MacBook or windows computer? I don’t know python thank you soo much for the script? What’s your Snapchat? Mine is @pegasusgoddess I hope to add you so you could
Maybe walk me through or use Skype to control my computer to help me install it!! Thank you sooo much!
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

October 26, 2021 14:33
Hi Tiffany,

A call to go over how to run the script is not something I'm able to do. I'm considering creating a tutorial to go over how to do everything though.

The script itself is super short, but it will probably require changes to run fine on macOS. The major difficulties arise from getting all the webcam software installed and working nicely together and getting all the dependencies for the script installed.

I'll see what I can do about that tutorial. Just be aware it isn't just a matter of installing Python and hitting go.
Comment actions Permalink
Tiffany Wick
Snap Lens Network Member Lens Studio Team

October 27, 2021 13:28
@modelsbymike3d omggg!! Thank you soo much I would appreciate it soo much!! I’m so glad you saw my message and got back to me! Can you add me on Snapchat @pegasusgoddess I want to be able to make sure I can keep in touch with you about this! Thank you So much!!
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

November 10, 2021 21:41
@... I've cleaned up the code and provided instructions (both written and a video) going over how to install and run the script. I made it as straightforward as possible.

If you get any Python-related errors, please Google them because that's just what I am going to do.

Link to code: https://github.com/modelsbymike3d/SnapCameraPyBot
Comment actions Permalink

Adding filter to DSLR camera video footage

We're here to help! We just need a little bit of information...

What system do you run Lens Studio on?

Follow the next steps to help us solve your issue:

Thanks for submitting this issue.

We'll try to resolve this issue as soon as possible. Thanks for letting us know about it!