Pynerds

In this post, we are going to discuss how to replace a video which is having green screen background with a background image using OpenCV and Python🐍. To understand this, you have to know how to detect colors using OpenCV and Python and you can check out by clicking here 🐱‍🏍. Input video and background image😄: Code😄: Output😄:  I hope it will help you😊.

In this post, we are going to see how to detect and track movements(simply motion detection and tracking) using the OpenCV module. At first, you need to install the OpenCV-python module, to install the module just open your command prompt and type, pip install OpenCV-python Then hit enter, it will install the module automatically. After installing the module, just import the module and write the basic code to read the video. # import the opencv module import cv2 # capturing video capture = cv2.VideoCapture( "videos/input.mp4" ) After that, we have to get the two frames from the video or webcam and find the difference between the two frames, which is nothing but if there is a movement that occurs between the frames there might be a difference.  So, here we are trying to get the difference using the  cv2.absdiff() function in the OpenCV module and this method takes two parameters which are the two frames. # find difference between two frames diff = cv2.absdiff(img_1 , img_2) T...

In this post, we are going to see how the colors are detected by the OpenCV module.  The first step to get into this is just install the modules as I mentioned below and import the modules, then read the input image and convert the BGR (Blue, Green, Red) image to HSV (Hue, Saturation, Variance) image then find the lower and higher HSV value of the color which you want to detect from the HSV color map (Shown below),  Then, we have to generate the mask of the color which we chose. So, we will use the cv2.inRange() function to generate the mask. Just pass the input image, lower HSV value higher HSV Value. This will generate a masked image of the input image and assign the masked image to the variable (mask). To detect the color we have to use the cv2.bitwise_and() function and pass the input image as the first and second argument and the third argument will be the mask and store this in the variable (detected_image). detected_image will be the final output of our progra...

     The face mesh is a face geometry solution that estimates 468 3D face landmarks in real-time even on mobile devices. The output of the following code will be like this, Packages to install :  pip install opencv-python. pip install mediapipe. Program :  import cv2 import mediapipe as mp import time # Creating objects for face mesh mpFaceMesh = mp.solutions.face_mesh faceMesh = mpFaceMesh.FaceMesh( max_num_faces = 2 ) # Creating objects for drawing utilities mpDraw = mp.solutions.drawing_utils drawSpecs = mpDraw.DrawingSpec( thickness = 1 , circle_radius = 1 , color =( 0 , 255 , 0 )) # Capturing video from the web cam video = cv2.VideoCapture( 0 ) previousTime = 0 currentTime = 0 while True : success , img = video.read() # Converting BGR image to RGB image imgRGB = cv2.cvtColor(img , cv2.COLOR_BGR2RGB) # Getting landmark points and storing in multiFaceLandmarks variable result = faceMesh.process(imgRGB) multiFaceLanmarks ...

Packages to install :  pip install opencv-python. pip install mediapipe. Program :  # Face Detection using mediapipe with python import cv2 import mediapipe as mp import time # Creating objects for detecting face mpFaceDetection = mp.solutions.face_detection mpDraw = mp.solutions.drawing_utils faceDetection = mpFaceDetection.FaceDetection() # Capturing video from the web cam video = cv2.VideoCapture( 0 ) currentTime = 0 previousTime = 0 while True : success , img = video.read() # Converting BGR image to RGB image RGBimg = cv2.cvtColor(img , cv2.COLOR_BGR2RGB) # Getting landmark points and storing in multiHandLandmarks variable result = faceDetection.process(RGBimg) # This 'if' block will run when it's having the face landmark points if result.detections: for index , detection in enumerate (result.detections): score = detection.score[ 0 ] * 100 boundingBox = detection.location_data.relative_bounding_box ...

     The following python program shows how to save the video in your machine which is captured through the webcam. cv2.VideoWriter(filename.mp4, fourcc, fps, frame size) is the method used in the code. Program :  import cv2 # Capturing videos from the webcam video = cv2.VideoCapture( 0 ) # Defining codec fourcc = cv2.VideoWriter_fourcc(* "XVID" ) # Creating videowriter object out = cv2.VideoWriter( "asdf.mp4" , fourcc , 20.0 , ( 640 , 480 )) while video.isOpened(): success , img = video.read() if success: # writing frame by frame to the video file out.write(img) cv2.imshow( "Video" , img) key = cv2.waitKey( 1 ) if key == 13 : exit () else : break out.release()

    The following python code shows the conversion process of the detected face to blur using the OpenCV module. The method is used to convert blur is GaussianBlur(Source, ksize, sigmaX) . source: The image. ksize  : (kernel.width, kernel.height). kernel width and kernel height can differ but they must be positive and odd. Program :  import cv2 trainedDataset = cv2.CascadeClassifier( "haarcascade_frontalface_default.xml" ) img = cv2.imread( "images/Elon Musk.jpg" ) faces = trainedDataset.detectMultiScale(img) for x , y , w , h in faces: cv2.rectangle(img , (x , y , w , h) , ( 50 , 50 , 50 ) , 2 ) img[y:y + h , x:x + w] = cv2.GaussianBlur(img[y:y + h , x:x + w] , ( 93 , 93 ) , 0 ) cv2.imshow( "Image" , img) cv2.waitKey( 0 ) Output :  If you have any doubts in the code please refer face detection in image file using python .

     High fidelity human body pose tracking, inferring up to 33 3D full-body landmarks from RGB video frames. The 33 full-body landmarks will be like,  And, The output will be like this,  Packages to install :  pip install opencv-python. pip install mediapipe. Program :  # Pose Estimation with Python import cv2 import mediapipe as mp import time # Capturing video from the web cam video = cv2.VideoCapture( "videos/running.mp4" ) # Creating object for pose detection myPose = mp.solutions.pose pose = myPose.Pose() mpDraw = mp.solutions.drawing_utils currentTime = 0 previousTime = 0 while True : success , img = video.read() # Converting BGR image to RGB image RGBimg = cv2.cvtColor(img , cv2.COLOR_BGR2RGB) img = cv2.resize(img , None, fx = 0.15 , fy = 0.15 ) # Getting landmark points and storing in poseLandmarks variable result = pose.process(RGBimg) poseLandmarks = result.pose_landmarks # This 'if' block will run when it's h...

     Basically, the hand tracking is based on the 21 landmarks in 3D with multi-hand support, based on high-performance palm detection and hand landmark model. The 21 hand landmarks will be like,  And, The output will be like this,  Packages to install :  pip install opencv-python. pip install mediapipe. Program :  # Hand Tracking with python import cv2 import mediapipe as mp import time # Capturing video from the web cam video = cv2.VideoCapture( 0 ) # Creating objects for hands mpHands = mp.solutions.hands hands = mpHands.Hands() previousTime = 0 currentTime = 0 while True : success , img = video.read() # Converting BGR image to RGB image RGBimg = cv2.cvtColor(img , cv2.COLOR_BGR2RGB) # Getting landmark points and storing in multiHandLandmarks variable result = hands.process(RGBimg) multiHandLandmarks = result.multi_hand_landmarks # This 'if' block will run when it's having the handlandmark points if multiHandLandmarks...

The following code shows the accuracy level of the trained face and test face. If the value is small, then the accuracy is high. Packages to install :  pip install openCV. pip install Face Recognition. pip install numpy. Images used :       Trained Face                               Test Face   Program :  # Detecting accuracy level of the trained image and test image import cv2 import face_recognition import numpy as np # known image imgElon = face_recognition.load_image_file( "images/Elon Musk.jpg" ) # imgElon=cv2.imread("images/Elon Musk.jpg") imgElon = cv2.cvtColor(imgElon , cv2.COLOR_BGR2RGB) # Test image imgElonTest = face_recognition.load_image_file( "images/Elon Musk Test.jpg" ) # imgElon=cv2.imread("test images/Elon Musk Test.jpg") imgElonTest = cv2.cvtColor(imgElonTest , cv2.COLOR_BGR2RGB) # known image location & encodings faceLoc = ...

Program : # Eye detection in video import cv2 # trained dataset for face (from github ) face_cascade = cv2.CascadeClassifier( "face detection/haarcascade_frontalface_default.xml" ) # trained dataset for eyes (from github ) eye_cascade = cv2.CascadeClassifier( "face detection/haarcascade_eye_tree_eyeglasses.xml" ) # for detecting eye in video pass the location of the video as a argument video = cv2.VideoCapture( 0 ) # 0 is for accessing webcam while True : success , frame = video.read() if success == True : # converting color frame to grayscale frame gray_frame = cv2.cvtColor(frame , cv2.COLOR_BGR2GRAY) # getting values of x-axis, y-axis, width, height faces = face_cascade.detectMultiScale(gray_frame) """ print(faces) -> return values of x-axis, y-axis, width, height """ # creating rectangle around the face for x , y , w , h in faces: # cv2.rectangle(frame, (...

Program : # Eye Detection in Python import cv2 # trained dataset for face (from github ) face_cascade = cv2.CascadeClassifier( "face detection/haarcascade_frontalface_default.xml" ) # trained dataset for eyes (from github ) eye_cascade = cv2.CascadeClassifier( "face detection/haarcascade_eye_tree_eyeglasses.xml" ) # read image img = cv2.imread( "images/elonmusk.jpg" ) # convert colour image to grayscale image gray_img = cv2.cvtColor(img , cv2.COLOR_BGR2GRAY) # getting values of x-axis, y-axis, width, height for face faces = face_cascade.detectMultiScale(gray_img) """ print(faces) -> return values of x-axis, y-axis, width, height """ # creating rectangle around the face for x , y , w , h in faces: """cv2.rectangle(img, (x, y), ((x + w), (y + h)), (0, 0, 255), 2)""" # roi means region of interest roi_gray = gray_img[y:y+h , x:x+w] roi_color = img[y:y+h , x:x+w] # getting value...

# Face detection using webcam import cv2 # trained dataset (from github ) trained_dataset = cv2.CascadeClassifier( "haarcascade_frontalface_default.xml" ) # capturing video via webcam video = cv2.VideoCapture( 0 ) while True : success , frame = video.read() if success == True : # converting color frame into gray frame gray_frame = cv2.cvtColor(frame , cv2.COLOR_BGR2GRAY) # getting values of x-axis, y-axis, width, height faces = trained_dataset.detectMultiScale(gray_frame) """ print(faces) -> return values of x-axis, y-axis, width, height """ # creating rectangle around the face for x , y , w , h in faces: cv2.rectangle(frame , (x , y) , (x + w , y + h) , ( 255 , 255 , 255 ) , 1 ) # showing face dectected video cv2.imshow( 'Live' , frame) key = cv2.waitKey( 1 ) if key == 13 : break else : break ...

# Face detection in video import cv2 # trained dataset (from github ) trained_dataset = cv2.CascadeClassifier( 'haarcascade_frontalface_default.xml' ) # getting video video = cv2.VideoCapture( r'video\face-demographics-walking-and-pause.mp4' ) while True : success , frame = video.read() if success == True : # converting color frame to grayscale frame gray_frame = cv2.cvtColor(frame , cv2.COLOR_BGR2GRAY) # getting values of x-axis, y-axis, width, height faces = trained_dataset.detectMultiScale(gray_frame) """ print(faces) -> return values of x-axis, y-axis, width, height """ # creating rectangle around the face for x , y , w , h in faces: cv2.rectangle(frame , (x , y) , (x + w , y + h) , ( 0 , 0 , 255 ) , 2 ) # showing face dectected video cv2.imshow( 'Video' , frame) cv2.waitKey( 1 ) else : break Also Refer: Face detec...

# Face detection in a image file import cv2 # trained dataset (from github ) trained_dataset = cv2.CascadeClassifier( 'haarcascade_frontalface_default.xml' ) # read image img = cv2.imread( 'images/multiface.jpg' ) # convert colour img to grayscale img gray_img = cv2.cvtColor(img , cv2.COLOR_BGR2GRAY) # getting values of x-axis, y-axis, width, height faces = trained_dataset.detectMultiScale(gray_img) """ print(faces) -> return values of x-axis, y-axis, width, height """ # creating rectangle around the face for x , y , w , h in faces: cv2.rectangle(img , (x , y) , (x+w , y+h) , ( 0 , 0 , 255 ) , 2 ) # show image cv2.imshow( "Face Detected" , img) cv2.waitKey() Also Refer: Face Detection in video using python