In this post I’ll be covering how to process footage that was shot at night. By default, it is difficult to see what was captured with the camera. I do know the length of the video as well as other aspects of it. The clip I’ll be using is 5 minutes long and has a resolution of 1280×720 at 30fps using the H.264 \/ AVC codec. The audio is a single channel (mono) 16-bit PCM at 32000Hz. I like that the audio is a lossless raw format, this will be useful for later posts when doing audio signal processing.<\/p>\n
Before I start to apply filters, I’ll want to select a portion of the footage to use as a filter test.\u00a0 I’ll be selecting a 5 second portion of the video and splitting it out to another file.\u00a0 I’ll test my filters on that new file instead of wasting time processing all of video.\u00a0 To split the video, I’ll choose a point when I want to start my split and set it for a duration of 5 seconds.\u00a0 Here is the command I’ll use.<\/p>\n
ffmpeg -i MINI0492.MOV -ss 00:03:10 -t 00:00:05 -acodec copy -vcodec copy -async 1 -y MINI0492_Split1.MOV<\/pre>\nNow I have a nice short clip that has most of the visual attributes I can test filters with.\u00a0 Also, the command retained the format of the source video, so I shouldn’t see any artifacts created by FFMpeg.<\/p>\n
The first filter I would like to use is one that will brighten the video.\u00a0 I’ll use the hue filter to do this.\u00a0 Here is the command I’ll use to test the filter hue=b=x, x being a range from -10 to 10.<\/p>\n
ffmpeg -i MINI0492_Split1.MOV -vf hue=b=2.11 MINI0492_Brightness.MOV<\/pre>\nThis command increases the output video brightness by a factor of 21.1 percent.\u00a0 Based on the range, we have a lot of variance.\u00a0 There is one problem with the results, the dark areas lack depth.\u00a0 I’m going to use the “eq” filter with my 5 second clip to correct the gamma levels, here is the command.<\/p>\n
ffmpeg -i MINI0492_Split1.MOV -vf \"eq=gamma=1.8\" MINI0492_Gamma.MOV<\/pre>\nThe results of this were better than the brightness filter.\u00a0 The clip has better dynamic range.\u00a0 Now I can see how shaky the video is.\u00a0 This next filter will stabilize the video with 2 commands.\u00a0 The first command creates what I call a motion profile.\u00a0 The second command applies the motion profile against the source video to create a stabilized clip.\u00a0 Here are the commands.<\/p>\n
ffmpeg -i MINI0492_Gamma.MOV -vf vidstabdetect=shakiness=10:accuracy=15 -f null -\r\nffmpeg -i MINI0492_Gamma.MOV -vf vidstabtransform=smoothing=40:input=\"transforms.trf\" MINI0492_Stable.MOV<\/pre>\nThe profiling filter are already set to their highest setting, shakiness=10 and accuracy=15.\u00a0 The second stabilization filter has a smoothing range of 0 to 1000.\u00a0 The higher you go, the more smooth, but you sacrifice FOV (field of view).\u00a0 I found 50 good enough.\u00a0 Now I want to sharpen the video, since much of it appears to be out of focus.\u00a0 Here is a command I ran to enhance the edges of the clip.<\/p>\n
ffmpeg -i MINI0492_Stable.MOV -vf unsharp=luma_msize_x=9:luma_msize_y=9:luma_amount=3 MINI0492_Sharp.MOV<\/pre>\nThis gave me good results after changing values for the following filter ranges.<\/p>\n
luma_msize_x range 3 to 23
\nluma_msize_y range 3 to 23
\nluma_amount range -2 to 5<\/p>\nNext I’ll create a side by side composite of both the source and final processed clip.\u00a0 Here is the command to do that.<\/p>\n
ffmpeg -i MINI0492_Split1.MOV -i MINI0492_Sharp.MOV -filter_complex \"[0:v]setpts=PTS-STARTPTS, pad=iw*2:ih[bg]; [1:v]setpts=PTS-STARTPTS[fg]; [bg][fg]overlay=w\" MINI0492_SideBySide.MOV<\/pre>\nThe results are impressive, I find that I’m referencing the clearer clip on the right to see what isn’t visible on the left.\u00a0 With the commands tested and validated with my clip, I’m ready to apply these commands to the entire video.<\/p>\n
This will be a time consuming process, that’s alright.\u00a0 I’m going to script it and go to sleep.\u00a0 When I wake, the final processed video will be ready.\u00a0 Here is the script I’ll be using.<\/p>\n
[bash]#!\/bin\/bash
\n# this runs while everyone else sleeps
\n# use the command "sh ProcessVideos.sh" to run manually from command line<\/p>\n#########################################################
\n# #
\n# Night Time Video #
\n# Enhance and stabilize processing #
\n# #
\n#########################################################<\/p>\n# Change to the working directory
\ncd \/home\/local\/Desktop\/Clip<\/p>\n# Correct the gamma levels so video is brighter and depth remains
\n# The commented command will brighten only
\n# ffmpeg -i MINI0492.MOV -vf hue=b=2.11 MINI0492_Brightness1.MOV
\nffmpeg -i MINI0492.MOV -vf "eq=gamma=1.8" MINI0492_Gamma.MOV<\/p>\n# Create a stablization profile and apply it
\nffmpeg -i MINI0492_Gamma.MOV -vf vidstabdetect=shakiness=10:accuracy=15 -f null –
\nffmpeg -i MINI0492_Gamma.MOV -vf vidstabtransform=smoothing=50:input="transforms.trf" MINI0492_Stable.MOV<\/p>\n# Sharpen the video
\nffmpeg -i MINI0492_Stable.MOV -vf unsharp=luma_msize_x=9:luma_msize_y=9:luma_amount=3 MINI0492_Sharp.MOV<\/p>\n# Create a side by side video of the original on the left and processed on the right
\nffmpeg -i MINI0492.MOV -i MINI0492_Sharp.MOV -filter_complex "[0:v]setpts=PTS-STARTPTS, pad=iw*2:ih[bg]; [1:v]setpts=PTS-STARTPTS[fg]; [bg][fg]overlay=w" MINI0492_SideBySide.MOV[\/bash]<\/p>\nHere are the results.\u00a0 The noise from the camera’s processor shows some noise.\u00a0 I’m guessing it’s the write burst to the SD media on the camera.\u00a0 Daylight video doesn’t reveal that artifact, but night time processed video does.\u00a0 It messes with the stablization, so I would dial the level of stabiliztion down a bit to reduce that.<\/p>\n