The making of a video clip

Telling stories through songs. When there is no story I have no drive. Sometimes I actively scout for interesting stories. A sequence of words. A thought. Serendipity. Usually a picture forms in my head that shapes the story and that is when I start thinking about a clip. Last year this was very strong when Sam came to work on Memories. Its actually one of the first songs that I posted on SoundCloud, but Sam shaped it, rewrote the lyrics and sang it in the attic.

The original song was inspired by a school reunion. A magic event that reshaped my past, because most of what I remembered actually was wrong or incomplete. It seemed apt to make a video clip for it that somehow would take you back to school and down memory lane. But, how shape this image?

Usually I try to cast the original singer and maybe let him or her sing at least a few lines in the clip. I got into contact with the head of my old school, not far from Leiden, in Sassenheim. He arranged the possibility to shoot a video in the school. First everything seemed fine, but then came the terrible news that Sam could no longer take part in the project. No conflict, but personal problems. Disaster. Sam recovered, but still could not take part in the project. However, she agreed that I could use a stand in. She took part in the final result from the sideline.

A clip needs a story!

The first thing I try to do is write down the story of the clip, but in this form. A form that works for me:

  • The premise: the initial state of affairs that drives the plot. In this case: Coming back to your old school to look around and remember all the fun and nice memories of your school years after a school reunion.
  • Scenes: all the images I have in my head. The locations. The video shots. How to shoot the video, moving the camera or on a tripod.
  • All necessary props and assistance needed for every scene

This way I can answer all questions that people involved usually have. How long do you need to shoot in the school? Which locations? What to wear? Earlier I would just take my camera and go, but I found that when you start filming that its nice to come prepared. Also, it really helped a lot that I already knew the school and made an extra visit to fill in some details.

Ingrid in school
Ingrid in school

In this case Ingrid saved the whole project. She agreed to be the stand in for this clip and she is such a graceful and beautiful lady. Throughout shooting she remained strong and focussed. Even when we somehow seemed to be locked up in school by the cleaning ladies.

We have stuff…

A short word on equipment. I have invested in a Panasonic system camera that is capable of shooting 4K. It has image stabilization, but when shooting a shot while moving I now insist on using a gimball. When movement is not smooth its just not right, or it has to be a special effect. For shooting while moving I use the DJI Osmo that has a 4K camera attached. Earlier I found out that insufficient lighting can ruin recordings, so I also invested in special 1000W video lights. I always try to reuse the recordings in the form of making-ofs. For this shoot I also brought the VR 360 camera and an action camera to shoot the recording setups while recording. Makes sense? I hope so.

Why 4K? I have found that when the starting material is 4K, a resulting HD movie is of higher quality than a movie shot with HD equipment. Its the pixel interpolation that somehow results in a sharper image. Also, if the end result is a 4K edited movie, it is also ready for the foreseeable future of video. And if the end result somehow has imperfections, it is possible to cut out the best bits while keeping a HD quality result. Also 4K has overall better quality. No more jaggies much less moire. The only thing that I have saved on for now is framerate. My budget unfortunately does not allow me to shoot 4K at more than 25 frames a second. For now it will have to do.

…but how to use it

What I try to do is to set up all equipment manually. This is extra hassle and extra risky, but what I try to avoid is to have all equipment think for itself. These camera’s all have auto-everything settings. These settings make smart decisions to make sure the subject(s) that you film are well lighted and in focus. However, when filming I find that a camera may suddenly shift to new settings for the best lighting and focus in the middle of a recording. This will make it more difficult in the final video production to choose the correct color tones and lighting. Shifting focus in the middle of a recording will probably make the recording useless. So everything is set to manual, focus and lighting will be fixed.

In the school setting the use of my video lights with a fixed color tone makes sure that the prevailing color tone of the recordings is also fixed. For the final video production I chose to give the whole clip a warm summer tone. Even when the clip was shot on a cold and cloudy autumn afternoon.

And there is more

For this clip I also made sure that Eline from Beauty & Visagie could be there. While recording I am already juggling all the equipment and video shooting. Eline made sure that Ingrid looked her best and remained stunningly beautiful throughout the whole afternoon. She also checked clothing and made sure that colors did not clash and that contrasts were in check. Walter also assisted, supported Ingrid, guarded stuff while we were running around and made sure we had power.

During recording I continuously play the music from the clip to make sure that the ‘rhythm’ of all movements matches. It also helps making sure that the mood is correct. Even though the final production might not be very pro. This way at least it will have the right flow and mood to match the music.

Also I always make sure that everyone in the clip is aware that it will be put on YouTube and made public. For these occasions I always carry paper release forms that people can sign to agree to ‘be in the movie’. For the people directly involved I just ask, but for strangers it might be best to let them sign a form.

As always: this is just the way I try to work and this is a reminder to self. Maybe it helps you.

If you want to support me making higher quality VR 360 video clips, please click here:





Editing VR 360 video

In the previous post showed you how i currently currently record VR 360 video. The Gear 360 does not output large video files (typically 100 MB). On the whole these files can be processed on any laptop or PC easily. The bit rate is not as extreme as the 4K output of professional camera’s. The GB files from these camera’s can bring a lower spec PC to its knees immediately. Expect this also with balls of GoPro camera’s. You shouldn’t have problems with Gear 360 video.
You can process these files with any video editing software, as long as you only use cross fades or other basic transitions. Slow motion or any speed effects will be ok. Even some special effects will apply, like vignette effects. These will blur or darken parts of the 360 video and that can work out quite ok. Coloring effects are also fine of course. One of the effects that does not apply is anti shake, because that will snip the edges of the video and thereby breaks the stitching of full 360 video. Actually technically anti shake could be done by rolling in and out parts of the video on opposing sides. I didn’t find any effect that can do that yet.
Now, titling and logos. If you want any titling you will either have to accept that it will be curved in strange ways, or you will need software that can apply the necessary curving to mix in the titling at the right viewing distance and angle. You can try to do this using Hugin. You can find instructions on how to create images that can be blended into your VR 360 video for logo’s and titling.

Hugin 360 title
Hugin 360 title

So now you’ve got mixing of different shots covered and titling and thus your basic needs. But is this enough for you? The remaining problem is that you can only see the final result after finishing editing, rendering and outputting to your VR device. This makes editing a chore. Fortunately, VR 360 is catching on and there is software that allows you to edit in a real 360 way. Even on a classic flat PC monitor.
Enter Pinnacle Systems Studio 20 Ultimate. The first affordable editing software for VR 360 movies. Now you get a 360 preview window and a way to place 2D content, like logo’s and titling, in the 360 space and preview the result immediately. This also means that you can mix in flat 2D video as part of your 360 video. You still need to be aware which effects and transitions apply in the VR world, but at least you can see the results without first rendering it and move it to the viewer. I am quite sure that more video editors will support VR 360 video. For now your starting point can be Studio 20 Ultimate, or just keep it basic and simple. The end result is worth the effort!

Filming VR 360 video clips

This year i started filming with the latest and greatest gadget of this year, the Samsung Gear 360. Not bigger than a cricket ball and outfitted with two 190 degree lenses it can capture full 360 VR video in one take. Its small enough to carry on your holiday and its a snap to use. Getting the captured video from the Gear 360 to your editing software to make full video clips is quite another matter. Once you get the hang of it its ok, but you’ll have to keep aware of some limitations.

Samsung Gear 360
Samsung Gear 360

Obviously you will not capture the same quality video as a ball of 6 or more GoPro Hero camera’s. The Gear 360 only has 2 camera’s. Count on UHD (2560×1280) movies and 4K (7776×3998) pictures. If you are filming in bright light on the side of one camera and at the same time shadow rich environments on the other side, often the two images cannot be stitched seamlessly. Specifically not if one camera picks up a lens flare.
Another limitation is the handle and tripod that you can attach to the camera. If you hold the camera in your hand with the handle you will find that the two sides of your hand will be stitched in a freaky way. Once i got hold of simple extension sticks for the camera mount it changed everything. With a thin stick as a handle the stitched result ‘floats’ in the air. Just like you want it.
Camera mount extenders
Camera mount extenders

Once you’ve captured photo’s or video, you will find that the camera actually captured two fish eye images side by side. This is the raw picture format and you have to convert this to an ‘equirectangular’ form first in order to be able to upload this to Facebook or YouTube. This is where it starts to get tricky here you can see a raw picture and the stitched equirectangular image:
Fish Eye Avignon Soap Shop
Fish Eye Avignon Soap Shop

Stitched Avignon Soap Shop
Stitched Avignon Soap Shop

As you can see the stitching can be hit and miss. Samsung gives you two options. Stitching by the Samsung Galaxy S7(Edge) Gear 360 app or stitching on your PC with Gear ActionDirector software. The last one gives the best image quality results in good lighting situations. The phone gives you the most reliable overall stitching of images. Even with low light images or less than optimal captures. You will only know after capturing and stitching if your capture is ok. That’s the catch. Of course the app also allows you to remotely record and view the camera image. Vitally important if you don’t want to be in the movie yourself.
The Gear 360 ActionDirector software also offers very limited editing of your video, but that is not enough by far to make video clips. No titling, no effects, just mixing. In the next upcoming article i will focus on editing more.
The sound that the camera can record is acceptable, but susceptible to wind fluttering in. Don’t expect the quality to be adequate to record live music. Make sure you have separate sound recording and mix that in later. For me its quite ok, because in a clip you usually replace the sound with the song.
For now i think this is great for capturing more than just a video clip. Just pop your phone in a VR viewer and you and your viewers can really step into the clip and start experiencing it. How great is that? Of course, the resolution is limited, UHD quality and then divided by the screen resolution size of half your phone. The effect however, can already be very convincing. Stay tuned for the next episode!
Here you can checkout Stone (feat. Evelien) in glorious VR: