Post-Production : Why Netflix Is Using Machine Learning To Train AI To Do Match Cuts by Geoff Hall

Geoff Hall

Why Netflix Is Using Machine Learning To Train AI To Do Match Cuts

Just when we were worried about AI replacing screenwriters, perhaps we should have been more concerned about post-production talent been replaced?

Thoughts?

https://nofilmschool.com/netflix-ai-match-cut-machine-learning?

Why Netflix Is Using Machine Learning To Train AI To Do Match Cuts
Why Netflix Is Using Machine Learning To Train AI To Do Match Cuts
Will Netflix's new AI match cut program replace human editors or make us realize that AI can't do every human job?
Mike Boas

Good article from NoFilmSchool. They point out that it's a faulty premise that this is something editors need help with. As an editor, I don't quite understand how it helps either. We're usually not given a random pile of clips and told to find the match cuts. Every shot has an intention, and if you want to cut from a flying bone to a space ship (2001) it's because you wrote, planned, and shot the material to be able to match cut later. Same goes with something as simple as the framing of an actor center frame looking at the camera. Of course it cuts well, because it was shot for that purpose.

Sam Sokolow

Interesting article. I agree with Mike. Editing is an art form and a collaboration with a director and not just a skill set that a computer can generate, at least at the highest levels.

Shadow Dragu-Mihai, Esq., Ipg

Many dull editing functions are being transferred into AI automation. "Exciting trailer" AI has been out for a little bit now... which might explain some of the trailers you are starting to see. Certainly, the AI generated spam video podcast has been flooding YouTube for several months now. It's not all good and not all bad. (well the content is generally all bad... the tools are not)

Geoff Hall

Mike Boas well said, Mike. I can’t think of a shot that would go unplanned, even match cuts. They are there for a purpose.

Eon C. Rambally

I agree with the commentations! I don't see "AI" having the relevant abilities and "technicalities", particularly at the highest levels! If the statistics proves otherwise, the impact will be significant!

Linwood Bell

For the guy who really isn't into photography, but insists on taking photos. https://photofocus.com/photography/this-strange-ai-camera-has-no-lens-or...

Eon C. Rambally

This is great Linwood Bell, I will certainly like advice on how to show up in a prestige ceremony with one of that!

Linwood Bell

Maybe I'll give them a marketing hook...The Camera That Made History Famous!

Eon C. Rambally

Exactly!! Another pertinent subject!! "Marketing"!!

David Kleve

AIs can be trained to do simple tasks perfectly, I include chess and GO in that category, but we don't understand some aspects of what they do. A phenomenon has come to light where an AI asked to find court cases for lawyers to use in a trial, made up cases completely out of thin air. It's like asking an AI to edit your Scifi movie and it gives you back a Western. It seems when you give an AI a complex problem you may get a complex and completely imaginary answer. It's referred to as an Hallucination. There is a reason Tesla tells you "keep your hands on the wheel" when the car is in its semiautonomous mode. Things can go wrong quickly, at the worst time.

Eon C. Rambally

Well noted, David Kleve! Experience and comments of "great wisdom"! As an internationally certified chess teacher, I'll say this, I've won games in chess, playing against "AI", at the top levels of computer games in the past, so understand clearly, that part! Otherwise in particular, AI making up court cases out of thin air, as opposed to utilizing actual records, for lawyers, will scare anyone with relevant intelligence! Tesla's "keep your hands on the wheel" when the car is in it's semiautonomous mode....What does it cost anyway? Wisdom!

David Kleve

An AI might be able to engage in rewrites fairly easily. I think a Tesla is about $80K. I don't own one.

Linwood Bell

I got an email from a library that I write for to inform me that they are doing a deal with a company that will use the entire music catalog to train AI.

David Kleve

It's funny to discuss this topic. In my novella, from a few years ago, AI, androids that are essentially artificial people, have been outlawed on Earth.

Eon C. Rambally

A great day today! Science fiction of the past, is now science fact of the present,! It's "history"! That history includes, Tesla's $80K, semiautonomous vehicle and "AI". What serious responsibilities, we have, whether or not it gives us "headaches" or entertainment. Not forgetting all this fits into the subject of, "The God particle". "Good music", certainly helps in soothing all of this! I'll refer to some past "personal data" to consider. Years ago while competing against "AI", on computer in "A Game Of Chess", the program although not considered advanced for real competition, after winning against it a couple of times, began "changing it's moves" and became, as far as our (a group of us) then abilities is concerned, "unbeatable", at the highest levels, which is at levels 8, 9 & 10. We were very good players, that's why today, I'm an "Internationally rated chess teacher". I've had difficulties reacquiring "that program", hope it's mistakes on my behalf! That was about ten years ago and that was then "just a simple chess program", against "very good players"! Interesting, Scary? Today is a great day, lots of families are celebrating their happiness, I wish "everyone" the best!

Geoff Hall

@David Kleve perhaps they forgot to turn off the FICTION setting!!!

David Kleve

This is also strange: https://reason.com/2023/06/07/the-a-i-defamation-cases-are-here-chatgpt-sued-for-spreading-misinformation/

AI is intelligent but it's mistakes are curious.

Eon C. Rambally

Fiction!!! Is it really "Fiction", when it has the "statistics", to become "Fact"? Reminds us of "thoughts", "concepts" and relevant "potential"!

Kevin Jackson

When it comes to AI, it can be applied anywhere the imagination can go. Pre, prod, post, marketing and distribution. Just think of a task and it can be done.

David Kleve

Kevin, That is true but AI learns differently than we do. An autonomous car learned what a STOP sign was in training and would stop each time it saw one. Until someone put a bumper sticker on a STOP sign. Then the AI didn't recognize it as a STOP sign and didn't even slow down for the intersection. AIs must be trained for the task. They can't be relied on to learn exactly as we learn.

Eon C. Rambally

Gentlemen, on that subject of AI reading stop signs etc., maybe it should be given "eyes" or better sensery abilities. I'll refer to that AI camera mentioned by Linwood Bell, it's statistics are rather interesting and advanced!! Ironic!

David Kleve

The AI driving the car was using cameras. The issue is perception. The AI sees a STOP sign as an octagon painted red with white letters. When a bumpers sticker is added the AI no longer sees a STOP sign. The AI knows nothing about street signs being defaced or degraded by weather. We take in information based on our experience. AIs only know what they have been trained to know. Training AIs is expensive so they are trained to just barely know what to do and sometimes the training is inadequate for the task. AIs are best at doing simple things for now.

Eon C. Rambally

David Kleve, already taken into consideration, and understand the important need for detail. The topic of the "AI" camera", however goes beyond that! "Perception" is indeed the new "evolved", challenge! Is it possible? is the controversial question and subject of concern! Statistics do prove "AI", despite having the best of technological advancements including "cameras", are not actual "eyes", hence the statistics. The "AI camera makes the boast and inspiration, by "the star-nose mole", also straight out of a "science fiction movie", again "fiction" becomes "fact". Our brains can perceive images trough camera lenses far better than AI, however with the invention of the AI camera, we are looking at a new dawn, a breakthrough and leap in evolution. As said before, we do have responsibilities, whether or not it gives us headaches or entertainment! Good music, helps sooths! Certainly now, we need "Perception"!

Geoff Hall

Eon C. Rambally darn it, that's another job that screenwriters won't be able to do, when they hit hard times! We are just being pushed out of every market!!!

Eon C. Rambally

Geoff Hall, got that! Reminds us! We do have responsibilities, whether or not it gives headaches or entertainment!

Zerrick-Rafael Solece

Wow, this is interesting.

Niki H

My personal opinion is that everyone involved in making art should be concerned. We should all be paying attention and speaking up now, when it matters. Before our ownership and likeness rights are dissolved. Not after.

Eon C. Rambally

Zerrick-Rafael Solece, interesting indeed!!!

Eon C. Rambally

Niki H, you've presented a very important subject!!!

Geoff Hall

@Niki H preach it, Niki.

Other topics in Post-Production:

register for stage 32 Register / Log In