A Reader's Notes On Script Scoring

A Reader's Notes On Script Scoring

A Reader's Notes On Script Scoring

Stephen Notley
Stephen Notley
a year ago

My name is Stephen Notley. I'm a screenplay contest reader as well as a screenwriter, so I've written and received loads of script analyses (also known as "coverage"). With this experience on both sides of the coverage game, I thought I'd offer some thoughts you folks might find useful.

My last blog post was called "A Reader's Notes on Proofreading," which I thought was a nice, simple, straightforwardly objective subject on which to chat. This time, though, I'm going to try to dig a bit deeper. Join me, if you dare, as we explore the scarily subjective subterranean world of... Script Scoring.

What Is Scoring?

Scoring is the process of grading scripts by assigning numbers to different categories of script elements.

As far as I can tell, there are NO well-known industry standards in either the *range* (most use a 10-point scale, but some use a 5-point scale instead) *or* the number and type of categories. The contest I read for has a 10-point scale over 10 categories, but I've received coverage that included percentage ratings for, no joke, 29 different script factors. All that said, three categories are near-universal: Concept, Characters, and Dialogue.

My Scoring Method: How I Score

When I got the reading gig, the first thing I did was establish my baseline rating range for scores:

1 - Abysmal
2 - Really Bad
3 - Bad
4 - Below Average
5 - Average
6 - Above Average
7 - Good
8 - Great
9 - Excellent
10 - Off the Charts

Technically a 10-point rating system doesn't match up correctly with the Bell Curve of a normal distribution, but it works as an approximation, like so:

A Readers Notes On Script Scoring

Assuming the distribution is normal-ish, one would expect most scripts to fall in that middle zone of being somewhere between struggling and almost there, with fewer examples of exceptionally good or bad scripts occupying those higher and lower ratings. And, at least in my observation, this is in fact how and where the scores tend to land.

Spreadsheets Are Magic

Once I had my ratings worked out, the next step was to, of course, like any rational human being, create a spreadsheet.

Lightly fictionalized, it looks like this:

A Readers Notes On Script Scoring

The magical properties of spreadsheets are well known, and this one is no different. Not only does it allow me to keep all the scores I've given in one place, but also allows me to compare the scores I'm giving across multiple scripts. Laying it out this way provides a visual representation of scripts' scores in a way that lets me tell any script from another at a glance.

Let's take a look at these three imaginary scripts in more detail to see what their scores say about them-

But Mom!
Concept Character Dialogue Writing (4), Structure (5)

But Mom! is no fun to read, sadly. Not only are there multiple spelling and punctuation mistakes on every page, but nothing else is working either. The concept is weak, the characters are all the same, and the dialogue is supposed to be funny but is not. It does have a discernible beginning, middle, and end, though, so it gets a 5 for structure. Some scripts are... is there a nice way to say "a slog"? Such a bummer, but that's what happens.

This is basically about as far down as I will score, however. The rating system does have 3s, 2s, and 1s, but giving those scores is just... mean. My job isn't to brutalize or humiliate writers or try to convince them to stop writing. Plus, and more importantly, any writer who actually finishes a screenplay deserves sincere respect for showing up and completing the assignment. So, this terrible script gets a score tally of 21/50, or 0.42, rounded down to a final score of 4. I wish this writer the best, but they have a long way to go.

The Sexeners
Structure (4), Character Dialogue Writing (6), Concept (8)

The Sexeners, meanwhile, has different problems and strengths. It's got a great concept, maybe from some fascinating lesser-known corner of history where the core story is dynamite. There's huge potential for a compelling story in this script. Meanwhile, the characters, dialogue, and writing are mostly there as well. So far, so good. BUT... it's all held back by an overly convoluted structure that breaks things up into so many layers of nested flashbacks that it's a huge struggle to follow what's going on and, sadly, prevents the big emotional moments from landing properly. Strong plusses coupled with unfortunate minuses equals a script with great potential but needs serious work to get there. The final score of 6 means The Sexeners ultimately falls short of what I would call "good" if somebody asked me about it-- though I'd be happy to stipulate that the concept is solid and the overall scriptwriting has potential.

Fart Squad 3
Writing (4), Structure Dialogue Character (8), Concept (9)

Fart Squad 3 is the most imaginary of these imaginary scripts because it is that total unicorn: a script that is littered with agonizingly grotesque spelling and grammar errors on every page but somehow still carries everything else off near-perfectly. The dialogue is hilarious, the characters are distinct and vivid, the concept is truly outstanding, and it all clicks together so every element supports every other element. A blast to read even as I'm tearing my hair out over all the typos. Score tally: 37/50, or 0.74. I could round it down to 7 (that 4 for sloppy writing is really hurting it), but because it truly is a unicorn, and because I did come to enjoy it a lot, and because I did laugh out loud at a couple of places, and because I am seriously considering stealing some of its jokes, I give it the benefit of the doubt and round up for a final score of 8.

And that, in roughly 1000 words, is How I Score!

A Readers Notes On Script Scoring

What About Other Readers?

Honestly? I have NO IDEA how they score. I have been flummoxed and flabbergasted at the weird numbers I've seen readers assign to scripts, both my own and others. The reality is that, just as there's a wide range in the quality of scripts, there's an equally wide range in the quality of readers.

Some have no discernment and give everything 7s, 8s, and 9s (also a tendency of an AI script analyst service I tested). Others hate everything and will only give 3s to 6s. Still others can be just bizarre: I once received a piece of coverage that said in the analysis "This is one of the best and funniest scripts I've read in months" and yet still dinged me with a bunch of 3s and 5s out of 10. Huh? If I liked a script enough to say that, I can't imagine giving it those kinds of scores. WHAT'S THE DEAL?

Scoring Doesn't Matter

The first rule of Scoring is Don't Get Worked Up About Scoring. They always tell you not to get hung up on the numbers. Most providers of coverage I've seen include various disclaimers about how writers should focus on the feedback rather than the scores, that scores are irreducibly subjective, and that different readers might well score the same script differently-- all of which is true. And yet...

A Readers Notes On Script Scoring

Scoring DOES Matter!

The second rule of Scoring is Don't Tell Me Not To Get Worked Up About Scoring I'll Get Worked Up If I Bloody Well Want. It's not as snappy as the first rule, for sure, but I feel the pain. As much as I try to be the good writer, consider the notes and the notes behind the notes, constantly work on improving the craft, blah blah blah... I want those scores, dammit! GIMME THEM GOOD GOOD HIGH SCORES!!!! I don't CARE how dumb they are!

Does Scoring Matter?

I find this the toughest question to answer. One thing I don't do in my analysis is assign a Pass, Consider, or Recommend rating, which seems ultimately more consequential to me. It's not that I wouldn't or couldn't, but it's not my assignment.

In theory, my scores could determine tangible benefits to a writer's career like how far a script advances in a contest, but I don't make any judgments about which scripts move forward. Other folks at the contest make those decisions, and I don't know if my ratings factor into it at all. I just hand out numbers!

Well... and words. I also hand out hundreds or even thousands of words, all cunningly arranged to convey in detail my assessment of the categories I'm analyzing. And those are what's most worth paying attention to, anyway! Fie on scores! FIE I SAY!!!

Let's hear your thoughts in the comments below!

Got an idea for a post? Or have you collaborated with Stage 32 members to create a project? We'd love to hear about it. Email Emily at blog@stage32.com and let's get your post published!

Please help support your fellow Stage 32ers by sharing this on social. Check out the social media buttons at the top to share on Instagram @stage32 , Twitter @stage32 , Facebook @stage32 , and LinkedIn @stage-32 .

Get engaged
19

About the Author

Stephen Notley

Stephen Notley

Content Creator, Screenwriter, Story Analyst

Well, the occupation list above doesn't include "Cartoonist," but that's what I mostly am, having regularly drawn the infamous webstrip Bob the Angry Flower for over 25 years while also holding down a game designing job for PopCap Games. With all these years of various funnymaking under my belt, I f...

Want to share your Story on the Stage 32 Blog?
Get in touch

19 Comments on Stephen's Article

Geoff Hall
Screenwriter, Director, Producer
My biggest concern is that Fart Squad rated a 9 on concept, Stephen!!! As a screenwriter, I’m still wondering why I would want my script scored, when what you say, it seems so arbitrary?
a year ago
Gregory Barone
Illustrator, Concept Artist, Graphic Designer, Storyboard Artist, Voice Actor
Fart squad! not sure what to make of that???
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Sadly, no. I'd KILL to land a spot on that franchise!
a year ago
Gregory Barone
Illustrator, Concept Artist, Graphic Designer, Storyboard Artist, Voice Actor
was really hoping to see it. guess you didn't write it?
a year ago
Bob Canning
Screenwriter, Playwright
Hi Stephen -- What I liked about your blog was clarity of how you come up with your scores for Structure, Dialogue, etc. But your HUMILITY was another factor, admitting to your mistake on your "dumb pass" on Stargate! (In Hollywood?!?!?!!?!) Which brings to mind a Pass I got from a coverage service earlier in the month that is supposed to connect you with Representation. I submitted a project that I adapted from a PD story and an EARLY DRAFT received two RECOMMENDS (it also was named Semi-Finalist in 2 contests) and so I felt comfortable submitting a revised new & improved version it to the last one . Here are the standout quotes I use on the Concept Poster: CCM1: “An absolute pleasure to read. By almost every important measure… this is a very funny, very successful script and a compelling adaptation.” SW38: “The strong imagery makes for a lasting impression that will set this script apart from more traditional adaptations... Great work!” Well, you would've thought I submitted "But Mom!" to these people. They ripped it to shreads and gave me a hard pass! Clearly One Wo/Man's opinion but it really sucks! (And so does s/he :-) Thanks!
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Oh, quick question... when you say you had a project "adapted from a PD story," what's a PD story? Who's PD?
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
It's tough. Gatekeeping is a huge part of the industry by necessity; there are 10,000 people on the hunt for every single opening and opportunity. We *want* to believe there's some rhyme or reason to how it works, and I think there is... but there's also a significant irreducible element of chance as well.
a year ago
Catherine Cole
Screenwriter
Thanks Stephen!
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
You're welcome, Catherine!
a year ago
Doug Kayne
Actor, Comedian, Director, Screenwriter, Studio Teacher
Thank you for the insight into scoring (at least from your perspective). it would be ideal to have some sort of standardized scoring process, but I understand why there isn't. In any event, at least we're coming away with a little deeper knowledge as to how it goes down.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Glad you enjoyed the post. As I stipulated in the comments, this is only me throwing some light on my own little corner of the system, but I hope it can give folks a reference point to consider.
a year ago
Katherine Blessan
Screenwriter
This is a fascinating insight into the process. One thing I've found interesting is that on Coverfly your rank for a script can go up even if you don't place in a competition. Apparently that's because the underlying score card is good. I find that encouraging because not all competitions will score in that way.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
I think a lot of the inconsistency stems from all of these coverage services and contests are their own beasts with their own internal cultures and whatnot; under those circumstances it's not surprising that they don't all fit together sensibly.
a year ago
MB Stevens
3D Animator, Screenwriter, Voice Actor
Nice article, Stephen. I agree with many of the comments. The unofficial entertainment industry slogan should be "Right place, right time."
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Yeah, it's kind of an eternal mystery, one I don't claim to understand. There have been plenty of blog posts here on Stage32 on the theme of "The whole 'It's all about who you know and luck' thing is way overblown; you can own and control your career." And generally speaking I agree that you can make a lot of your own luck by being professional and prepared. And yet... the "right place, right time" thing is super real and affects everybody from the most hapless would-be screenwriter all the way up to established figures in the field who get their projects killed for random timing reasons.
a year ago
Sarah Brockmann
Costumer, Screenwriter, Producer
I've experienced the "extremely positive comments, low score" thing too. No idea what that's about. I'm also a reader for a competition, and your bell curve pretty well matches my experience, especially the spelling, grammar, punctuation and usage errors. People - get a proof reader!
a year ago
Sarah Brockmann
Costumer, Screenwriter, Producer
GREAT blog! PREACH!!!!!!!!!!!!!
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Ha! Check out my "A Readers Notes on Proofreading" blog linked above. I rage about it! It is NUTZ how sloppy some scripts are.
a year ago
Ashley Smith 23
Creative Executive, Script Consultant, Producer
Thank you for sharing this peek into your process, Stephen! It's really helpful to get an inside look and gain perspective that there are people behind the grading, coverage, notes, etc. that have the difficult job of having to look at material with a critical eye and make judgment calls that aren't always easy to make.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
You're most welcome, Ashley. It's a murky part of the business, I find, so I hope me shining a light on my own little corner of it helps folks get an idea of what's going on.
a year ago
Bob Canning
Screenwriter, Playwright
Extremely helpful.
a year ago
Hilton Moore
Actor, Author, Director, Marketing/PR, Producer
I got a "pass" by a Story Anal-yst once. It was a feature length script. It received a finalist award in a California film contest shortly after the analysis. A month later it was optioned by a producer for a series. So much for anal-ysts.... Sorry, won't ever use them again.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Fair enough. As John Carter observed in a comment below, there's always going to be luck and randomness inherent to anybody's reaction to any script. There are Academy Award-winning movies out there with armies of detractors, so there's never (or almost never) going to be universal agreement on quality. I'm sure you can imagine plenty of popular things that aren't to your own personal taste, and the same thing applies in the other direction when we're creating stuff and putting it out there. Regardless, congratulations on the placement and option!
a year ago
Jill Gambaro
Producer, Screenwriter
Thank you for this article Stephen, it was most enlightening. My experience scoring scripts was much different as it was for studios and talent agencies. I had to work under the pass/consider/recommend model. I once got fired for recommending a script the executives did not like. I'm afraid my bell curve would slant far more to the left.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
An embarrassing story from my story analyst past: Decades ago when I was starting out reading in Canada, I got the pilot script for Stargate SG-1. I passed on it on the grounds that the pilot basically replicated the movie with superficial changes, and didn't take advantage of all the amazing potential of the core concept. While that was true enough, I wasn't experienced enough to appreciate what a pilot does and how it relates to the overall potential of a series. It wasn't the *pilot's* job to expand and expound on the concepts; that was what the series was going to do. Obviously, they went ahead and made the show anyway despite my dumb pass, and it went on to do 10 seasons plus several spin-offs. So, an early lesson for me in a) realizing that my own pass or recommendation only went so far, and b) that I had a lot to learn about TV production.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Yeah, as I allude to in the blog, the Pass/Consider/Recommend model is, I think, a much more operative way of doing things. If you're going to stick your neck out and assign a "recommend," you have to seriously believe in a script, not just on its own terms, but in terms of how well it fits into what the organization you're in is looking for. I think it's rather lame that the execs fired you for recommending something they didn't like; a far smarter approach on their part would have been to take the time to talk to you about what you liked about it and why it didn't line up with what they wanted. But I don't doubt there are plenty of execs who expect you to read their minds right off the bat and have no problem burning through readers until they find one whose tastes exactly line up with their own.
a year ago
Jill Gambaro
Producer, Screenwriter
Extremely helpful.
a year ago
Maurice Vaughan
Screenwriter
Excellent breakdown, Stephen! “Most providers of coverage I've seen include various disclaimers about how writers should focus on the feedback rather than the scores, that scores are irreducibly subjective, and that different readers might well score the same script differently.” Scores are important, but I think the feedback is more important. The feedback is what I focus on. Thanks for writing the blog!
a year ago
Maurice Vaughan
Screenwriter
Thanks, Stephen. You gave me something to think about.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Yeah, that's a tough one. I haven't done that myself --gotten an analysis, made changes, sent script back to same reader to see what they made of the changes -- but I've been on the other end a couple of times. Unfortunately it was pretty frustrating. Back in Canada, there were two scripts by two filmmakers who absolutely were going to get the funding for their movies, but they kept making use of the service provided by the group I was working for. Thus, I ended up getting draft after draft with little tweaks here and there for two scripts I never liked, and having to make detailed notes on them. I don't know if they were specifically requesting my updated feedback or if they were just feeding their drafts into the same system over and over again, but I felt like it was ultimately a waste of everybody's time, since there was pretty much nothing they were going to be able to do to get these scripts to a place I was going to feel fundamentally differently about them. It was like: "This is a pass for me, but you're clearly going to make this movie, so you should just go ahead do it and stop asking me for my opinion on it." And, to their credit, they did make their movies, so good on them, even if the reviews essentially backed up my initial and ongoing concerns with every version of the scripts.
a year ago
RJ Lucas
Screenwriter, Producer, Creative Executive
An enlightening and entertaining read. Thanks, Stephen!
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
You're welcome; glad you liked it!
a year ago
Thomas Kelleher
Screenwriter
Thank you, Stephen
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
You're welcome! I hope some of it was useful!
a year ago
MJ Leonard
Screenwriter
Thank you for another highly informative piece, Stephen! I appreciate you sharing your scoring system and your insights with us!
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Thanks! I stipulate that this is all simply my own experience, but I hope pulling back the curtain a bit on how this works in at least one instance can be useful to folks.
a year ago
Thank you, Stephen
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
You're welcome!
a year ago
John Carter
Screenwriter, Producer
My experience of competitions so far is I either do really well or get nothing. Which suggests to me that for all the spreadsheets and pseudo-scientific approaches, it's still just purely subjective. The reader either gets the script or they don't. And success in the completion is dependent upon pure luck in landing an initial reader who gets it, or not.
a year ago
Stephen Notley
Content Creator, Screenwriter, Story Analyst
Honestly, I'm with you 100%. I do my best to be as consistent as I can with my own scoring, but it's always going to come down at some level to taste and my gut reaction to a script. And I've had similar experiences with contests as well; the same script can get to the finals in one and not even break the quarters in another. It's not *entirely* random, but it's a long way from "objective."
a year ago
19