WCM Network: 
 


Go Back   mmorpgforum.net > Machinima > WarcraftMovies.com > Movie Discussion - NEW
Register Projects FAQ Members List Calendar Search Today's Posts Mark Forums Read

Reply
 
Thread Tools Display Modes
Old 04-30-2008, 11:48 PM   #1
Abyzz
Initiate
 
Join Date: Dec 2006
Posts: 28
Abyzz is an unknown quantity at this point
How To Properly Rate Movies

Have you ever stopped to wonder why any first-kill movie is automatically granted 5 stars on quality and editing? Or how the average Joe receive almost as good a score as the semi-professional who has dedicated months on a project? Rating has become a phenomenon of cyber-social status rather than an actual evaluation of the work at hand, and the pace at which stars are awarded seems to match the financial hyperinflation in Zimbabwe.

Some of you could not care less about these imbalances, some deny their existence, and again others are oblivious to fact that there is actually a point to the rating. Hopefully there are also some of you who want to be able to show your appreciation for a good piece of work, and actually rate a movie based on the given perimeters. Regardless, I have devised a little walkthrough on what I think are crucial factors in rating movies, which in terms should be a hint at how to make them.

Why bother? Well, your effort will help make WCM a better place, which - seeing that you spend time on it - should be in your interest, and as a movie maker it will help you understand what to aim for and how to aim for it, which ultimately makes you better at what you do, but also increases the chance that others will like it. Surely a win/win then? Read on to find out. But before you do though, it needs to be said that you should not see this as a final product, but a work in progress, that – with your help – will develop over time to provide the best, most up to date information. Much of the following is inevitably affected by my personal opinions (that’s the whole concept of rating) but I hope you can make some use of it.


Content

Probably the most important aspect of a movie (and at the same time the most difficult one to generalize on) is its content. Various elements depending on genre and theme will be of importance here, but a few should be universal; namely the ones that makes you laugh and the ones that makes you excited.

The fun-factor. Never underestimate the value of a good laugh. Most of us watch movies for the sheer pleasure of it, others do it to learn and improve, but no matter what the setting is, a movie always gets better when it's actually fun to watch - and being fun, ladies and gentlemen, often involves humour. When rating a movie's content then, simply keep in mind to what extent it is presented in a way that makes you laugh, smile and cheer.
Quote:
Example: Lagspike Production's "Thrall’s Crib": The fun-factor is used as the bearing element throughout the movie, and has a profound impact on how we – so far – have received it. Few would find their time spent watching it wasted, even though the setting is actually quite boring. See the movie.
Example: Champu's "Dorkette 3 - Smite Still Sucks": The fun-factor here is used to legitimate the lack of performance figures (see excitement-factor) by giving a sort of laid-back approach to the whole PvP concept, and thereby excuse the shenanigans that would else have been downrated. See the movie.
The excitement-factor. Based on your personal preferences, this is what gets the viewer excited and what keeps him/her spellbound. Examples could be high damage output/crits, fights that are won by a small margin, content/encounters explored for the first time, or following a character’s journey in becoming a man/hero/whatever. This factor is mostly dictated by the setting of the movie (whether it’s arena, raiding etc.), but can also be enforced by the choice of focus. Perhaps with the exception of world first kills, this factor should never be the key focus of a movie, but merely a contributing factor towards improving the content. It's definitely worth bearing in mind when making a movie. Another key excitement factor is of course the audio, but we'll get to that later.
Quote:
Example: Awake's "World First: Nihilum Vs. Illidan Stormrage": The number four highest rated and most downloaded movie on WCM. Admittedly some effort was done towards making this a quality movie, but I still reckon the major contributing factor is that of excitement about the achievement. See the movie.

Creativity

As this name says, this is about to what extend a movie brings something refreshing to the community, be it on an editing level, music-wise or in the content. Not in the sense that it hasn’t been seen before (the first Twin movies wasn’t exactly creative, was it), but in using any of the above aspect in a new manner that breaks with tradition or opens up for possibilities the viewer had not thought of.

Originality. I like to think that everyone watching a movie do so because he/she hopes to see something new, from a new perspective or from another angle, so obviously originality has to be important – for the ones making the movies as well as those rating them. Achieving this can be done in many ways, even within relatively static settings (say level 70 arena’s): one could add off-topic clips in between the fights, show fights in a stylish way without UI displayed, or try to come up with a story of why this character seeks to eradicate others – your imagination sets the limits. When I rate movies on creativity this is an absolutely crucial element. It doesn’t have to be as groundbreaking as the below examples to be original, but you get the idea.
Quote:
Example: Buffalo’s "15 Warriors III Beginning": Simply because this is concept is never seen before, the trailer has almost made platinum – despite the fact that content-wise it shows absolutely nothing but a screenshot of 15 players. See the movie.
Example: Biber’s "Emo Army Multiboxing PvP 2 Teaser": Same story, this trailer has made 60k downloads and 4.65 rating solely for its unorthodox approach to gaming. See the movie.
Recycling. Only few movies are truly original (per definition), but even so movie makers can still differentiate themselves from the throng and when they do, it is most often by recycling existing ideas in a different manner. The setting may still be an arena, but by spicing it with clips showed in a new way the viewer’s interest is maintained. Ways in which to recycle can differ from content to editing, but I like to think that it is creativity that inspired the use of it. This also means that editing can’t be about how original the effects used are, but we’ll get to that in a minute.
Quote:
Example: Deep’s "Deep 6": What’s shown in the movie has been shown countless times already, and even by some of the world’s best players (Sonny, Beasteh etc.), but by drawing lines from previous Blizzard productions we are entertained in a new manner. Not that the concept of clips is new, but done in this new manner it contributed to the 125k downloads and 4.79 rating. See the movie.

Editing

This is typically where it gets hairy, and where it is difficult for me not to bloat about my own preferences. Generally speaking there has to be a balance between editing and content so that the content is never subdued or distorted by the means to present it. Editing is a supplement to what’s going on, a way to make what you see more edible and to guide the viewer through the content for either demonstrational or entertaining reasons – it should never be the driving force.

Consistency. More often than not I see movie makers failing on their editing because they’re either too eager to demonstrate what they’ve learned, or because they somehow got the insanely stupid idea, that the more, the merrier. As a consequence, poorly edited movies often display a large array of different editing tools with little or no connection, which gives the viewer that very un-theme’ish feel. If you have a fetish for turning the image red upon critting your opponents, then I guess that’s alright, but by God I shall haunt your nightmares if you then show half the crits in blue. If zooming in on your character every time he/she makes a killing blow is your thing, then stick to that concept. Why is this important, you may ask? Because every time you introduce a new form of editing the viewer is forced to focus on that, rather than what’s actually going on, which is mostly a bad thing - unless of course you find the zooming effect to be more important than the boss encounter.
Quote:
Example: Olibith’s "I’m only sleeping": All transitions come from a circle zooming out from the center of the screen. By using the same transitions every time we quickly relax, and can focus fully on the content. See the movie.
Effects/Textures. This is an aspect of editing that is often misused. I'm not the one to say that the effect of purple items and big swords have undone people's common sense, but sometimes it feels as if that is exactly what has happened. NO, 'big boom' distortion effects will not be entertaining when used every 10 seconds for 12 minutes, and going for some odd texture that makes everything unreadable is not the path to glory and fame either. In fact, there are very few cases where this actually couldn’t work better with another form of editing, so unless you feel bold and want to aggravate our senses you best leave it.
Quote:
Example: BaronSoosdon’s "The Device Has Been Modified": The picture distortions used at e.g. 0:44 and 0:56 work because they supplement the content (trying to establish contact), but they aren’t – and never should be – used frequently. This movie is also a very good example of how well amplifying and zooming effects can be used to create a sense of atmosphere and intensity. See the movie.

A/V Quality

This aspect is commonly overlooked, which is awkward seeing that it is the easiest one to determine, and the one where you get to be somewhat objective and therefore most fair. For obvious reasons it is divided into two.

Audio quality. Genre and feel: Contrary to what seems to be the general consensus, rating the sound (usually music) should be based on whether or not it follows the content in a plausible way, and not the number of times it has been used elsewhere. If the song matches the content it does its job well, okay? Okay. The story-line movies that depict the development of a set of characters usually call for the subtle and dramatical music genre which is often found in the Hollywood soundtrack section. Similarly, a fast paced, combat-heavy movie will often call for more fast-paced and loud music. Rhythm: The second aspect of audio rating is to what extent the rhythm and feel dictates the content, for example the timing of shifting camera angles, or the timing of various editing tools. Use of it should be employed carefully, but when done correctly it adds intensity to the movie and anticipation for what’s to come. A very useful tool in keeping the viewer interested, and thereby something that should inspire to a better rating.
Quote:
Example (genre and feel): Martin Falch's "Tales of the Past III": the sound effects supports the content, and the music is subdued to keep the story in focus, but is also altered to emphasize certain moments; after Blazer kills a companion the music increase in volume, as the song talks about his state of mind. The genre changes depending on the content - large scale combat uses dramatical full orchestra scores, while other parts use more subtle music. See the movie.
Example (rhythm): Yume's "Arithmomania": Camera transitions based on rhythm are used frequently throughout the movie, but a prime example can be found between 1:43 and 1:54. See the movie.
Video quality. While probably the easiest on to rate, this is also the one that least people rate accurately on. I guess they just don’t have a clear reference to relate to, so let us straighten that out right away. Stars should be awarded based on the best quality you have ever seen in a submitted movie. Usually that means one encoded in H.264, or if you want an actual reference, go and watch Arithmomania Super HQ or The Device Has Been Modified x264. If you are reading this and you are about to make a movie, be sure to visit Yume's excellent guide on how to encode with H.264. For those of you that do not have the hardware to support full-size frapsing, I am inclined to say “tough luck”. If the image quality is poor the movie will receive poor A/V rating, and that has nothing to do with how good the movie is. Live with it, or provide a better quality. Now you know how to, let that be the end of the discussion. As for those rating the movies, if you only watch the stream or a medium/low quality release you have nothing to say about image quality. If you must rate, then please do it based on the audio aspects alone.

On a side note, different people have different connections as well as different opinions to how much image quality matters. I am one of those who believe that a message poorly presented is only half a message, but to oblige to those who do not think that way it never hurts to publish both a low and a high quality release. I have even seen one bloke publish with different aspect ratios, and found that a nifty detail - especially if you are sitting behind a widescreen monitor. All these things contribute to a better rating, and compared to the work put into the actual movie this should really be standard procedure for every movie maker.


In closing...

I have probably forgotten a bunch of things, and there is a good chance I have also been rambling on about some aspect that are not quite so important, so if you made it this far I would like to give you my compliments. I do not claim to have any unique knowledge on the topic, nor do I work in the field, so if I have missed something or gotten something wrong, make sure you are the first to tell me! Other than that I hope you now have a better picture about how to rate movies, and that you learned a few things that will help should you ever want to make one.

Best regards
Abyzz

Last edited by Abyzz : 05-02-2008 at 08:24 AM.
Abyzz is offline   Reply With Quote
Old 05-01-2008, 10:27 AM   #2
Hacky
Hall of Fame member
 
Hacky's Avatar
 
Join Date: Aug 2005
Posts: 76
Hacky is unknown at this point
Literally 75% plus of people who rate completely ignore the ratings category system. This is party to do with because, well, people just do coz they're a bit ya know ;-P dumb. Also people if they like something tend to just max it out with 5's. Which again isn't very helpful at all. BUT, a good chunk of the reasons why all this happens is because the ratings system is flawed imo. I know it's damn hard to come up with a good system, but the one on WCM simply just doesn't fit for a lot of movies and kind of forces you to just ignore it completely.

Also, you can't search by ratings category. It would be mighty cool if I could for example search by editing rating, and see all the best edited movies listed, regardless of if they have any PvP skills or whatever.

It would be cool to have an open debate about a new ratings system, like a discussion on what a new one should be. But again this is flawed because it means you guys have to write a new one, and someone convert the old one into the new one, plus no one reads these forums anyways so everyone will most likely scream and freak out when things change. Catch22 situation! hehe so perhaps we just have to live with it as it is maybe.

Last edited by Hacky : 05-01-2008 at 10:31 AM.
Hacky is offline   Reply With Quote
Old 05-01-2008, 10:32 AM   #3
Abyzz
Initiate
 
Join Date: Dec 2006
Posts: 28
Abyzz is an unknown quantity at this point
Rightly so, yet I've not come across a movie where I couldn't point out a couple of flaws in regards to the above perimeters, so it's mostly up to you as a rater. Unless you choose to ignore the possibilities I'd say WCM offer very good rating opportunities. My only major regret so far is that skill isn't part of rating, even though it's absolutely crucial to whether or not the movie is a success. I've made a topic about that, but things run a bit slow around these boards..
Abyzz is offline   Reply With Quote
Old 05-01-2008, 10:36 AM   #4
Hacky
Hall of Fame member
 
Hacky's Avatar
 
Join Date: Aug 2005
Posts: 76
Hacky is unknown at this point
Yeah, same, I mean if I could add just TWO things it would be the ability to rate skill, because most of the categories are bias to the actual MOVIE MAKING skill itself and not the player/content skill/fun factor, which again makes people just ignore it. But a way to rate more the content itself, and also secondly the ability to search by category like how you can for download numbers or over all rating.
Hacky is offline   Reply With Quote
Old 05-01-2008, 11:03 AM   #5
Dwârv
Senior Member
 
Dwârv's Avatar
 
Join Date: Sep 2006
Posts: 267
Dwârv is unknown at this point
Howdy -

Not the first try to give people a guideline on how to rate,but sure the best one so far.
Like Hacky allready mentioned,chances are that this one will drown into the sea of oblivion like many others,just because people don't come to the forum.

So first of all:This should be linked on the frontpage.
Second: sticky please.

The rating system will be discussed for ever and ever, due to it's weak points, and I doubt that we will have an improvement one way or the other, but I want to repeat the suggestion I threw out once or twice:
People give five stars on movies just because they like it, and they give a damn about the rating categories (example:the clip where the paladin wipes a raid,forgot the exact name atm.Its funny,but creativity,editing and A/V quality a definitly no 5-stars.Still its collecting 5 star ratings like crazy).
Imho it might help to add a category that fills this point:Something like "I liked the movie 1 - 5",a general rating in a way...Maybe then people start to pay more attention to the other categories.

Thanx for the efford,Abyzz.

Regards
__________________
RunningDwârv productions

Last edited by Dwârv : 05-01-2008 at 11:07 AM.
Dwârv is offline   Reply With Quote
Old 05-01-2008, 12:07 PM   #6
Abyzz
Initiate
 
Join Date: Dec 2006
Posts: 28
Abyzz is an unknown quantity at this point
For those who don't put too much effort into rating accurately (hey, it's a game) I definitely understand where they're coming from. If you can't rate the things you really think matters (which, being the arena-era that it is, most often revolves around character skills) you are not able to give representative feedback on your experience - so why bother trying to? I've seen movies that were entertaining purely because they displayed unparalleled reflexes or clever teamwork, but which I've been forced to rate as average movies because of image quality, lack of editing or whatnot. Great movies, but under the circumstances downrated non the less.
Abyzz is offline   Reply With Quote
Old 05-01-2008, 02:47 PM   #7
Hacky
Hall of Fame member
 
Hacky's Avatar
 
Join Date: Aug 2005
Posts: 76
Hacky is unknown at this point
For sure, I mean let me use extreme examples, a movie like Leeroy, one of the most downloaded movies in WoW, zero skill, far from it, it's anti-skill, but it's funny as HELL! It has crap AV quality, it has no skill, no editing skill either, nothing, it is just a simply funny, but it always gets maxed out ratings in all categories hehe. As do all movies of this type.

Then we have another end of the spectrum, like BaronSoosdon's movies. Again, zero skill in game play or PvP or PvE, yet EXTREME best of the best skills in editing, creativity and AV quality and encoding. And skill in like editing the game exploiting and hacking it for art. How do you rate that shit?

Then you have the 100000000000000000000 x trillions of PvP movies which WCM is 99% about, most have no editing skills at all, and dubious vision quality, but again how do you rate them, all the categories are movie making categories all about movie making skill. Yet again, we see 5/5/5/5/5/5/5/5 always yet all PvP movies are basically the same, MOVIE wise, it is only in PvP skill they vary.
Hacky is offline   Reply With Quote
Old 05-01-2008, 03:04 PM   #8
Abyzz
Initiate
 
Join Date: Dec 2006
Posts: 28
Abyzz is an unknown quantity at this point
I'd tend to keep Leeroy out of the equation - what happened back then was a cyber-cult based on nothing apparent save perhaps the lack of a word for that action. And one must admit, a "Leeroy" is quite well elaborated at this point.

The BS movie genre I actually find quite easy to rate. The only difference is that the content usually doesn't follow any logical story-line, and that mostly there's no 'message' embedded in it. A/V quality is usually high, as is editing, and creativity and content depends on whether or not the movie succeeds at combining these aspects well. "The Device Has Been Modified" that I linked to brought something new to WCM through its funny time-line at the intro as well as the combination of Portal and WoW, which made it - to me - a very creative piece of work, while the content actually summarized the entire Portal game in a meaningful yet different way.

The arena section which, precisely as you say is 99% of all movies, is where I start pulling my hair out. Partly because any attempt of fair rating is blown to pieces, and partly because most of the submitted movies are so unbelievably unoriginal that I find I have to strap myself onto the chair not to bang my head against the wall repeatedly.

What's needed right now is more story-telling in the PvP segment. Add some of the Tales of the Past goodness to an arena movie and make it more than just a number's game of mana and insignia's.
Abyzz is offline   Reply With Quote
Old 05-01-2008, 03:12 PM   #9
Dwârv
Senior Member
 
Dwârv's Avatar
 
Join Date: Sep 2006
Posts: 267
Dwârv is unknown at this point
Basically, in my humble opinion, we should stick to the ratin categories and rate the movie according to them.Meaning "Leeroy"would would bite the dust and The Barons movies would collect 5 star ratings like the raters get paid for it.
Thats why I ask for this "overall" rating category.There you could vote "Leeroy" 5 stars,regardless of what you voted the other cat's.I know it's too much to ask for,but it would be perfect to see 2 ratings on each movie.One as a conclusion of the rating cat's we have so far, and one resulting out of the "general"-rating.

Until then, I don't hesitate to give low ratings when a movie deserves them.Even when it's against the mainstream.Mainly because anithing different - like 5 stars on a movie like "A WoW paldin wipes the raid" - would be a slap in the face of the moviemakers who really put efford in their work and come up with something special (like Tamzin,e.g.)

P.S.:Anybody else with an opinion around here..?...just anybody..?
__________________
RunningDwârv productions

Last edited by Dwârv : 05-01-2008 at 03:19 PM.
Dwârv is offline   Reply With Quote
Old 05-01-2008, 05:15 PM   #10
Hacky
Hall of Fame member
 
Hacky's Avatar
 
Join Date: Aug 2005
Posts: 76
Hacky is unknown at this point
Quote:
P.S.:Anybody else with an opinion around here..?...just anybody..?
haha yeah right! I once asked a question on this forum, and it was replied to 6 months later, and I'm not kidding u hehe /wrists. There isn't much interest in the 'scene' I think that's party a side effect of everything we been talking about, it's the MTV generation out there, just let me press 5 and I'm done, no forums, no categories to bother about, just BAM done! cum shot, game over, k NEXT!

But to reply to something u said... the problem is, logistically speaking I mean, coz I've had this debate ad-infinitum with Uzbeki and Baron many times in the past, they must hate my whine spam hehe, but anyway, the problem is if you rate something low in one category it pulls the over all rating down a lot so it's really hard to find rating categories which weave together seamlessly yet while also giving you details about which aspects are good or bad. It's far from an easy task to make THE perfect ratings system unfortunately.

I mean take my new movie for example, the Illidan tactical guide one. It has no 'skill' really in game play, I mean ok so we're killing Illidan but anyone can do that, so one could in theory rate it high in movie making skills and low in 'game play' skills categories, thus making the over all rating really low, so people would not bother to watch it. But as we seen what people do is rate 5 in everything, if they like it hehe. I wish they wouldn't though coz it gives much more constructive feedback if you rate constructively. But u can ONLY do that if u do that for EVERY movie coz u can't rate one movie 5 coz it made u laugh and is 10 megs long then a 1 gig art movie rate it 4 because you felt the way motion blur was used was too similar to his last master piece. It needs consistency. I mean I think I have never rated a Baron movie 5 in all categories, coz if I DID it tells him 'this is perfection, u can do no better, this is your master piece' so I don't want to give him 5... YET

Last edited by Hacky : 05-01-2008 at 05:23 PM.
Hacky is offline   Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Forum time (GMT) 01:39 PM


Powered by vBulletin® Version 3.6.12
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.