2008 Judge's Choice Awards - Aftermath/Suggestions/Comments

Announcement & discussion of Anime Music Video contests
Forum rules
Coordinators who fail to maintain necessary communication with entrants, or provide timely updates on results may be barred from announcing future events.
Locked
User avatar
Nessephanie
Cookie Monster
Joined: Sun Nov 07, 2004 1:54 am
Location: Chicago
Org Profile

Post by Nessephanie » Mon Feb 25, 2008 5:57 pm

Darius GQ wrote:1) the judge or expert cannot be the person, who takes part in competition as a clip creator;
The judges who were nominated weren't allowed to vote in the categories they were nominated in. Personally that was good enough to keep it fair. More judges though could make this better. Then when one of the judges can't vote, it wouldn't effect the numbers are much.
Darius GQ wrote:2)to invite or choose 6 judges or experts from the different countries. It seems to me would be more fair...
I think the judges were pretty diverse this year...I mean four out of the five judges were from different countries. That's only one step away from what you suggest.

As well, the judges aren't invited, they're voted in by everyone. Limiting it down to who can be voted for seems like it would make the contest less fair...As long as the judges can't vote in the categories their nominated in, it's fair game.


I think overall the contest ran pretty smoothly for the first time around ^^ I do think that more judges next time would be a good idea in general, but that all depends on the amount of participation.

User avatar
Koopiskeva
|:
Joined: Sun Mar 17, 2002 7:31 pm
Status: O:
Location: Out There Occupation: Fondling Private Areas ..of the Nation.
Contact:
Org Profile

Post by Koopiskeva » Mon Feb 25, 2008 6:06 pm

Darius GQ wrote:....I didn't like this competition in general....
Truly, the idea is GREAT but the realization of it is not perfect.
I am not satisfied with judges or experts discussion. There were people who know each other well and, excuse me, they have easily pushed up their proteges & friends…(nothing personal. It is my opinion and feelings only)....
btw - how Godix could became a judge?! he is the most subjective son of the bitch I've ever seen.... this is the BIGGEST BulLSHIT of the year.....
The judges were selected anonymously via a poll:
http://www.animemusicvideos.org/phpBB/v ... hp?t=86061

All the people in the polls were nominated by those that chose to participate:
http://www.animemusicvideos.org/phpBB/v ... hp?t=85800

In the end, nobody knew, except for me, who the selected judges were. The judges decided on each category on their own, and they did not know who each other were. There was no 'discussion' between the judges - I had asked them to leave comments on the videos per category. It was all blind judging in the context that they were not told who the other judges were, nobody knew who the judges were, and they didn't know what the current poll standings were for each video.

So, basically your comment on 'There were people who know each other well and, excuse me, they have easily pushed up their proteges & friends…(nothing personal. It is my opinion and feelings only)....' is incorrect.

While you think certain people were not 'good enough to be a judge' thats how the votes went. It can't be helped that certain parts of the community did not participate enough to get their votes heard. It's a first year thing - so I advertised as much as could on every ground I was familiar with. It can't be helped that its mostly a-m-v.org based - as it is the largest ground to start on.
Darius GQ wrote: What I have suggested to change in next year:

1) the judge or expert cannot be the person, who takes part in competition as a clip creator;
The fact is, that is quite difficult to do unless the editor's themselves chose not to participate in the VCA/JCA altogether - just like I did. To alleviate from this damaging the results, all judges were not allowed to vote in any category that they were in. This removed the possible 'bias' that they may have had to vote towards their own videos.
Darius GQ wrote: 2)to invite or choose 6 judges or experts from the different countries. It seems to me would be more fair...
As outlined here:
http://www.animemusicvideos.org/phpBB/v ... 59#1096759
The 5 judges actually come from 4 different countries. 2 of which are American, but considering that the largest population of AMV editors comes from the US, it was bound to be the case. I hope to add even more judges for next year's panel so perhaps even more countries would end up being selected.

I do think you rushed into your own conclusions about how the JCA is run without reading the fine print. If you disagree with the end result, then thats fine, but don't assume how the contest was run without reading about it first.
Hi.

User avatar
Brad
Joined: Wed Dec 20, 2000 9:32 am
Location: Chicago, IL
Contact:
Org Profile

Post by Brad » Mon Feb 25, 2008 6:08 pm

I suppose it's pretty hard to take my comments seriously considering that of the 5 judges that entered, I ended up winning 3 awards. I can certainly see how it can be perceived as in-voting or what-have-you. It should be noted however that we were not allowed to vote in categories that we were nominated in. It should also be doubley-noted (as Jay already pointed out) that the nominees weren't primarily restricted to VCA semifinalists since we had the opportunity to include other un-nominated videos. So the field was very open.

As far as the whole in-voting idea goes, I can't speak for the other judges, but I know that I gave fair votes to every video and I sat down and watched every single nominated video and judged them on my own personal basis, which was a combination of technical merit, artistic/creative merit, and simply visceral enjoyment, which is a factor I think a good number of people don't factor in. Take Magic Pad for example. A lot of prominent editors like to rail on Magic Pad because it feels like his other videos and isn't "groundbreaking" or whatever. I can agree with both points, but the fact still remains that I still enjoy watching it quite a bit. It's got flow, it's got style, it's got good scene selection, everything just works very well. In terms of JCA justification (it winning Best Multiple-Anime), it did a fantastic job of blending a wide variety of sources together to make something seamless and simply fun to watch. Basically, I voted for the videos that I thought deserved to win, and not on WHO deserved to win.

Now when it comes to what I think should change, I do think adding to the number of judges would help make it a broad spectrum of well-informed opinions. As far as putting a restriction on who can be a judge would be very tricky. For one, the people who are TYPICALLY (as in, not making a set in stone rule here) best suited for a position like this are people that have a lot of experience with editing, have seen a lot of videos, have been around for a while, and thusly can see a video for many different facets. Typically these people end up making videos throughout the year, and typically their videos end up making it into the VCA semifinals. It's just the nature of the beast. Again, THAT'S NOT TO SAY THAT NOBODY ELSE WOULD MAKE A GOOD JUDGE. Take Quadir for example. He's been running the AMV Reviews and obviously he seems to have a pretty well-informed opinion (even if it might vary from other people's), even though he's not an editor. You also have people who simply haven't been editing for quite a while but still know quite a bit about the artform (Take AbsoluteDestiny, NightOwl, Kusoyaro, etc. for example). However, I think that restricting it to these individuals would be a mistake, since I do think current familiarity with what's going on with the hobby makes a difference. So what I'm saying is, I like the idea of a wide variety of opinions and reasonings.

The inherent problem comes with the judge selection. I think we need to come up with a more balanced way of doing it. Unfortunately I don't really have any good ideas for how to do this, but it's something to think about.

Overall, I think the JCA results were balanced, grounded, and successful. Congrats to the winners :)
Image
Ask Brad an After Effects Question! - Forum - Site

User avatar
Koopiskeva
|:
Joined: Sun Mar 17, 2002 7:31 pm
Status: O:
Location: Out There Occupation: Fondling Private Areas ..of the Nation.
Contact:
Org Profile

Post by Koopiskeva » Mon Feb 25, 2008 6:22 pm

Illia Sadri wrote:I will second is that it is hard to give credit when many if the winning videos were by people who did participate in judging. It gives the feeling of it being ultimately an insular group dominating.


As been said, the judges were not allowed to judge in the category they were in.
Illia Sadri wrote:Basically, people will know one another and thus it is impossible to eliminate that factor, but people in the semifinals should not be involved in voting. Get respectable people who do not have a video participating to judge. I also agree with just a larger sampling simply to encompass different views of what makes a good video.
A larger panel will be possible, but to ask every one of the judges not to participate in the voting would also be skewed. Let's face it, anybody who is anybody in this hobby will have made a video within that year that'd be up for contention. To ask them not to participate would skew the overall results anyway because we'd be taking out their possibly superior videos from the contest. I believe that just by not allowing the judges to vote in the category they are in is much more feasible without causing the results to be further skewed.
Illia Sadri wrote:I also agree with expanding it from the VCA semifinalists (even as a dominant basis) because ultimately lets be honest in that it is a name game. Poeple nominate the names that are well known and vote for those they know. While many if the videos in the VCA finals are very good, there are many others that are not given quite the same attention partially because the editor is lesser known and might not submit to the major contests. I am all for giving those videos opportunities as well to compete.
This is partly why there was supposed to be a 'video nomination' round aside from just picking those from the semi-finalists - but even still. I had made it so the judges were allowed to 'add' 2 video in any category of their choosing to be voted on by the others. As it stands - there are about 20 videos per category based on the semi-finalists. Where would this line need to be? Sadly, there is no one person that has seen everything and can know every video that has been out. I believe the semi-finalists of the VCAs does a good job of rounding up most of the videos that truly have a chance of winning. Note- none of the videos that the judges 'added' came even close to winning in their respective categories.
Hi.

User avatar
Vlad G Pohnert
Joined: Tue Jan 02, 2001 2:29 pm
Location: Edmonton, Alberta, Canada
Org Profile

Post by Vlad G Pohnert » Mon Feb 25, 2008 6:40 pm

I do have to agree that it's best to have a full selection of judges even if they might not be able to vote for a few categories that they are in that possibly only ones that don't take part...

I know from my AMV contest panel of judges I run, there is a bit more logistics involved in having many judges as it's hard for everyone to commit to watching so many AMVs in a relatively short time, however maybe adding a few more, say 7 or 8 might be a good idea.. I think anymore after that starts to become a mini VCA type arrangement

Vlad

User avatar
godix
a disturbed member
Joined: Sat Aug 03, 2002 12:13 am
Org Profile

Post by godix » Mon Feb 25, 2008 6:58 pm

Darius GQ wrote:....I didn't like this competition in general....
Truly, the idea is GREAT but the realization of it is not perfect.
I am not satisfied with judges or experts discussion. There were people who know each other well and, excuse me, they have easily pushed up their proteges & friends…(nothing personal. It is my opinion and feelings only)....
btw - how Godix could became a judge?! he is the most subjective son of the bitch I've ever seen.... this is the BIGGEST BulLSHIT of the year.....

What I have suggested to change in next year:

1) the judge or expert cannot be the person, who takes part in competition as a clip creator;

2)to invite or choose 6 judges or experts from the different countries. It seems to me would be more fair...

....And now I do not consider the JCA is more objective competition than VCA…
sorry Koop, but this year JCA<VCA

"Video of the Year - Daydream" - :up:
I loled. I'm tempted to leave it at that but for some stupid reason I'm not going to.

I promised koop right from the start that I'd treat this seriously and I did. I tried to look at the good points and bad points of a video and evaluate them fairly, in many cases I voted for videos I didn't like at all because they were good videos that just didn't happen to be my thing. I actually tried to pay attention to what category things were, if I didn't think it fit the category I didn't even consider it. I entirely ignored who did the video, hell at one point I even voted for a wondertwin vid and it's well known what my opinion of their work generally is. And as has been mentioned, I didn't vote in categories I was nominated in despite the fact I was the obvious joke candidate in them.

But hey, if you think that's all bullshit I got no problem with that. My opinion isn't infallible and Spoil didn't win in the JCAs so I know you gotta take that out on someone. I just wanted to clarify that despite my usual antics I didn't treat the JCAs as a joke.

Judges couldn't vote for categories they were in so that suggestion has already been dealt with. As for being from different countries, who gives a shit? I want to see people be judges because they know about AMVs and can choose quality work. I don't want to see a judge that's obviously just the token Ruskie.

More judges might be a good idea but as Vlad pointed out it shouldn't be too many more. Five gave enough that there was a genuine consensus instead of one person jamming his choices through. I wouldn't suggest more than seven or so next year. Whoever suggested keeping judges from being the same year after year has a good point although it does beg the question, are there enough people who's judgment you'd trust to start eliminating some people from consideration?
Image

User avatar
Brad
Joined: Wed Dec 20, 2000 9:32 am
Location: Chicago, IL
Contact:
Org Profile

Post by Brad » Mon Feb 25, 2008 7:07 pm

I think having 10 judges would be good. I don't think it'll become a "mini-VCAs" because we're still cutting it down by a major amount and essentially only going with people with relatively trusted and well-informed opinions, as opposed to an all-comers open type of scenario. I'd actually be interested to see what the raw numbers for the VCAs look like (in terms of the total number of accounts that cast any kind of vote, either in the nomination round, semifinals, or finals).
Image
Ask Brad an After Effects Question! - Forum - Site

User avatar
Vlad G Pohnert
Joined: Tue Jan 02, 2001 2:29 pm
Location: Edmonton, Alberta, Canada
Org Profile

Post by Vlad G Pohnert » Mon Feb 25, 2008 7:21 pm

Darius GQ wrote:....I didn't like this competition in general....
Truly, the idea is GREAT but the realization of it is not perfect.
I am not satisfied with judges or experts discussion. There were people who know each other well and, excuse me, they have easily pushed up their proteges & friends…(nothing personal. It is my opinion and feelings only)....
btw - how Godix could became a judge?! he is the most subjective son of the bitch I've ever seen.... this is the BIGGEST BulLSHIT of the year.....
Well, everyone is entitled to their opinion and I do appreciate your honesty, but having judges from different countries doesn't mean it's going to be better or more fair.. How so? Actually, if international judging committees are any indication, it could even be worse.

However, I as much as I value your opinion, I do find it a bit harsh on your assumptions and assessment that we all knew each other and "pushed up their proteges & friends" I take the judging very seriously and judged the videos of what they were and not who made them, what music they are, anime, or creator nationality, etc, etc... It almost sounds a bit prejudice in some ways...

Actually, just as a point, several of the judges were from different countires (NO, Canada is NOT the US... :wink: )

Vlad
Last edited by Vlad G Pohnert on Mon Feb 25, 2008 7:26 pm, edited 1 time in total.

User avatar
OropherZero
Joined: Tue Dec 21, 2004 9:48 pm
Location: Australia
Org Profile

Post by OropherZero » Mon Feb 25, 2008 7:25 pm

Unless the .org Op system one was used maybe release a syllabus which all the judges had to use to judge all the videos? Just would seem more professional and balanced in terms of all judges being on the same level in the competition and making that obvious to everyone else.

User avatar
Koopiskeva
|:
Joined: Sun Mar 17, 2002 7:31 pm
Status: O:
Location: Out There Occupation: Fondling Private Areas ..of the Nation.
Contact:
Org Profile

Post by Koopiskeva » Mon Feb 25, 2008 7:29 pm

OropherZero wrote:Unless the .org Op system one was used maybe release a syllabus which all the judges had to use to judge all the videos? Just would seem more professional and balanced in terms of all judges being on the same level in the competition and making that obvious to everyone else.
A judging 'rubric' is what I had in mind to come up with during this process - unfortunately I realized too late that this rubric is not something I could write myself, but rather something the general audience would have to help write for the judges to abide by. It's definitely something that would help give more 'uniformity' to the judging criteria - but it could also limit the judge's views on what makes a certain video stand out in a category. It'd be hard to agree on I think - but we could definitely try it out for the upcoming year.
Hi.

Locked

Return to “AMV Contests”