The AMV Genome Project

General discussion of Anime Music Videos
User avatar
CrackTheSky
has trust issues
Joined: Sun Aug 27, 2006 11:01 pm
Status: Maybe editing?
Location: Chicago
Org Profile

Re: The AMV Genome Project

Post by CrackTheSky » Mon Aug 25, 2014 6:47 pm

Lirinis wrote:If I were doing such a project and if I were result-, not process-oriented, I'd be thinking in two directions:

a) Making tags' definitions as formalized as possible so that the work could be offloaded to one of the services where people do simple tasks for little money.

b) Focusing on automatically extractable data like music genres, number of sources, cuts intensity, color gamma, video length, keywords in comments. Comments can really be a treasure chest for auto-tagging.

Plan b) sounds pretty feasible to me.
For (a), this is already halfway done. I've provided formalized definitions in a Word document included in the ZIP file for all the "General tags". The FX tags will (hopefully) receive a similar treatment at some point.

(b) is a little harder. Much of the data you reference isn't actually extractable, at least not from the .org directly (music genres, cuts intensity [not really sure what you mean there], and color gamma to be precise). Even if it was I wouldn't know how to automatically get that, I'm no programmer. As for the comments, it's an interesting idea but unfortunately it relies on the editors actually talking about their own videos in the context I'd need them to to get the proper tags. I don't think it would be terribly efficient. If this were to get integrated into the .org redesign, something like that might be useful...however as it stands right now, there's no way that could be consistently applied across all videos to get the kind of information that's going to be useful to me.

trythil wrote:It may be useful to associate short video clips with each usage of each tag to illustrate what each tag means; all examples of a tag can then be shown in a single document. Systems like danbooru use this approach.
If I understand what you're saying, this can already kind of be done with the spreadsheet I have. You can filter the list so that only videos with specific tags show up; if anyone wants to know what a certain tag means, all they'd have to do is watch a few of the pertinent videos to (hopefully) get a feel for it. Obviously there are no "short video clips" right now but that might be something to consider in the future.

User avatar
CrackTheSky
has trust issues
Joined: Sun Aug 27, 2006 11:01 pm
Status: Maybe editing?
Location: Chicago
Org Profile

Re: The AMV Genome Project

Post by CrackTheSky » Fri Aug 29, 2014 6:12 pm

I have updated the Project Files link (see link in my signature below) with the up-to-date master list. Within the ZIP file is now a text file called 'Changelog.txt' which I will include with all subsequent updates. It will show the list of videos added since the last update, along with any other changes that might have taken place within other files. There are a few that have taken place already within the last week. Check it out if you're interested.

Also, it was noted in the first post but I know a lot of people probably just skimmed it so I'll mention it again: the .txt file in the FTP that's just a date is just there to show when the ZIP file was last updated. It serves no other purpose.

From here on out, the project will be updated silently every Friday, barring 9/12/14 when I will be out of town for NDK (woop woop). If there are any major updates that require their own post, I will post in this thread. I will continue to answer any questions that people might have as well, so feel free to post here.

I do plan to get a blog up and running, hopefully within the next few weeks, if for no other reason than to serve as a journal for the development of the project. If this comes to fruition I'll post a link here. Thanks for the feedback and support guys!

User avatar
TritioAFB
Ambassador of the AMVWorld
Joined: Fri Sep 04, 2009 12:38 am
Status: Doctor
Location: Honduras
Org Profile

Re: The AMV Genome Project

Post by TritioAFB » Sat Aug 30, 2014 9:47 am

Scintilla wrote:
CrackTheSky wrote:Besides...odd as it may sound, this is actually a lot of fun for me |:>
... have you ever considered a career in actuarial science?
That's how I ended in medicine :awesome:

I'll take a read, I want to see what you're planning :book:
Specialist in Geriatric Medicine

User avatar
CrackTheSky
has trust issues
Joined: Sun Aug 27, 2006 11:01 pm
Status: Maybe editing?
Location: Chicago
Org Profile

Re: The AMV Genome Project

Post by CrackTheSky » Fri Nov 07, 2014 6:38 pm

Clicky

In a poorly-disguised attempt to keep this thread from locking, I wanted to post an update here for those few of you who showed interest in this back when I first posted it. Now might be a good time to look into this again, as I have been adding to the database consistently since I started, and it now has over 500 entries. In the grand scheme of things, it's not a huge number, but a few things are starting to come into focus and I thought some of you might be interested. So, I'd encourage you to check out the spreadsheet now to see how things are developing. A list of things that have been added since I originally publicized the project:
  • New tags, including "Live action", "Long", "Short", and "Video game" for helping to track specific types of media other than anime used in some AMVs, as well as providing a quick reference for AMV length in tag form. (As ever, specific definitions for each of these tags is provided in the "Tag definitions.doc" document in the ZIP file).
  • A "Duration" column has been added in the List worksheet, which provides the length of each video in seconds...this has been one of the more interesting things added, as I'll explain below.
  • A "Duration" worksheet has been added to start analyzing trends in video duration. Again, see below for my comments.
  • Added an "average-by-year" of my personal ratings in the Refined Data worksheet. This probably won't interest the general public much but it's helped me to see that I'm not quite as cynical as I thought I was.
  • Added a "Notes" column to the List worksheet. This has actually been quite useful, it allows me to make personal notes on various videos, as well as general notes for observers (i.e. if a video is YouTube-only, or if it is a Vault video with limited information available).
  • Changelog.txt has been added to the ZIP file which shows what specific videos are being added to the list each week, as well and other changes made to the documents since the last weekly update.
As it was the last time I commented, there's still a relatively small number of videos in the list when you consider how many videos have been uploaded to the .org overall, but some stuff has come to light, specifically in regards to video duration, that will probably not change too much as more videos are added. Check it out:

Image

Not too surprising, but cool nonetheless. This basically shows a general downward trend in video duration over the last 15 years. Of course, and I can't stress it enough, there aren't very many videos per year, so take this with a huge grain of salt, but I predict as I go on this trend will be confirmed, and down the road might even become more extreme. It's already somewhat confirmed in my mind by the fact that there are three separate years which have comparable numbers of videos (2002, 2007, and 2014) and the difference between then and now is pretty unmistakable. Also, I do believe that in the case of duration the sampling is pretty close to random, as there's no bias in my watching shorter videos vs. longer videos.



Image

This is a little bit more unexpected, at least for me. This shows a similar breakdown of average video length, but this time by genre. It's no surprise to me that parody, comedy, dance and fun videos are shorter than drama, romance, sentimental, and serious videos, but it does surprise me that action videos are tending to the higher end of the spectrum. The most surprising thing, though, is that last bar, the one I've so eloquently entitled "FXgasm".

"FXgasm" is a tag in the database, not a genre, but I was interested how it compared so I added it. These are the videos that put effects on display throughout the duration of the video; basically, these are the videos that were made just to show off effects work, and everything else was (in most cases) secondary. I'm honestly quite surprised to find that FXgasm videos are the longest videos on average, as I would have expected exactly the opposite. It'll be interesting to see how that develops as more and more videos are added to the database as well, but I'd expect these figures to polarize as time goes on, rather than even out.

Anyway! Just thought I'd share. I'm loving this project, and enjoying it every step of the way. I'll keep you updated as more and more things come to light. In the meantime, if you feel like following the development of the project, I do post occasionally about it specifically on my blog, subculture diaries. If you just want the Genome Project-specific entries, click here. So far there's only one entry, but I'll be updating it occasionally as I come across things worth posting.

User avatar
guguza
Joined: Mon Nov 03, 2014 2:15 pm
Org Profile

Re: The AMV Genome Project

Post by guguza » Sat Nov 15, 2014 2:43 pm

interesting project, but is still working?

Locked

Return to “General AMV”