More Bandwidth and Revenue Needed

Locked
User avatar
Coderjo
Joined: Sat Mar 03, 2001 11:46 am
Org Profile

Post by Coderjo » Tue Oct 04, 2005 9:49 am

Coderjoe wrote:Hmm.. Within the month of august, Animix was downloaded 768 times, using a total of 557GB of bandwidth. There are 10 videos that, in August alone, used over 100GB apiece. Perhaps BitTorrent might be worthwhile for very popular vids. All but three of the top ten bandwidth users from August had over 1000 downloads.

Thank you, (someone), for providing the statistics.
hmm.

On the other hand... AniMix only used 1.93% of the total local download amount in August...
xort wrote: And just how much memory do you think it takes to track lets say 25,000 torrents? Do you know?
Do you know? Also, how many downloaders do you expect per torrent, on average?

Bittorrent really isn't wothwhile for the mass of videos being downloaded a few times a month. Especially when many people are likely to close the torrent once their download is complete. Additionally, who do you think would be seeding the torrents? More than likely the same download server that is storing the video and currently sends it out via http already.

Bittorrent might be worthwhile for videos with a large number of downloads per month, or for top bandwidth consumers in a month, but not for the peek on Phade's curve.

RECONstiPated
Joined: Wed Mar 17, 2004 9:27 pm
Contact:
Org Profile

Post by RECONstiPated » Tue Oct 04, 2005 3:05 pm

I never thought I'd actually want to donate, my letter is being sent in now!

User avatar
derobert
Phantom of the .Org
Joined: Wed Oct 24, 2001 8:35 am
Location: Sterling, Virginia
Contact:
Org Profile

Post by derobert » Tue Oct 04, 2005 9:42 pm

xort wrote:And just how much memory do you think it takes to track lets say 250,000 torrents?
I doubt there is much of a technical issue with tracking that many torrents. Now, let's talk about seeding even 30,000 torrents. I'm pretty confident the disk arrays required to support random access to 2TiB at 30 MB/sec are confortably out of our price range.
Key 55EA59FE; fingerprint = E501 CEE3 E030 2D48 D449 274C FB3F 88C2 55EA 59FE
A mighty order of ages is born anew.              http://twitter.com/derobert

User avatar
Mroni
Joined: Tue Aug 14, 2001 5:08 pm
Location: Heading for the 90s living in the 80s sitting in a back room waiting for the big boom
Org Profile

Post by Mroni » Wed Oct 05, 2005 5:05 am

I like the idea of booths at the cons. I think you would get a great response selling hats there too. I would easily plunk down 20 for a hat and make a donation too. I am very bad at mailing things out Ive had a hd waiting to get shipped for almost a month now. I want to help the org Ive been leeching since 2001. And I don't use a credit card so having a booth at Otakon or Katsucon would be great for me I would also donate time in watching it. I don't know how you would secure the money I certainly wouldn't rip off anybody maybe only the big name creators could run it.


Mr Oni
Purity is wackable!
"Don't trust me I'm over 40!"

User avatar
bum
17747114553
Joined: Sat Nov 08, 2003 9:56 pm
Org Profile

Post by bum » Wed Oct 05, 2005 6:46 am

Coderjoe wrote:
Coderjoe wrote:Hmm.. Within the month of august, Animix was downloaded 768 times, using a total of 557GB of bandwidth. There are 10 videos that, in August alone, used over 100GB apiece. Perhaps BitTorrent might be worthwhile for very popular vids. All but three of the top ten bandwidth users from August had over 1000 downloads.

Thank you, (someone), for providing the statistics.
hmm.

On the other hand... AniMix only used 1.93% of the total local download amount in August...
Considering how much bandwidth this place goes through each month (roughly 3TB) 1.93% is alot. What I believe would be a good idea is if torrents of the top 10% in 25 video blocks are put up. As the list changes (which it rarely does, esspecialy closer to the top) little signs can be placed where appropriat.

User avatar
Coderjo
Joined: Sat Mar 03, 2001 11:46 am
Org Profile

Post by Coderjo » Wed Oct 05, 2005 11:41 am

bum wrote:(roughly 3TB).
Try closer to 30TB. (in august 28,826,947,411,928 bytes)

User avatar
celibi87
Joined: Mon Oct 11, 2004 10:48 am
Location: That one place
Org Profile

Post by celibi87 » Wed Oct 05, 2005 9:17 pm

Coderjoe wrote:
bum wrote:(roughly 3TB).
Try closer to 30TB. (in august 28,826,947,411,928 bytes)
damn.....

xort
Joined: Fri Jun 29, 2001 7:00 pm
Org Profile

Post by xort » Wed Oct 05, 2005 10:48 pm

Coderjoe wrote:Do you know? Also, how many downloaders do you expect per torrent, on average?
I do know, however I wouldn't expect anyone to take my word. It would be more worth while to research an answer than to be given one that you would never honestly believe. For the mean average about 150 downloads evenly spread over 30 days.
Bittorrent really isn't wothwhile for the mass of videos being downloaded a few times a month. Especially when many people are likely to close the torrent once their download is complete. Additionally, who do you think would be seeding the torrents? More than likely the same download server that is storing the video and currently sends it out via http already.
Those that close without providing a full return should have their acounts limited, to upload only or download equal to upload. Management for anti leech control is highly effective. Members that can't upload should be able to donate money for download credits or an upgrade to an unlimited acount. Although even the tighest ISP could handle a few megs uploaded over a month. Or maybe your acount will have download bandwidth added ever 15 days or something for free just for being a member. The seeding would be handled in part by the current server and in part by people downloading. As their is a steady flow of downloads, their will always be someone downloading a file that would be able to upload to others.
Bittorrent might be worthwhile for videos with a large number of downloads per month, or for top bandwidth consumers in a month, but not for the peek on Phade's curve.
Think of it like this: if you already serve all that content each month, by changing the way it's downloaded from HTML transfer to BT, what is lost?

After talking this problem over, the solution offered was to convert the whole database into a single superset torrent, and provide single file access torrents (IE one video) for download. People would be able to grab single files and might in passing upload to others, (for sure if they actively choise to help) while the very popular files would mostly transfer themself.

The seeding of the whole database would be covered by the current http servers while the tracking might need to be offloaded onto another system or one of the freed transfer servers.
Try closer to 30TB
30TB in 30 days. I could offer a link to a tracker that passed 70TB in a day.
I doubt there is much of a technical issue with tracking that many torrents. Now, let's talk about seeding even 30,000 torrents. I'm pretty confident the disk arrays required to support random access to 2TiB at 30 MB/sec are confortably out of our price range.
And yet somehow this site currently runs... Further the most common vidoes would not require any access help.

However this is speculation, Phade having taken the effort to dig up a graph and post it, Combinded with his own bad BT experience will likely mean that AMV dot org will never have any BT support, ever. That's my own experience on human nature talking here so I might be wrong.

My parting suggestion is that someone finds what are the top 100 videos by bandwidth, and just go ahead and set up a tracker and make the torrents for them. Ask nicely and have a BT section added in the download options and take at least some of the load off.

If even a fraction of 1% of the people here are willing to offer money, I know that many more would offer bandwidth.

User avatar
Kalium
Sir Bugsalot
Joined: Fri Oct 03, 2003 11:17 pm
Location: Plymouth, Michigan
Org Profile

Post by Kalium » Wed Oct 05, 2005 11:10 pm

Let me explain why BT is a bad idea for the Org.

It works like this. BitTorrent solves the problem of a number of users wanting a small number of files of significant size (200+ meg seems to be the sweet spot) simultaneously. To be really effective, you need hundreds at a time. Aside from the most popular of videos (ex: AMV Hell 3) just after release, the simultaneous demand just doesn't exist.

HTTP solves the problem of a relatively low number of users wanting a relatively high number of files.

"But wait!" you protest, "the Org has lots of users!"

"Ah," I retort "yes, but only a handful of users (at most!) are likely to be downloading a random video a random moment."

"As a result, the simultaneous demand neccessary for BitTorrent to be useful doesn't exist. This is, in fact, precisely the situation our old and dear friend HyperText Transport Protocol was created for!"

Need I continue?

User avatar
Phade
Site Admin
Joined: Fri Oct 20, 2000 10:49 pm
Location: Little cabin in the woods...
Org Profile

Post by Phade » Wed Oct 05, 2005 11:20 pm

Hey,

It also seems that web site + BT = high on "nuke" list. Until that changes, I think we really can't raise our risk exposure even more than it is now.

Phade.

Locked

Return to “Site Announcements”