NetGenEd Event at ReactionGrid Post Mortem

The Good, the Bad, & the Ugly

Edited by: Jani Pirkola

Link

ReactionGrid hosted a 100-200 person event for NetGenEd. The experiences and lessons learned how to host big events technically and socially.

The Good:

The good for ReactionGrid is this event challenged us to try and manage a large event on OpenSim technology. We did testing we normally would have not which proved 30-50 avatars could be logged onto a single for 30 to 60 minutes with little trouble. This led use to estimate we could handle 4 sims on our grid loaded to 25 avatars each for an event. Unfortunately this estimate did not include many human factors and the inescapable Murphy's law.

We were able to prove our streaming audio system worked pretty good grid wide with only a couple of dropped audio sections. Our use of YouTube video streaming of their .MP4 worked fine when sims were not loaded but try and change parcel media settings with 10-20 people on a sim, it simply wouldn't work until of course later in the event when not needed. But this let us know that you can stream full size video onto a grid using YouTube.

We had estimated likely the event would be 50-100 users, this turned out to be accurate.  However we had more users than we thought who had not dressed beforehand and this "edit appearance" group event was something we had not allocated enough power for and the grid strained because of it. Again the upside is we will know best practices for our next event.

We were able to record the audio stream of presenters, we were able to capture some video, and we were able to interview Don Tapscott the event speaker.  In addition we were able to announce the NetGenEd winners to people worldwide.

welcome.sflb.ashx

The Bad:

ReactionGrid tested like mad pre-event so why did we only get 20-30 users stable for the event? Especially after successful 40-50 users tests?  We made some assumptions which did not pan out. We assumed we could get an early start on the user staging process. A power outage at one of the schools ruined this plan mid-stream, aka Murphy's law. We also assumed our avatar tests simulated properly what a "real" avatar would do on a sim. However when we tried to enforce the same "no fly-get seated asap" rule we practiced with it didn't work on any level with real users.

For this reason login was chaos. Once the kids, teachers and others started to pile in at the same time we could no longer handle the load.  Our best was 30 or so avatars attending the event far short of the 100 minimum we had hoped to accomodate.

The Ugly:

The ugly was simply the failure of not accomodating all 50-100 participants.  We achieved only about 30% of this target and those had a rocky time.  I call this "The Ugly" not because we didn't put real effort into trying to make this work smoothly but because we didn't do enough real practice and testing before trying such an event with live users under a very narrow event time window.  We simply cannot expect all users to do as we think they will and as such instead of entire classes logging in we should have had a few representative kids and teachers from the schools participate until we properly tested more.  The Ugly happened simply due to not enough pre-event testing and practicing. 

On the upside, we won't ever be able to learn how to accomodate 100-200 users if we don't try, and possibly fail, to do it.  This event was invaluable to us learning how to make this work and the next large event will benefit from today. 

Summary:
So did we learn today OpenSim cannot handle large events? No, we simply tried to go for the gold and allow all avatars to be within sight of the stage for presenters.  Had we gone with a multigrid event with chat bridge we likely would have come much closer to our 50-100 concurrent users goal.  We also learned we need not 1 hour before events to stage users but 3-4 hours especially when dealing with people around the world under a very tight window of time.

This is not a reflection on the attendees merely a best practice forming for large events.  We achieved 25-35% of our estimated true attendance over the events course, we streamed to dozens reliably and we recorded video which means we can now setup the event sim to show the 3 videos that were winners 24/7 along with the video capture and audio capture of the event being available on the sim for anyone to see and hear. In addition to live events the real payback of virtual worlds is persistent event elements long after the event which usually accounts for a larger number of views than did the live event.

I want to thank the attendees, my ReactionGrid team and especially Trevor Meister & Vicki Davis the event organizers. While we cannot call today's event a qualified success we did get enough materials to recreate it persistently & we are very happy to have hit 20-30 users on one grid node as opposed to the 6 max we got when we started ReactionGrid.  Things can only improve from here if we keep hammering away as we are dedicated to doing!

Kyle "G" aka Dr_Manhattan

 

Article tagged: reactiongrid

We recommend that you discuss this article on Think, but if you really want to you can leave a comment right here as well:

8 comment(s) for “NetGenEd Event Post Mortem”


Gravatar of SP SP said on Tuesday, April 28, 2009 (1:40:51 AM)
If at first you don't succeed... I guess the great thing is that RG have learned from the experience - and I'm pretty sure it will go very much better next time, Somebody has to be the trailblazer in large events handling and it looks like RG is that somebody :)
Gravatar of Kyle "G" aka Doc Manhattan Kyle "G" aka Doc Manhattan said on Wednesday, April 29, 2009 (11:15:33 AM)
Thanks SP, we feel like publishing the ups and the downs will only move us all forward faster. We're already retooling for the next try!
Gravatar of RobinG2 RobinG2 said on Wednesday, April 29, 2009 (11:29:37 AM)
Our new system to stream audio into ReactionGrid held up stellar and could have handled many more connections - using Jetcast DSP plugin to WinAmp5 to Jetcast Server on our Darwin server gave us a nice clean stream to broadcast all over the grid and outside. Used Skype for the speakers and relayed to JetCast.
Great little system - put it through its paces and it came out triumphant! YEAH!
Gravatar of Chris Hart Chris Hart said on Wednesday, April 29, 2009 (11:31:41 AM)
We learned a lot from the experience, and all involved knew the potential hazards in what we were attempting. Each edition of OpenSim code that we use has its own unique strengths and weaknesses, such is the nature of the alpha platform, but it's that same platform that enabled people like the students from Vicki's school to come in to the grid and build out such wonderful sims. We have students from all round the world participating and learning, and while we had a little bit of a bumpy ride on event day, that doesn't stop the day-to-day success stories that emerge from our Gridizens.

We'll keep learning, improving and developing more plans and ideas for making any event as smooth as possible, and we're immensely grateful for the patience and feedback from all our members in achieving this.
Gravatar of SP SP said on Thursday, April 30, 2009 (3:19:47 AM)
I shall look forward to trying the new system in the "yet to be announced" informal public event we have planned in the next few weeks :)
Gravatar of Nebadon Izumi Nebadon Izumi said on Friday, May 01, 2009 (12:20:52 PM)
Interestingly OSGrid experiences same limit #'s at our tuesday meeting, 30 is about the absolute limit, but i think if your looking for more than 1-2 hours of stability, more like 15-20 is probably more realistic, you will be lucky to get 30 people for more than 1-2 hours.
Gravatar of Kyle "G" aka Doc Manhattan Kyle "G" aka Doc Manhattan said on Monday, May 11, 2009 (9:21:26 AM)
Thanks for that info Neb. We always recommend between 15-25 avatars max depending on sim design, server power etc.

We did get 40 on a single sim on our grid but this was under a very controlled environment. Our next big event will utilize Hyper-Grid and text/audio/video chat bridges.

We will keep you posted here as to those results.
Gravatar of c3 c3 said on Sunday, June 21, 2009 (6:18:57 PM)
Interesting results.
Ill contribute some realworld results from the Mediapodz- Cinema Insomnia Screenings Night event we have done as a balance.

As some may know we have been using the in browser, java based 3Dxplorer.com tech as the platform for the officepodz and mediapodz we built.

they can be demoed at http://www.cube3.com/officepodz.html

we did two events, one very impromtu, with just a facebook/ myspace type invite to fans of the Cinema Insomnia show to gather one friday night to meet up with the shows host, mr. lobo.

we offered little in instructions to the media, and just gave a log in link.

we received and held 5 max concurrent avatars at any time, ( aprox 8 people -)loggin in and out for a few hrs.

the second event, had a longer "invite" schedule, and also promised the video screening of a new dvd show----

we received and held 8 avatars concurrent (aprox 12) people loggin in over a 3 hr time. all but one had no problems viewing the youtube video playing -external- but linked on top of the world scene.- chat worked fine as well

so theres some info--- a very easy log in/ no real set up for the users... just mainly popup blocker needed taking offline, and btw most had never used a 3d chat /vr world scene before...

the 3d scene was set to max out at 20 avatars, id still like to test that.... if anyone want to help, contact me

cube3