What’s a browser MMO? Today, not 5 years ago?

In the previous post I poked Earth Eternal for claiming to be the “*REAL* MMO for your browser”, and disappointing on that front (although it could be awesome on all other fronts). I finished with:

So … EE may be a great game … and it may be launchable from within a browser … but it’s a long way from a poster-child for browser-based MMOs. It’s still fighting the browser as much as it’s complementing it.

It’s 2010. I know a lot of people in the industry still haven’t accepted even the concept of a “browser-based” MMO, let alone realise where they’ve got to now.

I’m not in the loop on this stuff any more, but it set me to wondering what I’d be chasing if I weren’t doing iPhone exclusively right now.

What about you? Are you fighting the browser?

The Executive’s impression

Game developers aren’t stupid. Executives aren’t clueless. But some are.

In the minds of those who make games but “don’t do” browser games on principle, I’ve found “a browser MMO” often means some or all of:

1. A text-only game running off a single Perl webpage, where each action causes the whole page to be refreshed.
2. Non-real-time interaction (because, you know … web-servers aren’t powerful enough to run anything in real-time)
3. High-latency, jerky, shallow movement of characters and objects
4. Weak 3D graphics – 5 years or more behind the curve of Console graphics
5. Fat client downloads that “no-one” can be bothered to wait for, and would be better-off distributed on a DVD

What’s reality? Well, here’s a few observations…

Drop-dead gorgeous graphics … are the norm

For a look at today, go browse some of the Unity demos. Unity is *not* the “best” 3D engine, the fastest, the best language – but it’s nicely balanced towards ease of adoption. It’s very easy for new developers to get into. And so it’s setting a very achievable base standard that’s higher than many people would believe. With anyone able to produce 3D to this level, and embed it in the browser almost as an afterthought, the use of plugins becomes a new landscape.

Right now, crappy Flash MMO’s are still re-treading the ground of Dragon Fable (which is coming up to it’s 4th birthday) et al – albeit that’s now the “standard” and there is better and better appearing. But just as it only took a few games to adopt this approach and show how good it could look, widespread adoption of Unity, and a few high-profile innovative products, will drag forwards the rest of us.

(by “us” I don’t mean professional developers, I mean primarily the amateur and semi-pro teams who don’t yet work for a living – the students etc)

2 years ago I wouldn’t have thought it would be necessary to say this (I assumed that FB would have kicked everyone’s butts) but maybe it’s still relevant: going forwards, I suspect “browser MMOs” still need to be a lot more “browser” and a lot less “traditional MMO” if they wish to stand out.

The facebook question

Browser MMO, huh? So … Why is there no option to use Facebook Connect to login? In 2010, I think that’s what browser-MMO probably means to most people: “it works from Facebook”.

The massive, fundamental changes to Facebook that are coming in this year may push a lot of content-providers off FB, and back to the web – but users will continue to demand single-sign-on access, and shared access to friends lists. This already works, off-site, thanks to Facebook Connect (both for websites and for other hardware platforms, e.g. iPhone).

I may be completely wrong, but my suspicion is that many developers still want to “use Facebook”, by which they mean:

“use (the large number of accounts on) Facebook (to get lots of users in our game without having to do so much advertising)”.

…while (again, merely a suspicion) users want their games to “use Facebook”, by which they mean:

“use (the apps, data, and list of friends I already have on) Facebook (to reduce the effort I go through to play the game)”

The problem here is the developer is chasing more signups, and the user is chasing ease-of-access. IMHO, the FB changes are going to cut off most of the former, leaving the question: who will do best at fulfilling the latter?

The Glottal-Stops and Square Pegs of User Experience

When people surf to your MMO direct from the Web, do they get a feeling akin to the glottal-stop? Do they feel like they mentally “stumbled”, as the paradigms and user-interface go through a sudden change?

Embedded within an ordinary web-browser, does your MMO look like a square peg forced into a round hole?

The effects are subtle, but they decrease virality, decrease engagement. The effects are tiny, but with millions of web-users out there, they can be cumulative. Each time a user experiences this, you marginally shrink your maximum user-base, and you push your conversion rate down.

Why was I so shocked that Earth Eternal is (silently) Windows-only? (as is/was Free Realms, for that matter)

Well, largely because it reminded me of years ago, when you’d occasionally go to a website only to see:

“This site is only valid in Internet Explorer; you are not running that browser, so you are seeing this special page instead of the site. Please download IE now and then come back.” (or Netscape, or “desktop, but you are using a mobile phone”, etc)

History suggests that this is not a viable strategy when you’re fighting it out on the web…

I’ll know it when I see it

I’m waiting for one feature in a major MMO. I’ve seen it in a few “amateur” MMOs, and you get it on Facebook apps etc. It’s a fundamental expectation from the Web, and it is incredibly powerful:

Each piece of interesting content is *named* … it has a unique URL … so that I can directly tweet places, events, people, and things. I can bookmark conversations I’ve had. I can archive, I can cite, save, and return.

Bonus points for incorporating a bit.ly service in the client, so I can literally copy/paste direct into twitter

I’m hoping it’s out there already, and I just haven’t spotted it yet. When it comes, someone let me know; until then, I’ll be spending more time in flash games, and less in mainstream MMO’s. I prefer my gaming to be Web-compatible, thanks…

6 Comments »

I got this in my inbox a few days ago, and it’s been forwarded to me by a few people since:

(NB: the fact that you still have to login MERELY TO READ THE DAMN FAQ linked from the PR statement is IMHO symptomatic of some of MP’s problems :( )

metaplace.com is closing on january 1, 2010

We will be closing down our service on January 1, 2010 at 11:59pm Pacific. The official announcement is here, and you can read a FAQ guide here. We will be having a goodbye celebration party on January 1st at 12:00noon Pacific Time.

Some of the correspondence I’ve seen on this – what went wrong? what should they have done differently? – has been interesting. Personally, I’m in two minds about it. I think there were some great things about and within MP, but from the very start I felt it had no direction and too little real purpose (and if you ask around, I’m sure you’ll find plenty of people who’ll confirm I said that at the time).

I’ll hilight a couple of things that haven’t come up so much in conversations:

Bad

1. On the face of it, MP was “the bad bits of Second Life…” (poor content tools, poor client, no direction, no purpose)
2. “… without the good bits of Second Life” (no sex, no mainstream publicity, wrong target audience to charge millions of dollars in land-rental to)
3. Poor discoverability (how do you find something cool in Metaplace? Go to site, login, download client, wait a lot, browse a weak index, wait for more downloads, wait for content to stream in … etc)

Discoverability was IMHO the killer: this is something that so many “hopeful” social sites and systems get wrong, and only a few get right. The best examples are still simple: browsing your friends’ friends on Facebook by looking at photos of their faces (hmm; who do I fancy?), or using Google to find things you’re looking for (the gold standard in tech, but also the base *expectation* of the modern web surfer).

The history of SLURLs in Second Life should probably be required reading for people interested in this – if you can find ways to experience / re-live life pre-SLURLs, and read through some of the trials and tribulations that Linden went through in getting them to work.

And even then, of course, SL still had no browsability – but it least it had “open” bookmarks and copy/paste references you could share with people, and embed in webpages. That was barely acceptable (and still “awful”) back when SL was in its prime; the equivalent “minimum acceptable” is probably Faceboook Connect with full Facebook integration (i.e. not just FC-login, but having a bona fide FB app too that acts as an alternate access-path for your virtual world).

Good

1. Well, obviously, there was a lot of great content in there. I only skimmed it, but apart from the problems above, I saw a lot of interesting stuff
2. The AJAX/CSS/HTML GUI … it was really easy for me to mess about gaining and browsing badges (both mine and other peoples).

Early on, I found the AJAX vs Flash part particularly interesting. The former showed up how weak the latter (the world-client) was: sometimes I went to the site, all happy about the badges, the popovers, etc, and as soon as I got into the Flash client, my mood would drop noticeably. Eventually, I stopped bothering visiting at all; I dreaded the slow, unwieldy, “clicking all over the place to move fractionally”, Flash experience.

One question I had was how much this was to do with the languages / platforms involved: did AJAX/CSS inspire the people working in it to make lighter-weight, faster, more abstracted core experience? Or is this just coincidence? There should be literally no reason why either of those platforms forced the designers to provide the experiences that way (Flash is capable of a much faster, snappier, fluid usability experience – it’s been excelling at this for years).

5 Comments »

I’ll do a follow-up post in a minute with the anecdote that lead me to this. But here’s the general opinion/analysis first.

Project history (skip if you know all about Warhammer Online and Mythic already)

Huge project (cost in excess of $50 million to develop), based on a 20-year-old IP that is known and loved around the world, the game launched last year to a big marketing campaign.

Initial sales figures were excellent.

First-month renewals were dire, the company lost large amounts of money, they laid off large numbers of staff, and the CEO quit/resigned. They are now (late 2009) into the key point in such a product’s lifecycle where it has one last chance to succeed.

The parent company has recently laid off 1500 staff across different countries and products, but also just bought a small studio for $400 million.

The problem with Mythic/WAR today

Here’s what’s going on right now (based on observation, guesswork, and personal experience of similar situations at other companies):

They are spending large amounts of money to acquire new customers, while simultaneously erecting artificial barriers to turn away those new customers.

They are running loud marketing campaigns to attract those who’ve already rejected the product, while simultaneously creating powerful negative publicity for their own product.

In other words, this is a company that has a failing product AND has a non-unified product strategy, and yet is continuing to spend heavily. This strategy is known as “pure, blind, Hope”. It looks extremely similar to what happened with TR towards the end of it’s (brief, painful) lifetime:

“let’s work harder, do more, spend more! Cross your fingers, chant the secret mantra, and hope it all turns out for the best!”

Hope is not a strategy. All that can happen is that they might get lucky despite all the mistakes; there might be enough good left that they can survive this foolishness long enough to ditch the deadweight and pull themeslves out of the mire.

The inevitable PlayFish comment…

Maybe this would be a good project for the new hires from PlayFish to start work on? The essentials are there – and if the product could be made to succeed, it is a huge cash-cow. It could single-handedly pay-off a lot of the debt on that $400 million…

10 Comments »

Conferences don’t make these public.

But they should.

So … here are the evaluations (from the audience) for our panel session at AGDC 09.

Judge for yourself whether you want to attend any future sessions featuring us again (Adam Martin, Bill Dalton, Rick Lambright, Joe Ludwig, Marty Poulin).

Head Count: 74; Evaluations: 32 (43% response rate)

• Overall rating of the presentation – 88% (AVG: 86%)
• How relevant was the topic to you? – 86% (AVG: 84%)
• How well did this class meet your expectations? – 94% (AVG: 84%)
• Would you recommend this session to a colleague? – 90% (AVG: 84%)
• Evaluate the speakers’ ability to communicate – 94% (AVG: 86%)
• If there were visual aids (slides) how were they? – 74% (AVG: 60%)

All of those are above average, and I’m glad that a particularly high number would recommend the session to their colleagues.

It seems that we did particularly well on fulfilling the remit (very high number for “met expectations”), and that our speakers had an awesome ability to communicate (almost 10% higher than average for the other speakers at the conference).

Audience Comments

1. The most entertaining session I attended, but didn’t sacrifice information value.
2. Interesting format, I wouldn’t mind seeing more of this, but it is time consuming
3. Good stuff
4. Slow, confused start lost valuable time for Q&A
5. Should have done middleware
6. Only 3 topics covered. Expected others

Comment 4 – yeah, something I’m unhappy about too, (it wasn’t our fault, it was the people running the conference), but there was nothing for it but to grin and carry on. Someone screwed-up the radio microphones, and we lost a lot of time at the start waiting for them to fix it. There was nothing we could do – they had connected the mics from a different room to *our* speakers. We didn’t find out until the person in the other room started talking, and it all came out through our speakers :(.

Comment 6 – we covered 4 topics (oops, audience can’t count :P). We all wanted to do more, but at GDC conferences, the organizers only give us 1-hour slots. With 4 speakers + moderator, I think that was pretty good, especially considering the time we lost at the start.

Perhaps someone will clone this format for a future conference (seems a good idea), and try to get a 2-hour slot for it?

1 Comment »

The problem

It’s a great piece of openness to put your bug lists in the public domain. It makes it easier for your customers and partners to make decisions that save you time because they can see what’s coming and when (and save you money in reduced support requests). It saves you money in that you get free QA / testing from your users.

The downside is that it exposes to the world the places where you are especially incompetent, lazy, or just plain self-centred.

This is a recurring theme I’ve seen with corporates looking at both Open Source and also Web 2.0:

We say we’re the best, but secretly I believe we’re the worst; if we expose ourselves to the public, people will ridicule our mediocrity, and refuse to do business with us.

Also … I will probably get fired because my colleagues and my boss will finally realise what a clusterfuck I preside over on a daily basis

Eclipse, and a tale of two bugs

I was going to log two high-impact bugs that Eclipse has had for several years. Then I did a search on that area of Eclipse, and realised that the current Eclipse maintainers don’t give a **** about this whole section of the IDE – some of the core bugs we see every day were logged in 2001, and are still open:

https://bugs.eclipse.org/bugs/buglist.cgi?query_format=specific&order=relevance+desc&bug_status=__open__&product=&content=syntax+coloring

What you find when you do some basic research

If you go looking through the bug history for some of the more “obvious” bugs there, you often find little gems of passive-aggressiveness from maintainers. That’s an exceptionally effective way of making sure people stop helping and supporting any Open-Source project…

You’ll also find endless re-logging of the same old bugs from 10 years ago, revolving around the basic problem that Eclipse lets you set everything you could possibly imagine … EXCEPT the colours that it prints text in.

(all IDEs let you set the colours; most dont give you enough control over the other parts; Eclipse fails on the basic challenge, and succeeds on the advanced challenge)

This wouldn’t be so bad, except that its default is very bright with low-contrast – i.e. very hard to read on laptops when outside, and bad to read for long periods of time. As of about 5 years ago, you are finally “allowed” to set the colours yourself – except that the app breaks if you do, because they “didn’t bother” to allow you to change the colours on 20% or so of things.

Final thoughts

The next time someone – especially at a corporate – resists openness and transparency … in any form … ask yourself this:

What have they got to hide?

Often, once you ask yourself that question of the right person at the right time, it very quickly becomes obvious what they’re hiding (if not why). A little more digging, and you can pry open the can of worms, and see what trouble they’ve been up to…

(Incidentally (and unsurprisingly), in the face of the point-blank refusal of Eclipse developers to make basic usability concessions across the board, I didn’t bother logging either of the two bugs I’d found)

3 Comments »

(Start by reading Entity Systems are the Future of MMOs Part 1)

It’s been a long time since my last post on this topic. Last year, I stopped working for a big MMO publisher, and since then I’ve been having fun doing MMO Consultancy (helping other teams write their games), and iPhone development (learning how to design and write great iPhone apps).

Previously, I posed some questions and said I’d answer them later:

• how do you define the archetypes for your entities?
• how do you instantiate multiple new entities from a single archetype?
• how do you STORE in-memory entities so that they can be re-instantiated later on?

Let’s answer those first.
(more…)

44 Comments »

Slides for our panel arehere: “Killing mmo tech sacred cows.pdf”.

Final panel was myself (moderating) and speakers: Bill Dalton (Bioware), Rick Lambright (Gazillion), Joe Ludwig (Valve), Marty Poulin (Shady Logic).

PLEASE NOTE: WE DON’T REALLY ADVOCATE EXTREMIST RESPONSES TO TECHNICAL QUESTIONS; THIS WAS JUST A BIT OF FUN. (Mostly).

4 Comments »

(c.f. my original post here: http://t-machine.org/index.php/2009/06/28/want-to-help-write-a-simple-rpg-for-iphone/)

I’ve been playing around with GUI setups for DM / EOTB / Wizardry clones on iPhone, and thought I’d post some of the more interesting results here – I’m interested to see what other people think of each of them.

The first three are all assuming a single-character RPG, the fourth is something more like DM / Wizardry (could be 6 chars, could be 3).

Everything is clickable – small maps become full screen map, blue buttons fire spells, character portraits go to the inventory screens.

Screens with no arrow buttons require you to drag your finger forwards/backwards/left/right to move, and allow 360 degree movement. Screens with arrow buttons assume you can only turn 90 degrees at a time (like the original games), although they smoothly animate the rotations (UN-like the original games – because I have access to OpenGL to do the 3D for me).

What do you think?

4 Comments »

Over the past few weeks, I’ve been looking at a lot of independent developers’ websites. It’s quite surprising how many of them go out of their way to make their site unusable – clearly thinking that they’re achieving the opposite. But also, today, Wikipedia started actively doing a very minor (but no less irritating) content-block on mobile users. And last week, I found one of the main games-news sites is also actively *hard*-blocking mobile users.

This was annoying (and stupid!) 5 years ago, when sites added the “smartphones” to their content-blocking, even though smartphones could (and happily would) render full-fat webpages perfectly (tabbed browsing worked fine in Opera on Windows Mobile back in 2005 – I used it a lot).

Now, with the iPhone added to the list of clients that these sites are blocking, it’s a bit worse: Apple won’t allow you to purchase any web browser other than their version of Safari, and Safari won’t allow you to lie to the website and tell it you’re not using a cell phone (this was the standard workaround on windows mobile/opera for stupid web design teams: tell Opera to claim your cell phone was a Windows desktop). The iPhone, with a better quality web-browser than many desktops currently run? That’s just insane…

Wikipedia: mobile users, go away

Until/unless they decide to fix it, it’s now too much hassle to read WP pages unless I do it on my laptop. Since I’ve probably just followed a link from google, that would mean emailing myself the link from my iPhone, and going to WP via my desktop. More wasted time. I’ll just stop using wikipedia, thanks.

So far this morning I haven’t been able to access WP short of manually changing the URL to go to a country-specific Wikipedia mirror, switching to a “slow” (non-broadband) internet connection, reloading the page, and hitting the stop button before they redirect me to a “cut down” version, and no link to escape from it. There’s a link for you to “comment” on the new “feature”; my commentary would have been unprintable, so I declined.

Gamespot: we don’t want money, money is for wimps

The other week I noticed that Gamespot – one of the big ad-driven news + reviews/cheats/etc websites for games – is still locking-out all mobile users. That’s probably a fairly substantial load of ad revenue they are literally throwing away every day.

The web, HTTP, and HTML…

Why do people do this? I don’t know. But here’s a few points you should bear in mind:

• No website should ever block content based on the user’s device
• No website should ever have a flash-only front page
• Since the very first versions of HTTP and HTML in the mid-1990’s, the web has been designed to avoid these problems; this shouldn’t be happening

Content Blocking

Gamespot checks your web browser when you fetch any article, review, etc. If it finds you’re coming from an iPhone, then it refuses to let you view the content. Instead, it serves up a custom “news page” that is identical no matter which link you came in on. There is no way for you to see the actual content you tried to view – literally: they do an auto-redirect that wipes it from the URL.

I can see no reason for this other than the bizarre assumption that an iPhone was launched 10 years ago with a tiny black-and-white screen and an inability to scroll and render web pages. I would love to ask the Gamespot web design team: have you ever seen an iPhone? You do realise it has a better web browser than most desktop PCs, yes? So … why are you manually blocking them from your website?

Amazon has for a long time done a similar thing with any mobile device (again, sadly, the stupid bit is that they apply it to devices where it’s completely unnecessary) – except that Amazon has three essential features which Gamespot lacks.

Firstly, they do actually show you some of the content you were trying to view (not all of it. ARGH!)

Secondly, there’s always a link on the page to view the real version of the page. If you click that, it gives you a warning something like: “YOUR MOBILE PHONE MAY NOT RENDER THIS PAGE … ARE YOU SURE!!!!????!”. Of course, this is somewhat inappropritate when applied to most smartphones, especially iPhones. But hey – at least the option is there.

Finally, they have a link something along the lines of: “Do you want to permanently stop seeing the broken, cut-down version of pages on amazon.com? You can re-enable them whenever you want”.

Irritating, patronising, and foolish (the default should be “view the website normally”, not “don’t view the website”) – but at least you only have to fix it once, and you never again get problems. Gamespot et al offer no such option – they just block you, dead.

Flash-only front pages

About 50% of indie studios have decided to put a massive flash on their front page, most of them with *no* link to “skip intro” or “go to website” or any kind of navbar. About 50% of them (in my sampling over the past few weeks) have made that flash NON clickable: you cannot (you are “not allowed to” ?) view the “real” website until the flash has loaded, you have seen the self-promoting advert for the studio embedded in it, and clicked some internal link at the end. This was foolish, unnecessarily slow, and contrary to the spirit and standards that drive the web even 10 years ago when it first started happening.

Games industry companies please take note:

The 1990’s phoned – they want their web-designers back.

(real web companies don’t do this kind of thing any more)

But now, with the iphone, it’s particularly dumb: it is de-facto content blocking – because the iPhone cannot / will not run Flash. If the Flash is clickable, you can at least (if you know what the studio did – which many people won’t guess) access the site anyway. I’m amazed how many sites don’t even give you that small fillip.

If this post persuades JUST ONE web designer, somewhere, to wake up and smell the roses, and spares us yet another self-blocked website, then I shall be happy.

Of course, maybe I should be grateful that we’re even this far “ahead” … I heard from someone the other day that he still has to explain to web design teams that websites don’t need to be hardcoded for rendering at 800×600 any more (i.e. that – OMGWTFBBQ! – everyone has rather larger desktop screen resolutions than that these days; or else so much smaller that hardcoding to 800×600 isn’t going to help at all).

9 Comments »

Now I’ve recovered from GDC illness, I’ve got a little free time again, and I’m starting one of the iPhone games I wanted to write. This is a “for fun and learning” project, so it’s deliberately chosen to be low maintenance / easy to make a first version / easy to extend later / etc. I need artists, designers, quest-writers, and programmers.

Well, I don’t *need* anyone; I can do this all myself. But I’d rather do it with other people, and I thought there might be some hobbyists reading this who’d like to do something similar.

EDIT: there’s now a googlegroup for people working on this. You *must* contact me first via email (see below) or your request to join will be automatically rejected. http://groups.google.com/group/dmclone
(more…)

6 Comments »

Really? O, RLY?

Well, no, probably not – but this is the kind of opening statement I often make at industry-conference parties. In this rare case, at LOGIN this year, I was showing something on my laptop at the time and happened to *type* my opening salvo, rather than just say it.
(more…)

11 Comments »

Richard has often been accused of being “arrogant”, “insane”, and even, simply, “wrong” for his comments along the lines of:

1. He hasn’t “played” an MMO in decades (possibly “ever”) … because he can’t stop himself from interpreting as he uses them
2. Surprisingly many MMOs are just WoW by another name
3. He only needs to play the first few levels of a new MMO to see if it’s really new; he needn’t bother with the rest of it

He’s explained before, in abstract terms, why this is all true *to him*, and pretty much left people to stew if they don’t understand that (while always actively engaging them in conversation to try and explain further).

Now he’s blogged a concrete example of what goes through his head when playing a particular quest-chain / zone: WoW’s STV. If you’ve ever wondered, and/or been confused/horrified/dismayed/insulted by Richard’s statements online and haven’t had the chance to speak to him about it all in person, then I’d highly recommend reading it. I suspect that this concrete analysis will elucidate to a lot more people most of the meaning that the abstract explanations failed to convey. Well, we’ll see…

1 Comment »

Reviewing video games is hard. In some ways, it’s an impossible mission: a reviewer has too many conflicting interests:

1. please the publishers or else be denied access to the materials they seek to review
2. please their editor or else don’t get paid; but the editor’s primary source of capital is often advertising … from the publishers
3. answer the consumer’s main question in a way that earns their trust: should they purchase this game or not?
4. stand out from the crowd of a million game players who decide to write about their hobby

Who’s your Daddy?

This has been a problem for as long as I can remember (20+ years of game playing and reading game reviews); the consumer *believes* that the reviewer is answerable to them – but it has been a very long time (10 years now?) since consumers were the paymaster of reviewers; nowadays, it’s advertisers (which usually means: game-publishers).

Of course, consumers still wield huge power. The virtuous value circle – the only circle that matters – is driven by consumers:

• A reviewer has a “readership” of consumers who are influenced in their purchasing decisions by those reviews
• Publishers therefore court the reviewer to try and curry favour with the consumers and increase sales of the publishers’ products (to those readers, and anyone they themselves influence – friends, family, colleagues, etc)
• Reviewers earn more money, and get deeper access to development teams (courtesy of the publishers), so produce more reviews

But that power is – clearly – both indirect and hard to quantify. A consumer – even many of them – threatening to “stop reading a reviewer’s reviews” is not particularly effective.

Publications like Edge helped along the indirection of consumer-power when they decided to go out of their way to obscure the identities of their individual reviewers, turning reviews into as much of a crap-shoot as buying games was in the first place. Since the web rose to prominence, it’s been eroded at the other end – there’s now so many reviewers around that, well … who has the time to remember who any individual reviewer is?

Qui custodet custodes?

But if journalists/reviewers are supposedly there as a watchdog on the publishers’ marketing depts, supposedly helping the consumer determine which are the (non-refundable) purchases they ought to be making, then who’s checking that the journalists themselves are honest?

No-one, really. And that’s where the rot begins. The storms of outraged public opinion are nothing new: examples of journalists writing reviews of games (reviews both scathing and rejoicing) they hadn’t even played go way back into the 1980’s.

A case study in lies, damn lies, and video game journalism

In case you hadn’t heard, this week a “staff writer” from Eurogamer (a games review / news site) ripped to pieces one of the most recently-released MMOs – Darkfall. At which point Aventurine, the developer of Darkfall, responded with increasing anger and dismay.

But the really interesting thing here is that Aventurine didn’t merely rant “you bastards! Our game is Teh Awesum!!!111! STFU, Beotch!” (well, they did that as well) … no, they dropped a little A-bomb in the middle of their reply:

“We checked the logs for the 2 accounts we gave Eurogamer and we found that one of them had around 3 minutes playtime, and the other had less than 2 hours spread out in 13 sessions. Most of these 2 hours were spent in the character creator”

Pwned. MMO developers *actually know whether your journalist played the game before reviewing it*. What’s more … they have proof…

The EG reviewer (whose “references and background are immaculate”, according to the editor – but from reading his only two EG reviews, I’m afraid it does rather sound like he knows little about MMOs), responded (via his editor) with the claim:

“the logs miss out two crucial days and understate others, … and he insists he played the game for at least nine hours”

It would seem that someone is lying (and it could be either party). Worse, someone is being particularly stupid. Because the journalist is claiming “your computers lie”, and the developer is claiming “your journalist is a lier”; either way, it’s not a subtle, small, mistake – whoever is wrong, if they get discovered, they’re going to create themself a good amount of long-term trouble (bad reputation).

Lots of MMO developers write shitty server code, and honestly don’t know what the hell is going-on inside their own game-world (but fondly imagine that they do – and proudly boast to the press (in the vaguest terms) that they do). But the rule of thumb is that devs who don’t know … don’t even know what it is they ought to be claiming that they know. The specificity of Aventurine’s claims suggests that they do have the stats, and those stats are mostly correct.

(I say “mostly” because there is a bit of vagueness about what – precisely – the reviewer was doing in-game. That reeks of holes in their metrics/logging. They clearly know when the player was logged-in, and what they did/said in chat, and how many characters were created – but apparently not what they were doing in the client, e.g. how long did they spend in character creation? Implicitly: unlogged; unknown)

Whereas it’s quite likely that a non-knowledgeable journalist, accustomed to buggy games, would assume that they could safely claim “your server is buggy, those figures are wrong”.

Unfortunately for any such journalist, server logs are generally either correct, or absent entirely – there’s rarely any middle-ground. If he knew a bit more about MMO tech he might know this; very few journos (any of them?) know that much about the games they review, though.

So … based on nothing but casual observation and intimate knowledge of the tech issues (and several decades of reading game reviews…), I’m leaning in favour of Adventurine and against Ed Zelton. My guess (pure *guess*) is that he’s been caught out being either incompetent or perhaps a bit lazy as a reviewer, and he’s thought he could get away with blaming it on buggy code. From reading the review, I get the impression he wishes he were Ben “Yahtzee” Croshaw (from Zero Punctuation) – although he clearly isn’t funny enough – but he seems to like saying “it’s shit; you’re shit; you’re all shit; STFU” instead of reviewing the game, and seems to think that’s good enough. As an MMO player, my feeling was that the review was, well … useless – without even playing the game, there is so much more I would want to hear in a review, and so much of his wanky whining that I couldn’t care less about. As an MMO developer, it felt downright insulting, as if he’d made no effort at all to play the game as a game. Actually, it felt like he’d hardly played MMOs in his life, and didn’t really know what they were.

(NB, from the review: his apparent ignorance of some of the most important *and best-selling* RPG + MMORPG games of all time – the Ultima series – suggests that he really isn’t much good as a game reviewer. YMMV.)

Reviewing the reviewers

Up-front I’m going to point out that I don’t believe all MMO developers are currently capable of doing this – many people would be amazed to discover the true state of metrics collection in this industry – although *all* modern MMO developers ought to, and it’s not too hard to add-on later (add it to the list of “things MMO developers ought to do as standard practice, but many of them don’t do”). But it’s a general thing that I think we should move towards.

MMO developers (well, actually, the Operators, but that’s getting pedantic) are in an excellent position to help guard journalistic honesty, in a way that traditional game developers have never been able to. I would like to start seeing the following published by *every* MMO developer each time their game is reviewed:

1. What level the account(s) started at
2. What level the account(s) peaked at
3. How many hours the reviewer spent at the lowest levels, levelling-up manually
4. How many hours the reviewer spent at the highest levels
5. What percentage of time was spent on each of the different primary character classes and factions
6. Which areas of the game / aspects the reviewer actually engaged in (hours of combat, hours of crafting, hours of chat, etc)

…but, honestly, this isn’t so much about “journalistic honesty” (I used that phrase tongue-in-cheek above) as it is about starting a virtuous cycle of developers being more cognizant of what, actually, players “do” in their games – preferably *before* gold launch. In particular, if publishers (developers) started supplementing reviews with this info (as a matter of course), I think we’d see a sea-change in industry staff appreciating three key things about metrics:

1. How little metrics they’re actually collecting compared to how much they think they’re collecting
2. What metrics actually matter, and/or are useful?
3. How players actually play the game; by extension: how fun is the game, really, and which parts suck horribly?

Does this work / matter?

At NCsoft, I got into the habit of asking prospective partners, hires/employees, and external studios which MMO’s they played (fair enough) … and how many characters they’d got to the level-cap with / what level their characters had reached. It started as an innocent question, but I quickly noticed how often it gave early warning of failures of honesty among individuals, and how much it presaged the problems they would have in the future.

The two worst problems were “complete ignorance of the MMO industry (either of pre-existing design practices, or tech practices)” and “personal self-deceit about what the person knows, and what they don’t know”. The latter tended to be a far worse problem: when someone is deceiving *themself*, it’s doubly hard to re-educate them, because first you have to get them to accept their own deception.

Of course, it turned out to lead to a lot of defensive responses and a spew of self-justification, which made us both uncomfortable. In those situations, it can easily lead to making assumptions that certain people’s opinions are “worth less” because, say, you know for a fact they’ve never really played an MMO – at least, not in the way that most of that MMO’s players would/will/do play it. I hate that tendency, since it’s part of a snobbishness that lies at the root of a lot of oyster-like, head-in-sand behaviour in our industry. On the other hand, it’s important and useful to know when someone’s ideas are random conjecture and when they’re based on fact (and very few people in a design meeting or publisher/developer meeting will honestly tell you their ideas are conjecture :)).

On the whole, though, it turned out to be a really useful line of questioning – even bearing in mind the additional (smaller) problems it created. There are obvious problems that come from the statistical supplementing of free-form prose game-reviews – but I’m confident that these will be outweighed by the advantages (and the problems that will be shrunk).

PS:

Despite the TLC of good friends, I’m still weak and sapped of all energy from my month of illness. I’m triaging like mad to deal with urgent issues, but there’s plenty of highly important stuff that’s been pending on me for a while that I still haven’t had the time + energy to deal with. So, if you’re still waiting … I’m sorry.

5 Comments »

This week, a game service was announced that would stream games to your home TV without you needing to own a console or PC. A lot of people are wondering: are these guys smoking crack?

EDIT: Richard Leadbetter at Eurogamer has an article with some great “side by side compare” video to show theoretical quality you can achieve with off the shelf compressors right now. He comes to a similar conclusion on the issue of latency, although having seen the video I disagree on the quality (he feels it’s unacceptable) – it’s clearly inferior, but it still provides a very nice experience, especially if you’re sitting 6-12 feet away from the screen.
(more…)

8 Comments »

Alex Evans, Media Molecule
Mark Healey, Media Molecule

Summary

The MM guys are funny as ever, although Alex’s “I made it myself on the way here” presentation tool would perhaps have been more usefully replaced with something like Presi (or whatever it’s called – the “interactive” presentation tool that is like Alex’s thing, but on steroids. Ask Jussi, he’s a fan of it).

The overall impression I got is: here’s another studio that has “by trial and error and cunning and talent” independently discovered something very similar to Scrum. They don’t do Scrum, and I’m sure a lot of people will scream at me for even saying it, but … I went through similar “find a process that worked for game development” (not carried so far, and on much smaller projects), and I recognize a lot of the lessons they learnt and things they incorporated in their processes and approaches. And from my experience, I think they’d find it relatively easy to switch over to Scrum, and that they’d get a lot of benefit from having a more polished version of their processes. Not to say that Scrum is universally better – there’d be losses too – but for people considering their own processes to use – or trying to “understand” Scrum – you’d do well to read this liveblog and try to internalize some of the lessons and attitudes. And then consider this and scrum as alternative to each other, but both near-relatives. And … if you are *not* MM, and don’t have all the details of precisely how they work, you’d probably find it much easier and more effective to adopt the well-documented Scrum instead.
(more…)

1 Comment »

Sulka Haro, Sulake

Summary

The intersection between social and gaming, and where that should be going, instead of where lots of people are obsessing about taking it.

(I have more to add here later, but I’ve got to run to a meeting; will update the post when I have time)
(more…)

2 Comments »

Austin Hill, Akoha

Summary

Conference organizer introduced this as “during this first talk, think about the platform they’ve made, as much as you do the game; that could be especially interesting for this audience”.

I totally support the principles and the ideals. The game looks fun and interesting, and at the same time taking a very “Don’t worry, be crappy” approach to core game design: lots of classic mistakes made, obvious stuff. Is this a case of being brave enough to deliberately make the mistakes they understand (because they’re easy to fix later when you’re more successful – and it leaves you more spare time to focus on fixing/avoiding the mistakes you don’t understand yet) – or just naivety?

Interesting to hear the philosophy that fed into the creation of the game, the speaker’s personal journey and how it informed the design. On the other hand, I was a bit disappointed how little actual content there was in this talk. It was perhaps 50% or more made up of a few long video clips. They were long and very little was pulled-out / emphasised from them. Most had very little information content per minute. Worst example was a mildly entertaining video of one of their players giving an intro to the product – but, frankly, so what? This was “new” and “interesting” 4 or 5 years ago, but by now it’s happened thousands of times over, and we’ve all seen it for many games. I didn’t understand why we were watching it.

I have a sneaking suspicion that – given he’s a VC – the speaker was pitching that video stuff to show “look, we have players who love our game”. That’s interesting and exciting to investors who have little or no immersion in the online world, but IMHO for game developers that’s just par for the course these days. No?
(more…)

3 Comments »

I’m very tempted to make this:

http://gizmodo.com/5172615/iphone-os-30-will-turn-your-phone-into-a-revolutionary-sex-toy?skyline=true&s=x

…with particular emphasis on the social / avatar / chat / networking features.

0 Comment »

Maxis (part of EA) has a great competition up right now – use the public APIs for the Spore creature / user account databases to make “an interesting widget or app”.

I had a quick look at the API’s – they’ve got the right idea technically (use REST, provide PHP versions, etc), although the set of queryable data is pretty mneh (they could easily have done a *lot* more interesting stuff too). I’m impressed that they’ve got that right, and they appear to have done a great job of presenting it nice and clearly. Most importantly, because the selection of data is lame, the challenge is there – in your face – to be very creative with how you’re going to use it. Go for it.

I had a look at some of the demo apps that had already been done, and they show great variety. If you’re trying to break into the games industry as an online designer, you should try your hand at using their content (and this is *legal*) to design something cool. You (probably; I haven’t checked the legals) won’t own exploitation rights – but it could make a great portfolio piece.

So I was rather saddened that it’s taken until now, and a random glance at a newsfeed item, for me to be aware of this. Which isn’t so bad, except … I was one of the first wave of purchasers of Spore, and I played it heavily, and checked out the Sporepedia for the few months after launch.

But they launched with most of the Sporepedia either “broken completely” or “not implemented yet”. Having paid $50+ for a full price game, to discover that even after several months the Sporepedia was “mostly not implemented yet, watch this space”, my reaction was : “I have better things to do with my life than wait for you to pull your finger out and do your job properly and give me what *I’ve already paid for*”.

And because of the mind-numbingly stupid DRM decisions by EA, I’ve point blank refused to install their viruses – without which, the system isn’t going to let me upload any of my own creatures / UGC. Which takes away a lot of the other cause of interest that would have rapidly lured me in.

Finally if it had been a “real” online game (why wasn’t it? No-one really seems to know. My theory is “fear and shame over The Sims Online catastrophe”) of course … my friends relationships in-game would have meant I’d have been pulled-in to this new cool stuff as soon as it went live.

So … it would seem that when it comes to boundary-pushing game design Maxis is managing to go 2 steps forwards and 3 steps back. That’s a real pity, because I suspect a lot of people who would love what Sporepedia was *described* as being (rather than the massive short-sell it actually was) have already given up, gone home, and don’t care any more. Only the people who don’t know about the good games out there (the non-gamers who happened to pick up a copy – of whic there are many many of course, thanks to the Sims juggernaut) are still around to enjoy it.

Am I being too pessimistic here? Certainly, not a single professional I know has shown any remaining awareness or interest in what Spore’s doing for the last 6 months. That’s pretty damning, in my eyes, for a game with such big sales and the Sims driving marketing and sales for it.

(PS: in case it’s not clear – as far as I’m aware, there’s still literally zero socialising in Spore. That’s the irony of the title here. The only socialising is 1995-era “the players are doing it anyway despite the developer+publisher going out of their way to stop them”)

4 Comments »

http://www.gamasutra.com/php-bin/news_index.php?story=22528

“It is probably safe to say that, despite decades of ever more spectacular Hollywood visions of extra-terrestial domination, humanity in its worst nightmares never imagined it would have to contend with spawn-camping aliens.”

(also … If that article is accurate, sad but unsurprising to hear that (apparently) the underpowered server tech for TR yet again managed to make a misery of gameplay, even at the very end. If that article is accurate, then well done to the ops for managing to get some instancing sorted out, but note to self: never let this happen with future twitch-based / FPS MMOs)

0 Comment »