Touch Screen Dreams - A Discussion

posted by Ian Delaney
on 12 February 2009

This is how it started. We were having a meeting about something completely different when I was unwise enough to challenge Malcolm Garrett, my co-director on the Dynamo London digital design community site when he said that the iPhone changes everything. He’s also been following rumours that Apple is apparently planning a tablet-style device.

I said that Microsoft’s attempts in this area had met with niche success. Later, we followed up the debate on email:

Ian:

Still not convinced about the Apple tablet - Microsoft's Tablet PC was a pretty good platform (I know, I know...) but remained very niche because touch screens are so expensive. Their cost increases exponentially by size because the fault ratio on LCD panels is so much higher once you add touch. Also, people don't like 'typing' on touch screens because of the lack of physical feedback.

Malcolm:

I love typing on a touch screen :-) I hated my Nokia btns.

I think we'll be surprised at the way a fully-functioning, populist, personalisable, programmable, portable (rather than mobile) entertainment, communications, information carrying, global gps and wireless, device will have infiltrated daily life before we even know it. iPhone is a real trojan horse. I don't think the Microsoft tablet was any comparison.

IDEO had been saying for years and years that a touch screen device would NEVER be attractive to the public and consequently never be successful. I'm sure I saw Bill Moggridge (a hero of mine by the way) say something similar again in another magazine article at the weekend, despite such recent evidence to the contrary. In my view, iPhone blew that long-held tenet away comprehensively.

I think IDEO simply came at the issue of the interface design in quite the wrong way. A visual screen needed sophisticated and contextual visual feedback, not just tactile as many product designers have steadfastly, and failingly, maintained. I believe iPhone proved that. The screen interaction uses visual feedback that is virtually tactile, with immediate finger response, and effortlessly smart interactions such as sophisticated spring-loaded window motion. People are ready for things that work in an obvious way, the actual hardware/software 'concepts' are lost on them. Only the effects (i.e. practical and usable) mean anything. The touch screen revolution has effectively happened (witness the immediate launch of copycat phones from every other major manufacturer), now the results will begin to inundate us. This is akin to 1998 when the web supposedly broke into the mainstream and ceased to be new or interesting to the cognoscenti. That was wrong then - it was almost ten years more before it really could be described as mainstream.

As ever, we will need to be alive to exactly who are audience is, or should be, and target accordingly.

Ian:

"People are ready for things that work in an obvious way"

completely agreed, but with the caveat "People are ready for things that are better".

However, touch screens remain extremely niche despite being available for years. The causes for this are:

(a) cost (this can sometimes be offset by versatility/throughput e.g. tube ticket machines).

(b) durability (increasing this increases the cost considerably, only suited for high-volume public terminal-type applications; obviously the durability problem increases exponentially with size of screen).

(c) user experience.

You believe that (c) isn't a factor any more, or can be overcome by great interaction design. You might be right - I disagree. Typing has been perfectly possible on touch screens for a decade. Nobody does it. Why is that? Not just cost and durability. Similarly, voice input. No one does it. Typing at a keyboard isn't just learned behaviour - it's incredibly efficient compared to the alternatives.

You think that the iPhone is a game-changer - yet, you struggled to give me Catherine's contact details. Surely, that's pretty basic functionality? And you are someone who has followed every innovation in the digital space for 15 years. What chance Joe Normal?

Malcolm:

Actually, I found Catherine's details right away, much more easily than finding them by any other format I can think of. I struggled to show you the details on my screen as I recall, as I pointed and clicked simultaneously when I didn't want to - a result of having big clumsy fingers, and being eager to please, and trying to do something that it's not really designed for, nor was it intended to be. The iPhone is a personal device not a sharing device.

I appreciate your typing argument. However, my argument is that in the real world most people don't type. They do text, and a lot more than they type, and without a keyboard. It's the keyboard that has kept the computer firmly perceived as a business machine. My argument actually suggests that because of the success and versatility of the iPhone and its touch screen many more activities stray away from the need to function with a keyboard at all. I think that is very significant.

My view has always been that the keyboard has restricted broader acceptance and usefulness of computers rather than the other way around. I think this is just the beginning of a new relationship between people and and their little computer pals.  Joe Normal has these little pals all around him as normal. It is we who are more likely out of step, not the young people naturally occupying the digital space that even I've struggled with these last 15 years.

That said, I do now make more notes on the move, because it's easy and convenient to do it on iPhone, and it's guaranteed to directly transfer into the (currently) more versatile and permanent environment of my laptop. i think the effortless connectivity of iPhone and MacBook is another key to success, and conversely a reason for the failure of Newton, and every other phone I've possessed.

Voice activation is not popular because it doesn't work (still) and is vaguely embarrassing. but so is Skype and that is slowly (quickly?) finding favour. The time may become right for a having a useful conversation with your computer some time in the future. I'm not fully writing that one off just yet.

Don't let all that poorly designed, poorly functioning, crap hardware of the past cloud your vision for the future. 'Smartphone' has always been a misnomer, until now.  yes, people are now ready for things that are better. And working in an obvious way is better.

Ian:

Before you had an iPhone, you had a notebook computer, I guess. And I am also guessing that you still carry that notebook around a lot of the time.

If you need to do serious data-entry, then you need a device that is designed for that – and that’s your laptop (or, to be totally honest, your desktop). Your phone is fine as the equivalent for the back of an envelope, or a filofax. It’s not the same as being at your real computer. And if it can’t really replace your notebook computer, then isn’t it just bling?

The mainstream. Allow me a little diversion. Twitter, for all the chat, has not managed to engage teenagers. Bluetooth has.

You’d kind of think it would be the other way round. Twitter is really easy, while Bluetooth is sort of techy. Why’s that? Because the take-up of a technology is about what people want to do. File sharing is something teens want to do – pictures, music, what-have-you. On the other hand, microblogging to a community of peers? Isn’t that the same as Facebook status messages? The mainstream doesn’t adopt technology on the basis of trendiness, I take from this, but on the basis of functionality and cost. Interestingly and counter-intuitively, convenience seems to be less of a factor.

The world does need personal, personalisable, portable devices for work/comms/entertainment/etc – no-one would be buying any of this stuff otherwise. However, I am dubious about the touch-screen proposition. What does a touch screen add that isn’t better served by keyboard and mouse?

One thing. It (the device, whatever it is, phone/tablet) can be smaller. So it is less useful, less functional, less durable, less usable and more expensive.

But it – whatever *it* is - is smaller. Does this not smack of gadget fetishism rather than a real advantage?

[The discussion is ongoing. Malcolm's response to be posted as received]

what's been said

posted by Malcolm Garrett
on 12 February 2009

some previous relevant references on dynamo

Matt Cooper's predictions for 2009: www.dynamolondon.org/topics/72

Malcolm Garrett's initial review of iPhone: www.dynamolondon.org/projects/117

Mike Staines' post about Microsoft Surface: www.dynamolondon.org/projects/67

posted by Matt Cooper
on 12 February 2009

Matt:

I'm struggling to pick a side in this fight, on the one hand i'm with Malcolm on the fundamental shift which the iPhone is causing, and i dont think that we're even half way there when it comes to the changes that the iPhone heralds.

Equally, Ian's point about the limitations of a small touch screen as a rapid input device can't be ignored. I suspect there will be an interesting hybrid of txt shorthand and email brevity which will emerge. Probably supplemented with photos videos and sound clips.

Much in the same way that blogging is a very multimedia experience with people dropping links and photos in easily and painting 1000 words at a time, I can see that emails will look like that too.

This does rather point towards an entirely new kind of communication, mid way between txt, mms, blog post and powerpoint presentation. The question is how quickly the device and interface can deliver an effortless input form to do this.

So called smart devices will of course never rival the speed of the keyboard as a text input tool. But are we too attached to the keyboard? Inventor of the computer mouse Douglas Englebart (perhaps on the of the most overlooked figures in modern interaction design) has proposed an alternative to the traditional keyboard: the chorded keyboard http://en.wikipedia.org/wiki/Chorded_keyboard is a one handed device which, with only five button allows users to type by using combinations of keys (hence chords as you play a piano). I've never used on of these things but he claims that a novice can pick up and use the device in an hour or two.

So, if the keyboard is the only thing holding us back could this offer the solution? Or is this a red herring?

A keyboard will always be useful as a business tool, but 90% of my daily communications are not business communications. So is it such a fundamental tenet of communication?

A final thought as I type this lengthy response; i'm glad that i had a keyboard to do it with. The shorthand communication that restrictive input devices cause must have an effect on the way we communicate, the thoughts I've just expressed wouldn't have had the space to develop if I had to type them into the iPhone keyboard. I'd have made a far more basic comment.

Perhaps shorthand communication will encourage us to express complex thoughts in a more efficient 'Confucius say..' kind of way.

"Inefficient input requires efficient mind" Matt say.

posted by Malcolm Garrett
on 12 February 2009

Malcolm:

I think the fact that we're already passionately debating the pros and cons is proof positive that what we're witnessing is a 'serious thing', which was my initial point. The genie is out of the bottle.

Quite where it will take us, is akin to medieval religious scholars discussing how many angels could dance on the head of a pin. In some ways it's impossible to say and therefore somewhat meaningless. Albeit rather fun.

I am as ever the optimistic futurist and I always think the things I hope for will happen somehow. In well over twenty years of computing experience, something I've learned is that this has so far always proved to be the case, and that things pan out more or less as I hope. There are two specific caveats: it always happens faster than I imagine, and we always get more than I expect, rather than less.

So I'm sticking with my prediction that this touching the data thing, supplementing rather than replacing the trusty old keyboard if you prefer, will be very big.

I'll pick up Ian's last point above about the only improvement that iPhone has offered us is the reduced size of both the screen and the device itself a little later...

posted by Malcolm Garrett
on 12 April 2009

As previously imagined ...

... both by Matt in his new year predictions for 2009 <http://www.dynamolondon.org/topics/72> and myself in my iPhone review 18 months ago <http://www.dynamolondon.org/projects/117> according to the Wall Street Journal, Apple appear to be working on tablet that's bigger than iPhone but smaller than a laptop: http://www.macrumors.com/2009/04/11/steve-jobs-also-overseeing-apple-tablet-or-netbook-device/

posted by Malcolm Garrett
on 19 May 2009

Picking up where I left off ...

I didn't even begin to talk about the importance of the actual physical interaction with iPhone. No amount of rotating, jiggling, stroking, shaking, blowing, poring (or pouring) my keyboard illicits any kind of response or interaction with image or data on the screen.

The keyboard is just a bunch of dumb buttons, with but one (albeit sophisticated and unquestionably important) set of effects. The fact that the keyboard is clunky is only highlighted by the amount of debate over the practicality and usability (or otherwise) of smartphone keyboard buttons versus touch screen 'buttons', versus any other kind of virtual or realworld version of the qwerty array. (I mean qwerty for god's sake, talk about industrial inertia?)

As a ever with discussions of new media and new technology, we're really not talking about replacing anything from the past, but we are questioning that notion of industrial inertia, and looking towards a vast, and largely untapped, complement of new and wholly 'natural' ways of interacting with data, ways that don't need to be learned in order for them to be useful. (Thirty years of computing and I still can't touch type, so how useful is that?)

please log in to add a comment