Analysis, tutorials and tips for your Nokia and Samsung Phones

Smart in the Real World - the Nokia N95 takes on all-comers in a dozen common tasks

Published by Steve Litchfield at 12:13 UTC, July 21st 2008

Looking at real world usability of the current (smart)phone flagships...

Regular readers may know that, in the interests of knowing what to recommend, I'm fond of device advocacy, i.e. comparing the pros and cons of different phones to try and come up with some kind of ranking. Usually these pieces are centred around specification or feature lists, not unnaturally, but here I'm going to take a dozen real world tasks, things that you or I do (or would like to do) every single day, and then assess how easy and/or quick these tasks are to perform.

For the purposes of this comparison, I'm going to take the six month old Nokia N95 8GB, typical of the current S60 range, the brand new Apple iPhone 3G and the also-new HTC Touch Diamond. If Apple (and HTC's) marketing is to be believed, the iPhone should be an easy winner in a usability test, but the extra maturity and featurettes in S60 3rd Edition also make it a hard act to follow.

The three contenders

NB: just to head off a flood of emails, yes, I know the Apple device photographed and screenshotted here is the iPod Touch and not the iPhone 3G - but the latter is currently rarer than hen's teeth and Apple's policy of keeping the Touch bang up to date with the iPhone 2.0 software means that, for most purposes, the two are nigh-on identical. I've used various 'real' iPhones in the past few months during the course of research, fear not, so I've got a good handle on the differences...

 

As for the real world tasks, I brainstormed them with the rest of the AAS team, working out the most common things that we all wanted from a phone. They had to be non-trivial (i.e. making phone calls was out), non-geeky (so no requirements for VNC clients) and not obviously biased (e.g. explicit multi-touch photo manipulation or VGA video capture and editing). I've tried to be as fair and open as I can. For each task, there are 20 points up for grabs for each device, split between accomplishing the task, speed and efficiency and any other relevant factors.

1. Set an alarm for the next morning (and for the rest of the working week)

Nokia N95 8GB:Eleven keypresses (depends on where you've set 'Clock' to appear, though!), around eleven seconds to set the new alarm up, including the workday repeat. Score: 19 (loses a point for the user having to work out to press 'right' to get to the 'alarms' tab)

Apple iPhone 3G:Eleven screen taps this time(!), also (amazingly) taking around eleven seconds to set up. Score: 19 (loses a point for not knowing about workdays and the user having to manually tap on each day required)

HTC Touch Diamond:Nine keypresses, taking around seven seconds. Score: 20 (tempting to take off a point for a fiddly old-school interface, but this is counter-balanced by the general speed of access)

2. Enter a new calendar entry "Meet Jane at gym, take present" for 6pm the current day, with an alarm

Nokia N95 8GB: 27 seconds. Score: 18 (no real problems, but some words needed multiple taps to get to the right word predictions, plus the alarm setting needed quite a bit of scrolling down the dialog)

Apple iPhone 3G: 36 seconds. Score: 15 (multiple dialogs for title, timing and alarm slowed things down. Text entry was as fast as using T9 predictive text on the N95 keypad)

HTC Touch Diamond: 31 seconds. Score: 16 (slowed slightly by pause for getting the stylus out to use the fiddly Windows Mobile Calendar interface and qwerty on-screen keyboard, but speeded up a lot by the way alarms are 'on' by default)

Email on the Touch Diamond (sampled down)3. Check your GMail inbox, view a message and fire off a reply

Nokia N95 8GB: 50 seconds using built-in Messaging, accessing GMail via IMAP push email, slowed by the speed of Messaging and the clumsy access point selection etc. But only 30 seconds using Google's Java-based GMail client. Score: 14 (i.e. not a great experience, despite the true push nature, and almost have to use the supplied Google utility)

Apple iPhone 3G: 25 seconds, using GMail via default iPhone IMAP access. Really fast and slick, plus great presentation throughout. Score: 19 (let down a little by not being true IMAP-push, you have to refresh the mailbox manually)

HTC Touch Diamond: 70 seconds. Appallingly inconsistent interface, often unresponsive, slow message header downloads, terrible text entry practicalities. Score: 9

4. Write a 25 word text note

Test text: "Aiwa VCR bought at Comet on 20/7/08. Turned it on to see a blue error message. Returned to the shop and am awaiting a replacement."

Nokia N95 8GB: 93 seconds. I'm not the fastest texter in the world, but not that slow either. A good average score: 16

Apple iPhone 3G: 75 seconds. The iPhone's intelligent keyboard is a wonder to behold. Taking things a step on from predictive text, it allows for complete keyboard mishits and works out, based on the approximate location of your taps and their order, what word you were actually going for when you typed "rrtot" (error). A good, though finger-exhausting, alternative to a real thumb keyboard. Score: 19

HTC Touch Diamond: 156 seconds. I could probably have done it slightly faster using the tiny one-letter-per-key keyboard, but heck, I wanted to use at least one of the features of the new HTC software suite. This time was with the 'Compact qwerty' keyboard, which does well when plain English is needed, suggesting good words, but is incredibly slow when fiddling real names, number or symbols are needed in-line. Score: 10

5. Look up a UK train time, Reading to Torquay (a real journey that I'm doing in the near future)

Nokia N95 8GB: 55 seconds. Typed 'Rail enquiries' into Google, got automatically through to the mobile web site, the query was handled very quickly and smoothly. Score: 16

Apple iPhone 3G: 90 seconds. Same route, but the iPhone's version of Safari get served up he far more clumsy desktop version. Still navigable, but.... well.... clumsy. As a side-note, I noticed that one of the original iPhone 'web apps' (akin to Nokia's 'widgets' or 'web runtime' apps) offered a UK rail lookup service. With a shortcut to this on the iPhone homescreen, the process took a far more competitive 50 seconds. Score: 14 (a user would have had to have had a good rummage in the web apps scene to know about the Kizoom widget etc - but hey, at least it existed)

iPhone screen iPhone screen, Kizoom web app

HTC Touch Diamond: 130 seconds. Same route, with Opera 9.5 also being served the full desktop version of the rail enquiries site, which slowed things down. The initial search for the site and the entry of station names was also hampered by one of the new keyboards and I had to switch to the old, tiny version in order to see the data fields properly. Score: 9

6. Find an ATM nearby and plan a pedestrian route to it

Nokia N95 8GB: Using the built-in Nokia Maps, 39 seconds. This was using the supplied 'Banks/ATMs' points-of-interest ('Places') category. Every local match (there are quite a lot, it even included places which didn't have an ATM but which would give me cash etc.) was shown. Picking a match and choosing 'Show on map' brought up the graphic shown here. 'Walk to', i.e. pedestrian routing is built-in, as is voice-driven car navigation, provided you're subscribed (which costs money). Route calculation was slowish, but, once calculated, navigation was flawless and real time. Score: 17 (competent and complete, without being jaw dropping)

N95 screen and on the iPhone

Apple iPhone 3G: Using Google Maps (built-in on the iPhone), 27 seconds. I did get it to find me all the nearby cashpoint machines - this was after I got no sensible matches for "ATM" or "Cashpoint" - it turned out that "Cash" was what was needed. Tapping on 'Directions' and then 'Start' brings up the first turn instruction, but it's not real-time driven. Not a problem for a pedestrian to keep up, though. Score: 16 (it was fast and the map-based directions work fine when not in a car)

HTC Touch Diamond: Using Google Maps, built-in: 56 seconds. Despite the built-in QuickGPS (like Assisted GPS), GPS lock was slower than on the other two devices, and Google Maps interface under Windows Mobile could be slicker. Still, it got the job done, with the same manual advance turn issues as on the iPhone. Score: 15

7. Rip a new CD and get it playing on your phone while you go running

Nokia N95 8GB: Like all Nokia Nseries, plugging in the USB lead gives the choice of 'Windows Media' mode, upon which adding music to your memory card is as easy as adding albums or playlists to your 'Sync' list. However, transferring music files is slow, at around 1MB/s and there's an extra delay while the N95 refreshes its music directory. Playback is great with both d-pad control and dedicated music keys. Time taken from starting to rip to jogging along, listening to Deep Purple on wireless (A2DP) stereo headphones: 4 minutes. Score: 15

Apple iPhone 3G: Apple built its music device empire on seamless music handling and ripping and syncing a CD of music (to unencrypted AAC format) is as easy as you'd expect. Ripping was slower, but music transfer speed is three times faster than for the Nokia, the two factors cancelling each other out. Playback is via 3.5mm wired headphones only, as the iPhone doesn't support A2DP (wireless stereo). Total time taken was 5 minutes. Score: 13

HTC Touch Diamond: Working along the same lines as the Nokia N95, the Touch Diamond integrates neatly with Windows Media Player which, although a poor relative of Apple's iTunes in terms of online store integration, is a lot quicker for local operations. Music transfer was also around 1MB/s to the Diamond, with similar overall times to the N95 8GB. And A2DP works, too, although the confusing duplication between the TouchFLO music player and the built-in Windows Mobile Media Player loses the Diamond a point for simply being inelegant. Score: 14

Touch Diamond screenshot (sampled down)8. Take a photo and email it to a relative

Nokia N95 8GB: As simple as it gets, honestly. Press and hold the camera button to launch the camera. Focus and shoot a 1MB 5 megapixel image. Select 'Send|Via e-mail' and press in the d-pad to select a contact. Done. 33 seconds from starting the camera to the email starting to send. Score: 20 (Perfect)

Apple iPhone 3G: Ah. The first of the iPhone's real limitations really hit home here. Firstly, the camera is only 2 megapixels and with average optics. Rather more worryingly, the emailing process reduces every image to a maximum of VGA (0.3 megapixels), complete ruining what was already only an average photo. Time taken from starting Camera to the email starting to upload: 23 seconds, so at least it's quick. Score: 7. (Interestingly, and even more worryingly, if you save a large (say 3 megapixel) image off the web and then try viewing it in Photos, the software goes loopy, the screen corrupts and the iPhone simply can't handle such a large image, let alone getting as far as an email dialog. A big OS update needed, Apple.)

HTC Touch Diamond: Pretty much as with the Nokia N95, except that the user experience is much more clumsy. Camera has to be launched from a fiddly on-screen button and the email recipient can only be picked after using a menu option. The full image is sent, of course, but the camera itself is a mediocre 3 megapixel non-flash unit, although at least there's a semi-automatic focus. Time from start to email send: 35 seconds. Score: 14

9. Shoot 1 minute of video of your kids and dog in the park

Nokia N95 8GB: Near perfect again. Sorry if I sound like an N95 fanboy, but come on - VGA resolution video at getting on for 30 frames per second through semi-professional Carl Zeiss optics. Video is captured in H.264 MP4 and can be uploaded to YouTube from your PC or even to Ovi (for example) directly from the handset (probably via Wi-Fi, though, at 20MB per minute of footage!!) Score: 19 (loses a point for occasionally dropping the odd frame and thus appearing jerky)

Apple iPhone 3G: Next. There's no support at all for shooting video from the iPhone's camera. This is a showstopper for some, I'm sure. Sorry.... Score: 0

HTC Touch Diamond: Not in the N95's class on any front, but the Diamond does at least shoot video. In fact, it's at CIF (VideoCD) resolution and even sports initial focus in video mode, but it's downhill from there on, with poor picture quality, sub-par frame rate and truly appalling recorded sound. Add in a confusing storage system for your videos and you end up with a score of 10. And that's being generous.

10. Browse through a couple of subscribed RSS feeds in Bloglines

Now, I know that there are a bazillion RSS readers out there (if you don't know what RSS is, then you're utterly missing out on the fastest way to stay up to date with all your favourite web/news sites), but by far the two most common are Bloglines and Google Reader. Both of which are web-based, meaning that you can read stories and have what you've read marked  in perfect sync, whether you're reading on a phone or desktop or set-top box. Anyway, I use Bloglines, so this was my test case.

Nokia N95 8GB: With Bloglines Mobile bookmarked, the N95's QVGA screen shows feeds at super-legible size, although once into each feed there's lots of scrolling needed. Score: 16 (no showstoppers)

Apple iPhone 3G: Safari, in its infinite wisdom(!), decides to show Bloglines Mobile in a non-zoomable, microscopic way. Even worse, the links simply don't work - very disappointing. Never mind, there's always the full Bloglines interface. This appears at first glance just as on the desktop, which is good, despite the amount of vertical scrolling needed to read down busy feeds (e.g. Engadget). However, because the Bloglines 'framed' interface doesn't work on the iPhone, you then have to scroll all the way back up each page in order to get back to your feed list - at least there's a half-remembered Safari shortcut, in that double-tapping at the top of the screen zooms you back to the top of the page. And then I vaguely remembered something about a test interface for the iPhone, i.bloglines.com - which works brilliantly. Phew. Score: 14 (we got there in the end, but the average user would struggle to find out about the optimised interface)

iPhone screen, handles mobile sites badly, alas. Using the specific Bloglines iPhone interface

HTC Touch Diamond: Remembering the iPhone experience, I went for the full Bloglines interface first and this worked but with the same scrolling caveats and without the handy 'top of page' shortcut. I switched to Bloglines Mobile and this worked as on the Nokia, but with an annoying necessity to have to double tap the feed list every single time to zoom in to read it. Score: 14 (at least feed contents were scaled properly and were easy to read down the page)

The iPhone having trouble handling an RSS feed on the device11. Subscribe to an audio podcast, download it and listen to an episode

Nokia N95 8GB: A system of 'Web feeds' is integrated into S60 Web, it's all rather primitive and low-tech, but it works. You click on a RSS link in a web page and the feed gets added to your feeds list. Clicking through to a feed refreshes it and, if it's got media attached, you can click the link at the bottom of an entry to download and play it. (Worth noting and trying for top level pages, there's also 'Subscribe', the very first menu option, that appears when Web has detected that there are RSS feeds associated with the page.) Fairly quick and painless, though no glitz or glamour. Score: 17

Apple iPhone 3G: Navigating to a page with a podcast's RSS link and tapping on it links through to a reader.mac.com URL, presumably to handle the RSS feed online, rather than locally on the iPhone. I tried it numerous times and just got '.Mac Reader Error', as shown here. I'd blame server congestion, but I was trying (9am GMT) while the whole of the Mac-loving US was still tucked up in bed. I'm guessing the .Mac server would show the feed's contents and offer a download link for any audio podcast content, but.... I tried several other sites but found it impossible to do anything sensible with a direct RSS link (not helped by the lack of copy and paste on the iPhone). "Stop!", you say, "this is what iTunes is for!" And you're right. Finding podcasts, subscribing, downloading and syncing them via iTunes when you're back at your home/office is a piece of cake, so I'm not going to hammer the device too much on the podcast front - but wouldn't it have been nice to have some direct handling as well? Score: 15

HTC Touch Diamond: A surprisingly seamless experience for anyone with their wits about them. Clicking on an RSS link on any web page offers the chance to copy it to the Windows clipboard, then you just have to 'spot' the new RSS Hub application in Start|Programs. Opening this and adding a new channel then automatically inserts the copied URL from the clipboard and offers to download the feed's official name. A couple more taps and I was listening happily. Score: 17

Touch Diamond handling a podcast

12. Find a video of "Abba - Dancing Queen" on YouTube and watch it.

Phew - A little fun after all that RSS hard work!

Nokia N95 8GB: Heading to www.youtube.com is hard work on S60 Web - it's a high bandwidth page and rendering seems to take an age. It works though, and the N95 8GB just about handles the in-line Flash video, as shown. Playback is a little jerky at times, but watchable, full-screen. Time taken to get watching: 2 minutes 5 seconds. Going via YouTube's mobile site failed miserably, with the streaming 3GP version failing to get past my Wi-Fi router. Plan C is YouTube's very own S60 client, Java-based - this installed fine but then (despite correct RealPlayer settings) it too failed to stream its video through my router's firewall. Plan D (you can see where this is all going, can't you...) was to fire up the third party freeware Mobitubia, which managed to get Dancing Queen playing on-screen in 48 seconds from a cold start. Impressive, but - again - your average user may not know about such a useful piece of software. Score: 12 (uninspiring without going third party)

N95 screenshot (S60 Web)

Apple iPhone 3G: Wow, the advantage of a fully configured, built-in client, with a glorious user interface. 40 seconds from a cold start to hearing Anna-Frid and Agnetha warbling. Video quality was top notch too. Score: 19 (one point lost for the catalog of videos not being complete - not every video on YouTube is here, sadly)

HTC Touch Diamond: Another built-in, purpose-built YouTube client, similar to the iPhone one but slightly slowed down by the text entry limitations for my search string. On the plus side, it queries the full YouTube (as far as I can tell) and it only took 46 seconds to start playing from a cold start, on the downside, playback was a jerky in places - which shouldn't happen for a native Windows Mobile application. Score: 18

Final scores

Nokia N95 8GB: 199 (Max score: 240)

Apple iPhone 3G: 171

HTC Touch Diamond: 166

N95 8GB comes out the winner

Conclusions

Yes, this is a Symbian-focussed web site and I'm sure a few people here will cry foul, but let's examine the results more closely. The tasks that the AAS team set really were everyday requirements and not biased in any one direction. The N95 8GB comes off best by a margin of 28, as the best all-round (smart)phone for the user who wants more than just phone calls and texts. But what's fascinating is that this margin of 28 would be wiped out if the iPhone had had a decent camera that shot video clips. In other words, camera-apart, there's very little to choose between N95 8GB and iPhone in terms of real world speed and functionality.

Of course, this being the real world, the iPhone's average camera and lack of video leave it scoring just more than its main competitor (at least, if you believe HTC's marketing), the Touch Diamond, which manages to score less despite having a reasonable camera and a semblance of video recording. I've shouted down the Diamond before, in Smartphones Show 63, and I'll do it here again. It's a powerful Windows Mobile 6.1 business handheld shackled by a clumsy, slow and inelegant add-on UI and confusing set of text entry mechanisms. The iPhone, on the other hand, manages to impress for much of the time and it was a genuine pleasure to pick it up and try and do one of the tasks above, even if - like the photo emailing task - the results themselves were less than impressive.

But I have to emphasise once again that, as a 'swiss army knife' device, the Nokia N95 8GB is the best all-round phone in the world - bar none. It's not the thinnest or the sleekest or the fanciest or the fastest or the newest or the most trumpeted, but it can do everything you ever need it to, without breaking much of a sweat, and it has very, very few weaknesses.

Steve Litchfield, All About Symbian, 22 July 2008


 

Categories: Comment, Hardware
Platforms: General, S60 3rd Edition

Feature Discussion

GSi-R
There is an error in your link Steve.
slitchfield
Spec-sheet comparisons are all very well, but how good are the Nokia N95 8GB, the Apple iPhone 3G and the HTC Diamond in real life? The AAS team has come up with a dozen things that we all like to do with our phones and Steve was then set to accomplishing all of them on all three devices. Can the sheer usability and likeability of the iPhone triumph over Nokia's N95 design and S60? Is the HTC Touch Diamond a competitor here? Find out in the full usability feature.

Read on in the full article.
lynchem
I generally use my phone for... er.... making phone calls ! I had a shoot out with my iPhone wielding friend and gunned him down easy with my N82.

Another category you should have included is "Fitting the phone in your pocket alongside your wallet". :)
Enfors
As far as I know, S60 doesn't have any sort of push email support, only poll (automatically though, every X minutes). Correct me if I'm wrong. Marketers often call this setup "push email", but it isn't. It's automatic polling every X minutes.

Push email is when the client (read: phone) never asks the server if there is any new mail. Instead, the server contacts the client (pushes the mail to it), telling the client that a new mail has arrived.
Burcrim
Install SkyeQuiKey ot T9 Nav and you can get an alarm set or a new meeting in a lot less clicks.
Nexus1974
S60 does support push email via Mail for Exchange and I use with our Kerio email server on my N95 8GB and it works well.

You do however require the server to support push email (Kerio, Exchnage Server etc) which is more important.

In my mind its not really than much better than poll every 15 mins as long as you have an unlimited data contract.
Unregistered
I have been a nokia fan for last 15 years. but i think nokia has lost this battle hands down to apple. I will switch to 3g iphone as soon as unlocked version is available.
BTW i am not a fan N95 as i find the design cluncky and too gimicky to be practical.
Nemoi
thanks a lot for that comparison. I am thinking right now about getting a new mobile phone (or computer really, since what I do least on it is using the phone function ;), and for a while, as a long time Macuser, I was set on the iPhone. Then a friend of mine got it, and I really did not get a long with the touch keyboard at all. Now I finally understand why some people put so much emphasis on the 'use it with one hand' aspect. I also did not find web-browsing that much more convenient than on my e51 (except the screen size, of course).
Anyway, the game for me is now between the N95 8Gb and the upcoming N96. I hope you do a comparison on those two as well. But it probably comes down to the price of the N96, which might be a deal braker...
m_vitaly
My N95 does support IMAP IDLE on GMail.
And there's almost no difference between IMAP IDLE and Push email.
It has to be supported by your server, though.
Tzer2
Quote:
I have been a nokia fan for last 15 years.
Really? Since 1993? What was your first Nokia phone?


Quote:
But it probably comes down to the price of the N96, which might be a deal braker...
I would wait a month or two after it launches, like most phones the price is probably going to drop very steeply after the early adopters have bought theirs.
Menneisyys
Quote:
Playback is a little jerky at times, but watchable, full-screen.
Yup - while Flash Lite 3 is much better than the full Flash 7 on Windows Mobile (see my Youtube Bible for more info if interested - http://www.allaboutsymbian.com/forum...ad.php?t=72048 ), it indeed doesn't deliver stuttering-less video.

Quote:
Going via YouTube's mobile site failed miserably, with the streaming 3GP version failing to get past my Wi-Fi router. Plan C is YouTube's very own S60 client, Java-based - this installed fine but then (despite correct RealPlayer settings) it too failed to stream its video through my router's firewall.
Yup, but that isn't the problem of these clients. About 70-80% of cellular connections will work. Not that the 3GP "quality" would be worth writing home about. (See my RTSP and quality comparison-related comments in my articles, also discussed in the above Youtube Bible.)

Quote:
Plan D (you can see where this is all going, can't you...) was to fire up the third party freeware Mobitubia, which managed to get Dancing Queen playing on-screen in 48 seconds from a cold start. Impressive, but - again - your average user may not know about such a useful piece of software. Score: 12 (uninspiring without going third party)
1. Mobitubia isn't strictly freeware any more - much as you can get it for donating as low as $1 (I've donated $10). Or, wait for the latest version become free.

2. CorePlayer is far better at playing back some (not all!) videos than Mobitubia. THere're some videos that are VERY jerky when played back in the latter. Its, as of version 1.2.5, only downside is the restricted number of hits, which isn't an issue with Mobitubia.
Menneisyys
Quote:
Apple iPhone 3G: Next. There's no support at all for shooting video from the iPhone's camera. This is a showstopper for some, I'm sure. Sorry.... Score: 0

...


But what's fascinating is that this margin of 28 would be wiped out if the iPhone had had a decent camera that shot video clips.
There're third-party apps for the Apple to take videos.
Menneisyys
Quote:
It's (the Diamond) a powerful Windows Mobile 6.1 business handheld shackled by a clumsy, slow and inelegant add-on UI
I don't think it's a business phone. Most (if not all) WM business phones have a thumbboard.

The Diamond is targeted at the same folks as iPhones and "toy", "elegant" phones. That is, an Average Joe knowing almost nothing about phones will most likely buy a Diamond (if he/she goes for WinMo, that is) and NOT some other WIndows Mobile device.
sdeetz
OK, as comparisons go that was pretty fair. However, since I am one of the lucky few that actually owns a iphone 3G and a Nokia N95 8GB, I have a couple of notes here.

(I actually have a Samsung Blackjack and a HTC Kaiser too, but they are just about retired for me. I hate the stylus need on the Kaiser, and the Samsung just isn't as nice as the N95 or iphone)

First, on the Maps / GPS evaluation, you had a ipod Touch. I know that, as you said at the beginning of the review, the software is the same. However, the hardware is not. The iphone 3G DOES have built in GPS, and it picks up signals FAST. In a side by side comparison here in Los Angeles, the iphone picked up my exact position and was ready to start tracking my walking a full 60 seconds before the N95 was. And it is very accurate as well. Even though there is no pedestrian mode, it followed me down every street with surprising accuracy.

Next, I tested out the downloading of high res images off the internet that you described. I chose a full 5MP image that I have posted on my personal web page. It saved fine to the photo library, and opened up no problem on screen. Let me rotate it, zoom in and out, etc. I did not experience any of the glitches you mention at all. Not sure if that's a ipod touch issue or not.

Although all 3 Apple devices run the 2.0 software, there are different builds for each device. For example, the iphone 3G runs build # 5A345. My old iphone that was updated to 2.0 software runs build # 5A347. I don't have a ipod touch, so I'm not sure which build it runs. So that picture issue doesn't seem to hold true on the iphone 3G at least.

Also, I agree about your Safari comments, but you have to take some of that with a grain of salt. The whole point of Safari is to take you to the REAL internet pages, not a mobile version. So of course, there will be some sites that are easier to navigate with a stripped down mobile version, but do you want that for every site?

I would prefer the full desktop web pages all the time. That's why some sites do develop web apps when deemed necessary, or they deveop a full native app as you showed. In my experience, the iphone web apps and full native apps are optimized far beyond what a typical mobile web site does anyway, and are faster to use.

So I prefer having the full desktop websites by default, and the option to use native or web apps for the few things that I do often that need detailed navigation through a site. (Like book flights, etc)

With those three things accounted for, the Nokia N95 is still ahead by a little though. It is a great device, and I love it.

For me there are two determining factors in your review that would dictate which device would be best for a user. ..

One is video. If you need it, obviously you want the N95. Period. I don't shoot video at all on my N95, so this is not a consideration at all for me. Since this one category was a difference of 19 points alone in your review, if a user doesn't care about video, the two devices score virtually the exact same number. (coupled with the above points I made on GPS, Safari, and photos)

Second is the keyboard. I type a ton of emails on my phone while I travel, and the lack of a keyboard on the N95 means it stays in my bag more often, and I reach for the iphone to do my emails. This is the big one for me.

If you only read emails on your phone, or only type short responses, then this is not a consideration and the N95 is your baby. But if like me you type a lot, you probably require a qwerty, and lugging around a bluetooth keyboard is an option for some, but I don't like having extra stuff when I travel. I like to travel lite.

I use both devices because both are a pleasure to use. Clearly the best two mobile devices on the market today. But for day to day uses, I find myself reaching for the iphone more often than anything else. We'll see if that changes when the S60 touch interface comes out, and we see how the keyboard data entry works. If it's even close to the iphone, that will probably become the new device for me.
brendan
seems fair enough to me.

something you have written about but one cant really score is how much one likes a device. I have a e90, n95, n82 and now the iphone 3g. I like the iphone the most by far even though the other phones do more.

A small thing that nokia have really slipped up but isnt mentioned much is the deskstand. I always like them and having a deskstand for the iphone is great. why dont nokia do them? Does anyone else like them?
Antoine of MMM
Hello Steve; I don't want to come off too harsh concerning your article. I think its quite a timely and appropriate evaluation. However, my issue is with your scoring system, rather than the outcome or even the process.

You use a system based on a 20 point system. However, you don't really mention how those 20 points are weighted. If you will, it allows you to just throw points out there for whatever reason and then we the readers have to guess at whether 16 points for the #1 item is the same as 16 points in #9. Is it possible that you can explain the methodology behind the 20 point scoring system. For me personally, it would add considerable value to this evaluation from the scoring perspective, and then (possibly_ provide a chart for you/AAS to evalute devices on a similar scale in later compairsons.

If that's not possible, as that's not exactly a simple request; may I make the recommendation that your scoring system be simplified to a simple 1-2-3 kind of format. The item that wins gets a 3, the item that is worst gets a 1. A simplified scoring system, with some measureable metrics (for example, in #1 you mention time to complete, keypress amounts, and efficient user interfaces as measured items; the first two are consistent based on the fact that it is just you testing them, and the last one is opinon; this makes your scoring system hold value in the eyes of those who might not be as fast, but see the interface as more efficient).

In the paragraph you mention "other relevant factors" which may very well be the case that there are other factors, but without a breakdown of how those effect your 20 point scoring system, it (again) becomes very subjective to the tester (not the user).

Again, please do not take this as being a harsh critism; I think this is probably one of the better types of comparative reviews that I've read from you. However, the validity of the review is marred because of your imbalances in the scoring. In such a high profile review, I'm not sure that AAS should have to answer to any biases because of testing methodology inconsistancies.
Tzer2
Quote:
A small thing that nokia have really slipped up but isnt mentioned much is the deskstand. I always like them and having a deskstand for the iphone is great. why dont nokia do them?
They did do stands a few years ago, one of them let you make videophone calls on 3G models that didn't have a front camera, another had built-in stereo speakers so you could use the phone as a hi-fi. Presumably they didn't sell very well because there haven't been any new official stands since then, though there might be some third party stands on ebay etc.

However, if you just want something to prop the phone up, there is a built-in stand around the camera lens on the N96, and the Nokia internet tablets come with much bigger built-in stands along their full length.
Unregistered
I think the aspect you missed is how fast does each device render a full web page?

It has to be said the n95 browser renders full pages very slowly, it's painful. You really need Opera Mini as well. It works good on mobile sites, though.
Tzer2
Quote:
It has to be said the n95 browser renders full pages very slowly, it's painful. You really need Opera Mini as well. It works good on mobile sites, though
Have you tried it on wi-fi or 3.5g? It's pretty nippy with those kinds of connections, especially on the latest firmware.

The Opera Mini thing is another debate altogether of course, should phones render pages at all? There are good arguments on both sides...
Unregistered
why are you even including an s60 phone in the comparison?
For one thing, the contacts section sucks. So does calendar. As does messaging. Dont tell me I am abnormal for wanting to do all these things.Also got to pay $$ for all the stuff other people take for granted. Someone has already mentioned skyequikey (simiilar functionality available in latest SEs at no extra cost). Same goes for sms/call managers, a list of recently text'd contacts(WOW). Etc etc
Real people buy s40 or uiq phones.
It is not about cost either.
If you have ever used a p1i or a z8 or a 6270(as you have, steve), you'll know.
- a former e90 user.
P.s. I havent been a nokia user for 15 years, but I have been one for seven years. JUST GIVE ME A PHONE. I have an n800 for all the other stuff.
bartmanekul
Here here, with smartphones becoming mini computers, lets see a return of deskstands.
Williamoni
Nice test Steve.

One point though - using the phone to make phone calls is very important and I would be interested to see how the devices compare on that too.
notmicro
Really wish that you had compared syncing Calendar / Contacts via both USB and Bluetooth. So far I haven't found a single iPhone 3G review which mentions if it finally supports sync via Bluetooth. Even an ancient, long-gone Nokia of mine could sync everything over Bluetooth no problem.

Other "fun categories" for comparison would be Voice Dialing, Ringer Profiles, Tethering, Voice Memos, Java support. The iPhone inexplicably continues to do a total face-plant in several of these categories.
fbloise
For RSS reading you use Google reader...

And since this is a S60 based website, you will (believe me!) always make nokia win.

I do have the nokia 6120 classic, but right know the iPhone 3G is way better than the N95. Why?
Because people wants hassle free stuff, with the nokia you need to learn the good 'ol way.
but with the iPhone, even my granma can use it.

Your metrics aren't fair, since nokia (and winMo) aren't the easy to use as you keep guys saying.

iPhone wins hands down.
Mr Fabulous
I own both the iPhone 3G and the N95 8GB. And I enjoy using both on different occasions.

Steve, one very real 'real world' gauge ought to be the sheer pleasure of using the device, regardless of what you may be doing... the way one interfaces with this device that resides somewhere on their person almost all waking hours of the day, and how they experience hitches and slowdowns on the device.

iPhone: 19
N95: 12
HTC: 8

A fair assessment?

65 Comments / Post New Comment

Copyright Notes || Contact Us || Privacy Policy (Ellie)