Site Maps and Site Indexes, Revisited
January 12th, 2006
Before the holidays, I generated blogosphere fervor when I mentioned I think it’s a potential waste of valuable development resources to construct and maintain site maps and site indexes.
Several people left excellent comments which I never had the chance to address until now, so let me see if I can clarify my thinking:
Eric suggested that maybe site maps do have a use:
I’ve also used site maps and site indexes to teleport to a page I know they have (either saw a link, or actually visited the page), especially if the page I want has next to no relevance to the current page (e.g.. I might have drilled down some category to some product page, and want to jump to their page of press releases, or take a look at the management team). This way I avoid trekking through however many intermediary pages, and even having to sniff the scent.
When users intentionally teleport to another page with no relevance to the first, we can infer that they came to the site with multiple, unrelated missions. However, our research shows that multiple missions are very rare. Even when they do occur, they are usually related. For example, a user might go to the kitchen section of Amazon to buy a Martini Shaker then go to the book section to buy mixed drink recipes.
It’s my opinion that related missions should be supported by the primary navigation on the pages and it’s a design flaw if the only recourse is to use the generic site map/site index facilities. Of course, this puts more burden on the designers, who have to look at each content page and ask, “what missions are likely to go with this content?”
A site map/site index would be much simpler to implement, but, in general, I think the generic nature of those devices push the burden on the user. Plus, if you haven’t done the homework of determining what the alternate missions are (because it’s a lot of work), I think the chances are much less likely that you’ll accidentally create map/index entries that serve the same goals with the right trigger words. It comes down to the choice of explicit design efforts versus serendipitous results.
Heather asked:
On what kinds of sites have you conducted your user research? I agree that on most typical corporate web-presence sites (with the objective of “this is who we are and what we do”) a site index is probably not needed if the navigational structure is well-designed. But for sites rich in informative content, serving repeat visitors (such as intranets, companies with subscriber-users, government agencies, educational institutions, libraries, professional and trade associations, and other membership organizations), a site index can be quite valuable for the users who want to access precise information quickly.
We’ve conducted our research on all different types of sites. But, I was referring to information-rich sites, much like the type Heather described, which is where much of our research is conducted. I agree that users want to access precise information quickly. However, building out a quality index is a real skill and most sites do not have the craftsman available.
In addition, as I mentioned above, to do the research necessary to build out a quality index, you need to find out what users are looking for and why. While organizing that information into an alphabetical index is an option, if you have all the research, you probably will find that it’s the least desirable form. Instead, creating a logical organization of links where related information is clustered together will work better. And making it your primary navigation (aka home page) instead of located on a secondary page (which, itself, has a scentless name such as “A-Z Index”) would probably make the access even faster.
I’m not saying that indexes in themselves are bad, just that you are fixing a symptom, not the root problem, when you’re dedicating resources to them. To this end, Heather seemed to agree with my point:
Another issue specific to site indexes in existence is that they may not be done well. They might be mere alphabetized lists of site page titles (alphabetized site maps) yet labeled as an index. As such, they are not very useful. A book’s index is not a mere alphabetization of the table of contents, but some so-called site indexes get away with this. A good index has multiple access points/entries, each worded differently, which point to the same content, a structure of second-level terms or sub-entries, and cross-references. And on a web site the entries may point to anchors at headings within pages and not just to the top of the page.
All of this takes great skill and care. The efforts may be better dedicated to building out a better home page design, utilizing the same underlying content.
George pointed to a Boxes & Arrows article describing the building of the A-Z Index for the BBC. While the article is well written and informative, George does ponder:
It explains very well how they BBC reworked their index but didn’t get into much detail why they need an index, why they needed to rework it, what efforts were put into accomplishing this task and the what were the results.
So what do you think – could the BBC make better decisions in helping their visitors find content instead of redesigning their site index?
As with many discussions of site maps and site indexes, the article assumes an index is the right way for the site and only needs to be improved. The article goes so far as to mention this persona:
Sheila is 59, retired, and lives in Newcastle. Her web experience is mainly limited to genealogy and browsing kids’ content on bbc.co.uk with her grandchildren. She has used email and has bought online, but without great confidence. She doesn’t really like searching, and prefers to scan a list of links even if it means scrolling.
It then assert an alphabetical list of every topic the BBC covers (which gives serious competition to any well-done encyclopedia) is the best way to find all the content specific to Sheila’s two interests: genealogy and kids. Again, there’s gotta be a better way to solve this problem. I agree completely with George: the BBC could definitely find better ways.
Darrel shared where he’s coming from:
As a .gov entity, we’ve spent the last year discovering that we have no easily identifiable set of personals to target our IA at on a broad level. It’s across the board, pretty much consisting of everyone within the confines of our state. Some user interviews have led us to the conclusion that having more links up front is ultimately what folks are looking for. More scanning, less clicking, increasingly approaching a site map. So, in a way, the more we focus on our ’scent issues’ the more we’re working on our site map at the same time.
This is a brilliant observation. Since you have a constituency that is all over the board, having more links on the home page are going to play in your favor. In essence, your home page will become the site map.
So, the summary is this: site maps and site indexes are just another link library that the site designers have to build and maintain, without adding any real benefit by separating it from the other navigation on the site. Put all your important links in your primary navigation and you’ll make users happy while reducing the workload considerably.
Tweet
January 12th, 2006 at 7:57 pm
One of the really good uses of Site maps outside of a navigational sense is that search engines can use the site map (or site index) to easily spider your site. Some search engines do use links as a way to help work out page rankings thus a site map is valaubale in this sense.
And why all this hoopla about keeping sitemaps/indexes up to date.
Make simple script that dynamically creates site maps or indexs on the fly based on meta or title information or some other page indicator.
Most web developers could do this within a day. Thus theres no need to worry about it and those users who like site maps and site indexes are still being served.
January 13th, 2006 at 1:04 pm
Nick,
I fear an automated site map generator would only make a miserable site map easy to maintain. Figuring out the trigger words and clustering is the hard part and I don’t know of an automated way to do that.
January 13th, 2006 at 5:03 pm
[...] There’s an interesting comment on Jared Spool’s Site Maps and Site Indexes, Revisited (a follow up to What about Site Maps and Site Indexes?) that site maps might help search engines ‘easily spider your site’. While I agree that site maps might make a good seed/starting point for a search engine, I don’t quite see how any crawling engine is going to be taken seriously if it can’t cope with a sitemap-less site. Getting a good starting point can useful in a multi-domain crawl assuming you only want one connection per domain at a time because it allows you to get up to the maximum number of threads quickly, but this isn’t usually an issue with individual sites. [...]
January 18th, 2006 at 11:58 am
Thanks for writing about this topic, Jared. Being of the same opinion, I recently went so far as to tell a client to ditch their site map as it was merely a list of links organised to reflect the site hierarchy. The primary navigation was already doing this well (but not showing all links all at once!). My suggestion hit a snag – W3C WAI guidelines:
“13.3 Provide information about the general layout of a site (e.g. a site map or table of contents). [Priority 2] In describing site layout, highlight and explain available accessibility features.”
http://www.w3.org/TR/WCAG10-CORE-TECHS/#navigation
Also, see the rationale provided by the RNIB:
http://www.rnib.org.uk/xpedio/groups/public/documents/PublicWebsite/public_sitemaps.hcsp
So, as the client was looking to be Double-A compliant, we had to put the site map back in. I’ve looked at the WCAG 2.0 draft guidelines and it doesn’t look like this requirement will be going away anytime soon.
Any ideas how to be compliant without needing a site map or site index?
January 18th, 2006 at 7:19 pm
As I understand the W3C WAI guidelines, they suggest you just need something that acts like a site map, but doesn’t have to be labeled as such. For example, a home page with the same content would likely meet the spirit of the guidelines, if not the letter.
May 9th, 2006 at 3:23 pm
Sorry I’m a bit late on this, but count me in with the crowd that says site maps do have a great bit of use and worth. In short, I believe they do the following: 1) help search engines to index the deeper content pages on a site more easily, and 2) help an organization have a central point for the structure and organization of a website… and even they functions of their business in general. Its sort of an organizational or divisional map. For huge enterprises it may be more effort than reward, but for small or medium sized businesses/sites I highly recommend it.
May 9th, 2006 at 3:37 pm
GW,
The two value points you give them are true, except I’d suggest neither of them benefit the user really.
There are more effective ways to get the search engine to index deeper *and* benefit the user simultaneously.
And, haivng a central point for the organization or division is an internal issue, not something the user needs. You could keep it on a private portion of the site without troubling anyone.
That’s my thinking.