Sleep Centre before quote reduction

Sleep Centre after quote reduction

Sleep Centre is DssW’s massive archive of usenet and other conversations about Mac energy saving subjects. The entire archive is available on this web site and every so often I turn my attention to improving its presentation and usefulness.

Last week I turned my attention to the excess quoting in the archive. Quotes are useful when the referenced text is not immediately available, but in our archive the original is immediately above the response and has just been skimmed over by the reader. Bulk quoting in this situation is unhelpful — needing to bulk quote at any time suggests your contribution could be better formed.

I continue to struggle with how far DssW can edit and reformat the Sleep Centre content. My goal is to improve the content’s usefulness. To that end some reformatting is justified. Wholesale editing is not.

With regard to excessive quotes, bulk or automated quote removal risks changing the meaning of the author’s message. Removing quotes by hand is not feasible; a smart automated method is a must — or the excess quotes must remain.

The Sleep Centre available today has the majority of quotes removed. In most cases the improvement is incredible.

Discussions are less cluttered and feel easier to browse. It feels more like a real conversation.

How I decided which quotes to remove will be covered shortly, but other recent changes also improved readability.

Visual clutter

The removal of excess quoting reduces the occurrence of colour changes and indented blocks.

Multiple levels of quoted text

Sleep Centre’s quotes are denoted with a change in text colour, a slight indent, and a thin line to the left of the quote. If the quote appears within another quote — as is common with discussions — all these attributes are repeated within the original quote. The result is a mass of visual clues requiring effort from the reader.

The author colour scheme was introduced to help readers gauge who was talking. The goal was to allow readers to quickly judge how many people were involved in a discussion and who the main contributors were.

It felt noisy.

The result was colourful, but ultimately added little to the content. It did not get readers an answer any faster.

What matters to the reader?

Denoting who is speaking is still important, but not critical to the casual reader. Sleep Centre’s audience are looking for solutions to problems with their Macs.

I does not matter if a message is written by Gregory Weston, Mike Rosenberg, or Jolly Roger. It does not matter if this is the fifth message left by a specific author. It does not matter if one author is dominating the conversation. It does not matter if the conversation involves two people or twenty. What matters is solving the reader’s problem.

With this in mind I adjusted the layout to improve the reader’s ability to skim the content.

The new layout highlights a technical tweak Sleep Centre gained a few months ago. Messages have been reformatted from fixed width content into flexible paragraphs. There are very few specific line breaks in Sleep Centre’s content.

The content resizes, wraps, and acts as simple blocks of text. While this does not sound impressive, it is, and the new thinner layout makes good use of this capability.

Removing the quotes

So how did I decided which quotes to remove?

As a background task, I have been pondering the problem for many months. The problem felt overwhelming and so I flipped question to something more manageable.

How to decided which quotes should remain?

This question felt easier and arrived at the same result. Removing the quotes is an easy computer science task. The process of deciding which quotes to leave in is not.

In the end I based the solution on an approach taken by spam filters; apply a series of tests and total the weighted scores. If the final score falls below a set threshold, include the quote.

The tests include:

• the position of the quote relative to the author’s contribution;
• the length of the quote;
• the number of quotes;
• the proportion of quoted material.

The outcome was pleasantly surprising. I had a lot less tweaking to the algorithm than initially expected.

The framework lets me add new tests and tweak the various weights associated with each test. Thus as I can incrementally improve the results as time allows.

I suspect further fine tuning will be required but for now the result is a leap forward in the usefulness of Sleep Centre.

Sleep Centre attracts Mac users having problems with batteries, power management, and other energy woes. To that extent it does well — thousands of visitors every month discover an answer and DssW for the first time.

Offering a hand of friendship (flickr:delcimgp)

What happens next is important; I want our visitors to find answers and gain trust in DssW. The best outcome is a new visitor seeing our software and buying on impulse. But straining for instant customers quickly alienates anyone not immediately won over. Hardly the solid foundation to build a business on.

Seth Godin, a notable marketing consultant and enjoyable public speaker, recently commented on increasing font size for the sake of readability. It feels like an easy decision.

If you are reading this on the DssW blog, this is your browser’s default font size — big isn’t it? This is the size your browser designer’s found easiest on the eye. Yet most sites still deliberately reduce the font size.

Part of this font shrinking behaviour is historic but changing that behaviour will not be easy.

Regrettably there is a strong argument that will hamper Seth’s message for web designers, Google Adsense.

We use Google Adsense to recoup DssW’s server costs through limited adverts within Sleep Centre. It worked well for us, until the last design tweak. Google does not let you change the font size of its adverts. Advice to those wanting to maximise advert income is to match Google’s tiny 9px — 12px fonts.

This is a sample of a 9px font.

This is a sample your browser’s default font size.

Our advert income dropped with the change to a more readable font size. Hardly a good outcome for DssW’s bottom line.

But Sleep Centre’s larger font size is staying. Going back to a smaller font size detracts from our visitor’s experience. In the end I prefer to gain a happy customer tomorrow than an Google Adsense click today.

Thanks to Oliver Reichenstein for publishing 100E2R – recommended reading for web designers looking to improve readability.

Sleep Centre is the first contact most people have with DssW. As with any first impression I am keen DssW presents itself well.

I have been busying myself building new tools and scripts to get the most from our archive of conversations. As internal tools I had the freedom to play with a handful of new technologies.

DssW Conversation – our new tools for tagging Sleep Centre

From flea market to art gallery

The archive is stored in a collection of text files going back six years. The raw contents of those text files is a long way from the conversations you see on the site today.

Our new tools use a wonderful mix of technologies. Previously we used a combination of Perl and MySQL; we have now said goodbye to MySQL and hello to Apple’s Core Data.

Thanks to a heady combination of Template Toolkit; XML; and Apple’s Core Data, Cocoa, and SearchKit the new Sleep Centre design is far more accessible.

Making the best shine through

In the past Sleep Centre has only ever reproduced line for line the orginal conversations. This is no longer the case.

Where appropriate, the content is now condensed, reformatted, or highlighted to make sure pearls of value are not lost in a sea of banter.

Changing this policy was not done lightly but I believe the result is more focused and useful.

What’s new in Sleep Centre?

Quotes

The archive contains a disturbing amount of quoted material. Often newer messages quote chunks of previous messages. This quoting is helpful when viewing messages in isolation but redundant when the previous content is a scroll away.

Quoted text gets a make over.

Quotes gained a couple of improvements and more improvements are planned in the future.

Quotes in colour

Quotes have been colour coded. Picking out original content is much easier with coloured blocks.

Thanks to BareBone’s excellent Mailsmith program for the colours.

No more angle brackets

The original quote markers have been removed. The cluster of angle brackets down the left hand side of the paragraph felt visually awkward and duplicated the block quote notation used by web pages.

Block quotes are styled with a thin coloured bar separated from the text. Close enough to denote the quoted text but far enough away to be unobtrusive.

Links to related conversations

Conversations include links to other relevant conversations and categories.

The archive is being hand sorted and tagged. As each conversation is reviewed and tagged, we can find and highlight related conversations. The process is far from fast but the value it adds more than justifies our effort.

Categories and RSS feeds

Tagged conversations let us provide categories of conversations to make searching even easier.

All our categories have associated RSS feeds for the technically savvy. Subscribing to a category keeps you informed any time a new related conversation appears.

Visit the Sleep Centre categories page to browse around and subscribe.

Thanks for your feedback

As with all things DssW, we love getting your comments and feedback. Please let us know what you like and where we should focus our effort.