Improving the New York Public Library Web site one question at a time
The Digital Experience Group of the New York Public Libraries (NYPL) decided to try a bold experiment. Knowing that they wanted as much user feedback as possible and that they had willing participants—namely their web users, the Group created a trouble free survey tool to gather data. You may be saying, "Ohhhh, online surveys! What's so bold about that?". As usual, it's the chosen implementation that helps to make the difference. The Digital Experience Group created Infomaki, a system that provides a simple, one question survey asking a subject something as easy as "What would you click on to find events?". After the subject answers that question, they are thanked, and simply asked if they would like to answer another question. Here's what is so great about this approach: it's very mindful of the subject's time and very non-intrusive. The concept is that this will lead to more people willingly being repeat subjects. Also, more random questions will be answered. With a traditional survey, you may tend to get the same questions answered at the start of a survey, but have people drop out, thus not getting sufficient answers to the end questions. There are a few bugs in the system, but it appears the team is actively working on fixing them. I gave it a try, and quickly got hooked. While obviously, my subjective opinion and observations do not constitute a usability test, I have observed most test subjects glad to answer a single question. But conversely, I have seen that grimace or shoulder slump when a subject can sense you are settling in for a multi-part questionnaire. My experience would point to Infomaki being a well received data collection methodology. But don't take my word for it, look at the results of the 48 hour pilot:
[a prior] survey received 7,341 individual answers to questions from 520 respondents, 60% of whom completed the whole survey. This totaled 7,341 individual answers over 14 days. Infomaki, on the other hand, garnered over 6,900 answers from 840 respondents in its initial 48-hour maiden voyage.
Seems like the concept works, but the real measure of success will be the continued interest of the subjects and the quality of data. Let's hope we here more about how Infomaki works out.blog comments powered by Disqus