Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-28 Thread Allana Mayer
+1 Ruth! Further reading on MTurk's business model, demographics, etc.: https://motherboard.vice.com/en_us/article/the-unknown-poorl y-paid-labor-force-powering-academic-research https://priceonomics.com/mechanical-turk-new-face-of-behavioral-science/ Allana Mayer Media Coordinator, OurDigi

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-28 Thread Ruth Tillman
If you've got the budget for $5 available, why not pay $5? I have done piece contracting of this sort when I was very newly out of undergrad and working three part-time jobs, plus doing paid unskilled usability testing and other piecework. It may only take 5 min, but that doesn't mean they're spend

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-27 Thread Josh Welker
Thanks, Steven. That article is helpful. Funding will not be an issue for my university. My main concern is whether using MTurk is too cumbersome and whether its results are valid. I plan to limit my tasks to college-age people in USA, but I can't get much more granular than that. Whether that is a

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-26 Thread Turner, Steven
At my university, the biggest impediment would be funding the MTurk activities, that is, getting the university to agree to pay using their method. Steven Turner, MLIS Manager, Web Technologies and Development, Assistant Professor University Libraries The University of Alabama

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-26 Thread Turner, Steven
I did find this online, Joshua: https://www.viget.com/articles/how-to-run-quick-and-cheap-usability-tests-using-mechanical-turk S Steven Turner, MLIS Manager, Web Technologies and Development, Assistant Professor University Libraries The University of Alabama 416 Gorgas Libra

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-26 Thread Turner, Steven
Gosh, I am super interested in this process as well. S Steven Turner, MLIS Manager, Web Technologies and Development, Assistant Professor University Libraries The University of Alabama 416 Gorgas Library | Box 870266, Tuscaloosa, AL 35487-0266 office 205-348-1638 steven.j.turn

Re: [CODE4LIB] Usability testing with Mechanical Turk

2017-04-26 Thread Wilson, Robert
Joahua, we’re in the same boat here, and I would also love to hear about any experiences with Mturk and usability testing. Robert T. Wilson Emerging Technologies & Systems Librarian Bridgewater State University Bridgewater, MA On 4/26/17, 11:51 AM, "Code for Libraries on behalf of Josh Welk

[CODE4LIB] Usability testing with Mechanical Turk

2017-04-26 Thread Josh Welker
I'm thinking of using Amazon Mechanical Turk to do quick testing on some new UIs for our library website. The testing needs to be done over summer when there are few students available. Does anyone have experience using MTurk for UI testing and have any pointers for what works well and what doesn't