ID | Primary Volunteer Reviewer | Primary Review Completed Date | Optional Secondary Volunteer Reviewer | Secondary Review Completed Date | ID | Do you currently use WordPress? | Would you describe yourself mostly as a… | How old are you? | Have you used Gutenberg before? | Did the task take long or shorter than you expected? | Can you tell us why? | Was the task easier or harder than you expected? | Can you tell us why? | Are you more or less likely to use the Gutenberg editor in the future? | How long did it take to complete the task? | Was the title added correctly? | Was the quote added correctly? | Was the image added correctly? | Where were the main sources of friction? | Platform | Agent |
10001 | Luis Barragan | James Koster | 1/15/2018 | 10001 | No | Business Development | 31-40 | It took longer than I expected | Due to a little confusion with content typing. | It was about what I expected | I am unsure | 5 min | Yes | No | Yes | Content | Mac OS X 10.12 | Safari 0.0 |
10002 | Monique Dubbelman | 12/18/2017 | James Koster | 1/15/2018 | 10002 | Yes | Developer | It took about the amount of time that I expected | as dad | It was about what I expected | I am likely to use Gutenberg in the future | Mac OS X 10.12 | Safari 0.0 |
10003 | Fuyuko Gratton | Ian Hall | 1/11/2018 | 10003 | Yes | Developer | 31-40 | It took about the amount of time that I expected | I had no idea what to expect with a new tool. | It was about what I expected | unfamiliar setup | I am unsure | <5 min | Yes | Yes | Yes | unfamiliar mouse | Mac OS X 10.12 | Safari 0.0 |
10004 | Maria Scarpello | 1/10/2018 | 10004 | Yes | Designer | 31-40 | It took longer than I expected | The Design was cleaner, and easier to remeber when I learned it. but in any program I will need a little time to explore, make mistakes and learn. | It was easier than I expected | Because everything was so well layed out. | I am likely to use Gutenberg in the future | 10 | Yes | Yes | Yes | I got caught in the media library, just because I am use to adding images from there. | Mac OS X 10.11 | Chrome 0.0 |
10005 | Lynne Polischuik | Ian Hall | 1/11/2018 | 10005 | Yes | Developer | 41-50 | It took about the amount of time that I expected | I’ve used Gutenberg before. | It was about what I expected | I’ve used Gutenberg before | I am unsure | 5 minutes | Yes | Yes | Yes | Understanding how to use the mouse on this particular laptop. | Mac OS X 10.12 | Safari 0.0 |
10006 | Monique Dubbelman | 12/18/2017 | James Koster | 1/15/2018 | 10006 | Yes | Freelance designer/developer/business owner | 41-50 | It took about the amount of time that I expected | It was about what I expected | I knew enough about Gutenberg to know that it was going to more like a “builder” experience, rather than the WP editor I am used to. I felt anxious while using it because I wasn’t sure where the code editor went! Felt better once that was shown to me. | I am unsure | 5 minutes | Yes | Yes | Yes | Some uncertainty about how to add an image, how to add another list item, but my first assumption of what to do turned out to be accurate in both cases | Mac OS X 10.11 | Chrome 0.0 |
10007 | Monique Dubbelman | 12/18/2017 | 10007 | Yes | Developer, Blogger | 41-50 | It took longer than I expected | you can’t really free flow write – you have to format as you go. It inhibits the creative writing process. | It was harder than I expected | It wasn’t intuitive | I am not likely to use Gutenberg in the future | 20 min | I’m not sure | Yes | Yes | how to get the blocks to work. And having to think about formatting as I was trying content. | Mac OS X 10.12 | Safari 0.0 |
10008 | Grzegorz Ziółkowski | 12/18/2007 | James Koster | 1/15/2018 | 10008 | Yes | Developer | 31-40 | It took longer than I expected | It’s just a new experience. It’s fairly intuitive to begin with. | It was about what I expected | It just… was. | I am unsure | 15 | Yes | Yes | Yes | Not being able to drag and drop areas (I hear it’s coming, yay!), Figuring out new placement of buttons. Because everything is an icon, you had to intuit what each icon represented. I can see this being an issue with my clients who are not techie or intuitive. | Mac OS X 10.11 | Chrome 0.0 |
10009 | Monique Dubbelman | 12/18/2017 | 10009 | Yes | Developer | 18-30 | Yes | It took about the amount of time that I expected | I have worked with Gutenberg before, so I kinda now most of the blocks already. And it’s not that hard to try to get it right visually. | It was about what I expected | I am likely to use Gutenberg in the future | 6 minutes | Yes | No | Yes | Adding the quote. Didn’t know that the quote block had different styles. | Mac OS X 10.12 | Chrome 0.0 |
10010 | Fuyuko Gratton | Ian Hall | 1/11/2018 | 10010 | Yes | Developer | 31-40 | Yes | It took about the amount of time that I expected | Because it was my first time, I anticipated a learning curve, and there definitely was one. There were not many visual cues for what I was supposed to be doing. | It was about what I expected | I had used gutenberg in the past, so I think I had expectations that were set from that. | I am unsure | 2-3 minutes | I’m not sure | Yes | each paragraph being it’s own “editor” with input buttons that cover other areas were confusing and frustrating for me. | Mac OS X 10.11 | Chrome 0.0 |
10011 | Monique Dubbelman | 12/18/2017 | 10011 | Yes | Developer, Designer | 31-40 | No | It took about the amount of time that I expected | I needed to become familiar with where some of the UI tools moved to—in particular the add media button hiding under the plus. | It was about what I expected | I’m fairly familiar with design and UI patterns, so I may have an unfair advantage in recognizing ambiguous symbols. | I am likely to use Gutenberg in the future | 6min | Yes | I’m not sure | Yes | I didn’t read the quote instructions. The plus needed an initial learn to find the image inserter. I’m used to the advanced editing tools in the kitchen sink. I was caught off-guard by the image tools lacking size options. 3000px seems excessive. | Mac OS X 10.12 | Chrome 0.0 |
10012 | Fuyuko Gratton | Ian Hall | 1/11/2018 | 10012 | Yes | educator | 51-60 | No | I did not have any expectations | Never used the UI so I didn’t know what to expect. | It was about what I expected | No expectation | I am unsure | 6minutes | No | No | Yes | I wanted to change the font but couldn’t find how to change it. | Mac OS X 10.11 | Chrome 0.0 |
10013 | Andrew Duthie | 12/19/2017 | 10013 | Yes | Developer, Blogger | 41-50 | No | It took longer than I expected | I am not familiar with how the new editor works, had I spent time with the UI and was familiar with where things are now located I could have done it in about the same time as the now UI in WP | It was about what I expected | I am likely to use Gutenberg in the future | 13 minutes | Yes | I’m not sure | Yes | Formatting on the quotation | Mac OS X 10.12 | Chrome 0.0 |
10014 | Rodica-Elena Andronache | 12/19/2017 | 10014 | Yes | Developer, Business Owner | 31-40 | Yes | It took longer than I expected | Blocks are added for each paragraph which was confusing, toolbars hiding text, not knowing Paragraph was different than Quote. Adding image was not obvious, thought I could add it within a block of text. | It was harder than I expected | See above | I am not likely to use Gutenberg in the future | 6minutes | Yes | Yes | Yes | See above | Mac OS X 10.11 | Chrome 0.0 |
10015 | Rodica-Elena Andronache | 12/21/2017 | 10015 | Yes | Designer, Business Owner | 51-60 | No | It took about the amount of time that I expected | I’m familiar with what WP will do, so it was easier for me. I’m not sure my customers (with limited use) will find it beneficial. | It was harder than I expected | it was hard to right justify “Einstein” and the link menu popped up underneath the WP admin sidebar | I am unsure | 6 minutes | Yes | I’m not sure | Yes | text justification, learning the new interface | Mac OS X 10.12 | Chrome 0.0 |
10016 | Betsy Cohen | Ian Hall | 1/11/2018 | 10016 | Yes | Blogger | 51-60 | No | It took about the amount of time that I expected | I was trying to figure out the type buttons because I new to WP. | It was about what I expected | WP allows for buttons so you can eventually figure out how to get what you need. | I am likely to use Gutenberg in the future | 10 | Yes | Yes | Yes | I was not able to add the attribution to the caption | Mac OS X 10.11 | Chrome 0.0 |
10017 | Rodica-Elena Andronache | 12/24/2017 | 10017 | Yes | Developer | 41-50 | Yes | It took about the amount of time that I expected | I’ve used gutenberg before and knew how to get going | It was harder than I expected | I couldn’t figure out how to right align the ‘Albert Einstein’ photo caption/tag. I couldn’t find the preview button. | I am likely to use Gutenberg in the future | 3 min | Yes | No | Yes | sorting out the quote (and preview) | Mac OS X 10.12 | Chrome 0.0 |
10018 | Rodica-Elena Andronache | 12/24/2017 | 10018 | Yes | Blogger, Plugin Support | 41-50 | No | I did not have any expectations | I had a hard time getting the image to center. I wasn’t sure what each content area was supposed to be used for. | It was harder than I expected | It’s a completely new experience so I would need to use it some more to get used to it | I am unsure | 7 minutes | Yes | No | Yes | Image alignment and use of content blocks | Mac OS X 10.12 | Chrome 0.0 |
10019 | Rodica-Elena Andronache | 12/24/2017 | Abobade Kolawole | 10019 | Yes | Developer | 31-40 | Yes | It took about the amount of time that I expected | I’ve used Gutenberg a few times so I am somewhat familiar with it. | It was about what I expected | Breaking out of an image caption didn’t seem to be possible. Apart from that, regular formatting was pretty much inline with the current editor. | I am likely to use Gutenberg in the future | 8 minutes | Yes | No | Yes | I was familiar with the caption functionality for images, so I used that. I wasn’t aware of the quote functionality and when I did click it briefly it didn’t appear visually the same as the example so I switched back to a paragraph. The two styles for a quote are not very easily discoverable. It doesn’t appear to be possible to break out of a caption by hitting enter multiple times. (Might be the same in the current editor.) | Mac OS X 10.11 | Chrome 0.0 |