Table 3 Qualitative feedback: resource delivery and format (as per Kirkpatrick “Reaction” element).
Category | Sub-Category | Illustrative Quotesa | |
|---|---|---|---|
Navigation | Ease of access | “I would know also that if I needed a refresher, I could easily go back to the link. I know where it is now to be found.” Isaacb (lay member, no genomics experience) (quote 24) | |
Ease of navigation | Easy to navigate | “I’ve seen a lot of educational modules that are […] just a nightmare to navigate, and this was nice. Not too many pages, not too much clicking.” Mindyb (research member & genomics expert) (quote 25) | |
Unclear navigation | “[…] I got lost. What, having gone through the whole course, I quite frequently said, where am I in the course? Is this the third module popping up out of five?” Isaacb (lay member, no genomics experience) (quote 26) | ||
Website layout & format | What works well | Multimodal | “[…] it was a great blend of written and visual materials to cater to different learning styles […]” Staceyb (genomics expert) (quote 27) |
Good use of repetition | “I needed to have that reiterated to me, um, just because I feel like the majority of people don’t have a lot of experience in this area. So hearing it in two different ways helped. And then also then having the written consolidation afterwards I thought was good.” Elisab (research member, no genomics experience) (quote 28) | ||
Organisation & order of modules | “It had a good flow to it, so it all sort of fed into each other logically, which made it interesting and easy to keep up with as you went through the modules.[…] It’s like a natural progression through from like a really good intro and it kind of gets more and more narrow to then what I need to know practically. ” Staceyb (genomics expert) (quote 29) | ||
Asynchronous and customisable learning experience | “I was able to come in here as a fairly experienced person and jump straight to something that was new to me.” Lana* (research member & genomics expert) (quote 28) “I think anyone could do it, you know, even if they were really a busy clinician or a busy lay person, they could easily get the modules done at a pace that was convenient for them.” Marlinb (counsellor/allied health member, genomics experience) (quote 30) | ||
What didn’t work well | Not a structured, linear course | “[…] I was clicking on ones that interested me. I actually jumped to module three or four, you know, initially… I didn’t do it in sequential order […]” Brianb (chairperson, genomics experience) (quote 31) | |
Recommendations | Formatting and layout | Clearer and easier navigation | “[…] your navigation at the moment is letting you down […] The, the fact that I only just found your slider [navigation bar] […] possibly means that, uh, that, that, that someone else may not find it and then potentially get frustrated as they’re taken through.” Sherrib (genomics expert) (quote 32) |
Estimated read time per page | “[…] you can say estimated read time.” Lanab (research member & genomics expert) (quote 33) | ||
Number the modules & pages | “[…] name them, label them, because I got lost. What, having gone through the whole course, I quite frequently said, where am I in the course? Uh, is this the third module popping up out of five?” Isaacb (lay member, no genomics experience) (quote 34) | ||
Progress bar per module and course | “So you’ve actually got a progress bar right at the very beginning. ‘Cause I now go back to it said I’ve completed a hundred percent, but you need, I think, a progress bar for each module.” Issacb (lay member, no genomics experience) (quote 35) | ||
Search function or index | “Maybe some kind of index that you could jump to for the future would be good. So say if you had an application and you really just, you don’t want to go through the whole course again, you just want to jump to a particular place and just review that.” Noreenb (research member, no genomics experience) (quote 36) | ||
Choose from structured or non-structured delivery | “[…] pedagogical approach, […] could be sequential learning so that you’re, you’re building upon the knowledge that you want to give.” Brianb (chairperson, genomics experience) (quote 37) | ||
Active Learning and Engagement | Reflective Questions | “[…] pose a question, like, from what we’ve covered thus far in the course, what would might you be thinking would be potential, uh, areas of, of conflict or challenge, or what sort of questions would be coming up in your mind?” Isaacb (lay member, no genomics experience) (quote 38) | |
‘Check your knowledge’ activities | “[…]the idea of being able to use some kind of adaptive learning or some kind of quizzing, knowledge check, feedback, drag and drop, um, instant check, I think is still potentially viable to offer in a thing that’s for adults and professional adults.” Sherrib (genomics expert) (quote 39) | ||
Case study and examples | “I think examples and case studies sort of articulating why some types of practise are, what we should be looking for […] And sort of saying, well, this would be the ideal situation […] like giving them examples of what they could ask for from researchers.” Mindyb (research member & genomics expert) (quote 40) | ||
Additional features | Downloadable summaries | “[…]that written text that could be a single document that somebody can download and have as a reference. Um, yeah, I think particularly some people that are less sort of tech savvy or more inclined to use hard copies of things, but that would be useful for them to refer back to […]” Margob (research member, genomics experience) (quote 41) | |
Completion page/certificate | “[…] there’s nothing for me to say, hooray, I’ve done something.[…] for some people this would be a handy thing to have a certificate to get some credit points for.” Lanab (research member & genomics expert) (quote 42) | ||
Real-time learning opportunities | “a live webinar, just because […] you basically have to engage properly.” Arthurb (legal member, genomics experience) (quote 43) “potentially the opportunity to email members of your team for specific questions [about genomics ethics applications] or updates” Brianb (chairperson, genomics experience) (quote 44) | ||
