• Home
  • About Jean
    • Philosophy of Learning
    • Areas of Expertise
    • Skills
    • Work Experience
  • Publications
  • Designers Toolkit
    • Great Assignments Toolkit
  • Jean on Twitter
  • Blog
  • Upcoming Conference Presentations
  • Conference Presentations
    • Training and eLearning Presentations
    • Literacy Presentations
    • Ministry Training
  • Ask Jean
  • Work Samples
Applestar Productions

Learning about learning

Assessment: What Are You Measuring, Anyway?

3/28/2016

1 Comment

 
As an elearning manager, I have reviewed a lot of elearning during my career. Much of it dumps content out there followed by multiple choice questions. If training is learning new skills, then why aren't we testing the skills they are supposed to learn in our programs?  What is the difference between what we do and what marketers do in content marketing? As Harold Stolovich would say, "Tellin' ain't trainin' and trainin' ain't performance." 

After considerable noodling, I've come up with four reasons why we assess learning so poorly.

Hypothesis 1

We don't know what we are supposed to measure

Picture
It's easy to write multiple choice questions. They are quick to craft and program. But they usually only test remembering, which is at the bottom of Bloom's Taxonomy. 

If we spend our time crafting outcomes and objectives, then supposedly build our training around them, why aren't we measuring to those goals?

Maybe we don't know we should.

Hypothesis 2

It's hard to measure things in elearning

Yes, it requires a little more thinking to find creative ways to measure skills using an online function. But that doesn't mean you can't. If I am teaching a course to students learning to use a piece of software, shouldn't they be able to use it at the end? I can't tell you how many times I have seen multiple choice, text based questions asking about buttons at the end of these courses. There is no context, and no pictures. What is that helping?

Read More
1 Comment

imagine that!

12/30/2014

1 Comment

 
I love Chris Pappas. At least I love his work to support the world of elearning. His blog post yesterday in the eLearningIndustry blog Tips to Use Learners' Imagination in eLearning hit a nerve for me. I've been slogging through a project management course for PMP certification and am getting to see the torture that we put our learners through when we assemble uninspired elearning.

Don't get me wrong. The course is very professionally produced. There is video footage and synchronized slides expounding on the vocabulary of project management. The lectures don't repeat word-for-word what is on the slide, but rather support the intended message. They are chunked out into 5-8 minute segments. As far as lecture production goes, the course gets an A. However, after nearly two hours of this format, I have not done a thing to apply the project management vocabulary I've being "taught". I feel like I'm sitting in a lecture hall listening to a professor drone on and on, despite the professional actors' they have used to present the information. Have I learned anything? Not really, and that's not just because I've been doing project management for 20 years. I also don't think it's because I'm not taking copious notes on the talker and his slides. It's because the goal of this course appears to be to provide the mandatory 35 hours of prep time to sit for the PMP exam, which from everything else I've seen, is four hours of answering multiple choice questions about this kind of content. Some of the prep sites I've seen include math related analysis questions, so I live in hope that we shall leave the halls of the lectures and apply things soon. 

what should they be able to do?

This kind of course design flies in the face of good instructional design because there is no application of the learning. There's also no engagement with the learner. The production values are great, and I suspect cost a fair amount of money based on the price tag for the prep. But if in the end, I can't DO project management, and can only pass a test, what have I achieved?

I start every learning project by making my SME answer one question: At the end, what should the learner know and be able to do? If the subject matter expert cannot answer that in an single sentence, they do not know what they want. Whether it's curriculum, a module or a course, if we don't have the learner DOING at the end, why are they learning it? 

Imagine This

After reading Chris' article, I imagined many possibilities for this boring PM course. 
  • Imagine being immersed into a project and needing to figure out what the problems are. The learner could be cast in the role of the PM and need to manage the project. The tools for project management according to PMI could scaffold the process and the learner could reach out and research to find the answers. 
  • There could be scenarios, with alternate paths chosen with different results, allowing the learner to experience consequences of poor choices. 
  • The learner could bring their own project and apply the tools being learned to the process. The definition lectures could even remain, but this would apply the information and cement the learning.

The list goes on. I have to wonder. There must be explanations why the designers never thought about the learner when they built this.
  • Perhaps this is the challenge of building a MOOC to teach project management. There are no teachers involved, so the design needs to be self contained.
  • Perhaps project management people, who tend to be detail focused, like this kind of learning, and it is so difficult for me as a big-picture, creative thinker. Perhaps knowing the vocabulary words is really really important here.
  • Perhaps the designers focused more on the content and the process of getting it all in rather than starting with the learner needs. Ouch. Isn't that what we do sometimes?

There are 33 more hours left of this course. I'm not terribly hopeful that there will be wonders in store for me.
Picture

lesson learned

Remember the point of your elearning: At the end, what should the learner be able to know and do? There's a learner out there who will appreciate you for remembering.
1 Comment

tinkering with the Maker Movement

12/23/2014

0 Comments

 

active learners are better learners

The maker movement has been gaining a foothold in K12, which makes sense. Kids like to experiment and figure things out. If you're new to the Maker Movement, here's a great primer article from ASCD's Educational Leadership called Tinkering is Serious Play. Here's an excerpt from the article with an interesting set of definitions as to what it looks like from the framework of the Tinkering Studio at the Exploratorium, a museum in San Francisco. 

What learning in Tinkering looks like
During tinkering activities, learners show

Engagement
  • spend time in activities
  • display motivation or investment in activities
Initiative and Intentionality
  • set their own goals
  • seek and respond to feedback
  • persist to achieve goals
  • take intellectual risks or show intellectual courage


Social Scaffolding
  • request or offer help to solve problems
  • inspire or are inspired by new ideas or approaches
  • make physical connections to the work of others
Development of Understanding
  • express a realization through affect or utterance
  • offer explanation(s) for a strategy, tool, or outcome
  • apply knowledge
  • strive to understand

so what?

I am a huge proponent of active learning. I work hard to create activities that will help students grasp the concepts and apply them so there is transference. Problem-centered learning, group work and scenario-based learning are two ways to accomplish this in online learning, but that is largely about thinking. It applies the same skills. How can we leverage more of the maker movement in our online classes in higher ed and in our corporate training? 

I'd love your thoughts.
0 Comments

    Jean Marrapodi

    Teacher by training, learner by design.

    Archives

    January 2018
    July 2017
    November 2016
    October 2016
    July 2016
    May 2016
    April 2016
    March 2016
    February 2016
    July 2015
    May 2015
    March 2015
    February 2015
    January 2015
    December 2014

    Categories

    All
    Active Learning
    Assessment
    Bible
    Christmas
    Conferences
    Customer Service
    Design
    ELearning
    Learning
    Learning Theory
    Maker Movement
    Needs Assessment
    Performance Consulting
    Rebels
    Reflections
    SMEs
    Talent Development
    Talent Management
    Training
    Writing

    RSS Feed

Conference
​Resources

​Training/elearning
Literacy
Ministry.
Upcoming Events

Company
Info

About
Experience
Philosophy
Contact

Jean's
​Writing

Publications
Blog
Twitter Feed
© COPYRIGHT 2022. ALL RIGHTS RESERVED.