Thanks for attending our session at DevLearn!

We had a great turnout and a lot of fun. 

Remember that you can try out our tools and see results of the carousel survey at the session's website: http://sites.google.com/site/ispigoog/devlearn-home

What's the next generation of e-learning?

According to Marc Rosenberg, a presenter at the April, 2009 ISPI conference, the future of e-learning is a knowledge management system that combines online learning materials, communities of practice, direct access to experts, information repositories, and performance support.

Key points I took away from his presentation:

• work and learning are integrated; materials must be accessible at all times, in all locations
  
• mobility: people must learn wherever they are (ipods at the gym or on the subway, for example)
  
• we must think beyond just training to learning; most learning is informal (through colleagues, trial and error, Google searches)
  
• our role as performance consultants and instructional designers must shift from education and training to providing an infrastructure to enable information sharing
• the information must be accessible at the time of need
• the information should be generated by the learners
• "Don't kill the classroom!" There is a place for the classroom--some skills are most effectively taught in real life.
• Components of an effective Knowledge Management system:
• online training
• information repositories, which require structure, accurate content, and ease of use (examples of effective ones: WebMD , World Bank , Vehix.com)
• communities of practice, which are groups of employees with similar roles who are connected horizontally across the company (instead of just vertical groups) that share ideas and best practices
• access to experts and expertise, and a way of "matching the right expert to the right need at the right time"
• the best knowledge management system in the world is a library. You can walk into nearly any library in the world and find a specific book because they have common organizational structures. The implication is that information within a company should be easy to access, too, so disparate organizations within a company should agree on standard ways of presenting the information.
• performance support that helps employees accomplish a task at the moment of need is important, too
• Learning is a by-product of performance; learning alone should not be the focus of training initiatives

I look forward to continuing to advocate for these principles; we are spending a lot of effort conducting frustrating knowledge tests right now.

Summary of research about e-learning

The US Department of Education recently analyzed a series of research on the use of online learning. It was geared specifically for K12 education but contains interesting implications for adult use of e-learning as well.

The questions they set out to answer:

1. How does the effectiveness of online learning compare with that of face-to-face instruction?

2. Does supplementing face-to-face instruction with online instruction enhance learning?

3. What practices are associated with more effective online learning?

4. What conditions influence the effectiveness of online learning?

Some of the key findings:

• Students who took all or part of their class online performed better, on average, than those taking the same course through traditional face-to-face instruction.
• Instruction combining online and face-to-face elements had a larger advantage relative to purely face-to-face instruction than did purely online instruction.
• Studies in which learners in the online condition spent more time on task than students in the face-to-face condition found a greater benefit for online learning.
• Most of the variations in the way in which different studies implemented online learning did not affect student learning outcomes significantly.
• Of those variables, (a) the use of a blended rather than a purely online approach and (b) the expansion of time on task for online learners were the only statistically significant influences on effectiveness.
• Blended and purely online learning conditions implemented within a single study generally result in similar student learning outcomes.
• Elements such as video or online quizzes do not appear to influence the amount that students learn in online classes.
• Online learning can be enhanced by giving learners control of their interactions with media and prompting learner reflection.
• Providing guidance for learning for groups of students appears less successful than does using such mechanisms with individual learners.

"Despite what appears to be strong support for online learning applications, the studies in this meta-analysis do not demonstrate that online learning is superior as a medium. In many of the studies showing an advantage for online learning, the online and classroom conditions differed in terms of time spent, curriculum and pedagogy. It was the combination of elements in the treatment conditions (which was likely to have included additional learning time and materials as well as additional opportunities for collaboration) that produced the observed learning advantages. At the same time, one should note that online learning is much more conducive to the expansion of learning time than is face-to-face instruction."

You can read the report here: http://www.ed.gov/rschstat/eval/tech/evidence-based-practices/finalreport.pdf

(Originally found at http://www.brandon-hall.com/workplacelearningtoday/?p=5900)

What to do when you don't agree with your stakeholder's requests

When I attended the ISPI Principles and Practices of Performance Improvement three-day workshop last year, I remember a story that Miki Lane told. He was a young performance consultant when a company called him up and asked him to lead a team-building training. He said, "Yes, I am happy to help." He conducted a brief analysis and discovered that, in his opinion, this team did not need a team-building training. He recommended several alternative performance interventions. His client did not want to hear his ideas and did not hire Miki as a consultant. A few weeks later, he saw a news clip about ABC company taking their team on a team-building trip in the woods. 

This story has remained with me for over a year and seems particularly relevant in my current situation. It illustrates an example of when a stakeholder calls you up, knows exactly what solution they want, and doesn't want to listen to any alternative solutions. 

In my current situation, a key stakeholder has decided that he wants to implement a certification program that includes a difficult SAT-like examination. I am firmly opposed to any multiple-choice tests in the workplace (a topic for another day)! I do not believe they accurately measure performance. Since the vast majority of performance problems result from environmental problems (like a lack of clear expectations and feedback, inadequate tools and compensation models), why does it make sense to test people? 

The test will be used not only to assess individual's skill gaps but also to identify gaps in training offerings. It seems to me that if we have to create this test, we should create learning solutions from which people can study first. I am concerned about the self-esteem (or worse, employment) issues that may result from people "failing" the test. I am worried that it will be a waste of time because we do not have a clear plan of what we'll do with the data or how to communicate scores and gaps to the learners. 

And yet, the stakeholder says we must do it, so we will.

Presenting at DevLearn in November!

We will reprise our "Web2.0 and Performance: What's Working for Google Employees" presentation at the Elearning Guild's annual conference this year. 

We hope you will join us in November in San Jose at the DevLearn 09 conference!

A moment of empathetic instructor panic

Last night I went to guitar class as usual. I'm recovering from a cold, so I didn't have a ton of energy, but I had requested the song that we would learn this week, and it was the last class of the quarter, so I went anyway. I am so glad I did, because I witnessed how my instructor handled an unexpected situation with grace and managed to turn a near-calamity into a successful teachable moment!

The typical class session in this series starts off with a review of the previous week's music. (We, the twenty students, all practice like aspiring guitar rockstars (folkstars?) all week, of course, unless life happens to get in the way.) We then learn a new song by first listening to a recorded version of it, receiving a handout of the transcription in tablature, then having the instructor demonstrate the tricky parts, measure by measure. We then get a chance to practice together so she can assess our progress and rectify any mistakes we're making.

Last night was anything but typical.

For the first third of the class, we reviewed last week's music, as usual. It took slightly longer than normal since it was arranged as a duet, and some people wanted the chance to play both parts, so we played through it a total of four times. The instructor then put in the CD of this week's song that we were about to learn, and as we listened, she realized she did not have the printouts of the arrangement. "I must have left them at Kinko's down the street!" she exclaimed. While we continued listening to the recording, she dashed to the copy machine in the building where class occurs. Seconds later, she returned and announced that the copier was broken. Of course!

My stomach lurched. I pictured myself as the instructor and wondered what I would do in that situation. Panic! 

Here's how she gracefully handled it:

• Sent someone to Kinko's to search for her original copies and/or to make new ones
• Talked about how she arranges songs by ear
• Played the song for us again, called out chords, and invited us to play along with any strum or finger-picking pattern we wanted [I loved this part because it got me to think about just the chords, not the fancy finger-picking pattern that I usually focus on; it sounded great because everyone played along with a multitude of strums but since they were all on the same chords, it sounded harmonious; there's nothing quite like the sound of twenty guitars playing well together; I knew that even if I didn't nail every single fill when practicing or performing the song, I could still play the chords and sing along and it would sound great!]

Just as she started to teach us the fancy fills by demo-practice (less-than-ideal without having the music to look at), the copies arrived! For the remaining ten minutes, we walked through the music as we usually did. 

I left the class feeling inspired not only to practice the song but also to think about how to handle unexpected situations during training sessions.

Anyone have an example of a time your training or class didn't go as planned? Please share in the comments!

Top 10 Tools for Learning Professionals

Jane Hart at the Centre for Learning and Performance technologies has asked learning professionals to contribute their lists of top tools we use to enhance learning and performance. 

• Blogger : experts can easily contribute tips, thoughts, and best practices to a large community of learners. They can also be used to create a community of learners following learning events.
• Google documents:  multiple collaborators can contribute to online documents and spreadsheets. They can be used to brainstorm ideas, edit project plans, share ideas, and generate repositories of information for use before, during, after, and instead of a learning event.
• Google Moderator: this online tool enables a community to submit questions, ideas, and suggestions about a given topic. Members of the community can then vote on the ones they like best. President Obama has even used this tool a few times to gather citizens' sentiments.
• YouTube:  we have been using flip cams and SnagIt to have experts share tips, tricks, and best practices on a variety of topics. Members of the community can view these easily and rate the ones that they like best or find most effective. The YouTube Symphony is a recent example of gathering top performances from around the world!
• Twitter: I love hearing from learning and performance experts share quick tips, links, and information about what they're working on and how they're using new technologies. Our team has also used it for internal communication across geographies and for creating communities of learners following learning events.
• WebEx:  Since travel budgets have been slashed, virtual classrooms are being used more and more. I love the features of WebEx Training Center, which include enabling participants to write on (or annotate) the screen (great for brainstorming!) and break out into virtual sessions with each other (connected to each other via phone and a shared computer screen).
• SnagIt: I love this screen capture and screencast tool. For static captures, the annotation features are excellent (especially the spotlight and magnify features) for creating job aids for tool walk-throughs. For dynamic screencasts, SnagIt beat out Camtasia in a head-to-head competition for ease of use and quality of output (even though it has limited editing capabilities). Easy enough for a Subject Matter Expert to use! 
• Captivate:  Adobe Captivate is a great tool for creating interactive scenarios. It quickly records what is happening on your screen, including audio narration, and adds captions. You can also add interactive elements like rollovers and clickboxes easily!
• InDesign: I am a big fan of job aids. I think job aids can replace training and learning events 90% of the time; if not, they can certainly supplement what is being taught. Adobe InDesign enables the production of high quality, sharp PDFs.
• Wikis: I don't have a favorite wiki provider, but wikis are amazing tools for online editing and collaboration. Wikipedia is a great example, but I also have used Google Sites and PBWiki successfully.