HOW to report individual responses to each quiz question in a Storyline project

Hi --

I need to track in my LMS the responses that people provide to individual quiz questions (I'm up to speed on how to use a results slide to track the overall results as passed/failed, complete/incomplete).  For example:

Question 1:  True

Question 2: False

Question 3: D. All of the Above

Several moderators on the board point anyone who asks this type of question to this article:  http://www.articulate.com/support/storyline/quiz-data-sent-to-an-lms-in-articulate-storyline

My question is this:  The link above simply says WHAT is reported.  My question is HOW do I do this within Storyline?  Or, is it a matter of working with my LMS team to see where this data is stored within the LMS (and how to extract)?

Thanks in advance for your help.

Mike

32 Replies
Matthew Bibby

No idea, sorry Mike, I haven't used SumTotal before. Maybe check their knowledge base (if they have one) or ask their support.

Failing that, do a search of the forums here and see if there are any other articulate users who are familiar with SumTotal (it's pretty popular, so I'm sure there are some).

Ashley Terwilliger-Pollard

Hi Mike,

Storyline reports the data, but it's up to your LMS how it's reported back to you or displayed within the LMS reporting/tracking set up. To see "how" it's being reported or to give your LMS more information you could enable LMS debug mode so that you can see the information going back and forth, or you could also take a look at testing your content in SCORM Cloud which is an industry standard for testing SCORM content. 

Dominique D

Hi Ashley,

I have read a lot of threads here on the forum reporting individual response to quiz question to an LMS. There are tons of valuable information about the subject but I couldn't find a single complete example of a real SL quiz, the full set of parameter used to publish it and the report produced by one of the most used LMS. 

This kind of question is coming back for years and even spending hours in the forum it is very hard to have an idea of a couple of how some LMS behave in this regard.

Thank you for reading 

Dominique D
Mike Mazanec

Hi --

I need to track in my LMS the responses that people provide to individual quiz questions (I'm up to speed on how to use a results slide to track the overall results as passed/failed, complete/incomplete).  For example:

Question 1:  True

Question 2: False

Question 3: D. All of the Above

Several moderators on the board point anyone who asks this type of question to this article:  http://www.articulate.com/support/storyline/quiz-data-sent-to-an-lms-in-articulate-storyline

My question is this:  The link above simply says WHAT is reported.  My question is HOW do I do this within Storyline?  Or, is it a matter of working with my LMS team to see where this data is stored within the LMS (and how to extract)?

Thanks in advance for your help.

Mike

Hi Mike,

 

Did you succeed with your detailed answers report and what is the LMS you are using?

Thanks

Ashley Terwilliger-Pollard

Hi Dominique, 

What LMS are you using? Depending on the LMS and the settings and options you need there are a few different publishing options from Scorm 1.2, 2004, AICC or Tin Can - so it's really specific to the individual set up and your needs. I don't know that anyone's shared a full quiz, as often it's just examples of how to set something up or sections of a course they are having issues with. Our examples page may be the best place for your to look to see more fully fleshed out courses. 

Dominique D

Hi Ashley,

 Thanks for your answer. However, I am afraid it does not really help. I know all you are talking about and the standard answers about reading this and this section of your support. Your example pages do not have anything to do with my question.

The only thing I would like to see is something like a five question quiz, having it published to one of the standard and see a detailed report in a couple of the well known LMS. 

I do not understand that with the thousand of users you have it is just impossible to find a single example of a real life of report of a single LMS of your choice. The only answer that Articulate provides is a ten line article with the information sent by Storyline. Full stop. Then you say good bye and see the rest with your LMS provider.

Thank you

Matthew Bibby
Dominique Delcomminette

The only thing I would like to see is something like a five question quiz, having it published to one of the standard and see a detailed report in a couple of the well known LMS. 

I do not understand that with the thousand of users you have it is just impossible to find a single example of a real life of report of a single LMS of your choice. The only answer that Articulate provides is a ten line article with the information sent by Storyline. Full stop. Then you say good bye and see the rest with your LMS provider.

I've just published a sample quiz to Litmos.

It is a five question quiz that was published as SCORM 2004*.

This is how the results look in the LMS:

It took a few clicks to get to here, Reports > SCORM or Tin Can > Course Name > Learners Name, but it is an easy to understand report. If the learner has completed the course multiple times then you can view the data by changing the Attempts drop down in the top right. 

* I normally don't use SCORM 2004, however it is the only way that I could find to get the question data reported to the LMS. When using SCORM 1.2 it was hard at times to understand which question was being answered.

I also uploaded the same course to SCORM Cloud and after some digging around in the Reportage I found the responses:

As you can see the data isn't as readable.

I've included the .story file and the SCORM package below.

Maybe you could sign up for a free trial of any LMS that you are interested in, upload this test course and see how the report is presented?

It would be great to see more examples of this.

Dominique D

Thanks Matthew! That'S great.

By the way I had to re-create the zip because even SCORM Cloud told me there was no course in this package.

I will contribute by testing it against a couple of LMS I use. I already tried it with TalentLMS but unfortunately they support just SCORM 1.2 :-(.

I hope other people read this and contribute themselves too. This would be invaluable for everybody to know how each LMS behaves with this simple test and with with set oa parameters.

James Jordan

Hi Dominique,

We are on SumTotal 8.9.3 and we capture our Storyline quiz data and use it for reporting purposes, but we do it mostly on the back end.  There are certain tables in the database that keep this information.  You should be able to access them using Report Manager and the Assessment dataset.  If you use BIDS to do your reports it's easier to get to the data.  Accessing it via SQL Server Management Studio is even easier.  Below is an example of a query I use to retrieve the data.

SELECT [AssessmentQuestionID], emp.PrimaryJobName, emp.EmpNo, emp.EmpFName, emp.EmpLName, act.ActivityName, [QuestionID], QuestionIdentifier, ques.QuestionText, [QuestionResult], [UserResponse], [AttemptCount], [TimeSpent], [ElapsedSeconds], [AttemptStartDate], [AttemptEndDate]

FROM [S0PLRCDW].[dbo].[factAssessment] fact

INNER JOIN [S0PLRCDW].dbo.dimActivity act on fact.ActivityID=act.ID

INNER JOIN [S0PLRCDW].dbo.dimUser emp on fact.UserID=emp.ID

INNER JOIN [S0PLRCDW].dbo.dimQuestion ques on fact.QuestionID=ques.ID

WHERE (act.Code='nnnnnnnn')

ORDER BY AttemptStartDate,QuestionIdentifier

This gets me all the information I need for our business areas.  You just have to make sure that whatever quiz or survey you want captured shows up on the results slide.  We've done a pre-test and post survey in the same course along with the course content and built a custom results slide with them all on there and they all showed up in the data.  I've attached an example of the data we can pull.

Hope this helps.

Have a great day!

James

Leslie McKerchie

Hi Carlos!

This article describes the quiz data that Articulate Storyline communicates to learning management systems (LMSs) for SCORM and AICC content.

Hopefully some users will chime in if they have experience with that particular LMS and I wanted to share another forum thread with you, although dated, but has some conversation around this LMS.

 

Kristin Doll

Hi everyone!  I've read through a few different threads and while helpful, I have a different situation.  I am using an essay question and need to get the user's response out of the LMS (Cornerstone).  I can get responses to other types of questions, but not the actual words someone has entered in the essay question.  Does anyone have any suggestions or know how to do this? 

 

Thanks!

Crystal Horn

Hi Kristin!  First, make sure the essay question is tracked by a results slide that the learner visits.  SCORM 2004 does a really good job of sending question and answer text to the LMS.  I don't have experience with Cornerstone, but I know that I can get essay responses in SCORM Cloud using that publishing protocol.

Let me know if that works for you!

Kristin Doll

I saw this quiz data before and I'm pulling the "student response", which is where the other answers populate. I also tried on SCORM Cloud and I DO get results there. I would call this confirmation of my suspicion that Cornerstone is the issue and begin working on a workaround. I will also look through their enhancement suggestions to see if I can add or upvote something. Thank you for the response!

Astha Parmar

Hey folks, does anyone know how to do this in articulate online? I really need to get individual level reporting and can't figure out how to do this.

We're even asking for the person's name within the questions used for the tracking quiz. So really, being able to see data by submit would work.

Thanks!

Astha