[lpi-discuss] Multiple answers
t_boxmy at yahoo.com
Tue Jun 17 07:37:46 EDT 2008
Can someone point me to the psychometrics for the LPI test items? This should be a good guide on the multiple answers query.
SCJP, LPIC-1, CTP (CIPD, UK)
(URL http://tboxmy.blogspot.com )
--- On Sat, 6/14/08, Tobias Crefeld <tc-lx at myway.de> wrote:
From: Tobias Crefeld <tc-lx at myway.de>
Subject: Re: [lpi-discuss] Multiple answers
To: lpi-discuss at lpi.org
Date: Saturday, June 14, 2008, 1:03 AM
Actually I didn't want to discuss the tests. I'm just interested in
knowing how to deal with answers im multiple answer questions which
aren't clear in my view. Thanks for clarification!
On Fri, 13 Jun 2008 15:43:04 +0200 Alan McKinnon
<alan.mckinnon at gmail.com> wrote:
> On Friday 13 June 2008, Grant Sewell wrote:
> > Cisco used to have the same scheme on their Academy courses. They
> > recently (3 years?) changed their system to accommodate the
> > flexibility. Essentially their system now recognises that if a
> > question has 3 marks then there should be an opportunity for the
> > examinee to get 0, 1, 2 or 3 marks for it.
> It also encourages guessing and thereby completely screws up the
> statistical analysis of the answers.
The support of guessing is a disadvantage of multiple choice tests in
general no matter how many answers you offer.
The only advantage is the reduced efforts for automated scoring.
> Multi-answers questions test the candidates ability and knowledge on
> a topic that has more than one element. The whole point of the
> question is to identify if the candidate does in fact know all the
I think it depends on the type of answer and it depends on how close
to practical problems the test should operate:
If you ask how to solve a problem it should be enough if you have one
correct solution. If you have more solutions this is nice but
without any practical benefit so you get just one point and none if one
or more wrong answers got marked.
On the other hand if you ask e.g. for some effects of a command every
correctly marked item should count as it proves a slightly increased
level of knowledge and every wrong answer marked should bring one minus
point down to a limit of zero points per question.
The third possibility might be a security question, e.g. you have to
list all points you have to care about if you setup a secure host.
As there is no half secure host only a complete list should get scored.
This is just my personal point of view. Don't care about it. ;)
lpi-discuss mailing list
lpi-discuss at lpi.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the lpi-discuss