School of Information and Library Science
University of North Carolina at Chapel Hill

INLS 782
Information Systems Effectiveness
Fall 2006

Course Assignments

Syllabus / Schedule / Roster / Discussion Forum (INLS782-001, 782)

Table of Contents

Measurement Memos, due September 14-28
 Draft Measurement Instrument, due October 5
 Research Design Proposal, due October 17
 Participation in Data Collection, due October 23
 Data Analysis, due November 30
 Management Report: Oral Presentation, December 12
 Management Report: Written Presentation, due December 13
 Class Participation

1. Measurement Memos (10% each)

We will be discussing each of the six categories of IS success described in DeLone & McLean, 1992 (system quality, information quality, system use/user performance, user attitudes/satisfaction/experience, individual impact, and organizational impact), plus usability. Choose two of the categories that might represent appropriate criteria for evaluating the system you are studying. Identify one measure discussed in the literature that could be used to evaluate the system, for each criterion in which you're interested. Select one article (or section of an article) for the class to read about your measure.

For each criterion you selected, write a one-page memo explaining why the measure used in your selected article would be applicable to your case study. Consider the applicability of the criterion to your case-study system and the practicality, reliability and validity of the measurement instrument. Provide the necessary details about how the measure will be applied. Also note any problems in applying the measure to your case study. Be prepared to present your arguments to the class at the appropriate sessions.

Many resources are available for identifying measurement instruments.

Each memo is due at the beginning of the class session in which it is discussed, as listed below.

2. Draft Measurement Instrument (15%)

Select one of the measurement instruments you considered in the previous assignment (or you may select a different instrument if you believe that the disadvantages discussed in class are too significant). Modify the instrument as necessary to make it applicable to your case study. Prepare a copy of the instrument that could be administered in a pilot study. Identify appropriate respondents from your case study (if applicable).

In a brief memo (no more than 2 pages) accompanying your modified instrument, describe the modifications you made, explain why you believe they are necessary, and describe the effects that you believe they will have on the reliability and validity of the instrument.

Due October 5 , in class.

3. Research Design Proposal (10%)

Write a brief memo (no more than two pages) describing the manner in which your evaluation study will be conducted. Specify the participants, when any assessments will be conducted, and how the assessments will be conducted. Justify your design. Provide a brief budget of the staff hours required to conduct the evaluation study (the number of hours for each IS and end-user staff member that will participate).

Due October 17, noon.

4. Participation in Data Collection Activities (required, but not graded)

Each class participant will be expected to assist other class members in generating realistic data for later analysis. The data will be associated with a proposed evaluation study based on one of the selected case studies. Participants may be asked to respond to questionnaires or interviews, to participate in thinking-aloud protocols while using a software package, or to participate in other data-gathering activities. Such participation will be distributed as evenly as possible over all class participants.

Due October 23, noon.

5. Data Analysis (15%)

Prepare and analyze the data associated with your evaluation study. If the data set gathered from other class members is not sufficient, I will work with you to plan and generate a realistic data set. The analysis may require the use of statistical analysis software or may involve qualitative methods, such as analytic induction or content analysis. Selection of an appropriate analysis method will be discussed in class.

You should turn in the raw data set and the results. The results of the analysis will vary, depending on the method selected. For example:

Due November 30, in class.

6. Management Report (Oral Presentation) (10%)

Prepare and present orally your interpretation of the findings of your evaluation study. Provide a brief overview of the rationale for the study and the design of the study. Present the results and the conclusions that you would draw from them. Address at least two questions: is the system being evaluated successful, in terms of the selected criterion?, and, if not completely successful, how might the system be modified to improve its performance?

The presentation should not be longer than 10 minutes.

Your report will be presented during a special class meeting on December 12, beginning at 6pm.

7. Management Report (Written Presentation) (15%)

Prepare and present a written summary of your evaluation study. It should contain the same content as your oral presentation. It should be in the form of a memo to the manager of the IS department, with a copy being sent to the manager of the involved end-user department(s). The report should not exceed 3 single-spaced pages.

Due December 13, noon.

8. Class Participation (15%)

Throughout the semester, students are encouraged and expected to participate fully in class discussions and activities. Readings should be completed prior to the class sessions so that you can ask questions and benefit from the class discussion.

Syllabus / Schedule / Roster / Discussion Forum (INLS782-001, 782)

This page was last modified on August 15, 2006, by Barbara M. Wildemuth.
Address all comments and questions to Barbara M. Wildemuth at wildem at ils.unc.edu.

© Barbara M. Wildemuth, 2006. All rights reserved.