The digital university building a learning community

Computer Supported Cooperative Work

Springer-Verlag London Ltd.


Also in this series
Peter Lloyd and Roger Whitehead (Eds)
Transforming Organisations Through Groupware: Lotus Notes in Action
3-540-19961-6
Gerold Riempp
Wide Area Workflow Management: Creating Partnerships for the 21st Century
3-540-76243-4
Reza Hazemi, Stephen Hailes and Steve Wilbur (Eds)
The Digital University: Reinventing the Academy
1-85233-003-1
Celia T. Romm and Fay Sudweeks (Eds)
Doing Business Electronically: A Global Perspective of Electronic Commerce
3-540-76159-4
Fay Sudweeks and Celia T. Romm (Eds)
Doing Business on the Internet: Opportunities and Pitfalls
1-85233-030-9
Alan J. Munro, Kristina Hook and David Benyon (Eds)
Social Navigation of Information Space
1-85233-090-2
Mary Lou Maher, Simeon J. Simoff and Anna Cicognani
Understanding Virtual Design Studios
1-85233-154-2
Elayne Coakes, Dianne Willis and Raymond Lloyd-Jones (Eds)
The New SocioTech: Graffiti on the Long Wall
1-85233-040-6
Elizabeth F. Churchill, David N. Snowdon and Alan J. Munro (Eds)

Collaborative Virtual Environments: Digital Places and Spaces for Interaction
1-85233-244-1
Christine Steeples and Chris Jones (Eds)
Networked Learning: Perspectives and Issues
1-85233-47l-1
Barry Brown, Nicola Green and Richard Harper (Eds)
Wireless Wor1d: Social and Interactional Aspects of the Mobile Age
1-85233-477 -O
Ralph Schroeder (Ed.)
The Social Life of Avatars: Presence and Interaction in Shared Virtual Environments
1-85233-461-4
Elayne Coakes, Dianne Willis and Steve Clarke (Eds)
Knowledge Management in the SocioTechnical Wor1d: The Graffiti Continues
1-85233-441-X


Reza Hazemi and Stephen Hailes (Eds)

The Digital University
- Building a Learning
Community
With 29 Figures

'springer


Reza Hazemi, BEng, MSc, PhD

Stephen Hailes, MA, PhD
Department of Computer Science, University College London,

Gower Street, London, WCIE 6BT

Series Editors
Dan Diaper, PhD, MBCS
Head, Department of Computing, School of Design, Engineering and Computing,
Bournemouth University, Talbot Campus, Fern Barrow, Poole, Dorset BRI2 5BB, UK
Coiston Sanger
Shottersley Research Limited, Little Shottersley, Farnham Lane
Haslemere, Surrey GU27 IRA, UK
British Library Cataloguing in Publication Data
Hazemi, Reza, 1966The digital university : building a learning community. (Computer supported cooperative work)
1. Computer-assisted instruction 2. Universities and colleges
- Data processing 3. Education, higher - Data processing
4. Education, higher - Computer network resources
5. Universities and colleges - Computer network resources
J. Tide II. Hailes, Stephen, 1965378'.00285
ISBN 978-1-4471-0167-3 (eBook)
ISBN 978-1-85233-478-9
DOI 10.1007/978-1-4471-0167-3
Ubrary of Congress Cataloging-in-Publication Data
A catalog record for this book is available from the Library of Congress
Apart from any fair dealing for the purposes of research or private study, or criticism or review, as permitted under the Copyright, Designs and Patents Act 1988, this publication may only be reproduced,
stored or transmitted, in any form or by any means, with the prior permission in writing of the publishers, or in the case of reprographic reproduction in accordance with the terms of licences issued by
the Copyright Licensing Agency. Enquiries concerning reproduction outside those terms should be sent
to the publishers.



© Springer-Verlag London 2002
Originally published by Springer-Verlag London Berlin Heidelberg in 2002

The use of registered names, trademarks etc. in this publicat ion does not imply, even in the absence of
a specific statement, that such names are exempt from the relevant laws and regulations and therefore
free for general use.
The publisher makes no representation, express or implied, with regard to the accuracy of the information contained in this book and cannot accept any legal responsibility or liability for any errors or
omissions that may be made.
Typesetting: Camera ready by editors
34/3830-543210 Printed on acid-free paper SPIN 10834354


Contents

THE CONTRIBUTORS ............... ".................................................................. xiii
FOREWORD ................................. "................................................................. xvii
1.

INTRODUCTION ................. "........................................................................ 1
1.1
1.2
1.3

2.

THE NEED ............ ............................................... ...................................... 1
THE SOLUTION .......................................................................................... 2
THE STRUCTURE OF THE BOOK ................................................................. 3

UNIVERSITIES, DEARING, AND THE FUTURE ................................... 7
2.1

COLLABORATIVE TASKS ................................................. ........ .................. 8

2.1.1
2.1.2
2.1.3
2.1.4
2.1.5

Teaching ............................................................................................ 8
Research .......................................................................................... 11
Support ............................................................................................ 12
Administration ................................................................................. 13
Comment ......................................................................................... 14
2.3
THE FUTURE OF HIGHER EDUCATION: THE DEARING REpORT ................ 16
2.4.1 Teaching .......................................................................................... 16
2.4.2 Administration ................................................................................. 18
2.4.3 The Changing Face of Higher Education ........................................ 19
2.4.4 Comment ......................................................................................... 22
2.5
CONCLUSION ........................................................................................... 24
REFERENCES ....................................................................................................... 25
3.

MANAGING DISTANCE LEARNING: NEW CHALLENGES FOR
FACULTY .................................................................................................... 27
3.1
3.2
3.3
3.4
3.5

3.6
3.7
3.8
3.9
3.10
3.11

INTRODUCTION ........................................................................................ 27
A NEW MANAGEMENT MIND SET .............. .............................................. 28
A NEW STYLE OF MANAGEMENT ......... ............... .................................... 29
MANAGING METAPHOR ..................... ..... ................................................. 30
MANAGING MEANING .................. ........................................................... 31
MANAGING CULTURE ........... ................................................................... 33
MANAGING ROLES .......... ........................................................................ 33
MANAGING TIME ..................................................................................... 35
MANAGING AWARENESS ......................................................................... 36
MANAGING COLLABORATION ............................... .................................. 36
MANAGING FACULTY DEVELOPMENT ..................................................... 37


The Digital University - Building a Learning Community

vi

3.12 NEW CENTERS OF LEARNING .................................................................. 38
REFERENCES ....................................................................................................... 38
4.

COLLABORATIVE INTERACTIONS IN SUPPORT OF LEARNING:
MODELS, METAPHORS AND MANAGEMENT ................................. .41

4.1
4.2

INTRODUCTION ........................................................................................ 41
A MODEL OF THE INTERACTION SPACE ................................................... 42
4.2.1 Teaching Theaters become Stages for Collaboration ...................... 42
4.2.2 Collaborative Spaces ....................................................................... 44
METAPHORS AND THE HYPERCOURSEWARE PROTOTYPE. ...................... .47
4.3
4.3.1 HyperCourseware Prototype ........................................................... 48
4.3.2 Interface Design for Collaboration .................................................. 50
4.4
POLICIES FOR MANAGING LEARNING ACTIVITIES ................................... 52
4.5
CONCLUSION ........................................................................................... 55
REFERENCES ....................................................................................................... 55

5.

MANAGING TERTIARY EDUCATION IN A GLOBAL VIRTUAL
ENVIRONMENT: NETWORKED EDUCATIONAL
MANAGEMENT ......................................................................................... 57

5.1
5.2
5.3
5.4
5.5

INTRODUCTION ........................................................................................ 58
CONVENTIONAL EDUCATIONAL MANAGEMENT ...................................... 59
NEW FORMS OF EDUCATIONAL MANAGEMENT ....................................... 60
NEW FORMS OF PRIVATE ENTERPRISE MANAGEMENT ............................ 61
NETWORKED EDUCATIONAL MANAGEMENT ........................................... 62
5.5.1 Networking ...................................................................................... 63
5.5.2 Globalization ................................................................................... 64
5.5.3 Flexibility ........................................................................................ 64
5.5.4 Boundary Orientation ...................................................................... 65
5.6
CONCLUSION ........................................................................... ................ 66
REFERENCES ....................................................................................................... 67

6.

ECLASS ........................................................................................................ 71

6.1

INTRODUCTION .............................................................. .......................... 71
6.1.1 An Overview of eC1ass ................................................................... 72
6.1.2 Motivation ......................................................... .............................. 74
6.2
DEFINITION OF TERMS, ROLES, AND ACTIVITIES .................................... 76
6.2.1 Roles ................................................................................................ 76
6.2.2 Situation ................................................ .......................................... 76
6.2.3 Tools .............................................. .................................................. 77
6.2.4 Tasks and Activities ........................................................................ 77
6.2.5 What eC1ass Supports, and the Assumptions eC1ass Makes ........... 78
6.3

ECLASS IN DETAIL. .................................................................................. 79
6.3.1 The eC1ass Model of the Classroom ................................................ 79
6.3.2 The Tools ofeC1ass ......................................................................... 81
6.4
EVALUATION RESULTS ............................................................................ 88
6.4.1 Students Find eC1ass Worthwhile ................................................... 89
6.4.2 Students Take Less Notes ............................................................... 89


vii

Contents

eClass Does Not Encourage Skipping ............................................. 90
Augmentation of Pen and Paper Notes is Worth the Effort ............. 90
6.5
WHAT CAN BE IMPROVED ....................................................................... 90
6.6
CONCLUSION ........................................................................................... 92
REFERENCES ....................................................................................................... 93
6.4.3
6.4.4

7.

LEARNING GAINS IN A MULTI-USER DISCUSSION SYSTEM
USED WITH SOCIAL SCIENCE STUDENTS - THE COMENTOR
EXPERIENCE ............................................................................................. 95
7.1
7.2

INTRODUCTION ........................................................................................ 95

96
96
97
99
COMENTOR ........................................................................................... 99
7.3
7.3.1 Introduction to coMentor .............................................................. 99
7.3.2 coMentor Design Philosophy ........................................................ 101
7.3.3 Evaluation ..................................................................................... 103
7.3.4 Results ........................................................................................... 104
7.4
EXTENDING THE SPATIAL METAPHOR OF ROOMS ................................. 106
VLE INTEROPERABILITY ....................................................................... 108
7.5
REFERENCES ..................................................................................................... 110

8.

MUDs AND MOOs ...............................................................................
7.2.1 Defmition ......................................................................................
7.2.2 Educational MUDs and MOOs .....................................................
7.2.3 Pedagogy in MUDs and MOOs .....................................................

THE APPLICATION OF BUSINESS GROUPWARE
TECHNOLOGIES TO SUPPORT COLLABORATIVE LEARNING
WITH FACE-TO-FACE STUDENTS ..................................................... 113
8.1

8.2
8.3
8.4
8.5
8.6
8.7
8.8
8.9
8.10
8.11
8.12
8.13
8.14
8.15
8.16

EDUCATIONAL CONTEXT ... .................................................................... 114
COMPUTER SUPPORTED COLLABORATIVE LEARNING ........................... 114
OTHER RELEVANT MBA EXPERIENCES ................................................ 115
SPECIFIC CONTEXT .......... ...................................................................... 115
SPECIFIC PEDAGOGIC OBJECTIVES ........................................................ 116
DESIGN CONSIDERATIONS ..................................................................... 117
THE EXERCISE ....................................................................................... 117
POST-EXERCISE PHASE ......................................................................... 118
PRACTICAL PROBLEMS .......................................................................... 119
BENEFITS ............................................................................................... 119
GENERIC TEAM SKILLS .......................................................................... 120
ROLES OF ASYNCHRONOUS PARTICIPANTS ........................................... 120
GROUPWARE ISSUES: WEB AND NOTES FACILITIES .............................. 121

WERE THE EDUCATIONAL OBJECTIVES ACHIEVED? .............................. 121
THE FUTURE .......................................................................................... 122
CONCLUSIONS ....................................................................................... 123
REFERENCES ..................................................................................................... 123

9.

A REVIEW OF THE USE OF ASYNCHRONOUS E- SEMINARS IN
UNDERGRADUATE EDUCATION ....................................................... 125
9.1

INTRODUCTION ...................................................................................... 125


viii

The Digital University - Building a Learning Community

BENEFITS OF E-SEMINARS .................................... ..... ..... ....................... 126
9.2.1 Enhanced Student Interaction ........................................................ 126
9.2.2 Critical Reflection ......................................................................... 127
9.2.3 Enhanced Team and Communication Skills .................................. 128
9.204 Access to New Ideas, Perspectives and Cultures .......................... 129
9.3
ISSUES THAT REQUIRE FURTHER RESEARCH ......................................... 129
9.3.1 Student Motivation to Participate in E-Seminars .......................... 129
9.3.2 Assessment ofE-Seminar Discussions .......................................... 130
9.3.3 The Role of Student Individual Differences .................................. 131
9A
BEST PRACTICE GUIDELINES ................................................................. 134

904.1 Group Size and Composition ........................................................ 134
904.2 Moderation and Lecturer Presence ................................................ 134
904.3 Requirements for Participation and Assessment ........................... 135
90404 Technical Issues ............................................................................ 135
904.5 Group Atmosphere ........................................................................ 135
CONCLUSION ......................................................................................... 136
9.5
REFERENCES ..................................................................................................... 136
9.2

10. SUPPORT FOR AUTHORING AND MANAGING WEB-BASED
COURSEWORK: THE TACO PROJECT ............................................. 139
10.1
10.2

INTRODUCTION .......... ........ .......... ........ ..... ............. ..... ..... ........ .............. 140
BACKGROUND ....................................................................................... 142
10.2.1 Requirements for a Web-Based Coursework System ...... .............. 143
10.3 THE TACO SySTEM ................................................................ .............. 146
1O.3.l The TACO Authoring Interface ...................................... .............. 149
10.3.2 The TACO Student Interface ........................................................ 150
lOA RESULTS FROM THE PILOT STUDy ......................................................... 152
1004.1 Evaluation by Lecturers ................................................................ 152
1004.2 Evaluation by Students .................................................................. 153
1004.3 Observation on Student Behavior.. ................................................ 154
10.5 EVALUATION OF TACO IN CONTINUING USE ....................................... 154
10.6 IMPROVEMENTS IDENTIFIED DURING THE TRIALS ................................ . 156
10.6.1 User Interface ................................................................................ 156
10.6.2 The Process of Authoring Coursework ......................................... 156
10.6.3 Coping with Distributed System Environments in HEIs ............... 157

10.604 Participatory Design in the Development of Educational
Technology ................................................................................... 158
10.7 CONCLUSIONS ......................................................... .............................. 159
REFERENCES ..................................................................................................... 161
ApPENDIX A: LIST OF REQUIREMENTS FOR A WEB-BASED SySTEM ................. 163
1
Question Types .............................................................................. 163
2
Confidence Assessment. ................................................................ 164
3
Marking Schemes .......................................................................... 164
4
Feedback to Student ...................................................................... 164
5
Assignment Types ......................................................................... 164
6
Authoring Assignments ................................................................. 165


Contents

ix

7
8

Reports and Feedback to Lecturers ............................................... 165
Security ......................................................................................... 166

11. USING LOTUS NOTES FOR ASYNCHRONOUS COLLABORATIVE

LEARNING AND RESEARCH ............................................................... 167
11.1
11.2

ASYNCHRONOUS COLLABORATION ....................................................... 167
ACADEMIC COURSES ............................................................................. 168

Case 1: Professional Development for Practicing Management
Developers .................................................................................... 168
Case 2: A Modular Programme for the Development of Leaming
Technology Professionals ........................................................... 169
Case 3: Second Year Law Undergraduates ............................................... 169
11.3 RESEARCH AND PROFESSIONAL NETWORK SUPPORT ............................ 170
Case 4: Student Accounts of Residence Abroad ...................... ..... ............ 170
Case 5: PASOLD Database ....................................................................... 171
Case 6: Public Health Research & Development Network ....................... 171
Case 7: User Configurable Webs .............................................................. 171
11.4 ASYNCHRONOUS INFORMATION SHARING ............................................. 172
Case 8: Teaching Developments Database ................................................ 172
Case 9: Scholarly Activities ...................................................................... 172
Case 10: Lancaster University (LU) News ................................................ I72
11.5 SUPPORT ISSUES .............. ...................................................................... 173
11.5.1 Administration ......... ...................................................................... 173
11.6 PROBLEMS ENCOUNTERED IN SUPPORTING DISTANCE LEARNER USE OF
NOTES ............................. ...................................................................... 175
11.6.1 Replication .................................................................................... 176
11.6.2 The Groupware Mindset... ............................................................. 176
11.6.3 Hardware ....................................................................................... 177
11.6.4 Development versus Stability ........................................................ 177
11.7 ADVANTAGES OF USING NOTES TO SUPPORT LEARNERS ...................... 178

REFERENCES ..................................................................................................... 178

12. QUALITY OF USE OF MULTIMEDIA LEARNING SYSTEMS:
PRACTICAL CONSIDERATIONS ......................................................... 181
12.1
12.2
12.3

INTRODUCTION ...................................................................... ................ 181
LEARNING EFFECTIVENESS VERSUS QUALITY OF USE ........................... 182
ENGINEERING QUALITY OF USE FOLLOWING ISO 13 407 ..................... 183

12.3.1
12.3.2
12.3.3
12.3.4
12.3.5

Plan the Human Centered Process ................................................. 184
Specify the Context of Use ............................................................ 184
Specify the User and Organizational Requirements ...................... 186
Produce Design Solutions ............................................................. 187
Evaluate Designs Against User Requirements ..... ......................... 188
12.4 A CASE STUDY IN QUALITY OF USE ...................................................... 189
12.5 A GUIDE TO AVAILABLE TOOLS AND METHODS ................................... 191
REFERENCES ..................................................................................................... 192


The Digital University - Building a Learning Community

x

13. DESIGN FOR MOTIVATION ................................................................. 193
13.1 ARE OBJECTIVES CLEAR AND MEANINGFUL? ....................................... 193
13.2 Is ASSESSMENT RELEVANT? ................................................................. 195
13.3 ARE LEARNING ACTIVITIES STUDENT-CENTERED? ............................... 196
13.4 Do WE FORM A LEARNING COMMUNITY? ............................................ 196
13.5 Do ONLINE AND REAL-LIFE ACTIVITIES INTERPLAY? .......................... 198
13.6 Is STUDENTS' MOTIVATION DIRECTLY ADDRESSED? ........................... 199
13.7 ARE TEACHERS MOTIVATED? ............................................................... 199
13.8 ARE LEARNING TECHNOLOGIES WISELY USED? ................................... 200
13.9 ARE CHALLENGES BIG ENOUGH AND WORTHWHILE? .......................... 201
REFERENCES ....................................................................................... ........ ...... 202
14. EDUCATIONAL METADATA: FRIENDLY FIRE? ............................ 203
14.1

INTRODUCTION ...................................................................................... 203
14.1.1 Metadata .......... .............................................................................. 203
14.1.2 Education and Metadata ................................................................ 204
14.1.3 The MALTED Project. .................................................................. 204
14.2 THE MALTED SySTEM ........................................................................ 205
14.2.1 System Architecture of MALTED ................................................ 205
14.3 HANDLING METADATA IN MALTED ...................................................... 206
14.3.1 Searching via Metadata ................................................................. 207
14.3.2 Tagging Material with Metadata ................................................... 207
14.3.3 MALTED Metadata Interface ....................................................... 209
14.4 DISCUSSION ........................................................................................... 210
14.4.1 Material Usage and Metadata ........................................................ 210
14.5 CONCLUSION ......................................................................................... 212
14.5.1 Technical Implementation ............................................................. 212

14.5.2 Metadata Schema .......................................................................... 212
14.5.3 Future Work .................................................................................. 213
REFERENCES ..................................................................................................... 213
15. LEARNING ACTIVITIES IN A VIRTUAL CAMPUS ......................... 215
15.1
15.2

CONTEXT OF THE WORK ........................................................................ 215
PLATFORM SERVICES ............................................................................ 216
15.2.1 The Virtual Desktop ...................................................................... 216
15.2.2 The Enrolment Service .................................................................. 217
15.2.3 The Workgroup Service ................................................................ 218
15.2.4 The Work Organization Service .................................................... 219
15.2.5 The Delivery Service ..................................................................... 220
15.3 DELIVERY SERVICE ............................................................................... 220
15.3.1 Describing the Learning Resource ................................................ 220
15.3.2 LOM as the Basis of Notice Design .............................................. 221
15.4 SUPPORTING THE LEARNING ACTIVITIES ............................................... 224
15.5 CONCLUSION ......................................................................................... 225
REFERENCES ..................................................................................................... 226


Contents

Xl

16. THE RELEVANCE AND IMPACT OF COLLABORATIVE
WORKING FOR MANAGEMENT IN A DIGITAL UNIVERSITY ... 229

16.1

16.2

MANAGEMENT ISSUES ..................................................... ...................... 230
A VIEW ON THE DEVELOPMENT OF MANAGEMENT THINKING .............. 231
16.2.l The Balance of Power Between Competition and Cooperation .... 231
16.3 DEMANDS ON UNIVERSITIES ................................................................. 232
16.3.1 The Problems of Managing HE in the Late 20th Century .............. 232
16.3.2 Asynchronous Working Requires a Culture Shift in Management
Thinking ....................................................................................... 233
16.4 THE WAY IN WHICH COLLABORATIVE WORKING MIGHT IMPACT A
UNIVERSITY .......................................................................................... 234
16.4.1 Features ofa "Collaborative University" ...................................... 234
16.5 CHARACTERISTICS OF A DIGITAL UNIVERSITY ...................................... 235
16.5.1 Information must be Accurate, Appropriate and Available ........... 236
16.5.2 Contribution of the Intemet... ........................................................ 237
16.5.3 Example of a Process Based on Collaborative Working: No.1
Staff Recruitment.. ........................................................................ 237
16.5.4 Example of a Process Based on Collaborative Working: No.2
Course Development .................................................................... 238
16.5.5 Example of a Process Based on Collaborative Working: No.3
Research Management. ................................................................. 239
16.6 THE PROCESS FOR DEVELOPING COLLABORATIVE WORKING USING
ELECTRONIC INFORMATION SySTEMS ................................................... 240
16.6.1 How to Build Information Structures for Collaborative
Institutions .................................................................................... 240
16.6.2 Technical Infrastructure for Collaborative Management .............. 241
16.7 WHERE PREVIOUS MANAGEMENT THEORIES MIGHT BE ABSORBED
WITHIN THE BROADER CONCEPT OF COLLABORATIVE WORKING ......... 243
16.7.1 Relationship with Representative Management Philosophies ....... 244
16.8 CONCLUSIONS ....................................................................................... 246

ACRONYMS ...................................................................................................... 247
INDEX ................................................................................................................. 249


The Contributors

Gregory D. Abowd
Associate Professor, College of Computing & GVU Center, Georgia Institute of
Technology, Atlanta, GA, 30332-0280, USA.


Susan Armitage
Learning Technology Development Officer, Higher Education Development
Centre, Information Systems Services, Lancaster University, Lanes., LAl 4YW,
UK.


Jason A. Brotherton
College of Computing & GVU Center, Georgia Institute of Technology, Atlanta,
GA, 30332-0280, USA.


Mark Bryson
Collaborative Learning Technology Support Officer, Higher
Development Centre, Lancaster University, Lanes., LAl 4YW, UK.

Education

Mark D'Cruz
City University Business School, Frobisher Crescent, Barbican Centre, London,
EC2Y 8HB, UK.
s/


xiv

The Digital University - Building a Learning Community

Kristina Edstrom

KTH Learning Lab, SE-IOO 44 Stockholm, Sweden

Graham R. Gibbs

Department of Behavioural Sciences, University of Huddersfield, Queensgate,
Huddersfield, HDl 3DH, UK.

Stephen Hailes

Department of Computer Science, University College London, Gower Street,
London, WCIE 6BT, UK.

Christopher Harris

Department of Computer Science, University College London, Gower Street,
London, WCIE 6BT, UK.

Reza Hazemi

Clive Holtham

Faculty of Management, City University Business School, Frobisher Crescent,
Barbican Centre, London, EC2Y 8HB, UK.


Ismail Ismail
Serco Usability Services, 22 Hand Court, London, WCIV 6JF, UK.



The Contributors

xv

Lisa Kimball

Executive Producer, Group Jazz, 5335 Wisconsin Ave. NW, Suite 440,
Washington, DC 20015, USA.

J. Kirakowski
Human Factors Research Group, University College, Cork, Ireland.

Brian R. Mitchell

Director, Management Systems Division, University College London, Gower
Street, London, WClE 6BT, UK.

Peter Monthienvichienchai

Department of Computer Science, University College London, Gower Street,
London, WClE 6BT, UK.

Kent Norman

Department of Psychology, University of Maryland, College Park, MD 207424411, USA.

Martina Angela Sasse

Department of Computer Science, University College London, Gower Street,
London, WC1E 6BT, UK.

Ben Shneiderman

Founding Director, Human-Computer Interaction Laboratory, Department of
Computer Science, University of Maryland, College Park, MD 20742, USA.



xvi

The Digital University - Building a Learning Community

Jacqueline Taylor
School of Design, Engineering & Computing, Bournemouth University, Talbot
Campus, Fern Barrow, Poole, BH12 5BB, UK.

Ashok Tiwari
Department of Computing, Faculty of Engineering and Information Sciences,
University of Hertfordshire, Hatfield Campus, College Lane, Hatfield, Herts,
ALlO 9AB, UK.


Philip Uys
PO Box 220, Waikanae, New Zealand
philip.

Claude Vihille
Laboratoire Trigone - Equipe NOCE, Universite des Sciences et Technologies de
Lille 1, Bfttiment B6 - Cite scientifique, 59655 Villeneuve d'Ascq CEDEX - France


Richard Wheeldon
Department of Computer Science, University College London, Gower Street,
London, WClE 6BT, UK.



Foreword

Ben Shneiderman

The turbulence generated by the integration of information technology into higher
education provokes more conversations than the weather. The hot winds of
hyperpromises and the cold front of angry skeptics are clouding the judgment of
administrators, faculty members, and national planners. A clear forecast is not
likely to appear until implementations are in place and thoughtful evaluations are

conducted.
This edited collection points the way towards more clear thinking by presenting
detailed reports about promising projects and a hint of the thoughtful evaluations
that will be so important in the coming years. Multi-level evaluations will be
necessary for developers to refine their user interfaces, for professors to adjust their
teaching, and for administrators to understand how university life is being changed.
The changes implied by the digital university are nicely categorized by the Dearing
Report's four areas of activity: teaching, research, systems support, and
administration. First generation collaborative software tools are already being
applied in all four areas, and they are likely to become more sophisticated,
integrated, and ubiquitous. Evaluating the impact of these tools in each area will be
a prime occupation for several decades.
Evaluating teaching technologies has always been a challenge because adequate
theories were lacking, appropriate controls were difficult to ensure, and reliable
metrics were hard to identify. Furthermore, the introduction of new teaching
technologies has usually resulted in changes to the curriculum, or at least the actual
outcomes, thereby invalidating the existing student assessment tools. For example,
the introduction of collaborative methods in software engineering courses shifts the
emphasis on to teamwork and communication skills, which are rarely measured by
solitary programming tasks on tests. Secondly, collaborative methods often
increase student retention, making comparisons with other courses that have high
drop-out rates difficult.
Still the benefits of evaluation can be enormous for individual projects as well as
for rapid progress in this field. Anecdotes and case studies from developers of new
tools are a natural starting point, but these tend to focus on self-serving success


XV111

The Digital University - Building a Learning Community

stories. Outside evaluators and subjective evaluations questionnaire results from
students and faculty are a natural next step, which some of the authors in this
volume have done. Logging usage and interviewing students, to understand which
features get used and where users run into error messages, are simple low cost
steps that provide valuable insights for refinement. We've often been surprised that
features we as developers thought were terrific turued out to be useless or too
complex. Formal assessments based on a theory-driven hypothesis-testing
approach can produce important controlled empirical studies. These require more
substantial resources but the payoffs are generalizable insights and publishable
results that could influence many developers and theorists.
Each course, informal assessment, or quantitative evaluation requires a reevaluation of the purpose of education. As the answers swing from information
accumulation to process-oriented capabilities, the metrics for success change.
Educators increasingly talk about learning to learn, critical thinking skills, selfawareness, and capacity to participate in work environments, neighborhood (or
online) communities, and democratic processes. Students need to be able to
identify problems, understand existing solutions, explore creative possibilities,
consult with peers and mentors, and then implement and disseminate results. This
active-learning inquiry-based approach fits well with collaborative methods and
service-orientation, but educators are still struggling to assess collaboration.
Like several of the authors in this volume, I promote team projects to accomplish
ambitious goals, and add the requirement that the projects be done for someone
outside the classroom. This Relate-Create-Donate philosophy [Relate-CreateDonate: An educational philosophy for the cyber-generation, Computers &
Education 31, 1 (1998),25-39] has been useful to me in shaping undergraduate and
graduate courses, and effective for others with younger and older students.
I believe in the concept of Open Projects in which student work is on the web and
students get a grade for how thoughtful they are in suggesting improvements to
their colleagues. Then there is a 72 hours revision period before I do my grading.
Projects are published on the Web for everyone to see (you can see my students'
projects of the past 8 years on the Web by starting at
IS

at
/>and
my
summary
http://www .cs.umd.edulhcil/relate_create_ donate/).
Assessments can then include the intended audience for class projects, as well as
the project participants who can contribute peer reviews. Such multi-level
evaluations offer richer feedback to guide teachers and students. Questionnaires
and interviews with teachers and students can include process improvement
questions. Online logging gives useful feedback about the utilization of email,
listservs, web sites, and specialized educational software.
Documenting the benefits of these novel teaching/learning methods will help to
refine them and overcome the resistance to change in many teachers and students.
Some of that resistance is appropriate, and sometimes live lectures are an excellent
form of education. Rigorous evaluations of collaborative methods will help


Foreword

XIX

promoters of digital universities to get past their wishful thinking, develop more
successful strategies, and help calm the turbulence.

Prof. Ben Shneiderman,
July 23,2001


Chapter 1
Introduction

Reza Hazemi and Stephen Hailes

1.1

The Need

A recent report by Lord Ron Dearing! and the National Committee ofInquiry into
Higher Education published recently includes recommendations on how the
purposes, shape, structure and funding of higher education should develop to meet
the needs of the United Kingdom over the next 20 years. While this review is
aimed specifically at UK higher education, there is nothing particularly special
about the UK system in respect of the need continually to increase efficiency. As a
result, many of the report's conclusions are applicable in an international context.
In his report, Sir Ron notes that:
"A sustained effort to improve the effective and efficient use of resources by institutions is
required to secure the long term future of an expanding higher education system."

He goes on to note the importance of adopting suitable national and local
Communications and Information Technology (C&IT) strategies as a major factor
in achieving this aim. At the time of the Dearing report, C&IT spending was
estimated as being of the order of £ 1 billion (or 10% of the total higher education
turnover). Since then, further short-term money has been made available, partly for
use in enhancing C&IT infrastructure. This perhaps is a reflection of the fact that
"the full potential of C&IT in managing institutions has also yet to be realized" but
that, when it is, "There are likely to be significant cost benefits from its increased
use."
As can be seen from current expenditure, institutions are already recognizing the
importance of C&IT. Indeed, of 50 institutions responding to a survey conducted
by the Universities and Colleges Information Systems Association (UCISA), over

1

educol/ncihe

R. Hazemi et al. (eds.), The Digital University - Building a Learning Community
© Springer-Verlag London Limited 2002


2

The Digital University - Building a Learning Community

75% already have in place an integrated C&IT system in each of the areas of
personnel management, finance and accounting, and student registration. However,
only 26% of the same institutions use such systems in the management of research
and consultancy and the collection of institutional statistics, amongst other
important functions. They admit that they are severely underutilizing system
capacity, even in areas where utilization is highest, leading to Sir Ron's conclusion
that universities are "not near to" exploiting the potential of C&IT systems.
As a result of the above considerations it is clear that not only will the absolute
levels of investment in C&IT have to remain high, but that what there will have to
be spent ever more intelligently. Part of this will come through top-down
leadership, the setting of national and institutional goals, but these will have to be
realized through the development of appropriate strategies, including the training
of higher and middle management in using and developing the potential of C&IT,
and consideration of open standards.

1.2

The Solution

In this book, we consider one of the major ways in which the efficiency of higher
education institutions can be increased from a number of different perspectives.
Specifically, we choose to address the issue of collaboration, using what are known
technically as asynchronous collaborative techniques. In plain English, these
techniques are simply those used within a C&IT setting to allow some number of
people to perform some task jointly, without the requirement that those people
work in parallel2 . In its simplest form, this involves the exchange of electronic mail
where one person hands over a partly completed task to another.
So, why have we chosen to look at the collaborative aspects of C&IT policy and
why, specifically, have we chosen to look at asynchronous collaboration? Firstly,
as Sir Ron Dearing notes:
"Collaboration matters. It may, in some cases, make the difference between institutional
success and failure. But it needs to apply throughout institutions, from individuals to
management teams."
Many of the tasks which universities perform are inherently collaborative: the
teaching and learning process involves at least two parties - the lecturer and the
student; research normally involves several people, possibly split across different
institutions, maybe internationally; and administration inherently involves the
administrator and the subject of the administration. Thus, in seeking to increase the
efficiency of institutions, it is vital that we consider the potential for, and costs of,
different collaborative mechanisms. In fact, we believe that the greatest scope for
increase in efficiency specifically lies with asynchronous collaboration. The reason
for this belief is that many of the synchronous activities within higher education
In contrast, synchronous collaboration is typified by video conferencing-type applications,
where several people must simultaneously work on the same task for it to have any meaning.

2

Introduction

3

institutions are currently conducted face-to-face without great difficulty, in view of
the proximity of those involved. With the widening of the student base and the
consequent need for distance learning, and with the increasing inter-institutional
cooperation required by Dearing, this may change, though the numbers involved in
such activities will remain small compared to those still engaged in face-to-face
meetings. On the other hand, most of the significant and increasing administrative
load borne throughout universities, for example, is inherently asynchronous in
nature, with different subtasks being performed in a linear fashion by those with
the necessary information and expertise.
We aim to show throughout this book that there is a significant role for
asynchronous collaboration within higher education institutions, that its current
limited exploitation can usefully be expanded, and that there are exciting technical
developments which promise the potential to increase both cost-effectiveness and
the quality of the student experience well into the future. Although this book is
(intentionally) rather forward-looking, we recognize that in order for the full
potential of any form of C&IT collaborative techniques to be realized, both money
and political will within REI management, the funding bodies, and government
will be required. Again, the Dearing report tends to support our view:
"There needs to be more encouragement within institutions, for example to support faculty
teams to develop their ideas and evaluate the costs and potential of collaboration, and
incentives to staff. At institutional level too, governing bodies should include a review of
collaboration in the review of performance recommended in the Dearing Report (Chapter
15). At national level, there is scope for more imaginative funding arrangements which
would help institutions to get over the initial costs that can sometimes arise from
collaboration before the longer term economies arise. We think that the Funding Bodies
might usefully consider bringing forward part of institutions' allocations and offsetting this

against future funding, where institutions make strongly-founded proposals with clear
educational and financial benefits that cannot otherwise be realized. It will also be important
that the new quality assurance arrangements to be developed by the Quality Assurance
Agency do not discourage collaboration between institutions where this would lead to
improvements in learning and teaching."

The extent to which these laudable aims are realized will largely determine the
actual, rather than potential, benefits given by collaboration, and the C&IT
techniques which are used to support them.

1.3

The Structure of the Book

In this book we have concentrated on asynchronous collaboration in a learning
environment. We look into the future, at the challenges faced by universities and
how the technology can be used to meet these challenges.
We have tried to cover policies, market and management of asynchronous
collaboration and the technical section covers four main topics of principles,
experiences, evaluation and benefits of asynchronous collaboration but there is an
overlap between various sections.


4

The Digital University - Building a Learning Community

Chapter 2 is a tutorial chapter. It examines the functions of a university, which
include teaching, research, support and administration, and examines how these
functions could be performed more efficiently. The changes in performance of

these functions could result in what we term reinventing the academy. The Dearing
report which forms the basis of policies made by universities for the next few years
has been highly influential in writing this chapter, which also contains some
reflections on progress made since its publication.
Chapters 3, 4 and 5 look at managing distance learning and the challenges faced by
the universities. Kimball argues that teaching style and strategies impact the quality
of learning in distance learning more than the technology itself. She argues that
there is a need and a challenge to change the process of teaching and learning in
distance education. Norman argues that in order to support quality education,
principled models of interaction, user interface design guidelines, and policies for
management of interaction and collaboration have to be used. He then presents a
model and a metaphor for this purpose, and describes how the interaction between
students and teachers could be managed. Uys introduces networked education and
networked education management. He discusses networking, student focus,
globalization, flexibility, boundary orientation and the information base of
networked educational management.
Chapters 6 and 7 describe distance learning systems. Brotherton and Abowd
describe eClass, a system for capturing live lectures for later use by students and
lecturers. They discuss the motivation behind the design of eClass and describe its
structure. Gibbs describes a web-based object oriented tool called coMentor which
supports private group-work areas, role-playing, annotation and threaded
discussion, concept mapping and synchronous chat. He looks at both synchronous
and asynchronous support in a text-based virtual environment.
In Chapter 8, Holtham et al. review the support of asynchronous teams utilizing
intranet-based mini-case study publication with web-based conferencing. They
report on this exercise from both pedagogic and groupware perspectives.
Chapters 9 to 12 are about support for authoring. Taylor describes the use of CMC
systems to support e-seminars and introduces best practice guidelines for authoring
e-seminars. Chapter 10 presents TACO a tool used for distributed authoring and
management of computer-based coursework developed by Sasse et aT. TACO uses

a form-based tool which enables lecturers to create web-based self-learning
exercises and assessed coursework. Armitage and Bryson illustrate, through the use
of case descriptions, how Lotus Notes software is being used to support authoring
and research. Kirakowski looks at the application of ISO standards to multimedia
learning systems in Chapter 12. He also looks into quality of use, practical
considerations and usability guidelines in the development of multimedia learning
systems.
In Chapter 13, Edstrom looks at how the design of courses can connect with
student motivations and presents a checklist used to create flexible courses to keep
students motivated.


Introduction

5

Chapters 14 and 15 look into educational metadata schema and the draft Learning
Object Metadata (LOM). They highlight incompatibilities and weak points of the
standards. Monthienvichienchai et at. present a case study where they investigate
the usability of educational metadata schemas for the MALTED (Multimedia
Authoring for Language Teachers and Educational Developers) project. Vieville
describes the implementation of LOM for the "Le Campus Virtuel" platform and
describes the way the system supports learning activities.
Finally, in Chapter 16, Mitchell looks at the relevance of collaborative working to
the management of universities. He argues that a formal development of
collaborative working practices, supported by appropriate technology, can make a
substantial contribution to the effective running of a modem university.


Chapter 2

Universities, Dearing, and the Future

Stephen Hailes and Reza Hazemi
This chapter provides an overview of the ways in which asynchronous
collaboration is potentially able to benefit universities. In order to do this, we first
examine the functions of a university, then look at the basic tools and techniques of
asynchronous collaboration before bringing these together to show which functions
of a university are susceptible to support using asynchronous systems.
The importance of this activity cannot be underestimated. In the UK, the 1997
government-commissioned report of Sir Ron (now Lord) Dearing's Committee of
Enquiry into Higher Education placed an emphasis on the development of a
standard approach to the acquisition and delivery of electronic information,
including everything from the management of the teaching and assessment
processes through to the delivery of teaching material and the student admission
process. Given the unique nature and importance of this report, we present some of
its main recommendations.
It is clear from many of the chapters in this book that the development of

collaborative technologies for use in higher education has been proceeding apace.
It is also clear from the Dearing report, and from the development of institutions

such as the Jones International University, a range of Korean virtual university
programmes, and many other such activities, that the practical deployment of
computer aided techniques for the delivery and management of degree courses will
play a very important part in the future of university education worldwide.
However, it is less clear that such technologies have been widely adopted amongst
traditional universities and the remainder of the chapter will be dedicated to a
consideration of some of the practical constraints that tend to oppose their
introduction in universities in the UK.

R. Hazemi et al. (eds.), The Digital University - Building a Learning Community
© Springer-Verlag London Limited 2002


8

2.1

The Digital University - Building a Learning Community

Collaborative Tasks

There are essentially four different areas of activity within a university: teaching,
research, systems support and administration. The first two of these are very high
profile, and are assessed externally through TQA and the RAE activities in the UK,
the results of which can have a significant impact on the standing and income of a
university. However, the ability to perform these key tasks well is affected
significantly by the availability and efficiency of support and administrative
services. We will, therefore, analyze all four areas independently.

2.1.1 Teaching
Teaching is undoubtedly the activIty for which univerSIties are best known.
Traditionally, teaching has involved a mixture of lectures, practicals, and tutorials
of various types and this is still the predominant public perception of what
happens. However, this is overly simplistic. Even from a traditional point of view,
there are at least 6 different activities, which could reasonably be considered as
constituting part of the teaching "interface" between a university and its students:
1.

The production ofprimary teaching material. This involves the production

of slides, notes, videotapes and, increasingly, multimedia material, and
affords the primary mechanism through which students will be informed
about the course content. In many cases, this material is produced jointly
between multiple lecturers and it often relies on prerequisite material in
earlier courses or must be complementary to material in other, related,
courses.

2.

The delivery of course material. This can be done both through
synchronous communication, if the teacher is lecturing a class, or can be
used to present either primary material (Open University type courses) or
supporting material in an asynchronous manner [2].

3.

Small group teaching. Almost all courses run activities when small groups
of people from a course are involved at anyone time. Examples of such
activities are tutorials and project supervision. Often, the agenda of such
meetings is defined rather more loosely than for the delivery of primary
material, if at all.

4.

The setting and marking of exams and coursework. As part of the
mechanism of obtaining a degree, there is an obvious need to assess the
aptitude and progress of students. This can be done in the form of
unassessed self-testing to determine what course material has not been
understood clearly and hence should be revised, or in the form of formal
assessed coursework or examinations.