`
`
`
`
`
`
`
`Management Gaming on a Computer Mediated Conferencing System:
`
`
`
`
`
`
`
`
`A Case of Collaborative Learning through Computer Conferencing
`
`
`
`
`
`Enrico Y. P. Hsu
`
`
`
`
`Ramapo College of New Jersey
`
`
`
`
`
`Abstract
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Effective
`collaborative
`
`
`
`for
`is
`essential
`learning
`
`
`
`
`
`Management
`education.
`are
`skills
`Interpersonal
`
`
`
`
`
`A computer mediated
`important.
`particularly
`
`
`
`
`
`
`
`
`
`augmented with Virtual
`system,
`communication
`
`
`
`
`
`
`Classroom (R) software, was used in conjunction with a
`
`
`
`
`
`
`
`
`micro-computer based management game. Results of
`
`
`
`
`
`
`the experiment,
`in terms of game performance, and
`
`
`
`
`
`
`
`student group learning experience, were encouraging.
`
`
`
`
`
`
`Further experimentation is needed to firmly establish the
`significance of this experiential learning method.
`
`
`
`
`
`
`
`Starr Roxanne Hiltz,
`
`
`
`
`New Jersey Institute of Technology
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`room. “Read” is a way of handing out lengthy reading
`
`
`
`
`
`
`
`
`
`assignments, "Response"is a way of asking students for
`
`
`
`
`
`
`
`
`
`
`their answers or opinions. "Selection" serves to give the
`
`
`
`
`
`
`
`
`students to pick a topic or role amongthose available to
`
`
`
`
`
`
`
`
`"Decision support" is used to facilitate the
`them.
`
`
`
`
`
`
`
`
`students to contribute their input for group decision.
`
`
`
`
`
`
`
`Virtual Classroom (R) also includesa set of instructional
`
`
`
`
`
`
`
`
`
`
`
`managementtools, such as giving a quiz, maintaining a
`
`
`
`
`
`
`
`
`
`grade book, etc, The software has been used by a small
`
`numberofpilot courses and showspositive results (Hiltz,
`1989).
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Recently, the US educational system has been widely
`
`
`
`
`
`
`
`
`seen as deficient at teaching job-related skills. Part of
`
`
`
`
`
`
`
`
`
`
`the deficiency lies in obsolete or irrelevant course
`
`
`
`
`
`
`
`
`
`material, but another part lies in the very structure of
`
`
`
`
`
`
`the US educational system itself. For example, the US
`
`
`
`
`
`
`
`
`
`educational system rewards individual achievement at
`
`
`
`
`
`
`
`the expense of a nearly complete neglect of collective
`
`
`
`
`
`
`
`achievement, The assignment ofindividual grades and
`
`
`
`
`
`
`
`the "curving"of grades discourages students from sharing
`
`
`
`
`
`
`
`
`
`hard-won insights on difficult
`topics with classmates,
`
`
`
`
`
`
`
`especially ones who are not already close friends. This
`
`
`
`
`
`
`
`
`paper addresses the deficiency in teaching collaborative
`
`
`
`
`
`
`skills in the education of managers.
`In management,
`
`
`
`
`
`
`
`interpersonal skills, informational skills and decisional
`Indeed,
`are
`all of collaborative nature.
`skills
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`collaboration under proper
`leadership to achieve
`commongoalsis the very essence of good management.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Collaborative Learning has been known under many
`
`
`
`
`
`
`other labels in the educational
`literature,
`including
`
`
`
`
`
`
`
`
`“cooperative learning, group learning, collective learning,
`
`
`
`
`
`
`
`
`
`study circles, team learning..." [Bouton and Garth, 1983,
`
`
`
`
`
`
`
`
`
`p. 2].
`It includes a process of group conversation and
`
`
`
`
`
`
`
`
`activity which is guided by a faculty member who.
`structures tasks and activities and offers expertise.
`Its
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`that
`basic premise is
`learning involves the “active
`
`
`
`
`
`
`
`
`
`construction" of knowledge by putting new ideas into
`
`
`
`
`words and receiving the reactions of others to these
`formulations. Additional structured communication
`
`
`
`
`
`
`
`
`
`
`
`
`provided by Computer Mediated Communication
`systemsfacilites Collaborative Learning atcollege level.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Management gameshavelong beenstudied for teaching
`effectiveness [Greenlaw and Wyman, 1973, Wolfe,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1985}. The results were inconclusive. However, by
`re-analyzing the same data compiled by Greenlaw and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1. Introduction
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`This is a report on an on-going experiment [Hsu and
`
`
`
`
`
`Geithman, 1988], in teaching collaborative managerial
`
`
`
`
`
`a Virtual
`through
`simulation-gaming
`in
`skills
`
`
`
`
`
`Previous papers [Hiltz, 1986, 1988a]
`Classroom(R).
`
`
`
`
`
`described the Virtual Classroom(R) as a teaching and
`
`
`
`
`
`learning environment
`located within a computer
`
`
`
`
`
`
`
`
`
`mediated communication system. Accessible around the
`
`
`
`
`clock and around the world, it was designed to support
`
`
`
`
`
`
`
`
`“collaborative
`learning"
`distance
`education,
`for
`
`
`
`
`
`
`particularly at the college level. There are "spaces" and
`
`
`
`
`software support for lectures, class discussions, doing
`
`
`
`
`
`
`assignments (individually or collaboratively), private
`
`
`
`
`
`
`
`
`communication with the instructor or other students,
`
`
`
`taking tests, chatting informally in the student center or
`"cafe", and more.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`is a set of software
`Briefly, Virtual Classroom (R)
`
`
`
`
`
`designed for implementation on various a family of
`
`
`
`
`
`
`proprietary Computer Mediated Conferencing systems
`
`
`
`
`
`
`
`
`called Electronic Information Exchange Systems (EIES),
`
`
`
`
`
`
`
`
`developed and implemented at New Jersey Institute of
`
`
`
`
`
`
`Technology. The EIES systems consist of these basic
`
`
`
`
`
`
`facilities: mail, conference, notebook, directory, and
`
`
`
`
`
`
`
`notifications. Virtual Classroom (R) software expands
`
`
`
`
`
`
`the capability of conference module through "read",
`
`
`
`
`
`
`
`
`“response”, "selection" and “decision support" activities,
`designed to mimic the activities in a conventional class
`
`
`
`
`
`
`0073-1 129/91/0000/0367$01.00 © 1991 IEEE
`
`
`
`
`
`367
`
`Petitioner Valve - Ex. 1020, Page 367
`Petitioner Riot Games,Inc. - Ex. 1020, p. 367
`
`Petitioner Riot Games, Inc. - Ex. 1020, p. 367
`
`Petitioner Valve - Ex. 1020, Page 367
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Wyman and by Wolfe, with an eye towards the teaching
`
`
`
`
`
`
`
`
`of collaborative skills, Hsu [1989] demonstrated the
`
`
`
`
`
`
`
`
`
`clearly positive effects of group interaction on student
`
`
`
`
`
`
`
`performance in the playing of management games
`
`
`
`
`
`
`
`[1989]. The emphasis was on the group interaction
`
`
`
`
`
`
`
`
`benefits of game playing. Here we further buttress the
`
`
`
`
`
`
`
`
`conclusions of Hsu, by comparing the game performance
`
`
`
`
`
`
`
`student
`using a
`computer mediated
`groups
`of
`
`
`
`
`
`
`
`
`conferencing system to that of student groups without
`
`
`
`
`
`
`
`such a conferencing system. We show that computer
`
`
`
`
`
`
`
`
`conferencing increases the group interaction benefits of
`
`
`game playing. The student groups play better when
`supported by the Virtual Classroom{R) software. We
`
`
`
`
`
`
`
`also show that group cohesion and stability are
`enhanced, as well.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The Virtual Classroom project includes the development
`
`
`
`
`
`
`
`of software structures and pedagogical
`techniques to
`
`
`
`
`
`
`enhance the effectiveness of computer conferencing for
`
`
`
`
`
`
`
`
`
`the delivery of college level education, and the
`evaluation of the effectiveness of these innovations. The
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`research methodology is based on quasi-experimental
`
`
`
`
`
`
`
`
`designs which use matched sections of
`the same courses,
`
`
`
`
`
`
`
`delivered in various modes
`[Hiltz, 1988a, 1988b].
`
`
`
`
`
`
`
`
`Students who have used the Virtual Classroom(R), rate
`
`
`
`
`
`
`
`
`
`it, on the average, as delivering a more convenient and
`
`
`
`
`
`
`
`
`better quality education than the traditional classroom.
`
`
`
`
`
`
`
`Mastery of material as measured by grades was as good
`
`
`or better than that obtained by students in traditional
`classes. These outcomes established the viability of the
`
`
`
`
`
`
`Virtual Classroom(R)
`as mode
`delivery
`of
`of
`college-level courses.
`
`
`
`
`
`
`2. Review of the Gaming Environment
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`To encourage collaboration and group identification
`
`
`
`
`
`
`
`
`
`among students,it is necessary that they associate with
`
`
`
`
`
`
`
`
`each other as much as possible, and that they strive
`
`
`
`
`
`
`
`
`
`
`towards a common goal. In addition it is desirable that
`
`
`
`
`
`
`
`
`the instructor be able to monitor the exchanges among
`
`
`
`
`
`
`
`
`students. Physical meetings of groups of students outside
`
`
`
`
`
`
`
`
`of class are difficult to arrange, given the diversity of
`
`
`
`
`
`
`
`
`in terms of course loads, schedules and
`students
`interests.
`This is even more problematic in urban
`
`
`
`
`
`
`
`
`
`schools, where many students work part-time and there
`
`
`
`
`
`
`
`
`
`is not a strong spirit of school identification.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The Virtual Classroom(R)
`is ideally suited for such a
`
`
`
`
`
`
`
`situation. Students are grouped into teams to play a
`
`
`
`
`
`
`
`
`management game. Meetings among team members,
`
`
`
`
`
`
`
`however, need not be physical, nor must the members
`
`
`
`
`
`
`
`
`schedule special
`times for meetings.
`Students may
`
`
`
`access the computer conferencing system wheneverit is
`them, and conduct business
`most
`convenient
`for
`
`
`
`
`
`
`discussions. Additionally, the instructor can read all of
`the comments made.
`
`
`
`
`
`
`
`
`
`
`1.
`
`
`
`
`
`
`Turoff, et al.[1989], distinguish seven default conference
`structures:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Discussion Conference: Structured to optimize
`
`
`
`
`
`general purpose discussion by active groups of up
`to fifty or more individuals.
`Seminar Conference: Designed to facilitate
`learning oriented seminars and the "Virtual
`
`2.
`
`
`
`
`
`
`
`
`
`368
`
`
`
`3.
`
`
`4.
`
`
`
`5.
`
`
`
`
`
`
`
`6.
`
`7.
`
`L
`
`2.
`
`
`
`
`
`3.
`
`
`
`
`
`4.
`
`5.
`
`
`Classroom."
`
`
`
`
`
`
`Information Exchange: Optimized for very large
`
`
`
`
`
`
`groups
`(hundreds) engaged in unpredictable
`
`
`
`
`
`information exchange.
`
`
`
`
`
`
`
`
`Project Management:
`Incorporates
`various
`
`
`
`
`
`
`
`tracking, selection, and organizing features to
`
`
`
`
`
`
`
`maintain awareness of modifications, milestones,
`
`
`
`
`
`
`
`status, and task assignments thatare taking place.
`
`
`
`
`
`
`
`
`Composition Notebook: Allows a high degree of
`
`
`selective roles in different designated portions of
`
`
`
`
`
`
`the conference, and tracks the updates and
`
`
`
`
`
`
`
`changes being made to the generation of a
`collaborative document.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Data Collection Conference: Designed for the
`
`
`
`
`organization of structured data, and the tracking
`
`
`
`
`
`
`
`and validation of data changes for a group
`
`
`building and utilizing a collaborative data base.
`Simulation-Game Conference:Structured to allow
`
`
`
`
`
`a group to carry out a role playing, even-oriented
`scenario game.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`In our experiment, we used the Simulation-Game
`
`
`
`
`
`
`
`Conference option, supplemented by the Discussion
`Conference structure. A Simulation-Game Conference
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`allowsa group to carry out a role-playing, event-oriented
`
`
`
`
`
`scenario game.
`The game director can control all
`
`
`
`
`
`
`
`
`
`communication channels and the conditions and timing
`
`
`
`
`
`
`
`for events to occur. In order to simplify and standardize
`
`
`
`
`
`
`
`
`
`the scenarios, a microcomputer based management game
`
`
`
`
`
`
`was used to augment
`the role playing of the group
`
`
`
`
`
`
`
`
`members. In this sense, the management game served
`
`
`
`
`
`
`
`
`as a model to generate operating results based on a set
`
`
`
`
`
`
`
`of decision inputs and the Simulation-Game Conference
`
`provides the forum for the group members to formulate
`and agree on the decision inputs. The two technologies
`
`
`
`
`
`thus complement each other in a group collaboration
`environment.
`
`
`
`
`
`
`
`
`
`
`
`Among the many published management games,
`“Business Simulator" by Reality Technologies, Inc. was
`selected for the following reasons:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The game is relatively inexpensive so that all
`Students can afford ta own it.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The gameis playable individually. This way the
`
`
`
`
`
`students can learn business concepts at home and
`
`
`
`
`
`at their own individual paces. The students can
`
`
`
`
`
`
`
`also use the gameto predict probable outcomes
`
`
`
`
`
`
`
`of various decision parameters before submitting
`
`
`
`
`these decisions to their group.
`
`
`
`
`
`
`The game can be played by assigning functional
`
`
`
`
`
`roles to members of a group,
`thus requiring
`
`
`
`
`
`
`
`
`
`collaboration within the group.
`
`
`
`
`
`
`
`
`The gameallows for competition between groups,
`
`
`
`
`
`
`
`thereby stimulating greater studentinterest.
`
`
`
`
`
`
`
`
`The game is user friendly.
`It does not require
`
`much computer expertise to run. It provides on
`line help and tutorial. Furthermore, it includes a
`numberofcolor charts to show the performance
`results.
`
`Petitioner Valve - Ex. 1020, Page 368
`Petitioner Riot Games,Inc. - Ex. 1020, p. 368
`
`Petitioner Riot Games, Inc. - Ex. 1020, p. 368
`
`Petitioner Valve - Ex. 1020, Page 368
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Sales Force Size
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`3. The Experiment
`competes
`against
`three
`and against
`each other
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`companies played by the computer. Each week student
`
`
`
`
`
`
`
`
`
`Four sections of OS 471 Management Practices
`
`
`
`
`
`
`
`
`company must submit their quantitative decisions on the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`participated in the current study. A total offifty-three
`items listed in Fig. 1. Members of each company must
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`students who completed the course were organized into
`study the results of last year operation, economic trend
`
`
`
`
`
`
`
`
`eighteen companies, each comprising two to four
`
`
`
`
`
`
`
`
`
`and operational policies, and run the game program
`
`
`
`
`
`
`
`students with an average of three. “Company”is the unit
`
`
`
`
`
`
`
`
`
`independently by guessing how their competing company
`
`
`
`
`
`
`
`
`of analysis of our experiment. The assigned product for
`
`
`
`
`
`
`
`
`
`might play their hand. Then company members discuss
`
`
`
`
`
`
`
`
`all simulated companies was a household robot (Pet-
`
`
`
`
`
`
`
`pros and cons of the quantitative decisions as put
`
`
`
`
`
`
`
`Bots) that would do most domestic chores.
`
`
`
`
`
`
`
`
`
`forward. Since the members play different functional
`
`
`
`
`
`
`
`Three sections had access to the Virtual Classroom on
`
`
`
`
`
`
`
`
`
`roles: manufacturing, marketing and finance, they tend
`
`
`
`
`
`
`
`
`
`EIES2 at NJIT: one larger section used the basic
`
`
`
`
`
`
`
`
`
`
`to focus on their respective functional area more than
`
`
`
`
`
`
`
`
`facilities of the Virtual Classroom on EIES2 and two
`
`
`
`
`
`
`
`
`the other areas. However, they have a commongoal of
`
`
`
`
`
`
`
`
`the
`smaller sections used all
`advanced features on
`
`
`
`
`
`
`optimizing the operating results: units sold, back orders,
`
`
`
`
`
`
`EIES2 plus
`readily available off-line productivity
`
`
`
`
`
`
`
`
`ending inventory, market share, operating income,
`
`
`
`
`
`
`
`
`
`
`software, such spreadsheet and data base system. The
`
`
`
`
`
`
`
`
`incometax, net income, CEO’s net worth, company book
`
`
`
`
`
`
`
`fourth section, serving as the control group did not have
`
`
`
`
`
`
`
`
`
`
`value, etc.
`Here collaboration comes
`into play.
`
`
`
`
`
`
`
`
`access to ETES2 atall. Thus we have three treatments:
`Hopefully they converge toward a single set of numbers.
`
`
`
`
`
`
`
`
`
`In any case, before the weekly deadline, CEO must
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`make final decision.
`In the first
`treatment of the
`1.
`Control Category with no access to Virtual
`
`
`
`
`
`
`
`
`
`Classroom,
`experiment, CEO’s submit their decisions on a piece of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`2.
`Experimental Category I with regular Virtual
`paper. The instructor runs the game and saves the
`
`
`
`
`
`
`
`
`
`
`
`
`
`Classroom facilities, and
`results on a diskette available for the students to copy.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`In the second and third treatment, they declare these
`
`
`
`
`
`
`
`
`3. Experimental Category II using_regular Virtual
`
`
`
`
`
`
`
`Classroom facilities,the full
`features of the EIES2
`numbers in their company’s private conference. The
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`instructor, being an observerof all the conferences, picks
`
`
`
`
`
`
`
`
`
`conferencing system plus
`such off-line productivity
`
`
`
`
`
`
`up decisions from two competing companies and runs
`software as spreadsheet and data base management
`
`
`
`
`
`
`
`
`
`
`
`system.
`the game officially. The results of the game for the
`
`
`
`
`
`
`
`
`
`current year are then publishedin the Managers’ Lounge
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`(class conference).
`In the second treatment of the
`
`
`
`
`
`
`
`the students were randomly
`Within each category,
`
`
`
`
`
`
`
`
`
`
`experiment, some key results were published. This
`
`
`
`
`
`
`
`
`divided into six groups of three to four students. Each
`
`
`
`
`
`
`
`
`method requires more of instructor’s time in extracting
`
`
`
`
`
`
`
`
`
`group had a name and an organizational structure,
`
`
`
`
`
`
`
`
`the results from the game and inputting into the
`
`
`
`
`
`
`
`consisting of a CEO, a Financial Officer, an Operations
`
`
`
`
`
`
`
`
`conference.
`In the third treatment,
`the instructor
`
`
`
`
`
`
`
`
`
`
`Chief and a Marketing Executive. A Game Playing
`
`
`
`
`
`
`
`
`transfers a binary file containing all the results of the
`
`
`
`
`
`
`
`
`
`Procedure manual was distributed at the beginning of
`
`
`
`
`
`
`
`
`game through "binary file transfer" facility of the ENES2
`
`
`
`
`
`
`
`
`
`the semester, detailing the responsibilities of the various
`
`
`
`
`
`
`
`
`system. Students can download this file onto their own
`
`
`
`
`
`
`
`
`
`
`officers and the format of an end-of-semester summary
`
`diskette and play the next year game based on current
`
`
`
`
`
`
`
`
`
`report.
`year results. The game was played for nine weeks,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`representing nine fiscal years. The performances of the
`
`
`
`
`
`
`
`
`Three phases of the life cycle of a business were
`
`
`
`
`
`different companies were evaluated based on the final
`
`
`
`
`
`simulated:
`start-up, growth, and independence. The
`
`
`
`
`
`
`
`
`
`
`outcome of the ninth year.
`decisions to be made in each phase are shown in Figure
`
`1,
`
`
`
`
`
`
`
`
`
`
`The students also had access to the results of all other
`
`
`
`
`
`
`Figure 1: Decisions in Business Simulator(R) Game
`companies for comparison and reference. The key
`
`
`
`
`
`
`
`
`
`
`
`the
`results were recorded in a data base so that
`|: Phase Ik: Independence
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Price
`| Price
`is
`comparative results could be organized and published
`
`
`
`
`
`
`
`
`
`
`
`Advertising
`
`from time to time. This practice proved to be useful in
`
`
`
`
`
`
`
`
`
`
`i Advertising
`maintaining the interest and competitive spirits of all the
`
`Units
`} Units
`Units
`groups.
`f
`Factory Expansion
`Factory Expansion
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`i Long Term Debt Sold|Long Term Debt Sold
`
`CommonStocks
`CommonStocks Issued
`The companies with access to CMC were assigned a
`
`
`
`
`
`
`
`
`
`
`
`
`
`Issued
`group conference for the conduct of the simulated
`
`
`
`
`
`
`
`
`
`business. Typical uses were the assignmentof functional
`
`
`
`
`
`
`
`
`roles, discussion of the logistics and scheduling of
`
`
`
`
`
`
`
`game-playing, formulation of general strategies of the
`
`
`
`
`
`
`
`business, and review of operational
`Each
`results.
`
`
`
`
`
`
`
`
`student company discussed the results in its private
`
`
`
`
`
`
`
`the
`conference
`see whether
`outcomes met
`to
`
`
`
`
`
`
`
`
`expectations and to search for possible reasons for
`
`
`
`
`
`
`
`
`deviations. All students with CMC also participated in
`
`
`
`
`
`
`
`
`two other conferences: the Student Center for social
`
`
`
`
`
`
`
`activities and the Managers’ Corner for management
`
`
`related discussions.
`
`poCommissionraid|% Sales on Credit
`
`
`
`
`
`
`
`
`Research & Development
`
`One Year Loans
`Supplier Payment Period
`
`
`
`Dividend
`
`
`
`
`
`
`
`
`
`
`Each student company is paired with another company
`
`
`
`
`
`
`
`
`belonging to the same category or treatment. The pair
`
`
`
`
`369
`
`
`
`Petitioner Valve - Ex. 1020, Page 369
`Petitioner Riot Games,Inc. - Ex. 1020, p. 369
`
`Petitioner Riot Games, Inc. - Ex. 1020, p. 369
`
`Petitioner Valve - Ex. 1020, Page 369
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Both the Student Center
`students without CMC.
`Companies without access to CMC were dependent on
`
`
`
`
`
`
`
`
`
`
`
`
`face-to-face meetings or telephone or mail to conduct
`Conference and the Managers’ Corner Conference
`
`
`
`
`
`
`
`
`
`their communication.
`played importantroles in developing this camaraderie.
`
`
`
`
`
`
`
`
`
`4, Results
`One third of the students who used CMC asked to
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`remain on the conference for further socializing with the
`
`
`
`
`
`
`
`
`
`
`
`instructor and the students of the next semester, some of
`indication that CMC improves student
`The clearest
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`whom selected these particular sections as a result of
`learning of managerial skills is that the companies run
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`recommendations from the veterans. More importantly,
`by students with CMC performed dramatically better
`
`
`
`
`
`
`
`
`
`the average student with CMC clocked an average of 5
`
`than companies run by students without CMC. We
`
`
`
`
`
`
`
`hours per week on one or another of the conferences
`
`
`
`
`
`
`defined three criteria and a composite index:
`outside of class time, while students without CMC met
`
`
`
`
`
`
`
`
`
`
`
`
`less than one hour per week.
`Composite Index = Profitability + ROA (Return on
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Assets) + ROE (Return on Equity)
`
`
`
`
`
`
`
`the discussion in the Managers’ Corner
`Much of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`conference related to the potential problems of on-the-
`
`
`
`
`
`
`as measures to rank the performance of a company.
`job managers. For example, students discussed what to
`
`
`
`
`
`
`
`
`
`
`
`The results of the final year operation of the simulated
`do if the boss “goofs off frequently." WK responded:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`companies are shown in the following table.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`"My boss goofs off a lot since he becamea partnerin
`
`Performance: Measres of Simuldied Companies 9)
`8" See’
`
`
`
`
`
`
`
`
`
`
`
`
`the design firm I work for. He also has a good sense
`
`
`
`
`
`
`
`
`
`
`
`Company Name"[ Prottabiiry’ [ROA[ROE||Index|
`
`
`of humor. so when heis goofing off I ask him ‘How
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`|CompanieswithoutsecesstoVistuelClassroomonEIES?|
`can I help You,Bob?’andhe’ll tell me he’s notreally
`
`
`
`
`
`
`
`
`|iystericalCop[ea|
`doing anything andI'll tell him that it sounds goodto
` yA
`tabon
`
`
`
`
`
`
`
`
`me and [ want to do my fair share. Something like
`
`
`Robotron
`1L4
`19.3
`
`
`
`
`
`
`
`
`
`this usually makes him self-conscious and he starts
`4
`6.1
`
`
`
`
`
`
`
`
`
`[xsTechnotogies|61|74|106[24a|
`looking for something productive to do. 1 think most
`13.3
`SWATEngineering
`30.6
`
`
`
`
`
`
`
`
`
`
`
`bosses got to be bosses by being responsible ‘and
`[ss|92|soe|4.
`
`
`
`
`
`
`
`
`
`capable (I said MOST O.K.?) and I think if you can
`[RIM Partnesnip [as|42|Toi Peds
`
`
`sft 038°
`
`
`
`
`
`
`
`
`find some good natured way to point out to them that
`
`
`
`
`f Average
`
`their goofing off
`affects you,
`their
`sense of
`responsibility should take over without causing too
`Experimental category I with access to Virtual
`
`
`much trouble."
`
`
`
`
`
`
`
`
`[Fouewoe[115|
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[rscra|
`A comparison of the American managementstyle with
`
`
`
`
`
`
`
`
`|Machine|
`the Japanese proved an inexhaustible
`source of
`
`| KiesRobots R Us
`discussion, while hot debate took place over
`the
`
`
`
`
`
`
`
`
`
`economic relationship between West and East Germany.
`
`
`
`
`
`
`
`
`
`
`
`[Robbo|Total
`
`
`
`
`
`
`
`Discussion in the group business conferences was serious
`
`and of similarly high quality. A comment by OA, the
`
`
`
`
`
`
`
`
`
`
`
`
`CEO of FutureWave, represents a typical entry:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[oe[50|
`0.11]!
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`"I agree with you aboutraising the price fram $34 to
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The numberof students and companies was too small
`$41. We don’t have enough production to compete
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`for results on all dependentvariables to bestatistically
`
`at a low price so we might as well make like Hewlett
`
`
`
`
`
`
`
`
`
`
`
`
`Packard. This will result in a lower market share but
`significant at the .05 level, but the results are consistently
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`those with
`the Virtual Classroom.
`in favor of
`will maximize our profits until we are ready to
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Experimental category II has just ended. Preliminary
`expand. One suggestion: spend more on advertising.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`analysis of the enhanced condition shows extreme
`Instead of $500K maybe
`$525K. Oursales will be
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`variance: the highest and lowest performances of all
`targeted to a higher income bracket which has not
`
`
`
`
`
`
`companies observed occurred.
`In depth analysis is
`heard of us or has regarded our goods as lower
`required to identify the possible causes. Results shall be
`quality because of the lower price range. Good
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`discussed in an update report.
`hunting!"
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`A less tangible but perhaps more important measure of
`The groups with CMCalso benefitted from greater
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the value of CMCin teaching collaborative managerial
`group coordination and continuity in the face ofreal-life
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`skills is the camaraderie that developed in companies
`disruptions. For example, OA disappeared for a time
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`with access to CMC. As one of the questions on the
`and abandoned his prerogative of finalizing business
`
`
`
`
`
`
`
`
`
`decisions. LC and GB used all three conferences to
`final exam, the students were asked to list the names
`
`
`
`
`
`
`
`
`
`and nick namesof the class members. The students who
`plead for OA’s return by posting humorous comments:
`
`
`
`
`
`
`
`
`used CMC knew the names of 83% their classmates,
`
`
`
`
`
`
`
`
`
`
`while the students without CMC scored only 67%. The
`students with CMCorganized ski/skating trips and small
`parties, while nothing of the sort took place with the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`370
`
`Petitioner Valve - Ex. 1020, Page 370
`Petitioner Riot Games,Inc. - Ex. 1020, p. 370
`
`Petitioner Riot Games, Inc. - Ex. 1020, p. 370
`
`Petitioner Valve - Ex. 1020, Page 370
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`REFERENCES
`
`
`
`
`
`
`
`
`
`
`"Hey OA, did you get stuck in traffic again . We
`
`
`
`
`
`
`
`
`
`
`
`missed you at the class today. We wanted to confer
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`with you about the simulator but we will see you at
`
`
`
`
`
`
`
`Bouton, Clark and Russell Y. Garth (1983), “Learning
`
`
`
`
`
`
`
`
`
`
`another time. GB." "OA, First of all, I’m extremely
`
`
`
`
`in Groups. New Directions in Teaching and Learning",
`
`
`
`
`
`
`
`
`
`gratified to hear that you are alive and well. I thought
`Jossey-Bass, San Francisco, 1983.
`
`
`
`
`
`
`
`
`maybe you had been swallowed up by a garbage truck
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`or something!!! Nice io hear from you!!!"
`“How
`
`
`
`
`
`
`"The
`Greenlaw, P. S. and F. P. Wyman (1973)
`
`
`
`
`
`
`
`
`
`come you weren’t in class??? How come you don’t
`
`
`
`
`
`
`teaching effectiveness of games in collegiate business
`
`
`
`
`
`
`
`
`talk to us anymore??? Do we smell??? Are we
`courses.” Simulation and Games 4 (2): 259-264,
`
`
`
`
`
`
`
`
`
`offensive??? C’mon,lets get together and talk about
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Year #4!!! GB and myself shared some thoughts this
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Hiltz, Starr Roxanne (1988a), "Learning in a Virtual
`morning, but as our CEO we would like to get your
`Classroom - A Virtual Classroom On EIES: Final
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`thoughts on a plan of action. When you read this,
`
`
`
`
`
`
`
`Evaluation 1,"|ComputerizedReport, Vol.
`
`
`answer me right away so we can get
`the ball
`
`
`
`
`Conferencing and Communications Center, Research
`rolling!!!"
`Report # 25, 1988.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`OA returned eventually to FutureWave (not, however,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Hiltz, Starr Roxanne (1988b), "Teaching in a Virtual
`as CEO).
`Heparticipated actively in the game and
`Classroom - A Virtual Classroom On EIES: Final
`
`
`
`
`
`
`
`
`
`
`
`
`shared the
`the good performance of
`credit
`for
`
`
`
`
`
`Evaluation
`2," Computerized
`Report,
`Vol.
`
`
`
`
`
`
`In fact, FutureWave was
`the top
`FutureWave.
`
`
`
`Conferencing and Communications Center, Research
`
`performerby all the objective measures.
`Report # 26, 1988.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`JR, CEO of KJ&J, had a similar experience; however,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Hiltz, Starr Roxanne (1989), “Collaborative Learning
`he continued to maintain contact with his group through
`
`
`
`
`
`
`
`in a Virtual Classroom: Highlights of Findings,”
`
`
`
`
`CMC. Hewas able to return to the game and resume
`
`
`
`
`
`
`
`
`
`
`
`
`Proceedings, Second Conference on Computer
`his responsibilities as CEO. Both examples show that
`
`Supported Cooperative Work, Portland, Oregon,
`
`
`
`
`
`
`CMCprovides critical support for students who have
`1989.
`been temporarily distracted from their duties.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Hsu, Enrico (1989), "Role-Event Gaming Simulation
`In contrast, the CEO’s of Hysterical and RJM, both
`
`
`
`
`
`
`
`
`
`in Management Education: A Conceptual Framework
`
`
`
`
`
`
`
`
`companies without CMC,also vanished from their posts.
`
`
`
`
`and Review", Simulation and Games, Val. 20 No. 4,
`Neither returned for the duration of the semester.
`December, 1989. pp. 409-438.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the
`Finally,
`prepare
`students
`CMC helped
`
`
`
`
`
`
`Hsu, Enrico and D. T. Geithman (1988), "Experiential
`end-of-semester summary report. The groups that used
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Learning in Management Education:
`‘Virtual Lab’,
`CMCfor the conduct of their business had the benefit
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Management Games and Group Decision Support
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of a complete record of the individual contributions of
`System,” Proceedings of Sixth World Productivity
`
`
`
`
`
`
`
`
`
`the group members. The preparation of the report was
`Congress, September, 1988, pp. 507-531.
`
`
`
`
`
`
`
`
`
`
`only a matter of editing the contents of the conference,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`while the groups without the benefit of CMC had to
`
`
`
`
`
`
`
`Turoff, Murray; John Foster; Starr Roxanne Hiltz and
`
`
`
`convene several meetings
`to assign the work and
`
`
`
`
`
`Kenneth Ng (1989),
`“The TEIES Design and
`assemble the results.
`
`
`
`
`Objectives: Computer Mediated Communications and
`
`
`
`
`
`
`
`
`
`Tailorability’, Proceedings, Hawaii
`International
`5. Concluding Remarks
`
`Conference on System Sciences, January, 1989, pp
`403-411.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`in
`We have shown that CMC is extremely helpful
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`teaching collaborative skills to management students.
`
`
`
`
`
`
`
`Wolfe, Joseph (1985) "The teaching effectiveness of
`
`
`
`
`
`
`Simulated companies using the Virtual Classroom (R)
`
`
`
`
`
`
`games in collegiate business courses: A 1973-1983
`
`
`
`
`
`
`structures within a computerized conferencing system
`Update," Simulation and Games 16: 251-288.
`
`
`
`
`
`
`
`
`
`significantly
`higher
`profits,
`on
`achieved
`return
`
`
`
`
`
`
`
`investment and return on equity. It also provides a
`
`
`
`
`
`
`
`lifeline to students who become temporarily distracted
`
`
`
`
`
`
`from their class responsibilities. An enhanced CMC
`
`
`
`
`
`
`
`
`
`system (Virtual Management Practices Laboratory or
`
`
`
`
`
`
`
`Virtual Lab for short) with special features, such as
`
`
`
`
`
`
`
`on-line "forms," binary file transfer capability,
`role
`
`
`
`
`
`
`
`
`playing sessions, incoming mail organiz