Project management process models as antecedents for job satisfaction
a comparative analysis of waterfall and scrum
PhD student, Stevens Institute of Technology
Thomas G. Lechler
Associate Professor, Stevens Institute of Technology
This study analyzes conceptual differences between two well-known software development models, Scrum and Waterfall (e.g. agile, and non-agile) as a foundation to compare employee job satisfaction. Current research supports the general claim that agile software development processes are related to higher job satisfaction than non-agile processes. Hypotheses proposing differences in five aspects of job satisfaction (creativity, job security, social status, authority, and responsibility) between the two process models are empirically tested. A sample of 52 software professionals experienced with both process models was collected for this study. Results show that even though the general perception of Scrum is positive, a more differentiated analysis of satisfaction with responsibility, job security, and social status does not offer the same definite answer. Results show that managers are significantly more satisfied with their authority in Waterfall than in Scrum. This highlights the need for differentiated theoretical arguments regarding project management process structures and their influence on various performance criteria.
Keywords: Project process model, Scrum, Waterfall, Job satisfaction
The practice of software development makes use of several competing process models to assure efficient and effective software creation and implementation. The most common process models are Waterfall and Agile. The Scrum model is the most popular implementation of agile. West, Grant, Gerush, & D’Silva, (2010) survey shows that, until 2009, 10.9% of the responding organizations adopted Waterfall in their project and 8.4% adopted Scrum. The Waterfall model entails a sequential process structure laying out the different steps for development and stresses the importance of requirements, which are necessary to clarify project goals (Hass, 2007). The main critique is that the model is inflexible when changes or adjustments of the initial requirements are necessary. The relatively new agile models promise to improve upon the Waterfall shortcoming and are gaining more and more popularity. Agile process models present advantages such as providing higher productivity (Cardozo, Neto, Barza, França, & Silva, 2010) and efficiency (Dingsøyr, Nerur, Balijepally, & Moe, 2012; Li, Moe, & Dyba, 2010; Lindvall, Basili, Boehm, Costa, Dangle, Shull, & Zelkowitz, 2002).
Besides improvements in the outcomes it is widely assumed that agile process models lead to higher employee satisfaction. This assumption is supported by Melnik and Maurer’s (2006) comparative analysis of job satisfaction with agile and non-agile process models. Their results show that twice as many software development team members who are using agile models are satisfied with their jobs versus members using non-agile models. Job satisfaction has been proved to be an important predictor of job performance (Judge, Thoresen, Bono, & Patton, 2001), and organizational outcomes (McFarlin & Sweeney, 1992), and employee voluntary turnover rate (Lambert, Lynne Hogan, & Parton, 2001; Mobley, Griffeth, & Hand, 1979; Price & Mueller, 1986; Williams & Hazer, 1986).
Past research has been instrumental in shedding light on the relation between the employee job satisfaction and different process models but only few studies focus on the Scrum and Waterfall model (Mannaro, Melis, & Marchesi, 2004; Moe, Dingsøyr, & Dybå, 2010). However, these studies do not explore the conceptual differences between Waterfall and Scrum and how they are related to different aspects of employee job satisfaction. However, these differences are key to a better understanding of how job satisfaction is affected. Relying only on general statements about the satisfaction with a specific process model could lead to insufficient conclusions about the choice and implementation of a specific process model, e.g. it is not clear how the structural changes that come along with the Scrum model and their consequences for the leadership roles are related to the job satisfaction of project managers and other managerial positions. A differentiated analysis will also contribute to the theoretical discussions of project management structures and their consequences for outcomes. So far the literature mainly focuses on contingencies and management processes and their impact on project outcomes but consequences of alternative project management structures are rarely addressed.
The structure of our study follows the goal, question, metric (GQM) paradigm (Basili, 1993). Our goals in this research are to reveal how the conceptual differences between the Waterfall and Scrum model are related to job satisfaction. Secondly, we will analyze empirically whether the employee job satisfaction differs between different roles under the Waterfall and Scrum model. Table 1 provides a summary of the GQM approach of this study.
|Reveal how the conceptual differences between Waterfall and Scrum are related to job satisfaction; Analyze empirically whether the employee job satisfaction differs between different roles under the two models|
|Question||Q1||Is there any conceptual difference between Waterfall and Scrum?|
|Metrics||M1||Summarize from past literature and compare the two models conceptually|
|What are the general perceptions of Scrum and Waterfall? Which model is preferred? |
Preference questions rating; Analyzed by Student T-test and Chi-square test
|Question||Q3||Do project teams of Scrum experience higher, similar, or lower job satisfaction in regards to creativity, job security, and social status than Waterfall teams do?|
|Metrics||M3||Minnesota satisfaction questionnaire (MSQ) measure of creativity, job security, and social status; Analyzed by Student T-test|
|Question||Q4||Do project managers and team members using Scrum experience higher, similar, or lower job satisfaction in regards to authority and creativity than in the Waterfall model?|
|Metrics||M4||MSQ measure of authority and responsibility differentiated by roles; Analyzed by Student T-test|
Basic Definitions of Waterfall and Scrum Process Models
The Waterfall model is characterized by linear progression of discrete, consecutive process steps (Bullinger, Fähnrich, & Meiren, 2003). Basic assumptions of the Waterfall model are the following (Ktata & Lévesque, 2009):
- Project requirements are set and fully evolved before the project starts
- No revisit phases
- Stable context
In the Waterfall model, fully stated specifications and requirements are required before the planning starts. And design, development, testing, and deployment are performed in order. Once a phase is completed, it will not be revisited unless that phase fails inspection, review, or testing. This model also assumes that the development environment does not change much before the project is completed. However, clients usually find it quite difficult to completely define all requirements at the beginning of the project. Because of limitations like this, some researchers even pointed, “the Waterfall model is dead” (Boehm, 1988, p. 61).
Agile is a group of process models based on iterative and incremental development to develop software through collaboration between self-managing cross-functional teams (Conboy & Fitzgerrald, 2004; Fowler & Highsmith, 2001). The Scrum model is the most popular implementation of agile models (West et al., 2010). Basic assumptions of Scrum based on past literature can be summarized:
- Requirements always evolve due to the technology changes, customer’s need changes, and etc. (Turk, France, & Rumpe, 2005)
- Iterative project development processes (Schwaber, 1995)
The flexible, lightweight, and iterative process enables Scrum to embrace changes and survive in an unpredictable environment. Customers don’t need to worry about the disadvantages that requirement changes bring to projects. This is one of the major reasons why Scrum is gaining popularity in the rapidly changing and developing software industry.
The Scrum life-cycle model is composed of five distinct Scrum activities: the kickoff, the sprint planning meeting, the sprint, the daily Scrum, and the sprint review meeting (Cervone, 2011; Schwaber, 2010; Schwaber & Beedle 2002). These five activities are briefly introduced below. Figure1 presents the Scrum life-cycle model.
- The kickoff is a meeting in which the product owner defines and introduces the high-level backlog and the major project goals to the Scrum team and Scrum Master.
- The Sprint planning meeting takes place at the beginning of each Sprint. In the first part of the meeting, the product owner presents and discusses the product backlog (a prioritized requirements list for the project) with the Scrum team (the Scrum Master is considered as a member of the Scrum team). In the second part, the Scrum team determines the sprint goal, and creates the sprint backlog.
- The sprint is an iteration cycle of two to four weeks in which the functionality of the product is further developed. The product development processes such as development, testing, and adjustment happen in the sprint phase in an unpredictable and uncontrolled way (Schwaber, 1995).
- The daily Scrum is a meeting, which is held by the Scrum Master every day for less than 15 minutes, aimed at tracking the progress of project, improving communications between the Scrum team members.
- The Sprint review meeting is held at the end of each sprint, in which the Scrum team demonstrates the product to the product owner.
Conceptual Differences Between Waterfall and Scrum Process Models
In the next section, we will compare conceptual differences between the Waterfall and Scrum model in the following perspectives:
- Execution and Monitoring & Controlling perspective
- Role perspective
- Project context perspective
According to A Guide to the Project Management Body of Knowledge (PMBOK® Guide) – Fifth Edition, Planning, Execution, Monitoring and Controlling are the core project management processes. Figure 2 compares the basic software development phases of the Waterfall and the Scrum model to project management processes (D. Fernandez & J. Fernandez’s, 2008).
The planning process in the Waterfall model occurs up front, at the beginning of each project. The detailed planning phase consumes a considerable amount of time. A significant amount of requirements documentations are produced in this phase (Boehm, 1988; Hass, 2007). The plan developed in the planning phase applies to the entire project. The work breakdown structure (WBS) is an important planning tool, which breaks a project down into subprojects, tasks, subtasks, working packages, and so forth (Tausworthe, 1980). It is a must for the Waterfall model to structure the whole project, provide foundations for time and cost estimating, and monitor project status (Koskela & Howell, 2001 and 2002; PMI, 2013).
The planning in the Scrum model occurs in every Sprint based on the refined product backlog. Detailed plan for each Sprint will only be made in the Sprint planning meeting by Scrum teams (Cervone, 2011). This also helps to avoid problems that plan changes bring during the project development. The project duration and cost will not be settled in planning process and will change during the project implementation.
In the Scrum model, three artifacts together fulfill the function of the WBS. They are the product backlog, the Sprint backlog, and burn down chart. The product backlog is a prioritized requirements list for the project. The Sprint backlog is the subset of product backlog items, which are defined as the work for a particular Sprint (Figure 1). The burn down chart is a detailed tasks list to instruct how many tasks need to be done and depict the total backlog hours remaining in the Sprint. Even though the three artifacts of Scrum accomplish the function of the WBS, there are still some differences between the WBS and Scrum artifacts. First, the WBS seldom changes during the project, but the product backlog needs to be updated continuously by the product owner. Secondly, unlike Waterfall, the cost and duration estimation in Scrum is only accurate in the current Sprint based on the Sprint backlog and burn down chart (Cervone, 2011).
Execution and Monitoring & Controlling Perspective
In the Waterfall model, the project development phases are performed in a linear finish-to-start sequence (Boehm, 1988; Schwaber, 1995; Boehm & Turner, 2003). Once a phase is finished, it will not be revisited. Formal information distribution methods are utilized, such as emails. Project managers are responsible for the decision-making. Team members develop the product by following project managers’ command and control.
In the Scrum model, functions of the product are developed incrementally through Sprints (Schwaber, 1995). The daily Scrum meeting helps control the progress of the project. Contrary to the Waterfall model, Scrum mainly relies on the informal face-to-face communication to distribute information. Face-to-face communication is a richer media than any type of former computer based communication (Barkhi & Pirkul, 1999). Also face-to-face communication helps to reduce the cost of moving information from people to people, to improve communication efficiency, and to contribute quicker responses to the environment (Barkhi & Pirkul, 1999). Command and control is substituted by cooperation and collaboration between members. The Scrum team is entitled to make technical decisions without the involvement of management.
In projects that use the Waterfall model, there are two major roles, project managers and team members. Teams in the Waterfall model are manager-led teams, in which project managers divide projects into segments and assign them to relevant functional individuals (Larson & Gobeli, 1989). Therefore, team members are responsible only for the execution of assigned work (Hackman, 1987).
Scrum implements the iterative, incremental practices through three roles: the product owner, the Scrum Master, and the Scrum team. The product owner is a functional unit manager who is responsible for representing the interests of all parties in the project and its resulting product. Only the product owner is responsible for managing and controlling the product backlog. The Scrum Master is a new management role, whose major role is to enable the Scrum practices and processes (Cervone, 2011). The Scrum Master is also a member of the Scrum team. Besides enabling the Scrum practices and processes, the Scrum Master also needs to participate in the development process like the other Scrum team members. The team leader, or project leader, often assumes the Scrum Master role. In some industry practice, Scrum team members could also take turns to become the Scrum Master. The Scrum team typically is a self-managing team consisting of five to ten people who work on the project in the same location. The team is responsible for developing products by following the product backlog and Spring backlog. In the self-managing Scrum teams, leadership role within the team is not fixed, and team members take on responsibilities to regulate tasks by themselves (Cohen, Ledford, & Spreitzer, 1996). Teamwork is exclusively important for the success of the project. Managers have to relinquish some of their authorities to the Scrum team. The agility self-managing teams need to have a common focus, mutual trust, and be in charge of the collaborative decision-making process (Cockburn & Highsmith, 2001).
Project Context Perspective
In the current industry, software technologies are frequently and rapidly evolving. In such an unstable and flexible environment, it is quite hard for customers to fully state requirements at the beginning of projects. However, the Waterfall model is built based on the assumption of a fully developed requirements list from customers before the project development, and a relatively stable development environment. That’s one of the reasons that Waterfall has been losing popularity in software development projects.
In the Scrum model, functions of the project are developed incrementally through each Sprint, and a detailed plan is only made for the current Sprint. Therefore, changes in plan, including requirement changes or technology updates, can be easily applied and do not interrupt the current functions development. Thus, the plan changes are welcomed as opportunities to satisfy customers’ needs and improve the product (Turk et al., 2005). Therefore, the Scrum model is more likely to be applied in an uncertain, unpredictable, flexible environment.
Based on the comparison between the Waterfall and Scrum model from four perspectives, we are proposing that the Waterfall or Scrum model is closely linked with employee job satisfaction, which is the dependent variable in our model.
Job satisfaction refers to “an overall affective orientation on the part of individuals toward work roles which they are presently occupying” (Kalleberg, 1977, p. 126). The Minnesota satisfaction questionnaire (MSQ) is a well-established questionnaire to test the employee job satisfaction, in which 20 aspects of job satisfaction are measured1 (Weiss, Dawis, & England, 1967). The theoretical foundation of MSQ is the theory of work adjustment, which is about the relationship between the individual and his or her work environment (Dawis, Lofquist, & Weiss, 1968). Since MSQ measures satisfaction with specific aspects of work, it is feasible to obtain a more individualized picture about which aspects of work an employee is satisfied with. In this paper, we focus our research on the following 5 out of the 20 MSQ aspects: creativity, job security, social status, authority, and responsibility. These 5 aspects are selected because they are directly related to the conceptual differences between the Waterfall and Scrum model (Table 2). For the remaining MSQ aspects no significant differences between the two models are expected.
|Aspects||Waterfall||Scrum||Impact aspect of job satisfaction|
|Management method||Manager-led through command and control||Self-managing through cooperation and collaboration, relay heavily on team work||Authority |
Creativity Social Status
|Management structure (Power structure)||Hierarchy (Top-down)||Team based (team participates in decision-making process)||Authority Responsibility Social Status|
|Project Context||Stable||Flexible||Creativity Job security|
Satisfaction with Creativity
Individual creativity is the ability to identify new ways, and to transform subjective understanding into new actions (Joas, 1996). Interactions between individuals with different attitudes are argued to facilitate innovations. And teamwork can foster interactions between individuals. Therefore, Sacchetti and Tortia (2013) indicate that satisfaction with creativity at the work place is enhanced by the teamwork. The Scrum model is characterized by teamwork and cooperation. Furthermore, this model is typically used in a highly turbulent, unpredictable, and changing software development environment, which also fosters innovation and creativity (West & Farr, 1990). However, compared with the Scrum, the Waterfall model does not contain these qualities to foster creativity. Hence, based on the indications mentioned above, the hypothesis is as follows:
H1: Compared to the Waterfall model, the Scrum model is associated with a higher satisfaction with creativity.
Satisfaction with Job Security
Greenhalgh and Rosenblatt (1984) defined job insecurity as “perceived powerlessness to maintain desired continuity in a threatened job situation” (p. 438). Probst (2002) described job security as the perceived stability and continuance of an individual’s job as he or she knows it. For the individual, feeling insecure about the job may have detrimental effects on employee well-being and job satisfaction. Hartley, Jacobson, Klandermans, and Van Vuuren (1990) even suggested job insecurity as one of the most important stressors in the employment situation. Hence, studying the job security satisfaction will be significantly meaningful.
Probst (2003) argued that job technology changes are one of the antecedents of job insecurity. And job insecurity also causes low job security satisfaction. Therefore, there is a distinct relationship between technology changes in job and job security satisfaction. The Scrum model is frequently used in an uncertain, unpredictable, and changing environment, which requires more frequent technology updates. This unstable project environment is more likely to bring a sense of insecurity about one’s job, which is also related to low satisfaction with job security. Therefore,
H2: Compared to the Waterfall model, the Scrum model is associated with a lower satisfaction with job security.
Satisfaction with Social Status
The power structure in Scrum is different from Waterfall. In a self-managing team, members do not need to follow managers’ instruction and control all the time. Even though they do not get promoted, the participation in the decision-making process makes them feel more important. This virtually increases the social status of members in Scrum. We expect that people’s satisfaction level with social status is higher when they possess higher social status. Therefore:
H3: Compared to the Waterfall model, the Scrum model is associated with a higher satisfaction with social status.
Satisfaction with Authority
Authority involves power over someone or something. Individual’s authority plays an important role in his or her job satisfaction. There is a positive relationship between the authority a person holds and his or her job satisfaction (Bavendam, 2000). Adequate authority is an important factor that leads to job satisfaction (Muindi, 2011). Eimers (1997) demonstrated that the lack of authority in work can seriously mitigate job satisfaction in this aspect.
In the self-managing Scrum teams, managers have to relinquish their power over the project. That means managers have less authority. Since managers are not naturally willing to give up their authority (Hoda, Noble, & Marshall, 2013; Nerur, Mahapatra, & Mangalaraj, 2005), their satisfaction with authority in Scrum will decrease. On the other hand, in the self-managing Scrum team, members possess more decision-making rights than before, which gives them more power over the project. Additionally, the flexible environment requires giving the Scrum team members more authority to cope with it (Goldman, Nagel, & Preiss, 1995). In this research, we consider Scrum team members and programmers in Waterfall as “members,” product owners, Scrum Masters, project managers, and some higher management roles such as vice presidents, directors and so forth as “managers”. Therefore, based on the above analysis, the job satisfaction with authority depends on the employee’s role (members, managers) in the Waterfall and Scrum model.
H4a: Compared to the Waterfall model, the Scrum model is associated with a higher satisfaction with authority for members.
H4b: Compared to the Waterfall model, the Scrum model is associated with a lower satisfaction with authority for managers.
Satisfaction with Responsibility
Responsibility is the individual’s liability and accountability for the job that he or she performs (Oosthuizen, 2001), and the awareness of the consequence of his or her own actions (Schwartz, 1968). Cooper, Rout, and Faragher (1989) implied that the highest level of satisfaction is reported for the amount of responsibility given in work.
Participating in the decision-making process helps individuals to develop a higher sense of responsibility, and makes them more satisfied (Asproni, 2004). According to Muindi (2011), participating in a decision-making process can help to satisfy one’s need for achievement, and provide recognition and responsibility. Therefore, the Scrum teams’ decision-making ability empowers them with more responsibilities. Relatively, managers in the Scrum model don’t need to participate in technical related decision-making process compared with the Waterfall model. Based on McGregor’s (2006) Theory Y, the average individual is not only accepting but also seeking responsibility. Thus, managers should not be satisfied when their responsibilities are taken away. Therefore, the job satisfaction with responsibility depends on the employee’s role (members, managers) in the Waterfall and Scrum model.
H5a: Compared to the Waterfall model, the Scrum model is associated with a higher satisfaction with responsibility for members.
H5b: Compared to the Waterfall model, the Scrum model is associated with a lower satisfaction with responsibility for managers.
For this paper, we employed a survey approach to study the job satisfaction differences between the Waterfall and Scrum model. The survey approach is useful in accurately documenting the norm, identifying extreme outcomes, and delineating relationships between variables in a sample (Fowler, 2009; Gable, 1994).
First, a pilot survey was conducted by sending a questionnaire to five professionals who have both Waterfall and Scrum working experience. All five responses were completed and returned to us and served as a basis to revise and improve the questionnaire. In the second step we distributed the revised questionnaire to employees of two US software companies and participants of an industry conference about software project process models in Canada. Based on the data provided by the Hofstede Centre, the 6-D data of the United States and Canada are very similar2, which indicates that the US culture and Canadian culture are alike. Therefore we decided to conduct our survey in both countries the United States and Canada because they are culturally similar and can generally represent North America. We received 52 completed and qualified surveys. In order to qualify, respondents had to have both Waterfall and Scrum working experience. Since a portion of the questionnaires were sent out via a web platform, it is impossible to calculate the exact response rate.
The questionnaire consists of three sections: role and experience background, general perception and preference, and job satisfaction.
The role and experience background questions of the first section focus on the respondent’s experience in both the Waterfall and the Scrum model. Gathering data about the respondent’s experience will help us to evaluate whether the respondent’s job satisfaction toward the Waterfall and the Scrum model is in fact a result of his or her actual experience. Figure 3 shows the respondents’ background with Waterfall and Scrum as percentage. The median of the Waterfall experience participants have is 3–5 years, and the median of the Scrum experience participants have is 1–2 years. Figure 4 shows the respondent’s role. In this study, we categorize respondents with the title of vice president, director, project manager, product owner, and Scrum Master as the “managers” group; we categorize Scrum member and programmer as the “members” group. The “others” category contains respondents from consulting, testing, and strategy departments. Over half of the respondents are from the “members” group, and around 30% of the respondents are from the “managers” group, as shown in Figure 4.
In the general perception and preference part, three sets of statements are presented to the respondents (Table 3, Table 4). In the general perception statements in Table 3, the respondents are asked questions about their opinions regarding the two models, such as whether they think the Scrum model is more fun to work with. A seven item Likert scale is used here, ranging from 1=Totally Disagree to 7= Totally Agree. In the preference statements in
Table 4, respondents are asked to directly answer if they prefer the Waterfall or Scrum, or have no preference.
In the job satisfaction part, 25 questions of the MSQ scales are presented to measure the employee job satisfaction with authority, creativity, responsibility, job security, and social status3. A five item Likert scale ranging from 1=Very Dissatisfied to 5= Very Satisfied is used to collect data in this part. Each job satisfaction scale consists of five equal-weighted questions. The respondents are asked job satisfaction questions twice, the first time based on their Waterfall working experience, and then based on their Scrum working experience. By collecting the job satisfaction responses for each process model separately from the same person, we could eliminate individual differences sampling error.
Data Analysis Method
In this study, we utilize a Chi-squared test to analyze respondents’ preferences about the Waterfall and Scrum model. The null hypothesis states that the number of respondents who prefer Scrum is equal to the number of respondents who prefer Waterfall. Additionally, we employ a student T-test to assess whether the employee job satisfaction in the Waterfall model are significantly different from the satisfaction in the Scrum model. T-test assumes that two sets of data should be the same.
Data Analysis and Results
General Perception and Preference
The general perceptions of the Scrum and Waterfall model are captured through three sets of questions in the questionnaire. This part answers Q2 in Table 1, which is “what are the perceptions of Scrum and Waterfall? Which model is preferred?”
Table 3 presents two sets of statements and statistic and test results. As can be seen, the Waterfall model scored below “Neutral” (1=Totally Disagree, 4= Neutral, 7= Totally Agree) in both statements, and the Scrum model scores higher than the Waterfall. The T-test result also illustrates that every two sets of data are significantly different. Therefore, it can be concluded that the respondents believe that the Scrum model is more fun to work with, and it also enables lower error rate and the earlier detection of errors.
|Opinion statements and statistics, N = 52||Mean||Standard deviation||T-test|
|Waterfall is more fun to work with||3.49||1.54||7.50E-10**|
|Scrum is more fun to work with||5.47||1.39|
|Waterfall enables lower error rate and earlier detection of errors||3.02||1.64||7.50E-11**|
|Scrum enables lower error rate and earlier detection of errors||5.46||1.54|
Notes: * p< 0.05, ** p<0.01
|Chi-square analysis||Which one do you prefer to work with||Partial model |
|Which one enables better results||Partial model |
|Scrum||36||p=2.4 e-5 **||30||p=0.00077**|
|Total model Chi-square statistics||X2=3.2||p=0.2|
Notes: * p< 0.05, ** p<0.01
Table 4 shows the statements and results of the preference questions. Here, the respondents are asked to choose directly from Waterfall, Scrum, and no preference. The Chi-square results show that the response distributions of both questions are indifferent (p=0.2>0.05). And significantly more respondents prefer Scrum to Waterfall (p-values of both questions are less than 0.01). Hence, the majority of the respondents prefer to work with Scrum and believe that Scrum enables better results than the Waterfall does.
Non-Role-Depended Job Satisfaction Aspects
Based on our previous analysis, the job satisfaction with creativity, job security, and social status do not depend on the employee’s role (members, managers). We calculate the mean job satisfaction and standard deviation in these three aspects and conduct the Student T-test. Results are presented in Table 5 and Figure 5. This part is in response to Q3 in Table 1.
|Aspects||Mean||Standard deviation||Mean||Standard deviation||P-value|
|Job Security (H2)||3.34||0.56||3.4||0.55||0.6|
|Social Status (H3)||3.35||0.69||3.53||0.61||0.18|
Notes: * p< 0.05, ** p<0.01
- Creativity: H1 proposes higher satisfaction with creativity in Scrum. The result shows that the respondents’ satisfaction with creativity in Scrum is significantly higher than Waterfall (p<0.05). Therefore, H1 is supported.
- Job Security: H2 proposes that satisfaction with job security should be lower in Scrum than Waterfall. However, the respondents’ mean satisfaction with job security in Scrum is actually higher than Waterfall, according to the result. Therefore, H2 is not supported.
- Social Status: H3 proposes higher satisfaction with social status in Scrum than Waterfall. The respondents’ mean satisfaction with social status in Scrum is higher than Waterfall. However, the result is not significant (p=0.18 >0.05). Thus, H3 is not supported.
Role-Depended Job Satisfaction Aspects
As we stated before, the job satisfaction with authority and responsibility depends on the employee’s role (members, managers). Therefore, in this section, we analyze members and managers’ job satisfaction in the perspective of authority and responsibility. This part is in response to Q4 in Table 1.
|Aspect (N=52)||Waterfall experience||Scrum experience||T test|
|Mean||Standard deviation||Mean||Standard deviation||P-value|
|Authority- Members (H4a)||3.27||0.90||3.29||0.87||0.46|
|Responsibility- Members (H5a)||3.44||0.88||3.55||0.84||0.21|
|Responsibility- Managers (H5b)||4.05||0.35||3.90||0.46||0.24|
Notes: * p< 0.05, ** p<0.01
Figure 6 exhibits the mean satisfaction with authority aggregated by roles in the Waterfall and Scrum model. The results in Table 6 show that members feel slightly more satisfied with authority when using the Scrum. But the results are not significant (p=0.46 >0.05). Therefore, H4a is not supported. However, managers’ satisfaction level with authority is significantly lower in Scrum than Waterfall (p<0.05). Therefore, H4b is supported.
Figure 7 demonstrates the mean satisfaction with responsibility aggregated by roles in the Waterfall and Scrum model. The results show that members are more satisfied with responsibility in Scrum than Waterfall, as H5a proposed. However, the result is not significant (p=0.21 >0.05). Thus, H5a is not supported. And the managers’ satisfaction with responsibility is lower in Scrum than Waterfall, as H5b proposes. Nevertheless, the result is not significant (p=0.24 >0.05). Therefore, H5b is not supported as well.
Since H4b and H5b are all not supported by statistics results, it is still not clear whether Scrum is associated with higher satisfaction with authority and responsibility for members than Waterfall does.
The Waterfall and Scrum are two different kinds of process models: the former is represented by a rigid and stable process sequence, and the latter is represented by an iterative and more flexible sequence of processes. After studying the conceptual differences between Waterfall and Scrum, we want to discuss some “mysteries” of the two models.
Higher Job Satisfaction in General Does Not Mean Higher Job Satisfaction in All Aspects
Melnik and Maurer (2006) indicated that agile models are related to higher job satisfaction than non-agile models. Since Scrum is an implementation of agile, we conclude that Scrum also relates to a higher job satisfaction. However, when we look into detailed aspects of job satisfaction, the relation may not stand. Out of the seven hypotheses proposing differences in the job satisfaction between the two models, only two are supported. Therefore, even though Scrum is favored by respondents and provides higher job satisfaction in general, the impact that Scrum has on satisfaction with responsibility, security, and social status are unclear.
Programmer-Oriented vs. Manager-Centric
Industry practitioners believe that agile is programmer-oriented. Therefore, we expect that members should have higher job satisfaction in role-depended aspects, such as authority and responsibility, in Scrum than Waterfall. And the conceptual analysis in this study also indicates that members of Scrum teams possess more authority and responsibility compared to Waterfall. However, results show that Scrum is not significantly related to higher job satisfaction with authority and responsibility for members. This is may be because the respondents’ Scrum experience is not very long (median is 1–2 years), and they haven’t gotten used to the authority and responsibility they obtained in Scrum. Additionally, Waterfall is associated with higher satisfaction with authority for managers, compared to Scrum. This supports the point that Scrum is not a manager-centric model.
Scrum Is Not Always “Perfect”; Waterfall Is Not “Dead”
Based on our research, Scrum is a more popular process model than Waterfall. In the software industry, Scrum is in the mainstream adoption phase (Salo & Abrahamsson, 2008; West et al., 2010). And some people from software industry even predict that agile will completely overtake Waterfall by the next several decades.
Although moving from a hierarchical approach to a flexible collaborative approach is the global trend in software corporations, Waterfall is still a very important process model in managing software projects. Waterfall provides the basis for most government software standards. In small software projects where requirements can be fully stated, Waterfall is still the most efficient way to proceed. Besides, Waterfall is optimal to develop some classes of software, for example, compilers, secure operating systems, and information systems (Boehm, 1988). In this study, Waterfall also presents a merit by providing higher satisfaction with authority for managers.
Moreover, outsourcing plays an important role in today’s software industry. It is common now that software companies outsource some function packages to third party contractors. Companies in industries other than software even offshore outsource their IT department to low-wage countries in order to cut cost. In the Waterfall model, software development teams can work by themselves once the requirements have been completely documented. Hence, it does not matter where the members of development team are located, thus provides the context for outsourcing. Unlike Waterfall, Scrum is a team-based process model that requires members to work in the same location in order to enhance the face-to-face communication efficiency. But this requirement also constrains Scrum from outsourcing, even though some researchers argue that with some adjustments the Scrum process could be used for distributed and even outsourced teams (Sauer, 2006; Sutherland, Viktorov, Blount, & Puntikov, 2007). However, the outsourcing they discussed is still in a very small range and has many restrictions.
What About the Applicability beyond the Software Domain?
The Waterfall model originates from the manufacturing and construction industries, where requirements of products or projects must be fully stated before the manufacture or construction process starts. Also, the development processes have to follow a certain order, otherwise they will lead to failure. Based on the iterative nature of the Scrum model, it is quite hard to extend the application to other industries. Researchers argue that construction projects can apply agile ideas to facilitate possible solutions to complex and uncertain requirements (Owen, Koskela, Henrich, & Codinhoto, 2006). However, the application is still limited in the pre-design and design phase. Therefore, the applicability of Scrum in other industry domains is still unknown.
Do Not Adopt Scrum Just Because It Is Popular
For some corporations, the motivations to adopt Scrum are not clear. Some industry practitioners even stated that they adopted Scrum because it is popular, because everyone else is using it. Even though industry reports and empirical studies are showing that Scrum is helpful in achieving better results for some corporations, we still need to fully understand the limitations and constraints, and be certain about why we need to switch to Scrum before adopting it.
Our research analyzed the conceptual differences between the Waterfall and Scrum model, and proposed relationships between process models and job satisfaction with seven hypotheses.
The limitations of this research are related to the empirical part. The current sample size is not very large. It only consists of 52 copies of completed and qualified questionnaires. This limits the use of different statistical procedures and the significance of the results. However, the results for the general satisfaction with both models are similar to other empirical studies, allowing us to assume that we were able to receive a representative sample.
The results of this study show that the general perception of Scrum is positive. Employees prefer to work with Scrum rather than Waterfall. And compared with Waterfall, Scrum is associated with higher satisfaction with creativity. However, among the seven hypotheses we proposed, only two hypotheses are supported with statistical significance at p<0.05. This means that even though some studies proved that agile is related to higher general job satisfaction, the relationship between Scrum and satisfaction with responsibility, job security, and social status is still not well understood. In addition, we find that managers are significantly more satisfied with authority in Waterfall than in Scrum. This also supports the point that Scrum is not a manager-centric model. Lastly, both Scrum and Waterfall have their own special home groundings in which one works the best, whereas the other has difficulties. Thus practitioners need to understand which model works best for them rather than follow others and adopt the popular one.
The results suggest some directions for future research. The satisfaction differences between the Waterfall and the Scrum model demonstrate the need to better understand the underlying process structures of projects. The process types and their sequences seem to play an important role for the project outcomes. We identified in this study the conceptual differences between the Scrum and the Waterfall model that could serve as a starting point to analyze contingencies of project process structures and help to develop managerial decision models for choosing the most appropriate structure under a given set of contingencies. This discussion would directly support the effort to develop a contingency theory for project management models.
Asproni, G. (2004). Motivation, teamwork, and agile development. Agile Times, 4(1), 8–15.
Barkhi, R., & Pirkul, H. (1999). An experimental analysis of face to face versus computer mediated communication channels. Group Decision and Negotiation, 8(4), 325–347.
Bavendam, J. (2000). Managing job satisfaction. Bavendam Research Incorporated, Special Reports, 6. Retrieved from http://www.bavendam.com/pdf/specialreportsvol6.pdf
Basili, V. R. (1993). Applying the goal/question/metric paradigm in the experience factory. Software Quality Assurance and Measurement: A Worldwide Perspective, 7(4), 21–44.
Boehm, B. W. (1988). A spiral model of software development and enhancement. Computer, 21(5), 61–72. doi:10.1109/2.59
Boehm, B., & Turner, R. (2003). Balancing agility and discipline: A guide for the perplexed. Boston, MA: Addison Wesley
Bullinger, H. J., Fähnrich, K. P., & Meiren, T. (2003). Service engineering—Methodical development of new service products. International Journal of Production Economics, 85(3), 275–287.
Cardozo, E., Neto, J. B. F. A., Barza, A., França, A., & da Silva, F. (2010, April). SCRUM and Productivity in Software Projects: A Systematic Literature Review. In Proceedings of 14th International Conference on Evaluation and Assessment in Software Engineering (EASE). Keele University, UK.
Cervone, H. F. (2011). Understanding agile project management methods using Scrum. OCLC Systems and Services, 27(1), 18–22. doi:http://dx.doi.org/10.1108/10650751111106528
Cockburn, A., & Highsmith, J. (2001). Agile software development, the people factor. Computer, 34(11), 131–133. doi:10.1109/2.963450
Cohen, S. G., Ledford, G. E., & Spreitzer, G. M. (1996). A predictive model of self-managing work team effectiveness. Human relations, 49(5), 643–676.
Conboy, K., & Fitzgerald, B. (2004). Toward a conceptual framework of agile methods: A study of agility in different disciplines. In 2004 ACM Workshop on Interdisciplinary Software Engineering Research (pp. 37–44). New York, NY, USA: ACM. doi:10.1145/1029997.1030005
Cooper, C. L., Rout, U., & Faragher, B. (1989). Mental health, job satisfaction, and job stress among general practitioners. BMJ : British Medical Journal, 298(6670), 366–370.
Dingsøyr, T., Nerur, S., Balijepally, V., & Moe, N. B. (2012). A decade of agile methodologies: Towards explaining agile software development. Journal of Systems and Software, 85(6), 1213–1221. doi:10.1016/j.jss.2012.02.033
Eimers, M. T. (1997). The role of intrinsic enjoyment in motivating faculty. Thought & Action, 13(2), 125–42.
Fernandez, D. J., & Fernandez, J. D. (2008). Agile project management—Agilism versus traditional approaches. The Journal of Computer Information Systems, 49(2), 10–17.
Fowler, F. J. (Ed.). (2009). Survey research methods (Vol. 1). Thousand Oaks, CA: Sage Publishing, Inc.
Fowler, M., & Highsmith, J. (2001). The agile manifesto. Software Development, 9(8), 28–35.
Gable, G. G. (1994). Integrating case study and survey research methods: An example in information systems. European Journal of Information Systems, 3(2), 112–126.
Goldman, S. L., Nagel, & Preiss. (1994). Agile competitors and virtual organizations: Strategies for enriching the customer. UK: Van Nostrand Reinhold
Greenhalgh, L., & Rosenblatt, Z. (1984). Job insecurity: Toward conceptual clarity. Academy of Management Review, 9(3), 438–448. doi:10.5465/AMR.1984.4279673
Hackman, J. R. (1987). The design of work teams. In J. W. Lorsch (Ed.), Handbook of organizational behavior (pp. 315-342). Englewood Cliffs, NJ: Prentice Hall.
Hass, K. B. (2007). The blending of traditional and agile project management. PM world today, 9(5), 1–8.
Hartley, J., Jacobson, D., Klandermans, B., & Van Vuuren, T. (1990). Job insecurity: Coping with jobs at risk. Thousand Oaks, CA: Sage Publications Ltd.
Hoda, R., Noble, J., & Marshall, S. (2013). Self-Organizing roles on agile software development teams. IEEE Transactions on Software Engineering, 39(3), 422–444. doi:10.1109/TSE.2012.30
Joas, H. (1996). The creativity of action. Chicago, IL: University of Chicago Press.
Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001). The job satisfaction–job performance relationship: A qualitative and quantitative review. Psychological Bulletin, 127(3), 376–407.
Kalleberg, A. L. (1977). Work values and job rewards: A Theory of job satisfaction. American Sociological Review, 42(1), 124–143. doi:10.2307/2117735
Koskela, L. J., & Howell, G. (2001). Reforming project management: The role of planning, execution and controlling. In Proceedings of 9th International Group for Lean Construction Conference (pp. 185–198). National University of Singapore. Retrieved from http://usir.salford.ac.uk/9384/
Koskela, L., & Howell, G. (2002). The Theory of Project Management: Explanation to Novel Methods. In International Group for Lean Construction 10th Annual Conference (IGLC-10). International Group for Lean Construction. Retrieved from http://ljk.sdpublishing.org.uk/wp-content/uploads/downloads/2011/10/Theory-of-Project-Management-Explanation-to-Novel-Methods-Koskela-Howell.pdf
Ktata, O., & Lévesque, G. (2009). Agile Development: Issues and Avenues Requiring a Substantial Enhancement of the Business Perspective in Large Projects. In Proceedings of the 2nd Canadian conference on computer science and software engineering (pp. 59-66). ACM.
Lambert, E. G., Lynne Hogan, N., & Barton, S. M. (2001). The impact of job satisfaction on turnover intent: A test of a structural measurement model using a national sample of workers. The Social Science Journal, 38(2), 233–250. doi:10.1016/S0362-3319(01)00110-0
Larson, E. W., & Gobeli, D. H. (1989). Significance of project management structure on development success. Engineering Management, IEEE Transactions, 36(2), 119–125.
Li, J., Moe, N. B., & Dybå, T. (2010, September). Transition from a Plan-Driven Process to Scrum: A Longitudinal Case Study on Software Equality. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (p. 13). ACM, Bolzano, Italy.
Lindvall, M., Basili, V., Boehm, B., Costa, P., Dangle, K., Shull, F., & Zelkowitz, M. (2002). Empirical Findings in Agile Methods. In Proceedings of Extreme Programming and Agile Methods—XP/Agile Universe 2002 (pp. 197–207). Berlin, Heidelberg: Springer.
Mannaro, K., Melis, M., & Marchesi, M. (2004). Empirical Analysis on the Satisfaction of it Employees Comparing XP Practices with other Software Development Methodologies. In Proceedings of Extreme Programming and Agile Processes in Software Engineering (pp. 166–174). Berlin, Heidelberg: Springer.
McFarlin, D. B., & Sweeney, P. D. (1992). Research notes. Distributive and procedural justice as predictors of satisfaction with personal and organizational outcomes. Academy of Management Journal, 35(3), 626–637.
McGregor, D. (2006). The human side of enterprise. Annotated edition. New York, NY: McGraw Hill Professional.
Melnik, G., & Maurer, F. (2006). Comparative Analysis of Job Satisfaction in Agile and Non-Agile Software Development Teams. In Proceedings of Extreme Programming and Agile Processes in Software Engineering (pp. 32–42). Berlin, Heidelberg: Springer.
Mobley, W. H., Griffeth, R. W., Hand, H. H., & Meglino, B. M. (1979). Review and conceptual analysis of the employee turnover process. Psychological Bulletin, 86(3), 493–522. doi:10.1037/0033-2909.86.3.493
Moe, N. B., Dingsøyr, T., & Dybå, T. (2010). A teamwork model for understanding an agile team: A case study of a Scrum project. Information and Software Technology, 52(5), 480–491.
Muindi, F. K., (2011). The relationship between participation in decision making and job satisfaction among academic staff in the School of Business, University of Nairobi. Journal of Human Resources Management Research. 2011. doi: 10.5171/2011.246460
Nerur, S., Mahapatra, R., & Mangalaraj, G. (2005). Challenges of migrating to agile methodologies. Communications of the ACM, 48(5), 72–78. doi:10.1145/1060710.1060712
Oosthuizen, T. F. J. (2001). Motivation influencing worker performance in a technical division of Telkom SA. Acta Commercii, 1(1), 19–30.
Owen, R., Koskela, L. J., Henrich, G., & Codinhoto, R. (2006, July). Is Agile Project Management Applicable to Construction? In Proceedings of the 14th Annual Conference of the International Group for Lean Construction (pp. 51–66). Santiago, Chile.
Project Management Institute. (2013). A guide to the project management body of knowledge (PMBOK® guide) – Fifth edition. Newtown Square, PA: Author.
Price, J. L., & Mueller, C. W. (1986). Absenteeism and turnover of hospital employees. Greenwich, Connecticut: JAI Press.
Probst, T. M. (2002). The impact of job insecurity on employee work attitudes, job adaptation, and organizational withdrawal behaviors. In J. M. Brett & F. Drasgow (Eds.), The psychology of work: Theoretically based empirical research (pp. 141–168). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Probst, T. M. (2003). Development and validation of the job security index and the job security satisfaction scale: A classical test theory and IRT approach. Journal of Occupational and Organizational Psychology, 76(4), 451–467. doi:10.1348/096317903322591587
Sacchetti, S., & Tortia, E. C. (2013). Satisfaction with creativity: A study of organizational characteristics and individual motivation. Journal of Happiness Studies, 14(6), 1789–1811. doi:10.1007/s10902-012-9410-y
Salo, O., & Abrahamsson, P. (2008). Agile methods in European embedded software development organisations: A survey on the actual use and usefulness of Extreme Programming and Scrum. Software ,IET, 2(1), 58–64.
Sauer, J. (2006, August). Agile Practices in Offshore Outsourcing–An Analysis of Published Experiences. In Proceedings of the 29th Information Systems Research Seminar in Scandinavia, IRIS (pp. 12–15). Helsingoer, Denmark.
Schwaber, K. (1995). Scrum Development Process. In Proceedings of OOPSLA’95 Workshop on Business Object Design and Implementation, (pp. 117–134).
Schwaber, K. (2010). What is scrum. Retrieved from http://www.scrumalliance.org/system/resource/file/275/whatIsScrum.pdf
Schwaber, K., & Beedle, M. (2002). Agile software development with Scrum. Upper Saddle River, NJ: Prentice Hall.
Schwartz, S. H. (1968). Words, deeds and the perception of consequences and responsibility in action situations. Journal of Personality and Social Psychology, 10(3), 232–242. doi:10.1037/h0026569
Sutherland, J., Viktorov, A., Blount, J., & Puntikov, N. (2007). Distributed Scrum: Agile Project Management with Outsourced Development Teams. In Proceedings of the 40th Annual Hawaii International Conference on System Sciences, HICSS, (pp. 274a-274a). Hawaii, USA
Tausworthe, R. C. (1980). The work breakdown structure in software project management. Journal of Systems and Software, 1, 181–186.
Turk, D., Robert, F., & Rumpe, B. (2005). Assumptions underlying agile software-development processes. Journal of Database Management (JDM), 16(4), 62–87.
Dawis, R. V., Lofquist, L. H., & Weiss, D. J. (1968). A theory of work adjustment: A revision. Minnesota Studies in Vocational Rehabilitation, 23, 15.
Weiss, D. J., Dawis, R. V., & England, G. W. (1967). Manual for the Minnesota satisfaction questionnaire. Industrial Relations Center, University of Minnesota.
West, M. A., & Farr, J. L. (1990). Innovation and creativity at work: Psychological and organizational strategies. Hoboken, NJ: John Wiley & Sons.
West, D., Grant, T., Gerush, M., & D’Silva, D. (2010). Agile development: Mainstream adoption has changed agility. Forrester Research. Retrieved from http://www.heacademy.ac.uk/assets/bmaf/documents/events/Events_2011/agile_development_mainstream_adoption_has_changed_agility.pdf
Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231. doi:10.1037/0021-9010.71.2.219
Siwen Yang is a doctoral student at the Howe School, Stevens Institute of Technology. Her research focuses on project management process models. Specifically, she is interested in finding the opportunities and challenges that agile process models bring for projects. Particularly, she studies on the conceptual differences between agile and non-agile process models and how they are related to employee job satisfaction.
1 MSQ 20 aspects of job satisfaction are: ability utilization, achievement, activity, advancement, authority, company policies and practices, compensation, co-workers, creativity, independence, moral values, recognition, responsibility, job security, social service, social status, supervision-human, supervision- technical, variety, and working conditions.
2 United States: Power Distance=40; Individualism=91; Masculinity=62; Uncertainty Avoidance=46; Pragmatism=26; Indulgence=68
Canada: Power Distance=39; Individualism=80; Masculinity=52; Uncertainty Avoidance=48; Pragmatism=36; Indulgence=68
3 Authority: the chance to instruct other people what to do; Creativity: the chance to try my own methods of doing the job; Responsibility: the freedom to use my own judgment; Job Security: the way my job provides for steady employment; Social Status: social position in the community that goes with the job (the chance to be “somebody” in the community)
©2014 Project Management Institute Research and Education Conference