Extreme Programming Project Performance Management By
Total Page:16
File Type:pdf, Size:1020Kb
GLOBAL JOURNAL OF BUSINESS RESEARCH ♦ VOLUME 7 ♦ NUMBER 5 ♦ 2013 EXTREME PROGRAMMING PROJECT PERFORMANCE MANAGEMENT BY STATISTICAL EARNED VALUE ANALYSIS Wei Lu, Duke University Li Lu, University of Electronic Science and Technology of China ABSTRACT As an important project type of Agile Software Development, the performance evaluation and prediction for eXtreme Programming project has significant meanings. Targeting on the short release life cycle and concurrent multitask features, a statistical earned value analysis model is proposed. Based on the traditional concept of earned value analysis, the statistical earned value analysis model introduced Elastic Net regression function and Laplacian hierarchical model to construct a Bayesian Elastic Net model fitted for project performance evaluation and prediction. The model is demonstrated with the JAX Laboratory software development project data. With simulated coefficients estimation, we realized an empirical data support for project performance assessment. JEL: C35, C63, M15 KEYWORDS: Project Management, Performance, Prediction, Earned Value INTRODUCTION here has been growing tendency for the usage of the Agile Software Development paradigm these years, due to its claimed lower costs, better performance, productivity, business satisfaction T features by Mishra (2011). This paradigm can be applied to supply chain management (SCM), a complex software development project. Considering its wide scope and complex requirements, predictable models for software development process are not fitted. Targeting such problems involving variability and uncertainty, agile methodologies are adaptive rather than predictive. Thus, for project management, how to evaluate and manage the process performance aiming this development mode is an important issue. Project Management Body of Knowledge (PMBOK), presented by U.S.A Project Management Institution (PMI), regards earned value management as a key method for project performance management. For eXtreme Programming (XP) software project, the difficulty for spreading the application lies in the earned value determination during the process. Especially due to the variability of targets on a later stage of the project, the determination of earned value seems more difficult. Kim and Reinschmidt (2011) proposed a probabilistic cost forecasting method based on self-adaptive inside view (the bottom-up estimate), combining with outside (top-down) view of project cost estimates using Bayesian inferences and model averaging technique. Its precision is high under the condition of linear cumulative cost curve, but models with highly nonlinear features will affect its suitability. In this paper, we introduced a concept of statistical earned value analysis (SEVA). Targeted on the concurrent features of short release cycle, programming, test, and maintaining units for software extreme programming, an analytical model is proposed. This model is able to combine the data of project implementation process with Bayesian theory, and conduct posterior analysis according to the nonlinear characteristics, thus provide timely performance evaluation data analysis to project manager. 115 W. Lu & L. Lu | GJBR ♦ Vol. 7 ♦ No. 5 ♦ 2013 The remainder of the paper is organized as follows. In the next section, we review relative literatures; the data and methodology section, a short introduction to EVA is presented, and then an explanation of the Bayesian Elastic Net model followed by a description of the statistical inference methods employed. In the results and discussion part, the project case used is illustrated; subsequently, the analytical results are presented. LITERATURE REVIEW With increasing levels of complexity and uncertainty, project management is a vital task. Due to its contemporary and unique features, it is imperative to gauge the performance. Much work has been made in this area. For example, Hillman (1994) uses the EFQM Model to suggest a practical framework for progress self-assessment. Based on it, Bryde (2003) proposed a project management performance assessment (PMPA) model, using six criteria for assessing PM performance: “project management leadership; project management staff; project management policy and strategy; project management partnerships and resources; project life cycle management processes; and project management key performance indicators”. Qureshi, Warraich and Hijazi (2009) further examined the impact level of these criteria and their association scope. As is put forward by Wysocki (2009), two variables can be used to define the project landscape: “goal” and “solution”. With constant variability of goals and corresponding solutions, Extreme Project Management is an important category of PM. There is a wide range of work addressing the issues related to Extreme Programming (XP) and its process management, e.g., the work of Beck (1999) and Darwish (2011). According to PMBOK, earned value management is an efficient approach for project performance management. By conducting progress and cost analysis through Schedule Performance Index (SPI) and Cost Performance Index (CPI), this method is effective conditioned on two premises: first, earned value is convenient for acquiring and estimating, such as engineering project instance, completed progress’s proportion of the total work amount would be easier to estimate; second, the ultimate goal of the project is relatively fixed, which would make the earned value estimation benchmark more constant. However, as is discussed by Yap (2006) and Zhai etc. (2011), the difficulty of earned value determination during the process for XP software projects lays in its requirement frequent variability, deficiency and flood characteristics. The probabilistic cost forecasting method proposed by Kim and Reinschmidt (2011) is based on self-adaptive inside view combining with outside view of project cost estimates using Bayesian inferences and model averaging technique. During the execution phase, through incorporating actual predictive performance and pre-project cost estimation modification, this method can sufficiently use available prior information. It is precise for linear cumulative cost curve, but not for models with highly nonlinear features. Targeting those unique features of XP performance management, an adaptive model should be implemented. To analyze earned value data and give predictions for future performance, we consider a form of regression. The problem of interest is the estimation of the regression coefficient parameters as well as the prediction accuracy. Tibshirani (1996) proposed the Lasso method to address the feature selection problem and is widely applied in a variety of statistical analysis. However, many project process features has high correlation, while Lasso tends to arbitrarily select just a few of those relevant features and ignore the rest. This property of Lasso will undermine model’s interpretability and robustness. Thus, a naïve Elastic Net estimator is proposed by Zou and Hastie (2005), which yield sparse and grouped variable selection. Sequencing work by Park (2008) and Chen etc. (2011) provided the Bayesian and hierarchical from of Elastic Net method to further enhance the flexibility and accuracy of the model. 116 GLOBAL JOURNAL OF BUSINESS RESEARCH ♦ VOLUME 7 ♦ NUMBER 5 ♦ 2013 DATA AND METHODOLOGY The nature of the XP problem is shown in Figure 1; from which we can see that the prophase and interim performance prediction analysis, with the prophase performance benchmark obtained at early stage, will gradually be adjusted during the development process when performance information and clearer project requirements are gathered from clients and developers. The data is collected during a three-month software-developing project at JAX Laboratory in 2012. Through work breakdown structures (WBS), the total project quantities are determined. The weekly meetings provide assessments of performance for finished tasks and newly added workload. So as to realize plan updating, actual completion degree estimation and sample data collection. Figure 1: Performance Evaluation and Prediction before and after Requirements Change 10 8 6 4 2 0 0 1 2 3 4 5 6 7 8 9 10 11 12 This figure shows the idea behind XP project where darker bars indicate expected performance while lighter color bars are performance evaluations after requirements change Considering the differences between base and empirical performance for XP projects, the life cycle data is regarded as having truncated features. That is to suppose that only partial life cycle of subroutine individual (explicit requirement) is less than certain value, while the residual potential demand development time exceeds certain value. Since distinct truncation will lead to differences, the SEVA methods are based on Bayesian survival analytical theories. Using Elastic Net method and MCMC steady-state simulation method or variational Bayesian (VB) inference algorithms as derived by Park and Casella (2008), we constructed project Bayesian survival analysis model, in order to solve the difficulties of high dimensional numerical integration. By constructing XP project life period regression model, the influence of environmental and target conditions variability on the project performance is effectively reflected. The key steps for this analytical model, which are derived in detail by Chen, Carlson and Zaas (2011), are as follows: Step 1: Construct Elastic Net regression target function to solve multi-linear problem as a substitution of Principal factor