Publications -> Journal Papers

Towards data-driven software engineering skills assessment


Authors: J. Lin, H. Yu, Z. Pan, Z. Shen, and L. Cui
Title: Towards data-driven software engineering skills assessment
Abstract: Purpose Today’s software engineers often work in teams to develop complex software systems. Therefore, successful software engineering in practice require team members to possess not only sound programming skills such as analysis, design, coding and testing but also soft skills such as communication, collaboration and self-management. However, existing examination-based assessments are often inadequate for quantifying students’ soft skill development. The purpose of this paper is to explore alternative ways for assessing software engineering students’ skills through a data-driven approach. Design/methodology/approach In this paper, the exploratory data analysis approach is adopted. Leveraging the proposed online agile project management tool – Human-centred Agile Software Engineering (HASE), a study was conducted involving 21 Scrum teams consisting of over 100 undergraduate software engineering students in multi-week coursework projects in 2014. Findings During this study, students performed close to 170,000 software engineering activities logged by HASE. By analysing the collected activity trajectory data set, the authors demonstrate the potential for this new research direction to enable software engineering educators to have a quantifiable way of understanding their students’ skill development, and take a proactive approach in helping them improve their programming and soft skills. Originality/value To the best of the authors’ knowledge, there has yet to be published previous studies using software engineering activity data to assess software engineers’ skills.
Keywords: Crowd-sourced design and engineering; Task-oriented crowdsourcing; Agile software engineering; Tools and platforms to support crowd science and engineering
Journal Name: International Journal of Crowd Science
Publisher: Emerald Publishing Limited
Year: 2018
Accepted PDF File: Towards_data-driven_software_engineering_skills_assessment_accepted.pdf
Permanent Link: https://doi.org/10.1108/IJCS-07-2018-0014
Reference: J. Lin, H. Yu, Z. Pan, Z. Shen, and L. Cui, "Towards data-driven software engineering skills assessment," International Journal of Crowd Science, vol. 2, no. 2, pp. 28-42, September 2018.
bibtex: 
@article {LILY-j60,
   author 	= {Lin, Jun and Yu, Han and Pan, Zhengxiang and Shen, Zhiqi and Cui, Lizhen },
   title 		= {Towards data-driven software engineering skills assessment},
   journal 	= {International Journal of Crowd Science},
   year 	= {2018},
   month 	= {September},
   volume 	= {2},
   number 	= {2},
   pages 	= {28-42},
   publisher 	= {Emerald Publishing Limited},
}