Research Methods In Software Engineering

Research Methods in Software Engineering

Guide to Advanced Empirical Software Engineering

Empirical studies have become an important part of software engineering research and practice. Ten years ago, it was rare to see a conference or journal article about a software development tool or process that had empirical data to back up the claims. Today, in contrast, it is becoming more and more common that software engineering conferences and journals are not only publishing, but eliciting, articles that describe a study or evaluation. Moreover, a very successful conference (International Symposium on Empirical Software Engineering and Measurement), journal (Empirical Software Engineering), and organization (International Software Engineering Research Network) have all evolved in the last 10 years that focus solely on this area. As a further illustration of the growth of empirical software engineering, a search in the articles of 10 software engineering journals showed that the proportion of articles that used the term “empirical software engineering” d- bled from about 6% in 1997 to about 12% in 2006. While empirical software engineering has seen such substantial growth, there is not yet a reference book that describes advanced techniques for running studies and their application. This book aims to fill that gap. The chapters are written by some of the top international empirical software engineering researchers and focus on the practical knowledge necessary for conducting, reporting, and using empirical methods in software engineering. The book is intended to serve as a standard reference.

Design Science Methodology for Information Systems and Software Engineering

This book provides guidelines for practicing design science in the fields of information systems and software engineering research. A design process usually iterates over two activities: first designing an artifact that improves something for stakeholders and subsequently empirically investigating the performance of that artifact in its context. This “validation in context” is a key feature of the book - since an artifact is designed for a context, it should also be validated in this context. The book is divided into five parts. Part I discusses the fundamental nature of design science and its artifacts, as well as related design research questions and goals. Part II deals with the design cycle, i.e. the creation, design and validation of artifacts based on requirements and stakeholder goals. To elaborate this further, Part III presents the role of conceptual frameworks and theories in design science. Part IV continues with the empirical cycle to investigate artifacts in context, and presents the different elements of research problem analysis, research setup and data analysis. Finally, Part V deals with the practical application of the empirical cycle by presenting in detail various research methods, including observational case studies, case-based and sample-based experiments and technical action research. These main sections are complemented by two generic checklists, one for the design cycle and one for the empirical cycle. The book is written for students as well as academic and industrial researchers in software engineering or information systems. It provides guidelines on how to effectively structure research goals, how to analyze research problems concerning design goals and knowledge questions, how to validate artifact designs and how to empirically investigate artifacts in context – and finally how to present the results of the design cycle as a whole.