This talk will describe the deployment of Sapienz, a system for automated test case design that uses Search Based Software Engineering (SBSE) and which has been deployed at Facebook since October 2017 to design test cases, localise and triage faults to developers and to monitor their fixes (and, since August 2018, also to automate the process of fixing some of these faults). The talk will also cover the way in which we combine static and dynamic analysis for fault-finding and fixing at Facebook, concluding with a discussion of some open problems for static and dynamic analysis and challenges in deploying them at scale. This keynote is an account of the joint work of the whole Sapienz team and its partners and collaborators at Facebook.

Mark Harman is an engineering manager at Facebook London, where he manages the Sapienz team, working on Search Based Software Engineering (SBSE) for automated test case design and fault fixing. Sapienz has been deployed to continuously test Facebook’s Android and iOS apps, leading to thousands of bugs being automatically found and fixed (mostly by developers, but more recently, some of these faults have also been automatically fixed by Sapienz). The software tackled by Sapienz consists of tens of millions of lines of code; apps that are among the largest and most complex in the app store and that are used by over a billion people worldwide every day for communication, social networking and community building. Mark is also a part time professor of Software Engineering in the Department of Computer Science at University College London, where he directed the CREST centre for ten years (2006-2017) and was Head of Software Systems Engineering (2012-2017). He is known for his scientific work on SBSE, source code analysis, software testing, app store analysis and empirical software engineering. He was the co-founder of the field SBSE, which has grown rapidly with over 1,700 scientific publications from authors spread over more than 40 countries. SBSE research and practice is now the primary focus of his current work in both the industrial and scientific communities. In addition to Facebook itself, Mark’s scientific work is also supported by an ERC advanced fellowship grant and by the UK EPSRC funding council.