In August 2014, the IEEE Reliability Society (RS), with the support of the IEEE Future Direction Committee (FDC), launched a Tutorial Certificate Program on Software Reliability. The project was led by Professor Eric Wong (Vice President for Technical Activities back then). Each participant who attends an 8-hour tutorial (either a full-day tutorial or two half-day tutorials) will receive a certificate from RS.
The initial scope of the certificate program covered topics such as an introduction to software reliability concepts and analysis techniques, their applications across the software development lifecycle, review of the limits, pros, and cons of different models and tools, solutions to reliability underestimates or overestimates, and use of techniques such as failure modes, effects and criticality. The emphasis was on both fundamental and advanced topics related to the application of software reliability to help practitioners in practice. [more]
Three tutorials were organized at the following venues in 2014:
- QSIC 2014: The 14th International Conference on Quality Software (QSIC), Dallas, Texas, USA, October 2-3, 2014
- ISSRE 2014: The 25th International Symposium on Software Reliability Engineering, Naples, Italy, November 3-6, 2014
- Beihang University: In collaboration with the RS Beijing Chapter, China, December 19, 2014
The following articles published in the RS Newsletter provide more details about this program:
- An RS Tutorial Certificate Program on Software Reliability
(RS Newsletter, Vol. 60, No. 3, August 2014)
- An Update of the RS Tutorial Certificate Program on Software Reliability
(RS Newsletter, Vol. 60, No. 4, November 2014)
- 2014 Reliability Society Outreach in Changchun, Changsha and Beijing, China
(RS Newsletter, Vol. 61, No. 1, February 2015)
This program was successfully renewed in 2015 with an additional financial support from FDC. In addition, the scope is extended by also considering System Reliability wherever appropriate. All the tutorials will cover both fundamental and advanced topics related to the application of reliability to help practitioners produce more reliable and trustworthy software systems in a cost-effective way. Additional focus will be on systems that require ultra-reliability for critical missions. [more]
Once again, three tutorials were organized in 2015:
- QRS 2015: The 2015 International Conference on Software Quality, Reliability, and Security, Vancouver, Canada, August 3-5, 2015
- ISSRE 2015: The 26th International Symposium on Software Reliability Engineering, Gaithersburg, Maryland, USA, November 2-5, 2015
- ICRSE 2015: The 1st International Conference on Reliability Systems Engineering, Beijing, China, October 21-23, 2015
Refer to the following articles in RS Newsletter for more details:
- An Update of the RS Tutorial Certificate Program on System and Software Reliability
(RS Newsletter, Vol. 61, No. 2, May 2015)
- RS Tutorial at 2015 ICRSE/PHM in Beijing, Chin
(RS Newsletter, Vol. 61, No. 4, May 2015)
Starting from 2016, the RS Tutorial Certificate Program has become self-supported. We
have worked closely with RS chapters at different geographical locations and various
conferences to organize tutorials specifically designed for their audience. The scope
is also further extended to cover other related topics such as device and mechanic
Five tutorials were organized in 2016:
- QRS 2016: The 2016 International Conference on Software Quality, Reliability, and Security, Vienna, Austria, August 1-3, 2016
- Nanjing: The 2nd China Software Developers Conference, Nanjing, China, April 16, 2016
- PHM China 2016: The 2016 Prognostics and System Health Management Conference, Chengdu, China, October 19-21, 2016
- ISSRE 2016: The 27th International Symposium on Software Reliability Engineering, Ottawa, Canada, October 23-27, 2016
- ISSSR 2016: The 1st International Symposium on System and Software Reliability, Shanghai, China, October 29-30, 2016
The following articles in RS Newsletter gives more detailed stories:
- RS Tutorial in Shanghai, China and Dallas, Texas, USA
(RS Newsletter, Vol. 62, No. 1, February, 2016)
- RS Tutorial in Nanjing, China
(RS Newsletter, Vol. 62, No. 2, May, 2016)
In 2017, we will organize tutorials at the following venues: [more]
- QRS 2017: The 2017 International Conference on Software Quality, Reliability, and Security, Prague, Czech Republic, July 25-29, 2017
- ISSRE 2017: The 28th International Symposium on Software Reliability Engineering, Toulouse, France, October 23-26, 2017
- ICRSE 2017: The 2nd International Conference on Reliability Systems Engineering, Beijing, China, July 10-12, 2017
- DSA 2017: The 4th International Conference on Dependable Systems and Their Applications, Beijing, China, October 19-22, 2017
PowerPoint slides and videos of selected tutorials are available in a password-protected
section for RS members as part of their membership benefits. Such materials will not
only increase the appeal of our Tutorial Certificate Program by helping potential
participants gain a better understanding of what they will learn from our classes but
also provide those who have already participated in the program with on-demand access
to our constantly updated information, viewable at their own convenience. These on-hand
resources give them useful tips that can be critical to the success of their projects.
Send all your inquiries regarding this tutorial program via email to
Professor W. Eric Wong at the
University of Texas at Dallas.
RS Tutorial at NJSD 2018
A Tutorial on Software Testing
Software testing is one of the most important method to ensure the quality of software. In this tutorial, we will give a brief introduction of software testing and focus on developer testing. Developer testing is a general of all testing techniques used by developer, including unit testing, interface testing, integration testing, and so on. The team is encouraging to combine development and testing by seamlessly. The developers write testable code that enables them to verify it using various types of automated tests. Writing testable code, however, is often difficult, because it requires knowledge and skills that cut across multiple disciplines. In this tutorial, we will demonstrate how to use mooctest.net to improve testing skills of students. We will present two evaluation metrics: coverage ratio and bug detection ratio. All testing behaviors will be captured by mooctest platform and the teacher can monitor, investigate, and guide students. We also will introduce some experiences to design for testability and utilize techniques like refactoring, dependency breaking, unit testing, data-driven testing, and test-driven development to achieve the highest possible confidence in your software.
- Speaker: Zhenyu Chen [Bio...]
Zhenyu Chen is a Professor of Software Institute in Nanjing University. His research interests are mainly the area of intelligent software engineering. Hi is the Founder of mooctest.net, the initiator of National Student Software Testing Contest, and one of the sponsors of the NJSD Global Software Conference. He served as the editor board of the IEEE Transactions on Reliability Journal Associate Editor, the Guest Editor of JSS and SP&E Journal, the PC co-chair of QRS 2016, TSA 2016, QSIC 2013, AST 2013. He has published more than 80 papers in the leading academic conferences and journals such as TOSEM, TSE, ICSE, FSE, ISSTA, ICST, etc. He more than 30 patents (16 granted), and some of his patents have been transferred into well-known software companies such as Baidu, Alibaba and Huawei. He won the first prize of the Jiangsu Provincial Science and Technology Award in 2012 and the first prize of the Hubei Province Science and Technology Award in 2015.
RS Tutorial at ISSSR 2018
A Tutorial on Software Quality and Reliability
- Speakers: Sudipo Ghosh [Bio...]
Sudipto Ghosh is an Associate Professor of Computer Science at Colorado State University. He received the Ph.D. degree in Computer Science from Purdue University in 2000. His research interests are in the areas of modeling and testing software in the object-oriented, aspect-oriented, and component-based paradigms. Specific topics include data warehouse testing, fault localization, model-based software development, mutation testing and higher order mutation, and regression test selection. Dr. Ghosh has published over seventy five technical papers in refereed journals and conference proceedings. He is on the editorial boards of IEEE Transactions on Reliability, Software Quality Journal, Journal of Software Testing, Verification and Reliability, and Information and Software Technology. He was a general co-chair of the ACM/IEEE 12th International Conference on Model Driven Engineering Languages and Systems held in Denver in 2009, and the 16th Modularity Conference in Fort Collins in 2015. He was a program co-chair of the Third International Conference on Software Testing, Verification and Validation in 2010, the Fourth International Conference on Dependable Systems and their Applications in 2017, and the 29th IEEE International Symposium on Software Reliability Engineering in 2018. He is a member of the ACM and a Senior Member of the IEEE.
- Pete Rotella [Bio...]
Pete Rotella has over 30 years experience in the software industry, as a leader of large-scale development projects and as a software engineering researcher. He has led major system development projects at IBM Corporation, U.S. Environmental Protection Agency, U.S. National Institutes of Health, GlaxoSmithKline plc, Monsanto Company, Unisys Corporation, and several statistical software startups. For the past 17 years, he has been focusing on improving software reliability at Cisco Systems, Inc. Mr. Rotella is active in several software engineering communities, including ICSE, QRS, ISSRE, and FSE. He is the author of over 30 publications on software reliability, software security, and customer experience. Also, he has been leading reliability and security workshops, tutorials, and classes for over 10 years.
RS Tutorial at DSA 2017
A Tutorial on System Reliability
Reliability is a major aspect of any product as it affects not only the producer but can grossly affect the consumer. This is particularly true for manned and unmanned applications including such systems as cars, aircraft, manufacturing plants. This presentation provides a high level view of the practical physics that affect the reliability of a variety of parts used in today’s systems using examples found in large and small scale systems. The assessment of various failure mechanisms as applied to specific designs, can aid in identifying what drives failures for those designs and lead to solutions to eliminate or mitigate those failures. Topics include failure mechanisms, failure modes and effects, failure models and identification of tools needed to perform the basic tasks of assessment, allocation, and analysis of the reliability of parts and systems.
Speaker: Russel Morris [Bio...]
Special Announcement for the RS Tutorial at ICRSE 2017
An MBA-style Tutorial with Real-life Case Studies
After decades of development, the concepts and theories of reliability have been widely accepted by industries in China. However, the relatively low degree of quality and reliability has become the weakness and bottleneck for products made in China. Researchers and practitioners need help to apply advanced techniques of quality and reliability to solve the challenges they have faced at work and to improve the reliability of their products at a cost-effective way.
With this mind, the IEEE Reliability Society, in conjunction with other partners such as the Reliability Society Beijing Chapter and the International Society of Security and Reliability, will launch a series of tutorials with a focus on closing the gap between the state-of-art knowledge and the state-of-practice techniques used in the field. We will assist practitioners, no matter what their previous level of experience with reliability and quality assurance, to be quickly brought up to speed on the necessary background knowledge and gain the ability to apply a cost-effective set of techniques tailored to the specific projects. With this, it is more likely that they can improve the reliability and the quality of their products at a reduced cost.
Our tutorial speakers are top notch international experts in the field of quality and reliability engineering.
Instead of using the traditional one-way lecturing where instructors have little interactions with audience, we emphasize an MBA-style two-way communication group-based discussion.
Instructors will first present carefully selected real-life cases and explain technologies and possible tool support that may help engineers solve each case. Attendees will be divided into groups to work on these cases and present their solutions for further discussion. This is the most effective way to help tutorial participants better understand how reliability and quality are adopted in practice for real applications. This also gives them a chance to directly communicate with peers and instructors to learn from each other’s experience and receive a first-hand account of how these issues are currently resolved in the industry, the challenges that need to be overcome, and the possible solutions to take them to the next level.
We will have two tutorials organized at the 2nd International Conference on Reliability Systems Engineering, focusing on electro-mechanic reliability and system/software reliability, respectively. Our speakers are Mr. Richard Doyle and Mr. Pete Rotella. Please refer to their bios listed below for their well-versed experiences in various industry projects and technical training. To reduce participants’ traveling cost, the same tutorials will be held twice: Beijing on July 8 and 9, and Shanghai on July 13 and 14.
- Speakers: Pete Rotella [Bio...]
Pete Rotella has over 30 years experience in the software industry, as a leader of large-scale development projects and as a senior software engineering researcher. He has led major system development projects at IBM Corporation, U.S. Environmental Protection Agency, U.S. National Institutes of Health, GlaxoSmithKline plc, Monsanto Company, Unisys Corporation, and several statistical systems startups. For the past 16 years, he has been focusing on improving software reliability at Cisco Systems, Inc. Mr. Rotella is active in several software engineering communities, including ICSE, QRS, ISSRE, and FSE. He is the author of over 30 publications, and has been leading reliability workshops and tutorials for over 10 years. His leadership of the ‘Software Reliability Workshop: Improving Reliability in a Changing Industry’ addresses traditional reliability issues and improvement strategies, but also concentrates on the reliability aspects of the modern software development, testing, and deployment environment.
- Richard Doyle [Bio...]
Richard Doyle has over 30 years experience in the theoretical analysis and design of electrical and mechanical systems including: Consulting for the past 20 years in Aerospace, in Commercial Electronics, and Nuclear Power Industries. He has also presented this information many times as tutorials at different locations around the World. Mr. Doyle is a former president of the IEEE Reliability Engineering and Management, Published by McGraw-Hill, Inc. January 1996. He also wrote or rewrote approximately 70 pages as presented in Chapters 3.1 and 3.3 through 3.5 of the Standard Handbook of Electronic Engineering, Fifth Ed, Published by McGraw-Hill, Inc., in 2005. He also has written hundreds of reports and studies associated with the seismic qualification of nuclear instruments in nuclear power plants.
Certificates for tutorial attendees at the International Symposium on Software Reliability Engineering
- The 28th IEEE International Symposium on Software Reliability Engineering, Toulouse, France
- The 27th IEEE International Symposium on Software Reliability Engineering, Ottawa, Canada
- The 26th IEEE International Symposium on Software Reliability Engineering, Washington, D.C., USA
- The 25th IEEE International Symposium on Software Reliability Engineering, Naples, Italy (ISSRE 14)
PowerPoint slides for the tutorial at 2016 Prognostics and System Health Management Conference, Chengdu, China, October 19, 2016
- Issues and Challenges of Bayesian Inference in PHM: Prior, Data, or Lying
[Bio & Abstract]
Western New England University
- Combinatorial Testing and Its Applications
[Bio & Abstract]
W. Eric Wong
Professor & Director
Advanced Research Center for Software Testing & Quality Assurance
Univesrity of Texas at Dallas
Editor-in-Chief, IEEE Transactions on Reliability
- Software/System Reliability
[Bio & Abstract]
Cisco Systems, Inc.
- Electromechanical Systems Reliability
[Bio & Abstract]
IEEE Reliability Society
PowerPoint slides and videos for the tutorial at University of Texas at Dallas, Texas, USA, November 20, 2015
- Software Reliability: Part I, Part II and Part III
Reliability, Maintainability and Systems Health
PowerPoint slides and videos for the tutorial at Beihang University, Beijing, China, December 19, 2014
- Software Reliability: Part I and Part II
Dr. Michael Grottke
- Software Reliability: Part III and Part IV
Dr. Min Xie
Chair Professor of Industrial Engineering
Associate Dean (Internationalization), College of Science and Engineering
City University of Hong Kong, Hong Kong
PowerPoint slides and videos for the tutorial at QSIC, Dallas, Texas, October 2-3, 2014
- Keynote Speech
Critical Findings on Nuclear and Renewable Energies:
Reflections on Rainbow Energy, Environmental Protection and Safety
in the Wake of Fukushima Nuclear Accident
Dr. Way Kuo
President and University Distinguished Professor
City University of Hong Kong
Member of US National Academy of Engineering
- Panel on Software Quality Assurance in Practice
[Video I] [Video II]
- Mark Paulk [slides]
- Paul Grizzaffi [slides]
- Mas Kono [slides]
- Tim McClung [slides]
- John Medellin [slides]
- Chad Virnig [slides]
- Stuart Yarost [slides]
- Software Reliability: Part I and Part II
Dr. Kishor Trivedi
Hudson Professor of Electrical and Computer Engineering
- Software Reliability: Part III and Part IV
[Video IV] [Video V]
Dr. Allen Nikora
Autonomy and Control Section
Jet Propulsion Laboratory, NASA