Complete performance testing process
1. Preparation
At what stage should performance testing be carried out? Under normal circumstances, the performance test will only be carried out when the system under test has completed the functional test and the system tends to be stable.
1. Form a test team
According to the actual situation of the system under test, set up a performance testing team, team members include: developers, operation and maintenance personnel, DBA and testers, etc.
2. Research on performance requirements
The performance requirement research work is generally performed by performance testers, with the cooperation of product managers, developers, and operation and maintenance personnel.
Investigate the performance requirements of the online environment of the system, including performance requirements, reliability requirements, and maintainability requirements.
Investigate system-related information, such as hardware parameter configuration, system architecture, and deployment methods.
Investigate business scenario information, such as key business logic and processing flow, transaction list, transaction volume information, business distribution rules, etc.
3. Selection of tools
Consider comprehensive system design, tool cost, and test team skills to select the appropriate test tool.
Pressure measurement tools: JMeter, Loadrunner, Locust, etc.
Monitoring tools: nmon, lepus, jvisualvm, prometheus, grafana, etc.
2. Performance test plan
1. Analyze performance test background
Based on the understanding of the project background and business, determine the problems to be solved in this performance test. Common situations are:
For a new system, it is necessary to test the capability of the system.
For systems in operation that cannot meet actual needs, performance bottlenecks need to be identified.
New services are added, and the system's capacity needs to be reassessed.
The system architecture has been adjusted, and the system's affordability needs to be re-evaluated.
2. Analyze user scenarios
According to the analysis of system business, user active time, access frequency, scene interaction, etc., sort out business scenarios and provide a basis for test script development.
3. Identify performance goals
For specific business function points, formulate expected performance goals. It needs to communicate and negotiate with other business departments, and combine the current system response time and other data to determine the final response time and system resource utilization we need to achieve.
4. Develop a performance testing implementation plan
According to the schedule of the project team, plan the start and end time, participants, outputs, etc. of this performance test.
3. Performance test design
1. Test environment design
Different software and hardware configurations will restrict the overall performance of the system, so it is necessary to deploy multiple different test environments, check the performance of the application system on different hardware configurations, and analyze the test results of the system under different configurations to obtain the best results. Excellent result. Need to focus on the database server, application server, and software operating environment.
2. Test scene design
According to the business characteristics of the system under test, and through communication with the business department and past user operating habits, determine the user operating habit mode, as well as the number of users in different scenarios, the number of operations, determine the test indicators, and perform performance monitoring.
3. Test case design
Write test cases according to the designed test scenarios. The core content of the use case includes: use case number, use case title, preconditions, operation steps, test data, expected results, actual results, etc.
4. Write test scripts
Prepare test data and write test scripts according to test cases and selected tools.
4. Performance test execution
1. Deploy the test environment
Generally, OM or developers deploy the environment and coordinate resources.
2. Execute the test script
In the deployed test environment, execute the test scripts we have designed in order according to the business scenarios and test cases.
3. Performance monitoring and logging
According to the selected testing tools and monitoring tools, various performance indicators are monitored and recorded during the stress test.
Five, performance test analysis
Analyze different test environments, compare the performance indicators of the hardware equipment with the expected performance indicators, and determine whether the results we need have been achieved. Analyze specific bottlenecks for indicators that have not met expectations.
Analyze the performance indicators of components such as application servers, database servers, and middleware under different test environments.
During the performance test execution process, some functional deficiencies or existing defects may be found, as well as places that need to be optimized.
6. Performance test tuning
Determine the problem: Determine the existing performance problem based on the results of the performance analysis.
Analyzing the problem: Carry out specific and detailed analysis of the cause of the problem according to the determined problem.
Identify adjustment goals and solutions.
Test the solution: Test the tuned system again.
Analyze tuning results: analyze whether the tuning results have reached the expected goal.
7. Performance summary and report
Summarize the process and results of performance testing
Write a performance test report