Testing Levels or Testing Documentation  or different types of testing in software Engineering.

Testing Levels or Testing Documentation or different types of testing in software Engineering.

Testing Levels Testing itself may be clear at several levels of Software Development Life Cycle. The testing process runs equivalent to software development. Testing distinctly is done just to make sure that there are no hidden bugs or issues left in the software. Software is tested on various levels –

Unit Testing

While coding, the programmer performs some tests on that unit of program to know if it is error free. Testing is performed under white-box testing approach. Unit testing helps developers decide that individual units of the program are working as per requirement and are error free.

Integration Testing

Even if the units of software are working fine individually, there is a need to find out if the units if integrated together would also work without errors. For example, argument passing and data updating etc.

System Testing

The software is compiled as product and then it is tested as a whole. This can be accomplished using one or more of the following tests:

  • Functionality testing: Tests all functionalities of the software against the requirement.
  • Performance testing: This test proves how efficient the software is. It tests the effectiveness and average time taken by the software to do desired task. Performance testing is done by means of load testing and stress testing where the software is put under high user and data load under various environment conditions.
  • Security & Portability :These tests are done when the software is meant to work on various platforms and accessed by number of persons.

Acceptance Testing

When the software is ready to hand over to the customer it has to go through last phase of testing where it is tested for user-interaction and response. This is important because even if the software matches all user requirements and if user does not like the way it appears or works, it may be rejected.

  • Alpha testing: The team of developer themselves perform alpha testing by using the system as if it is being used in work environment. They try to find out how user would react to some action in software and how the system should respond to inputs.
  • Beta testing: After the software is tested internally, it is handed over to the users to use it under their production environment only for testing purpose. This is not as yet the delivered product. Developers expect that users at this stage will bring minute problems, which were skipped to attend.

Regression Testing

Whenever a software product is updated with new code, feature or functionality, it is tested thoroughly to detect if there is any negative impact of the added code. This is known as regression testing.

Testing Documentation Testing documents are prepared at different stages –

Before Testing

Testing starts with test cases generation. Following documents are needed for reference –

  • SRS document: Functional Requirements document
  • Test Policy document : This describes how far testing should take place before releasing the product.
  • Test Strategy document : This mentions detail aspects of test team, responsibility matrix and rights/responsibility of test manager and test engineer.
  • Traceability Matrix document : This is SDLC document, which is related to requirement gathering process. As new requirements come, they are added to this matrix. These matrices help testers know the source of requirement. They can be traced forward and backward.

While Being Tested

The following documents may be required while testing is started and is being done:

  • Test Case document: This document contains list of tests required to be conducted. It includes Unit test plan, Integration test plan, System test plan and Acceptance test plan.
  • Test description: This document is a detailed description of all test cases and procedures to execute them.
  • Test case report: This document contains test case report as a result of the test.
  • Test logs: This document contains test logs for every test case report.

After Testing

The following documents may be generated after testing :

  • Test summary: This test summary is collective analysis of all test reports and logs. It summarizes and concludes if the software is ready to be launched. The software is released under version control system if it is ready to launch.

Testing vs. Quality Control, Quality Assurance and Audit

Software testing is different from software quality assurance, software quality control and software auditing.

  • Software quality assurance: Software quality assurance are software development process monitoring means, by which it is assured that all the measures are taken as per the standards of organization. This monitoring is done to make sure that proper software development methods were followed.
  • Software quality control: Software quality control is a system to maintain the quality of software product. It may include functional and non-functional aspects of software product, which enhance the goodwill of the organization. This system makes sure that the customer is receiving quality product for their requirement and the product certified as ‘fit for use’.
  • Software audit : Software audit is a review of procedure used by the organization to develop the software. A team of auditors, independent of development team examines the software process, procedure, requirements and other aspects of SDLC. The purpose of software audit is to check that software and its development process, both conform standards, rules and regulations.
Testing Levels or Testing Documentation  or different types of testing in software Engineering.

Testing Approaches and Levels in Software Engineering

A test needs to check if a webpage can be opened in Internet Explorer. This can be easily done with manual testing. But to check if the web-server can take the load of 1 million users, it is quite impossible to test manually. There are software and hardware tools which helps tester in conducting load testing, stress testing, regression testing.

Testing Approaches

Tests can be conducted based on two approaches –

  • Functionality testing
  • Implementation testing

When functionality is being tested without taking the actual implementation in concern it is known as black-box testing. The other side is known as white-box testing where not only functionality is tested but the way it is implemented is also analyzed. Exhaustive tests are the best-desired method for a perfect testing. Every single possible value in the range of the input and output values is tested. It is not possible to test each and every value in real world scenario if the range of values is large.

Black-box testing

It is a software testing method in which the internal structure or design or implementation of the item being tested is known to the tester. It is carried out to  the internal structure or design or implementation of the item being tested is not known to the tester that is test functionality of the program. It is also called ‘Behavioral’ testing. The tester in this case, has a set of input values and respective desired results. On providing input, if the output matches with the desired results, the program is tested ‘ok’, and problematic otherwise. In this testing method, the design and structure of the code are not known to the tester, and testing engineers and end users conduct this test on the software.

Black-box testing techniques:

  • Equivalence class – The input is divided into similar classes. If one element of a class passes the test, it is assumed that all the class is passed.
  • Boundary values – The input is divided into higher and lower end values. If these values pass the test, it is assumed that all values in between may pass too.
  • Cause-effect graphing – In both previous methods, only one input value at a time is tested. Cause (input) – Effect (output) is a testing technique where combinations of input values are tested in a systematic way.
  • Pair-wise Testing – The behavior of software depends on multiple parameters. In pairwise testing, the multiple parameters are tested pair-wise for their different values.
  • State-based testing – The system changes state on provision of input. These systems are tested based on their states and input.

White-box testing

It is conducted to test program and its implementation, in order to improve code efficiency or structure. It is also known as ‘Structural’ testing. In this testing method, the design and structure of the code are known to the tester. Programmers of the code conduct this test on the code. The below are some White-box testing techniques:

  • Control-flow testing – The purpose of the control-flow testing to set up test cases which covers all statements and branch conditions. The branch conditions are tested for both being true and false, so that all statements can be covered.
  • Data-flow testing – This testing technique emphasis to cover all the data variables included in the program. It tests where the variables were declared and defined and where they were used or changed.

Q Distinguish or deference between Black Box Testing and White Box Testing

Black Box TestingWhite Box Testing
In this software testing in which the internal structure or the program or the code is hidden and nothing is known about it.In this testing the software in which the tester has knowledge about the internal structure or the code or the program of the software.
It is mostly done by software testers.It is mostly done by software developers.
No knowledge of implementation is needed.Knowledge of implementation is required.
It can be referred as outer or external software testing.It is the inner or the internal software testing.
It is functional test of the software.It is structural test of the software.
This testing can be initiated on the basis of requirement specifications document.This type of testing of software is started after detail design document.
No knowledge of programming is required.It is mandatory to have knowledge of programming.
It is the behavior testing of the software.It is the logic testing of the software.
It is applicable to the higher levels of testing of software.It is generally applicable to the lower levels of software testing.
It is also called closed testing.It is also called as clear box testing.
It is least time consuming.It is most time consuming.
It is not suitable or preferred for algorithm testing.It is suitable for algorithm testing.
Can be done by trial and error ways and methods.Data domains along with inner or internal boundaries can be better tested.
Example: search something on google by using keywordsExample: by input to check and verify loops
Types of Black Box Testing: 
 A. Functional Testing 
 B. Non-functional testing 
 C. Regression Testing 
Types of White Box Testing: 
 A. Path Testing 
 B. Loop Testing 
 C. Condition testing