| |
T3 Total Regression Test Suite
Complete Coverage Testing for FIX-Based Trading Systems
Regression testing is crucial to releasing reliable software. Doing this testing manually is so frustrating, tedious, and costly that many companies simply don’t do it. T3 is a regression test facility designed to provide automated, exhaustive regression test capabilities for FIX-based (and other protocols) order management trading systems (“OMS”). Generally deployed by sell-side firms and others who provide FIX connectivity, these OMS’ have many different external interfaces (e.g. FIX input and output, real-time data feed, direct database connections, etc.) making them very difficult to test. T3 coordinates these inputs and outputs into a reliable, repeatable and easy-to-use automated testing framework. And when used in conjunction with Aegis’ other Simulators, T3 can also record and playback complex test case interactions, making “test case construction” easy, intuitive and interactive.
T3 Controller
The T3 Controller provides a centralized, automated testing environment that controls all inputs into the OMS-under-test. The T3 Controller uses modular player components to control and verify various points in the system under test. Standard players include Client Simulator and Exchange Simulator players, which control the Aegis Simulator products. Using these players allows T3 to control all the “end points” around the OMS. This allows for total coordinated control of all OMS inputs. Standard test plans include:
- End to end testing of an OMS, using coordinated Client Simulator and Exchange Simulator players.
- Distributed Performance Testing, using Client Simulator players.
- Latency testing, using an embedded FIX client player.
- Bulk regression testing, using Client Simulator players and production trace files.
 Extensible Architecture
All T3 tests and players are written in Java, allowing simple extension of T3 to encompass players specific to your testing needs. For example, a player can be written to issue customized commands to the OMS-under-test, thereby exercising complete control over all aspects of the OMS. To validate test results, the Controller can monitor message output from any part of the system. The Controller can also be extended to verify data in a database table, examine a log file, or perform any custom validation. The T3 Controller automates this entire testing process using test scripts and plans written in Java. The use of Java also allows custom testing commands to be added easily, if necessary. The Controller also includes a “record” mode that operates in conjunction with the Aegis Simulators, making it easy to automatically create and maintain test scripts and suites with minimal programming.
State Machine
To facilitate comprehensive system testing, T3 includes the ability to model order processing over time and generate extensive scripts that the T3 Controller can execute. T3 provides a methodology and a structure to easily create and maintain full testing coverage when verifying and validating multiple combinations/permutations of events that occur in the trading lifecycle. Once the coverage tests are specified, the Generator automatically generates test scripts and suites to exhaustively test all possibilities of message flow, with a minimal amount of programming effort. This allows a decoupling of the test case specification from the actual test cases and provides a more resilient test case set.
Benefits
- Provides a solution to the pervasive QA problem in the industry: how to reliably regression test a trading system.
- Improves the quality of your trading system by giving you the comprehensive test coverage needed to uncover bugs that manual testers can miss.
- Reduces risk of downtime by automating the QA testing process and providing regression test capability.
- Reduces testing costs by replacing expensive, limited, error-prone manual testing. Instead, repetitive test scenarios are automated and executed regularly.
- Reduces development/maintenance costs of testing software by leveraging the power of (a) the embedded FIX stack, (b) existing Aegis test components (Client Simulator and Exchange Simulator), and (c) automated test-script generation
capability.
- Reduces the need for programming by allowing QA testers to define and generate tests from their specifications (or to pre-record manual tests) for easy playback.
Click here to request a product demo |
