The Workers Compensation Board of Manitoba (WCB) invites firms to submit a Proposal for the following: To provide performance testing for the WCB's Worker Mobile Application, including evaluating the current environment, developing a detailed test plan, recommending and implementing suitable tools, executing tests, and analyzing results to optimize performance. The WCB also requires a comprehensive knowledge transfer and training program for its internal IT team, including training sessions, detailed documentation, tools, hands-on support, and post-training assistance.
Description of Services
The WCB requires the Contractor to perform the following:
a) App Performance Testing: including:
(i) Evaluate the existing legacy environment and the App to create a performance-testing plan, tailored to both the App and its integrated systems;
(ii) Create a detailed performance test plan that defines the scope, types of tests, resource requirements, and the setup of the test environment;
(iii) Propose and utilize suitable performance testing tools, including load testing and monitoring tools (provided by the Contractor);
(iv) Develop test scenarios, set up the test environment, and design test cases to accurately assess performance;
(v) Perform the performance tests, monitor the results, and analyze the data to evaluate the integrated systems' performance;
(vi) Based on the test results, offer recommendations for optimization and conduct retesting to verify improvements;
(vii) Document and present the test results, including detailed findings and actionable prioritized recommendations;
(viii) Perform a review with various WCB teams to discuss the outcomes and next steps following the testing phase; and
(ix) Such other tests as may be recommended by the Contractor.
b) Support and Knowledge Transfer: collaborating closely with the WCB team to provide coaching, knowledge transfer, and tools for future performance testing initiatives; and
c) Ad Hoc Support: following completion of the App Performance Testing, and Support and Knowledge Transfer, on an as-needed basis when requested by the WCB.
The Services shall normally be performed during Business Hours. However, the WCB may request some of the Services to be performed outside Business Hours from time to time, as deemed necessary, in the unfettered discretion of the WCB. The Contractor shall not be entitled to charge overtime rates unless specified in the Fee Schedule.
The Contractor will be expected to have the following:
a) A comprehensive program that includes training sessions, documentation, and post-engagement support for its IT team;
b) Proven success with similar projects, supported by case studies and references from previous clients; and
c) A detailed, structured approach to performance testing, covering planning, execution, analysis, and reporting.
The Vendor must have experience and knowledge with the following:
a) Minimum of ten (10) years' of demonstrated experience in performance testing for mobile applications, including load, stress, and scalability testing;
b) Proficiency with relevant performance testing tools (e.g. JMeter, LoadRunner, AppDynamics, Firebase Performance Monitoring, etc.); and
c) Certifications in performance testing or mobile app development (e.g. Certified Performance Test Engineer).
The Vendor should have experience and knowledge with the following (which may be considered an asset when evaluating):
a) Experience in testing across various mobile platforms (iOS, Android, etc.) and devices (smartphones, tablets, etc.);
b) Ability to integrate performance testing tools with Continuous Integration/Continuous Deployment (CI/CD) pipelines;
c) Expertise in advanced analytics and performance optimization strategies;
d) Capability to implement synthetic monitoring and load testing to simulate user interactions and provide performance insights in the absence of actual users;
e) Capability to test the performance of mobile backend(s), including APIs and server-side components; and
f) Proficiency in advanced reporting and visualization tools to present performance data effectively.
The Proposal should include an overview of the proposed resource(s) being offered, including profiles of work, which highlight their experience performing similar projects. Vendors are expected to provide the following for each proposed resource:
a) Resource's name and identify any subcontractor relationship (i.e. if any individual resource is not an employee of the Vendor);
b) Completed skills matrix identifying resource's skills and knowledge;
c) Ability to start on the WCB's preferred start date or later date of availability; and
d) Resume of each resource.
The Contractor will not be required to have and maintain workers compensation coverage for its workers who will be providing the Services, unless required pursuant to The Workers Compensation Act.
The WCB expects the Contractor will be able to perform the Services remotely. Vendors are to specify in their Proposal if they plan to provide any of the App Performance Testing or Training and Knowledge Transfer onsite at the WCB's facilities located in Winnipeg, Manitoba.
It is expected the main components of the Services will be completed, immediately following execution of the Agreement, within these time frames:
a) App Performance Testing- to be completed in approximately four (4) weeks, based on a preferred start date of October 21, 2024 (to be performed on a full-time basis from October 21, 2024 to November 15, 2024); and
b) Training and Knowledge Transfer- to be completed in approximately six and a half (6.5) weeks, based on a preferred start date of November 18, 2024 (to be performed on a part-time basis between November 18, 2024 to January 31, 2025).
Following completion of the App Performance Testing and the Training and Knowledge Transfer, the Ad Hoc Support shall be provided to the WCB on an "as-needed" basis, invoiced at the hourly rate(s) to be provided in the Fee Schedule. The WCB makes no representation to guarantee any minimum amount of work will be assigned to the Contractor for the Ad Hoc Support.
The term of the Services will be for an initial period of three (3) years with a preferred start date of October 21, 2024 (with completion of the App Performance Testing and the Training and Knowledge Transfer on or before January 31, 2025 and Ad Hoc Support provided thereafter), continuing up to and including October 20, 2027. The WCB shall have an irrevocable option to extend the Ad Hoc Support component on the same terms and conditions and hourly rate(s) for an additional period of up to two (2) years.
