Development of Evaluation Demo Framework

The National Research Council of Canada is seeking a subcontractor to design and implement a demo framework that visually demonstrates the preliminary performance of machine translation systems. The framework must integrate both automatic evaluation metrics and human assessment results into a unified, reportable, or interactive format that effectively communicates system capabilities and limitations. This effort aims to provide stakeholders with an accessible tool to interpret and analyze translation quality outcomes during early-stage development, enabling informed decision-making and iterative improvement. The contract is classified under NAICS code 541512, indicating it falls under computer systems design and related services. The solicitation was posted on July 13, 2026, with a response deadline of July 29, 2026. While no set-aside provisions are specified, the project is structured as a subcontract under the Government of Canada and is linked to the Canada Buys tender portal. The performance location and point of contact details are not provided, but the work is expected to support national research initiatives in natural language processing and machine translation evaluation.