QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)

QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)

ABOUT THE OPPORTUNITY

Join the engineering team of a major Belgian telecom operator to take full ownership of test automation, including one of the most technically interesting challenges in QA today: testing AI Voice and Chat Agents that don't behave deterministically. This is a greenfield role with real influence — you'll propose the tooling, agree it with the Tech Leads, and then own it end to end.

PROJECT & CONTEXT

You will design, build, and maintain the automated test suite across all levels — unit and component guidance for developers, API and integration tests, end-to-end and UI tests, and contract tests for integrations — while assessing existing tests to keep, refactor, or replace them under a common approach. You'll build supporting infrastructure such as test data management, mocks, and service virtualisation, act as the testing expert alongside each product's Tech Lead to define strategy and release criteria, and integrate tests into CI/CD with quality gates that block unsafe releases. A first major deliverable is establishing how to test the AI Voice Agent (already live) and the upcoming AI Chat Agent — building an end-to-end approach that survives non-determinism, with scripted multi-turn conversations, criteria-based quality judgment, and statistical thresholds instead of exact matching.

WHAT WE'RE LOOKING FOR (Required)

• Strong programming ability in TypeScript/JavaScript, writing production-grade code
• Comfortable reading and navigating application code (Node.js, React/Vue)
• Proven experience building an automated test suite from a low or fragmented baseline, and consolidating inconsistent existing tests
• Modern test automation frameworks (e.g. Playwright, Cypress, Vitest/Jest, or equivalents)
• API and integration testing, including test data and mocking strategies
• Experience with CI/CD pipelines and integrating automated tests into them (e.g. Azure DevOps, GitHub Actions)
• Hands-on, current use of AI coding assistants (e.g. Claude, Copilot, Cursor) in real delivery work
• Practical experience designing and evaluating LLM-based systems: building evaluation sets, prompt regression testing, and working knowledge of how prompts, context windows, retrieval, and tool calling affect output
• Comfortable reasoning about non-deterministic results rather than expecting a binary pass/fail
• Solid SQL and database knowledge for verification and test data setup
• Git and standard engineering workflows
• B2 English (Upper Intermediate) or above

NICE TO HAVE (Preferred)

• Experience with contract testing (e.g. Pact) or performance testing tools (e.g. k6)
• Prior experience testing voice-based or conversational AI agents specifically
• Background working in telecom or other large-scale, regulated platform environments