About the company
Our client is a fast-growing software company.
The role
Raydar is recruiting for this role on behalf of our client. Own software quality end to end, pairing automated testing with evaluation work for systems whose results vary from run to run. You will establish the testing and evaluation practices from scratch, set release standards and keep delivery pipelines dependable.
What you'll do
- Build and maintain automated end-to-end, integration and regression test coverage across the platform.
- Design evaluation harnesses, reference datasets and scoring criteria to judge the correctness of machine-generated output.
- Determine whether model or prompt changes improve or degrade results.
- Define and document the quality gates that decide whether a release ships, and uphold them under delivery pressure.
- Keep CI pipelines reliable by fixing flaky tests, slow runs and unclear failures.
- Run exploratory and release testing on customer-facing workflows that automation does not cover.
- Triage defects through to verified fixes and feed recurring failure patterns back into planning.
Requirements
What we're looking for
- At least 5 years in QA, SDET or test engineering, with ownership of automated coverage for a production product.
- Experience building test frameworks, not only running existing suites.
- Solid scripting ability for test automation in Python or TypeScript.
- Hands-on experience with a modern browser automation framework, plus API testing.
- Fluency in CI/CD, including building and maintaining pipelines.
- Sound judgment on severity and prioritization, and disciplined handling of flaky results and false positives.
- Comfort testing systems whose outputs are not predictable.
- High agency in an environment without an established playbook, ideally with early-stage experience where the QA function was created from scratch.
- Confident spoken English for everyday collaboration with an international team.
Bonus points
- Hands-on work assessing the quality of AI-driven features, such as designing evaluations, catching fabricated output and setting up human review.
- Familiarity with large business software ecosystems, or willingness to learn one deeply.
- Exposure to enterprise test tooling, test cycles or user acceptance testing.
- Performance, load or security testing experience.
- Enough coding skill to fix bugs rather than only report them.
Benefits
Compensation and benefits
- Base salary: USD 60,000 to 72,000 per year
Location and work model
- São Paulo, Brazil
- Hybrid, 3 days per week in office
- Full-time