Lead, Big Data Engineer
qualys
Full time
QA Data Science Engineer
qualys· QLYS_IN Qualys Security TechServices Private Ltd.
About this role
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Job Description
We are seeking a Data Science focused QA engineer to develop next-generation Security Analytics products. You will work closely with Data scientists, engineers and product managers to design and optimize AI driven security solutions.
As QA engineer, the ideal candidate has a strong background in Backend engineering, system integrations, ML,AI and data pipelines.
Responsibilities (QA Engineer – Data Science / ML)
Establish QA best practices for Traditional ML and Generative AI workflows, including:
Functional and regression testing of ML pipelines using pytest and Airflow/Dagster test utilities and API testing tools (e.g., Postman, pytest-httpx).
Validate data contracts, schemas, and API compatibility across services using Pandera, and custom validation rules.
Model behavior validation (input/output ranges, invariants, edge cases) using NumPy, SciPy, and statistical assertions
Runtime and performance testing for inference latency, throughput, and resource usage using Locust, k6, or custom load tests.
Integrate ML-specific tests into CI/CD pipelines using GitHub Actions, GitLab CI, or Jenkins, alongside containerized workflows (Docker, Kubernetes).
Implement LLM-specific testing, including:
Prompt and response validation, determinism checks, and regression testing using LangSmith.
Evaluation of hallucinations, toxicity, and policy adherence using LLM-as-a-judge and/or rule-based checks.
Cost, token usage, and timeout monitoring for GenAI workflows
Verify logging, monitoring, and alerting for ML services using Prometheus, Grafana, and cloud-native observability tools.
Requirements:
BS or MS in Computer Science or a related field.
2-5 years of experience in Data or Machine Learning projects.
Familiarity and experience of GenAI applications and tools -PyTorch, LangChain, vLLM etc.
Demonstrates a commitment to continuous learning in this rapidly evolving field.
Tools listed in the responsibilities section.
Frequently Asked Questions
Is the salary disclosed for the QA Data Science Engineer position at qualys?
The salary for this QA Data Science Engineer role at qualys is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the QA Data Science Engineer position at qualys located?
This QA Data Science Engineer role at qualys is based in Pune. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the QA Data Science Engineer role at qualys full-time or part-time?
This is listed as a Full time position. It is posted as a QA Data Science Engineer role in the QLYS_IN Qualys Security TechServices Private Ltd. department at qualys.
Which team or department does the QA Data Science Engineer at qualys belong to?
This QA Data Science Engineer position is part of the QLYS_IN Qualys Security TechServices Private Ltd. department at qualys. See the full job description for more information about the team structure and responsibilities.
How do I apply for the QA Data Science Engineer position at qualys?
Click the "Apply Now" button on this page. You will be redirected to qualys's official application portal hosted on workday where you can submit your application directly.
QA Data Science Engineer
qualys
You'll be redirected to qualys's official application page on Workday.