Scalable Security & Performance Benchmarking Suite
→
Summary
Designed and implemented an end-to-end testing infrastructure for a high-security data environment as part of graduate research.
Chaitanya
Strategic Software QA Engineer
New York, US.About
Strategic Software QA Engineer with 5+ years of experience in high-stakes testing infrastructure, specializing in designing automated evaluation systems and scalable benchmarking frameworks. Proven track record of operating in fast-paced, 0 to 1 environments to prevent regressions and ensure the reliability of sophisticated software systems. Committed to advancing the frontier of physical engineering through rigorous, data-driven AGI evaluation.
Work
Amazon
|Senior Software QA Engineer
Albany, NY, US
→
Summary
Led the development of automated testing frameworks at Amazon, significantly reducing manual evaluation time and enabling high-velocity deployment cycles.
Highlights
Spearheaded the design and implementation of automated testing frameworks from the ground up, reducing manual evaluation time by 60% and enabling high-velocity deployment cycles.
Developed intricate evaluation benchmarks to precisely measure system accuracy against real-world data specifications, guaranteeing high-fidelity outputs for key enterprise clients.
Collaborated cross-functionally with AI/Software Engineers to translate abstract business requirements into precise, automated technical validations, enhancing product quality and integrity.
Pioneered and implemented a regression prevention strategy, proactively identifying critical system vulnerabilities before production and sustaining 99.9% system reliability.
Led a "0 to 1" initiative for a new internal tooling suite, guiding its development from concept to a fully tested, production-ready state within a single quarter.
TCS
|Software QA Engineer
Hyderabad, India, India
→
Summary
Engineered scalable automation suites using Selenium and Java, covering over 80% of critical paths and significantly reducing the risk of functional regressions for high-security financial systems.
Highlights
Engineered scalable automation suites using Selenium and Java, achieving 80%+ critical path coverage and significantly mitigating functional regression risks.
Optimized data-driven testing protocols, accelerating quantitative analysis speed during the evaluation phase by 40%.
Managed end-to-end testing lifecycles for high-security financial data systems, ensuring stringent compliance with information assurance standards.
Executed rapid-response bug triage in a low-bureaucracy environment, prioritizing and resolving critical bugs based on data-driven impact assessments.
Education
Wilmington University
Wilmington, DE, United States of America
→
Master's
Information Security Assurance
Grade: 3.7 GPA
Skills
Evaluation & Testing
Automated Evaluation Frameworks (Evals), Benchmarking, Regression Testing, Model Performance Evaluation, Test-Driven Development (TDD).
Technical Stack
Python, Java, Selenium, SQL, API Testing (Postman/RestAssured), Jenkins, Git, Docker, Kubernetes.
Engineering Domains
Quantitative Intuition, Data-Driven Decision Making, Information Security Assurance, Agile/Scrum, CI/CD Pipeline Integration.
Soft Skills
Rapid Prototyping (0 to 1), Cross-functional Leadership, Technical Problem Solving, High-Velocity Execution.
Projects
Automated Industrial Data Validator
→
Summary
Built a proprietary tool to validate massive datasets against physical-world constraints (quantitative intuition), identifying discrepancies that standard QA tools missed.
Autonomous Evaluation Framework for AI Agents
→
Summary
Engineered a custom benchmarking tool to evaluate the accuracy of logic-based outputs, utilizing Python and automated scripts to simulate 500+ edge-case scenarios.