D
dileep's photo
Aratla Sri Sai Dileep
From India 06:45 PM (GMT+05:30)
$50/hr or $12,000/yr

Active 1 hour ago


Member since Oct 2026

Share this profile:

GenAI Engineer | Agentic AI & LLM Applications

AI-native engineer
Available for hire
Years of experience
1+ years
Experience level
Mid-level
Available for
Full-time, Part-time, Contract, Freelance
Available from
19 Oct 2026

I'm an AI Research Associate with around one year of professional experience working on Amazon Nova Act, an agentic AI system, at Keywords Studios. My work focused on evaluating AI model behavior, analyzing responses, testing prompts, validating data, identifying errors and edge cases, and providing feedback to improve model quality and reliability.

I enjoy understanding how AI systems behave, identifying areas for improvement, and solving problems through structured analysis and testing. I'm interested in opportunities where I can apply my experience in agentic AI evaluation, prompt engineering, and AI quality assessment while expanding my technical skills and contributing to the development of reliable AI systems.

Skills

No skills.

Languages

Employment History

AI Evaluation Specialist (Freelance) at Handshake AI Fellowship 2026 - 2026
Authored a Terminal-Bench 2 coding-agent task with an agent-facing specification, executable reference solution, deterministic Pytest verifier, and Docker environment, enabling reproducible evaluation from observable outputs.  Developed Signal Siege, a strategy-game benchmark with hidden matches and legality checks; added timeouts, process isolation, and anti-cheat safeguards to evaluate agents under controlled conditions.  Validated tasks with Harbor reference and no-op runs and GitHub Actions checks; reviewed agent trajectories and verifier edge cases to fix ambiguous requirements and false-positive results.
AI Research Associate at Keywords Studios 2025 - 2026
Evaluated and tested Amazon Nova Act agentic AI outputs against task instructions and rubrics for task completion, accuracy, reasoning quality, and instruction following; identified hallucinations, unsupported claims, and failure cases.  Reviewed AI training-data annotations and validated structured outputs against JSON Schema requirements; created reusable scoring guidelines to keep recurring model evaluations and annotation reviews consistent
AI/ML Software Engineer Trainee at Centralogic 2025 - 2025
Completed training across data preprocessing, model experimentation, evaluation, deployment, and monitoring; supported benchmarking and hyperparameter optimization for internal workflow automation projects.

Education

Masters of Computer Applications at JNTUK 2022 - 2024
Bachelors of Computer Science at Aditya Degree College 2019 - 2022