Your brand on every pageBecome a sponsor →
medtronic logo

IT Developer - LLM Engineer

Medtronic

Nanakramguda, Hyderabad, India

Applied AI

Posted 4 days ago

midonsite

Verified open on Nov 15, 2026 · posted 3 days ago

Job Description

Careers that change lives start here. Medtronic is a global leader in healthcare technology with a Mission to alleviate pain, restore health, and extend life. Our 95,000 employees work across more than 150 countries to put patients first — developing innovative medical technologies that improve the lives of 72+ million patients each year. Your unique talents will help shape the future of healthcare while building a career grounded in purpose, growth, and impact.

A Day in the LifeAs an IT Developer focused on Applied AI and Large Language Model engineering, you will design, evaluate, optimize, and operationalize enterprise AI systems across the complete model lifecycle. You will partner with platform engineers, data engineers, security teams, and domain experts to improve model quality, deploy production-ready AI solutions, establish evaluation frameworks, and drive measurable outcomes through data-driven experimentation and governance.

Responsibilities may include the following and other duties may be assigned.

  • Design and implement training, fine-tuning, and adaptation pipelines for open-weight Large Language Models using supervised fine-tuning, LoRA, QLoRA, and Parameter-Efficient Fine-Tuning (PEFT) techniques.
  • Build and curate high-quality datasets from operational data sources, incidents, runbooks, logs, knowledge articles, and validated interactions for model training and evaluation.
  • Develop model evaluation frameworks covering reasoning, instruction following, hallucination detection, tool calling, safety, robustness, and structured output quality.
  • Evaluate and optimize retrieval-augmented generation systems through retrieval analysis, embedding model comparison, reranking, chunking strategies, and groundedness assessment.
  • Design and execute agent and tool-calling benchmarks that measure task completion, tool selection accuracy, failure recovery, and operational safety.
  • Optimize model serving performance through quantization, batching strategies, cache management, inference tuning, and serving-stack evaluation.
  • Implement experiment tracking, model governance, lineage management, release gating, and deployment workflows using enterprise MLOps practices.
  • Establish production monitoring, quality drift detection, observability metrics, security testing, and rollback criteria for deployed AI solutions.

Required Knowledge and Experience: 

  • 3+ years of IT experience with a Bachelor's Degree in Engineering, MCA, or MSc. with 3+ years of software engineering or machine learning experience, including 2+ years of hands-on Generative AI or Large Language Model development.
  • Experience with Python, PyTorch, Hugging Face Transformers, Datasets, PEFT, and model fine-tuning workflows.
  • Experience implementing Large Language Model evaluation, retrieval-augmented generation, model benchmarking, and experiment tracking frameworks.
  • Experience with Linux, Docker, Kubernetes, Git, REST APIs, and cloud or GPU-based model deployment environments.
  • Experience with MLflow or Weights & Biases for experiment tracking, model lifecycle management, and artifact versioning.

Preferred Skills & Competencies :

  • Experience with direct preference optimization (DPO), TRL, DeepSpeed, Fully Sharded Data Parallel (FSDP), or distributed training techniques.
  • Experience deploying and optimizing models using vLLM, NVIDIA TensorRT-LLM, SGLang, or comparable inference-serving platforms.
  • Experience with RAGAS, DeepEval, TruLens, or similar evaluation and observability frameworks.
  • Experience in AI Ops, IT service management, incident management, observability platforms, knowledge systems, or automated remediation workflows.
  • Experience implementing OpenTelemetry, Prometheus, Grafana, model monitoring, security testing, and production release governance.

 

Physical Job Requirements

The above statements are intended to describe the general nature and level of work being performed by employees assigned to this position, but they are not an exhaustive list of all the required responsibilities and skills of this position. 

‌

‌

 

 

Recruitment Fraud Alert 

We are aware of phishing scams targeting job seekers. Please keep the following in mind: 


Apply only through official Medtronic channels. All legitimate Medtronic recruiting communications come from approved Medtronic platforms and official @medtronic.com email addresses. 


Medtronic will never ask for payment or sensitive personal information (such as bank account or Social Security details) during early stages of the hiring process. Any such requests are not legitimate. 


If you receive a suspicious message claiming to be from Medtronic, do not respond, click links, or open attachments. 


If you have any questions, concerns regarding the authenticity of a communication alleged to have been made by or on behalf of Medtronic, please contact us immediately at AskHR@medtronic.com. 

Benefits & Compensation

Medtronic offers a competitive Salary and flexible Benefits Package
A commitment to our employees lives at the core of our values. We recognize their contributions. They share in the success they help to create.  We offer a wide range of benefits, resources, and competitive compensation plans designed to support you at every career and life stage.
 

 

 

‌

This position is eligible for a short-term incentive called the Medtronic Incentive Plan (MIP).

Share this role:WhatsAppLinkedInX

Not ready to apply?

Get new Applied AI jobs in your inbox

Weekly, free, unsubscribe anytime

Career context

This role is classified as Applied AI.

Preparing to interview? Read the Applied AI interview guide.

$196k - $263k is the middle 50% of disclosed salaries, measured from 461 live Applied AI postings on this board. Roughly two thirds of postings disclose nothing, so this describes the ones that do, not the whole market.

Share your AI salary

Anonymous. No login, no name, no email required. It takes about 20 seconds, and it is how this board builds real pay data for AI roles instead of guesses.

Before bonus and equity.

Hiring for a role like this?

Reach AI professionals browsing the board - your listing goes live instantly.

Post a job →

Related AI jobs

Stay ahead of the curve. Get the week's new AI jobs in your inbox. Free, unsubscribe anytime.