Machine Learning Engineer (LLM Infrastructure)

Quick Links for This Job

About This Role

Microsoft is hiring for Machine Learning Engineer (LLM Infrastructure) in Hyderabad, Telangana / India. The opening is listed for 2+ years. Expected work includes: Optimize training pipelines for massive datasets across thousands of GPUs. Candidates should be ready to discuss related project, internship, or previous work experience. The main eligibility point to check first is: Strong coding skills in Python and proficiency in PyTorch or JAX. Useful focus areas before applying: PyTorch, Python, LLMs and Distributed Training. Work mode is marked as office or company-decided.

Before You Apply

Before applying for Machine Learning Engineer (LLM Infrastructure) at Microsoft, update your resume around the exact role title and location. Check this eligibility point first: Strong coding skills in Python and proficiency in PyTorch or JAX. Add one resume bullet or project example related to: Optimize training pipelines for massive datasets across thousands of GPUs. Prepare to discuss PyTorch, Python and LLMs in simple interview language.

Source & Verification

Editor note: HiringsToday structured this Microsoft Machine Learning Engineer (LLM Infrastructure) listing on 2026-06-07 using the available job details. Please verify the apply link, eligibility, deadline, and company instructions before submitting your application.

Responsibilities

• •

  Optimize training pipelines for massive datasets across thousands of GPUs.

  This responsibility is part of the role's regular work. Prepare one example from your projects or previous experience that shows you can handle it.

• •

  Develop low-latency inference services for real-time AI applications.

  This is the core delivery part of the job. Be ready to explain how you write, test, debug, and improve code in a practical project.

• •

  Collaborate with researchers to implement modern model architectures.

  This is about working with managers, engineers, and other teams without losing track of requirements and timelines.

Eligibility

• Strong coding skills in Python and proficiency in PyTorch or JAX

  This should be visible through projects, internships, coursework, or interview answers.

  Keep proof ready through your resume, certificates, marksheets, project links, or previous work details as applicable.

• Experience with distributed systems and high-performance computing

  Experience requirements are usually reviewed through resume details and interview discussion.

  Keep proof ready through your resume, certificates, marksheets, project links, or previous work details as applicable.

• Understanding of transformer architectures and LLM training techniques

  This point should be checked against your resume before submitting the application.

  Keep proof ready through your resume, certificates, marksheets, project links, or previous work details as applicable.

Required Skills

Salary & Benefits

Listed compensation for Machine Learning Engineer (LLM Infrastructure): Competitive. Treat this as the published or collected range for the opening, and verify it again on the application page because companies may revise salary, stipend, joining bonus, or benefits during the hiring process.

Why Apply

Application Notes

Preparation Tips

How To Apply

1. 1. Check eligibility

   Review the qualification, batch, experience, location, and skill requirements for Microsoft before opening the application form.

   5-10 minutes

2. 2. Update resume

   Keep the resume short and role-focused. Add matching projects, internships, tools, achievements, and contact details.

   20-30 minutes

3. 3. Apply through the listed link

   Use the application link on this page and fill the form carefully. Do not pay money for job applications.

   10-20 minutes

4. 4. Save confirmation

   Save the application confirmation, job ID, email receipt, or screenshot so you can track follow-up messages.

   2-5 minutes

About Microsoft

Microsoft is the hiring organization listed for this opening. Based on the job details available here, the role is connected with PyTorch, Python and LLMs and is located in Hyderabad, Telangana / India. Candidates should verify company details, office location, and application instructions on the source page before applying.

Frequently Asked Questions