Find your next job. Start today.

From the employer's own careers site

Senior Software Engineer, AI Infrastructure Solutions

Date Posted: Nov 05, 2026
Apply on company website
Sign in to keep track of your applications.
Get jobs like this sent to you
Your own AI Job Agent checks every new job against your CV and sends only the ones that fit, on WhatsApp. ₹199 a month, GST included. Full refund if it does nothing.
Start my Job Agent on WhatsApp

Job Detail

  • location_on
    Location Pune, Maharashtra, India
  • desktop_windows
    Job Type: Full Time/Permanent
  • schedule
    Shift:
  • analytics
    Career Level:
  • group
    Positions:
  • calendar_view_day
    Experience:
  • male
    Gender: No Preference
  • school
    Degree:
  • calendar_month
    Apply Before: Dec 30, 2026

Job Description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. NVIDIA is seeking an outstanding Senior Software Engineer to join our AI Infrastructure Solutions team in Pune. This is your opportunity to work on groundbreaking technologies and help build the future of computing! NVIDIA is a global leader in innovation, offering a dynamic and inclusive work environment in Pune or equivalent experience. We value diversity and provide equal opportunities to all candidates. If you’re passionate about building scalable AI platforms and autonomous agent solutions that impact industries worldwide, we want to hear from you!


What You’ll Be Doing:

  • Design, build, and operate AI infrastructure solutions that power LLM-based applications and autonomous agents across the enterprise.
  • Develop agentic AI workflows and multi-agent systems, including tool calling, planning, memory, retrieval-augmented generation (RAG), and orchestration using frameworks such as LangChain, LangGraph, or similar.
  • Integrate and serve LLMs through APIs and inference endpoints, optimizing for latency, throughput, cost, and reliability.
  • Containerize applications with Docker and deploy and scale them on Kubernetes, including Helm charts, autoscaling, and GPU-enabled workloads.
  • Take applications to L3 level: own production readiness, advanced troubleshooting, root-cause analysis, performance tuning, and escalation support for complex issues beyond L1/L2.
  • Define and maintain observability for AI systems, including logging, metrics, tracing, and monitoring of agent behavior, LLM quality, and system health.
  • Build and maintain CI/CD pipelines for automated build, test, and deployment of AI applications and infrastructure.
  • Develop high-performance backend services and RESTful APIs (Python and/or .NET Core) that expose AI capabilities to internal applications.

What We Need to See:

  • Bachelor’s or equivalent experience in Computer Science, Engineering, or a related field.
  • 5+ years of software engineering experience, with 2+ years working on AI/LLM-based solutions.
  • Hands-on experience building agentic AI and autonomous agent systems, including tool use, multi-agent orchestration, and RAG pipelines.
  • Strong experience with LLMs and their integration (OpenAI-compatible APIs, NVIDIA NIM, Hugging Face, or similar), prompt engineering, and evaluation.
  • Strong proficiency in Python; experience with C#/.NET Core and ASP.NET Core for REST API development is a plus.
  • Solid experience with Docker and Kubernetes, including deploying, scaling, and troubleshooting containerized workloads in production.
  • Proven experience supporting applications at L3 level, including incident management, debugging, performance optimization, and root-cause analysis.
  • Experience with CI/CD tools (GitHub Actions, Azure DevOps, GitLab CI, Jenkins) and Git-based workflows.

Ways to Stand Out from the Crowd:

  • Experience with GPU-accelerated workloads, NVIDIA AI Enterprise, NVIDIA NIM, Triton Inference Server, or NeMo.
  • Familiarity with MCP (Model Context Protocol) and agent-to-agent communication patterns.
  • Experience with LLM evaluation, guardrails, and safety frameworks.
  • Contributions to open-source AI or infrastructure projects.

NVIDIA delivers competitive pay, a wide range of benefits, and the possibility to contribute to groundbreaking technologies. Join us in building the future of computing! Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Source: NVIDIA careers — Read the original posting and apply

This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.

See how well you match this job

Make a free profile in a minute — no CV needed — and we score every job against it.

Make my profile

Already registered? Sign in

Company Overview

NVIDIA
NVIDIA · Bengaluru, Karnataka, India
243 open roles

NVIDIA is an employer in the Semiconductors/Electronics sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam Ki Khoj is not a... Read More

Apply safely

From the employer's own careers site. Kaam Ki Khoj reads this job from nvidia.wd5.myworkdayjobs.com. You apply there, on the employer's own website.

Applying is free. A genuine employer never asks you to pay: no registration fee, deposit, training fee or kit charge, and never your OTP or bank PIN. If anyone asks for money for this job, it is a scam.

How to spot a fake job · Check an offer free

Report this job

Related Jobs

One upload, every employer

Let the right employer find you

Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.

Upload your CV Browse jobs