Senior Inference Technical Product Marketing Manager - Accelerated Computing Job at NVIDIA, Santa Clara, CA

cVZiTXc1WGR3cU11VTFLR3JWWW9mT2hyVXc9PQ==
  • NVIDIA
  • Santa Clara, CA

Job Description

We are looking for a Senior Technical Product Marketing Manager. This role will be located in our rapidly growing data center business and pivotal in our inference marketing. You will be focused on working with engineering to understand the technical capabilities of our inference stack from GPUs, CPUs, networking, CUDA libraries, model architectures and deployment techniques (parallelisms, configurations, etc.). You will influence NVIDIA’s entire technical marketing strategy to showcase our leadership position in AI inference.

Want to join a fun, creative company that is at the forefront of outstanding Generative AI technologies? NVIDIA is developing groundbreaking solutions in some of the world’s most exciting areas including artificial intelligence and high performance computing. Come grow your career to new heights at one of the fastest growing technology companies!

What You’ll Be Doing:

  • Help drive NVIDIA’s inference platform technical go-to-market efforts

  • Work closely with engineering and product management teams to understand key technical capabilities of our inference stack from GPUs, CPUs, networking, CUDA libraries, model architectures and deployment techniques (e.g.parallelisms, configurations, etc.)

  • Diligently review and remain up to date on model architectures, frameworks, arxiv papers, whitepapers deployment techniques (e.g.disaggregated serving, KV cache implementations) and identify intersection points between the latest AI models and NVIDIA’s platform to maximize performance and minimize TCO

  • Develop crisp clear positioning, messaging and assets to highlight NVIDIA’s leadership position in inference. Assets (blogs, whitepapers, presentations, analyst briefings, seminars at developer conferences)

  • Closely follow competitive inference announcements and prepare appropriate responses for business and technical/developer audiences

  • Assist on building keynote slides for executives for areas that you’re a subject matter expert

What We Need to See:

  • A BS Degree in Computer Science or Engineering or related field or equivalent experience in a technical product marketing role; Masters Degree preferred.

  • 6+ years of experience in LLM, AI/ML development in an engineering role followed by 5+ years of experience in product management or technical product marketing of AI/ML products

  • Deep understanding of modern data center architectures, accelerated computing, distributed inference, deep learning frameworks (PyTorch, TensorFlow, JAX), and inference-specific frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT-LLM, vLLM, SGLang)

  • Market Awareness – Experience conducting technical competitive analysis and synthesizing key insights

  • Collaboration & Influence – Proven ability to work cross-functionally across engineering, product management, sales, and marketing teams

  • Strong Communication, Asset Creation & Storytelling – Ability to translate sophisticated technical concepts into clear, compelling narratives for both technical and business audiences

  • Ability to present to executive audiences

Ways to Stand Out from the crowd:

  • Hands-on experience with AI inferencing workflows using NVIDIA or open-source serving frameworks running on accelerated computing in the data center

  • Experience developing LLM models

  • Experience working with hyperscale cloud providers

  • Hands-on Technical Competence – Background in software development, AI infrastructure, data center silicon

  • Demonstrated ability to engage with executive leadership and external partners

  • Published technical content or speaking experience at industry events

  • Have a portfolio of published marketing/launch assets

NVIDIA is widely considered to be one of high technology's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Our goal is to craft an environment where you can do your life's best work. If you're creative, self-motivated, and autonomous, we want to hear from you!

#LI-Hybrid

The base salary range is 144,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Job Tags

Similar Jobs

Connect Electric

Apprentice Electrician Job at Connect Electric

 ...Job Description Connect Electric is looking to add an Apprentice electrician to our staff. Wage DOE, benefits include vacation, paid holidays...  .... REQUIREMENTS At this time residential wiring experience preferred. We are looking for custom home, track home and/or... 

Aramark

Food Service Supervisor - JLL - Blackrock DE Job at Aramark

Job Description Time to step up your career! This is your moment to shine and lead the way for others too. Were hiring full-time Food Service Supervisors to join our passionate Food Services Team. Alongside a manager who will help coordinate and lead operations, you...

Westhab Inc.

Senior Case Manager Job at Westhab Inc.

 ...MANAGER DIVISION: SERVICES FLSA: NON-EXEMPT REPORTS TO: SHELTER DIRECTOR LOCATION: BROOKLYN, NY SALARY: $48,000.00 -$50,0...  ...day to day supervision to the case management team in a mens homeless shelter. He/She will need to work collaboratively with other on... 

Jerry's Enterprises Inc.

Cub Foods Chaska - Part Time Donut Fryer - Progressive scale up to $19.50 hour / based on experience Job at Jerry's Enterprises Inc.

Location: Cub Foods ChaskaReports to: Bakery ManagerClassification: Part Time UnionRate of Pay: Progressive scale up to $19.50 hour / based on experienceHours: Sunday - Saturday, varied hoursJerrys work perks:Store DiscountEmployee Assistance ProgramsFlexible ScheduleIndividuals...

HealthTrust Workforce Solutions HCA

Travel Paramedic - $1,689 per week Job at HealthTrust Workforce Solutions HCA

 ...HealthTrust Workforce Solutions HCA is seeking a travel Paramedic for a travel job in Asheville, North Carolina. Job Description & Requirements ~ Specialty: Paramedic ~ Discipline: Allied Health Professional ~ Start Date: 07/14/2025~ Duration: 26 weeks...