Senior Software Engineer - Code Gen - LLM Specialist

Posted 3 Days Ago
Be an Early Applicant
New York, NY
Hybrid
187K-240K Annually
Senior level
Artificial Intelligence • Cloud • Software • Cybersecurity
We are building the monitoring and security platform for developers, IT ops teams and business users in the cloud age.
The Role
The Senior Software Engineer will work on AI-assisted tools to enhance developer productivity at Datadog by building LLM-based agents. Responsibilities include collaborating with cross-functional teams, prototyping solutions, following latest research, and integrating systems to improve user experience. Candidates must have a background in backend engineering with experience in LLMs and developer tools.
Summary Generated by Built In

We're a new team building AI-assisted tools to make Datadog developers more effective, by autonomously generating tests, fixing bugs, and improving performance.
We're looking for a product-minded generalist to help us quickly define and ship products that make all Datadog customers 10x developers.
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What You'll Do:

  • Work closely with our users, designers, PMs, and data scientists on cutting edge and delightful LLM-based agents
  • Work on prompts, evals, and agent tools for working with code, and on the engineering to productionize these systems and integrate them with Datadog products
  • Prototype and see what works well in the real world, iterate closely with our users, and then ship
  • Follow the latest research on LLM prompting, agents, and code editing
  • Work with other Datadog teams to expand capabilities, for example integrating with the Datadog IDE extensions to deliver a CoPilot-like assistant, or Dynamic Instrumentation to collect more runtime data from production and pre-production environments


Who You Are:

  • You're a backend engineer with at least 5 years of professional experience (Go, Java, Python) who values code simplicity and performance. You've shipped software that uses LLMs to production
  • You are passionate about Generative AI and its ability to help software engineers be more productive
  • You have relevant experience with Large Language Models, large-scale systems and data sets, machine learning, or adjacent fields
  • You are a great community ambassador and can drive hard technical conversations towards a pragmatic solution
  • You want to work in a fast, high-growth startup environment that respects its engineers and customers
  • You have experience writing developer tools (such as IDEs, static code analysis tools, or compilers)
  • You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent experience


Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.
Benefits and Growth:

  • Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development
  • Have a lot of influence on product direction and impact on the business
  • Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
  • Competitive global benefits
  • Continuous professional development


Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.
The reasonably estimated yearly salary for this role at Datadog is:
$187,000 - $240,000 USD
About Datadog:
Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram , LinkedIn, and Datadog Learning Center.
Equal Opportunity at Datadog:
Datadog is an Affirmative Action and Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.
Your Privacy:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog's Applicant and Candidate Privacy Notice .

Top Skills

Go
Java
Python

What the Team is Saying

Darcy
Kyvaune
Mia
Zina
Cameron
LJ
Micah
Wissal
The Company
New York, NY
5,200 Employees
Hybrid Workplace
Year Founded: 2010

What We Do

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another.

Why Work With Us

At Datadog, we learn from and celebrate each other daily - each win is a team win. Datadogs solve tough problems, innovate pragmatically, and grow together. We promote from within, provide mentorship and opportunities for career development, and support our colleagues in the process. Best of all? We truly love what we do.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Datadog Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them and their team.

Typical time on-site: 3 days a week
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account