Compute Technical Lead

Posted Yesterday
Be an Early Applicant
Hiring Remotely in New York, NY
Remote
Senior level
Artificial Intelligence • Big Data • Software • Analytics • Business Intelligence • Big Data Analytics
Hex helps people do more with data.
The Role
The Compute Technical Lead will oversee and enhance Hex's compute architecture, ensuring fast data processing and collaboration with backend engineers. The role involves refining caching strategies, proposing backend improvements, and mentoring team members, all while focusing on user needs and product speed.
Summary Generated by Built In

About the role

Our Supernova team looks after all of Hex’s compute backend, and is responsible for scaling our architecture to support fast data analysis at any data scale. 

This is a hugely challenging problem. Our users do everything from analyzing 100 line csv files through to querying TB / PB scale Snowflake tables, and in all cases expect to be able to do this without worrying how this is done under the hood.

Our job is to define and build the how, and we're looking for a seasoned technical lead to help us do this. 

A few of the things we work on:

  • Distributing compute to underlying warehouses where appropriate
  • How to support Hex’s polyglot functionality (interoperation between Python and SQL) while also running things as quickly as possible
  • Operating on datasets that are too large to pull into memory
  • Expanding our features to work correctly across the enterprise, including scaling infrastructure (with help from our Infra team), and architecture to support things like permissions on datasets and metadata

What you will do:

The following are a few examples of the kind of work you can expect to do in this role:

  • Work on evolving our compute architecture, including entirely new compute components that support our goal of providing ultra-fast execution by using the appropriate executors for the relevant query or operation
  • Refine our caching strategies to minimize return trips to data warehouses
  • Propose designs for extensions, improvements, or entirely new parts of our backend, and implement said designs
  • Collaborate with other teams to support new features — for example, building and exposing an internal query language that compiles to the appropriate dialect for any given connected warehouse
  • Mentor and help grow a team of high caliber backend engineers

About You

  • At least 6+ years of software engineering experience
  • Bonus: 2+ years of management or tech lead-manager experience
  • Excited about making a product as fast as it can be. Hex’s version of this is complex — our users can execute their own code against their own data!
  • A strong eye for detail, and a desire to deeply understand what’s going on under the hood. We’ve found examples of significant performance gains in the past by poring over execution logs and thoroughly understanding the internals of things like the Jupyter kernel and specific data warehouse connection drivers
  • Experience working in a remote team, and able to operate and communicate effectively in this context
  • An interest and desire to collaborate through technical RFCs, writing, and reviewing code
  • An instinct for strategic thinking and aligning with business and product goals while keeping a healthy balance of velocity and engineering excellence
  • Interest in the data space, and a love of shipping great products and building tools that empower end users to do more
  • An ability to lead initiatives while collaborating and mentoring fellow engineers
  • Have a key interest in the latest compute, caching, and technological advances relevant to our field. Some things we’ve been interested in lately are DuckDB, SQLGlot, Calcite, Polars, etc.

Our stack

Our product is a web-based notebook and app authoring platform. Our frontend is built with Typescript and React, using a combination of Apollo GraphQL and Redux for managing application state and data. On the backend, we also use Typescript to power an Express/Apollo GraphQL server that interacts with Postgres, Redis, and Kubernetes to manage our database and Python kernels. Our backend is tightly integrated with our infrastructure and CI/CD, where we use a combination of Terraform, Helm, and AWS to deploy and maintain our stack.

In addition to our unique culture, Hex proudly offers a competitive total rewards package, including but not limited to, market-benched salary & equity, comprehensive health benefits, and flexible paid time off.

The salary range for this role is: $150,400 - $258,500

The salary range shown may be a reflection of additional factors such as geographical location and skill ranges/levels we’re open to. Placement in the salary range will be decided upon completion of the interview process, taking into account factors like leaving room for growth, internal fairness & parity, your demonstrated skills, and the depth of your experience. Our Recruiting team will be able to provide more details during the interview process.


Top Skills

Python
Typescript
The Company
New York, NY
100 Employees
Hybrid Workplace

What We Do

We're building a collaborative platform for data science and analytics. Our product empowers users to explore, analyze, and share data more effectively and has become essential to how data teams at 800+ companies like Notion, Brex, and Fivetran operate.

Every day, Hex empowers thousands of people to ask and answer new questions of data, and seamlessly share the results with everyone. We have a big vision for analytics, where everyone can access and create knowledge from data – and there’s so much left to do. Our roadmap is full of big ideas and little details, and we want your help bringing them to life.

Why Work With Us

We’re a team of builders. We spend our days designing and developing beautiful products, growing and supporting our user base, and helping each other succeed and learn. To do that, we've developed a culture focused on quality, craft, and speed -- with very few meetings, bias toward action, and taking care of each other through feedback and support.

Gallery

Gallery
Gallery
Gallery
Gallery

Hex Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We have a truly hybrid workforce, with many employees working fully remotely, and others coming into one of our two offices (SF or NYC) 2-3 days per week.

Typical time on-site: Flexible
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account