Lead Data Engineer

Job Posted 9 Days Ago Posted 9 Days Ago
Be an Early Applicant
New York, NY
150K-160K Annually
Senior level
Logistics • Software
The Role
The Lead Data Engineer will build and deploy new platform features, ensuring performance and reliability, while mentoring junior team members. Responsibilities include developing and maintaining ETL pipelines, designing data warehouses, developing APIs, and collaborating with cross-functional teams on data-related challenges.
Summary Generated by Built In

Title: Lead Data Engineer

Reports to: Chief Technology Officer

About the Company: 

Sourcemap is the leading provider of supply chain mapping, traceability, and transparency software. Our clients include category-leading global brands, manufacturers and suppliers across the food & agriculture, fashion, beauty, manufacturing and electronics industries. We seek committed individuals who will join our team to support our award-winning, values-led work and to tackle important supply chain challenges in a dynamic startup environment.

Job Summary:

Sourcemap is seeking a Lead Data Engineer to join our growing Engineering team. In this hands-on role, you will play a key part in building and deploying new platform features, while ensuring performance, reliability, and scalability. Additionally, you will participate in developing and mentoring junior team members by sharing best practices and past experiences to support their growth.

This role offers the opportunity to work with cutting-edge data technologies, collaborate with cross-functional teams, and contribute to the evolution of our data infrastructure.

Sourcemap is headquartered in New York City and there may be an option for this position to be remote or hybrid in CST or EST time zones.

Primary Responsibilities:

  • Develop and maintain ETL and ELT pipelines.
  • Design, build and manage Data Warehouse and Data Lake environments.
  • Develop APIs to support data integration and accessibility.
  • Assemble and process large, complex sets of data to meet both functional and non-functional business requirements.
  • Optimize data delivery to improve efficiency and reliability.
  • Automate manual data processing procedures to streamline operations.
  • Collaborate with stakeholders including data scientists, design, and product teams, to address data-related technical challenges.
  • Leverage strong analytic skills to work with and extract insights from unstructured datasets.

Experience Requirements and Skills:
Required

  • 7+ years of experience writing production-ready Data Pipelines (Python, SQL, Scala, etc.).
  • 6+ years of experience working with relational SQL and NoSQL databases.
  • 3+ years of experience using geospatial tools, data and techniques (ESRI, QGIS, GDAL, Geopandas,), including handling multiple geometry types and coordinate transformations, etc.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Data architecture experience with cloud platforms such as Azure, Databricks, etc.
  • Experience using Big Data Tools such as Databricks, Snowflake, Spark, etc.
  • Project Management experience.
  • Other experience: proficiency in Git and debugging complex data pipelines.
  • Comfortable with Data Visualization & Web Mapping concepts.

Other Skills & Qualifications:

  • Effective listening, verbal and written communication skills. Demonstrates openness to others' ideas.
  • Ability to identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Adaptable and agile in a fast-paced environment.
  • Enjoys working in a collaborative environment.
  • Goal-oriented and a self-starter.
  • Ability to multitask, prioritize and manage time effectively in order to meet demanding deadlines.
  • A natural leader who enjoys mentoring and guiding junior developers.
  • Enthusiastic and positive team player.

Sourcemap offers a competitive compensation package based on job-related factors such as business needs, experience, level of responsibility, and qualifications. For this role, the base salary range is $150K to $160K. Sourcemap offers a benefit package, including but not limited to paid time off, paid holidays, medical, dental and vision benefits, 401k.

Sourcemap provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
New York, NY
95 Employees
On-site Workplace
Year Founded: 2011

What We Do

Sourcemap is the supply chain transparency company: helping consumers and companies trace products to the source and ensure standards are met every step of the way. Founded in 2011 after the Tohoku Tsunami devastated supply chain worldwide, Sourcemap is committed to providing visibility across the world's most complex trade networks. Our software solutions help companies visualize their supply chains, discover indirect suppliers, measure risk, manage continuous improvement, track and trace individual products, and publish their supply chains online.

Similar Jobs

Capital One Logo Capital One

Lead Data Engineer (Python/Scala, Spark, AWS)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
176K-241K Annually

GoodRx Logo GoodRx

Lead Data Engineer

Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
Remote
Hybrid
5 Locations
800 Employees
151K-323K Annually

The Walt Disney Company Logo The Walt Disney Company

Lead Data Engineer

AdTech • Digital Media • News + Entertainment
New York, NY, USA
200000 Employees
152K-224K Annually

Capital One Logo Capital One

Lead Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
New York, NY, USA
55000 Employees
211K-241K Annually

Similar Companies Hiring

Hex Thumbnail
Software • Business Intelligence • Big Data Analytics • Big Data • Artificial Intelligence • Analytics
New York, NY
100 Employees
Stepful Thumbnail
Software • Healthtech • Edtech • Artificial Intelligence
New York , NY
60 Employees
Immuta Thumbnail
Software • Security • Data Privacy • Database • Cybersecurity • Cloud • Big Data
New York, NY
180 Employees
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account