Senior Data Engineer

Who We Are
At adMarketplace, our mission is to deliver the most engaging consumer search experiences while empowering advertisers to measure media performance accurately. Today, millions of people worldwide engage with our exclusive, transparent media placements across the internet's leading browsers, shopping apps, and review sites.
Our award-winning culture is built around five core values (known as our 5C's): Curiosity, Collaboration, Creative Conflict, Commitment, and Competitiveness. With these guiding values, adMarketplace seeks to empower our team to reach their full potential through continued learning, and the opportunity to do their best work.
The Role
At adMarketplace, we create best of breed consumer search technology using cutting-edge architecture with millisecond response time and crunch through terabytes of data every day. The ideal candidate is motivated to design for massive scale and push the boundaries of using real-time data in automated decisions. You will be involved in the entire software development lifecycle, from defining requirements to designing, coding, testing, and supporting the product in production. You will have a clear career progression path and numerous opportunities for both personal and professional growth in an intellectually stimulating and dynamic work environment.
Responsibilities

• Develop and maintain ad-tech related data systems and system components using Python
• Data streaming, processing, and aggregation solutions
• Data-driven applications, ETL/ELT Pipelines
• 24/7 low latency large-scale distributed systems
• Cloud migration and containerization projects
• External Integrations for data exchange
• Work with the team for technical implementation of Data Engineering projects including data streaming, data transformation and aggregation pipelines
• Build data pipelines on cloud-based platforms
• Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
• Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions

Basic Qualifications

• BS in Engineering, Computer Science or related discipline
• Must have 5+ years strong hands-on development experience using Python
• Must have experience with big data and streaming technologies like Apache Spark, Apache Kafka and Data Warehouse
• Experience with Cloud Analytics platforms like Databricks/Snowflake
• Experience developing, delivering and maintaining scalable data streaming, ETL processing and aggregation pipelines
• Experience Workflow Management tools like Airflow, Argo Workflows, Azkaban
• Experience with relational SQL and NoSQL databases
• Experience with public cloud AWS/ GCP/ Azure
• Experience working in a Linux environment/ Shell Scripting
• Ability to collaborate with multiple teams and understanding testing and deployment methodologies
• Experience building software in continuous integration and delivery fashion in an automated way
• Excellent documentation, communication, and troubleshooting skills

Preferred Qualifications

• Experience with Java/Scala development
• Databricks experience is a big plus
• Experience with Search Engines like Apache Solr, ElasticSearch
• Agile software development experience.
• Prior experience in the ad tech or e-commerce industry.

*Compensation Range: $170,000 - $220,000
#LI-Onsite
#LI-TB1
Join Us
adMarketplace has been named as one of the best places to work in New York City by Built In and Crain's- the latter of which have recognized us the past three years straight! AMP is currently experiencing triple digit growth, and it's never been a better time to join our team!
We offer a robust continuing education program, management training, regular company-wide lunch and learns, and well-defined career paths to ensure all our employees have an opportunity to grow.
At adMarketplace, we play to win, but we learn from our setbacks. Our commitment to a collaborative environment means no one succeeds alone, and no one fails alone either.
We know you've come to expect comprehensive healthcare, wellness programs, paid time off, commuter benefits, and 401k matching from any company, so it's a good thing we offer all of that and so much more. adMarketplace offers a dog friendly office, Summer Fridays, catered lunches, a fully stocked kitchen, ZogSports teams, happy hours and corporate retreats to encourage a strong work/life balance.
No Third Party Recruiters. We do not accept unsolicited agency resumes and we are not responsible for any fees related to unsolicited resumes.
*This range represents the low and high end of the base salary someone in this role may earn as an employee of adMarketplace in the New York office. Salaries will vary based on various factors including but not limited to professional and academic experience; training; associated responsibilities; and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.