Model Monitoring Analyst

Posted 9 Days Ago
Be an Early Applicant
Remote
110K-130K Annually
Junior
Consumer Web • Fintech
Instant financing to fuel your lifestyle.
The Role
The Model Monitoring Analyst will monitor and analyze the performance of predictive ML models in production, applying advanced techniques to derive business value. Responsibilities include analyzing large datasets, detecting feature drift, and generating recommendations for model quality. Communication with both executive and non-executive partners is crucial.
Summary Generated by Built In

Octane® is revolutionizing recreational purchases by delivering a seamless, end-to-end digital buying experience. We connect people with their passions by combining cutting-edge technology and innovative risk strategies to make lifestyle purchases - like powersports vehicles, RVs, and OPE - fast, easy, and accessible.

Octane adds value throughout the customer journey: inspiring enthusiasts with our editorial brands, including Cycle World® and UTV Driver®, instantly prequalifying consumers for financing online, routing customers to dealerships for an easy closing, and supporting customers throughout their loan with superior loan servicing.

Founded in 2014, we’re a company with 550+ employees and over 30 OEM and 4,000 dealer partners.  We are both the platform and the lender, which means we have both high growth and positive unit economics—rare for a fintech. Octane has raised >$100M in equity from IA Ventures, Valar Ventures, Contour Venture Partners, Citi Ventures, and other leading investors.

Now for the exciting opportunity, we are looking for a talented Model Monitoring Analyst to support monitoring predictive ML models deployed in production. You will be working with a versatile team of data scientists and financial professionals to analyze the performance of deployed models using dedicated monitoring tools and metrics. You will touch different phases of the model monitoring lifecycle from working closely with data science team to understand how the models should ideally perform based on pre-defined expectations to collaborating with business partners to ensure the efficacy of the deployed models is preserved to then visualizing different input features and the model score itself to flag alerts. You will have the opportunity to report key findings and metrics on a regular cadence to a larger group of professionals and bring forth recommendations relating to the quality of the model's health.

Responsibilities

  • Apply state of the art machine learning model monitoring techniques to drive business value 
  • Convert insights into concrete, significant recommendations for business or product improvement, and succinctly communicate these findings to both executive and non-executive partners
  • Analyze large data sets of proprietary and third-party data to detect drift in features and/or model score and suggest recommendations for policy, strategy, or product decisions
  • Research and keep up to date with new visualization and monitoring techniques and tools

Requirements

  • A recent advanced degree in Math, Statistics, Physics, Engineering, Computer Science or another quantitative field, OR a bachelor's degree followed by 2+ years of experience inclusive of business analytics, performance analysis, mathematical modeling, and/or data science
  • Ability to critically think and prioritize needs of the business
  • Familiarity / Experience with SQL
  • Familiarity / Experience with some data visualization tools, such as Tableau, Looker, Periscope, PowerBI, or similar software for reporting
  • Familiarity / Experience with Excel, Google Sheets or similar software 

Preferred 

  • Knowledge of Python, PySpark, SparkSQL, and statistical / ML packages
  • Experience with Databricks
  • Experience with cluster computing for data manipulation, analysis and data science 
  • Possesses understanding of machine learning algorithms and techniques
  • Basic command line experience
  • Experience with AWS or other cloud computing environments, specifically within the data domain
  • Experience with Git for code management
  • Experience with MLflow

Compensation: The role described above offers a base salary of $110,000 to $130,000.  Your offer will be based on the alignment of your qualifications with the requirements of the job, location and internal equity.  In addition to the above-mentioned salary, Total Rewards include a stock option package, and benefits as outlined below.

Benefits:

  • Robust Health Care Plans (Medical, Dental & Vision)
  • Generous Parental Leave
  • Up to 5 weeks time off (self-managed)
  • Retirement Plan (401k) with company match!
  • Educational Assistance/Tuition Reimbursement up to $3K/year 
  • Life Insurance (Basic, Voluntary & AD&D)
  • Short Term / Long Term Disability
  • Robust Ancillary benefits including accident insurance, hospital insurance, etc.
  • Wellhub wellness benefit
  • Powersports Safety Benefit

Octane Lending is an equal opportunity employer committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected status with respect to recruitment, hiring, promotion and other terms and conditions of employment.

#LI-JL1

#LI-Remote


Top Skills

Pyspark
Python
SQL
The Company
New York, NY
500 Employees
Hybrid Workplace
Year Founded: 2014

What We Do

Our Story
Octane was founded in 2014 to make financing powersports fast and easy.

Octane offers instant financing to fuel your lifestyle. We’re passionate about fast and fair lending, so we built the Octane Platform to enable instant financing for as many people as possible. And because we’re quicker and simpler than other lending platforms, we’re growing fast. Octane reaches millions of enthusiasts through editorial brands like Cycle World and UTV Driver and helps consumers buy their favorite products by prequalifying them on dealer and OEM websites. Join us in our mission to connect people with their passion.

Instant Finance Offers
Octane Prequal expands markets by providing personalized, real rates and payments. We give dealers and consumers tools to compare and understand what they can afford, even without perfect credit.

Soft-Pull, Impact-Free Credit Technology
We feel strongly about not impacting potential customers’ credit scores, so we built a technology that lets shoppers browse vehicles and rates without the damaging impact of hard credit pulls.

Robust Digital Tooling for Dealers
Our Dealer Platform provides flexibility and financing options for dealers. Octane enables serving more customers faster with an instant, fully digital experience, shaving hours off deal times. Octane increases sales and customer satisfaction.

Why Work With Us

We’re a diverse team of innovators determined to give our customers the best possible experience. Information is shared transparently, enabling cross-functional collaboration. We’re a performance based culture where accomplishments are both celebrated and rewarded, always looking for new talent to help us develop our industry-leading products.

Gallery

Gallery

Similar Jobs

MetLife Logo MetLife

Technical Functional Analyst I

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote
Argentina
43000 Employees

MetLife Logo MetLife

Senior Data Scientist - NLP

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote
Argentina
43000 Employees

MetLife Logo MetLife

Senior Data Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote
Argentina
43000 Employees

Smartcat Logo Smartcat

Product Analyst

Artificial Intelligence • Machine Learning • Natural Language Processing • Conversational AI
Easy Apply
Remote
12 Locations
242 Employees

Similar Companies Hiring

News 12 Thumbnail
News + Entertainment • Digital Media • Consumer Web
Bethpage, NY
720 Employees
Clay Thumbnail
Software • Sales • Productivity • Machine Learning • Consumer Web • Artificial Intelligence • Analytics
New York, NY
70 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
New York, NY
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account