🏢
Lyft
Data Engineer, Pricing
Job Description
ABOUT THE ROLE
As a Data Engineer on the Pricing team at Lyft, you will play a critical role in building the data foundation that powers Lyft's pricing strategies. You will be responsible for architecting, building, and maintaining scalable data pipelines to support real-time pricing, experimentation, analytics, and modeling.
WHAT YOU'LL DO
Your primary responsibilities will include:
- Owning the pricing data pipeline and scaling up data processing flow to meet rapid data growth at Lyft
- Evolving data models and data schema based on business and engineering needs
- Implementing systems to track data quality and consistency
- Developing tools to support self-service data pipeline management (ETL)
- Tuning SQL and MapReduce jobs to improve data processing performance
- Writing well-crafted, well-tested, readable, and maintainable code
- Participating in code reviews to ensure code quality and distribute knowledge
- Unblocking, supporting, and communicating with internal and external partners to achieve results
WHAT YOU'LL NEED
To succeed in this role, you will need:
- A Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
- 2+ years of relevant professional experience
- Strong experience with Spark
- Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
- Strong skills in a scripting language (Python, Ruby, Bash)
- Good understanding of SQL Engine and ability to conduct advanced performance tuning
- Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
- Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
WHY REMOTE
While this role is based in the Lyft office, with a hybrid schedule requiring at least 3 days per week in-office, you will have the flexibility to work from anywhere for up to 4 weeks per year. This role offers the opportunity to work with a talented team of software engineers, machine learning engineers, and data scientists on projects that directly impact millions of riders and drivers.
BENEFITS
Lyft offers a comprehensive benefits package, including:
- Extended health and dental coverage options, along with life insurance and disability benefits
- Mental health benefits
- Family building benefits
- Child care and pet benefits
- Access to a Lyft-funded Health Care Savings Account
- RRSP plan with company match to help save for your future
- Flexible paid time off policy, including 18 weeks of paid parental leave
- Subsidized commuter benefits and Lyft ride credits