Endereço We are seeking an experienced and visionary Lead Data Engineer to join our Stellar team!
As the Lead Data Engineer, you will be a key player in designing and implementing the robust data infrastructure to power our data-heavy company. You will collaborate with cross-functional teams to build core data pipelines, store data in optimal engines and formats, and feed our machine-learning models. This is an individual contributor role with the potential to lead. You will work closely with our VP of Technology to define and implement a strategic vision for Data Engineering within the organization.
Your expertise in Spark and Scala will be critical for success. CUSTOMER Our client is a CTV advertising platform purpose-built for performance marketers.
They leverage massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes.
PROJECT The solution combines media buying, optimization, measurement, and attribution in one, efficient platform.
The platform is built by industry leaders with a long history in programmatic advertising, digital media, and ad verification who have now purpose-built a CTV performance platform advertisers can trust to grow their business.
Job Description
- Design and implement robust data infrastructure using Spark with Scala
- Collaborate with our cross-functional teams to design data solutions that meet business needs
- Build out our core data pipelines, store data in optimal engines and formats, and feed our machine-learning models
- Leverage and optimize AWS resources
- Collaborate closely with the Data Science team
Qualifications
- Minimum of 7 years of experience in Data Engineering
- Proven experience building data infrastructure using Spark with Scala
- Familiarity with data lakes, cloud warehouses, and storage formats
- Strong proficiency in AWS services
- Expertise in SQL for data manipulation and extraction
- Excellent written and verbal communication skills
- Bachelor's degree in Computer Science or a related field
WILL BE A PLUS:
- Experience in AdTech
- Familiarity with Elastic Map Reduce (EMR)
- Previous experience leading and/or building out a Data Engineering function
- Proven experience working closely with Data Science teams on machine learning pipelines
