As a Data Engineer, you will apply your skills in the forefront of Big Data which drives Augury’s AI & BI core. You will handle over one million recordings a day, totaling up to 0.5TB ingested daily and growing, and you will build scalable & robust big-data infrastructure, pipelines and shape our data lake. You will be an essential part of keeping Augury’s ML models at the top of their game! Working closely with data science & analytics teams, you will provide fast and accurate business insights.
- Work closely with the data science / analyst teams on building the best infrastructure for their needs
- Build core infrastructure to support running Machine Learning models that do near real-time prediction
- Build CI/CD infrastructure for our big-data architecture components that includes code linting, tests, monitoring and deployment
- Debug core performance problems around big DB query and data pipelines efficiency and code complexity in both production & research environment
What You Bring
- Your playground: You’re a Data Engineer experienced in large scale data infrastructure. You enjoy working with data processing frameworks such as Beam, Spark, Storm, and streaming systems on a large scale such as kafka, etc. You are well acquainted with distributed (micro)services architecture. You are a proficient & versatile developer (preferably in Python). Experience working on projects going from research to production is nice to have.
- Own it: You are eager to drive meaningful changes by leading initiatives and projects. You’re a restless problem solver and have a good system understanding
- Team player: You love working with people. You have an open mind and are an active listener.
We love creating stuff. We are passionate about building meaningful products that can change the world. Our team is a diverse group of people that breed creative thinking and are not afraid of having fun. We treat each other with respect, dignity, and humility- we are only as good as the relationships we build. We don’t pursue the mythical work-life balance - there is only life, and Augury is a part of it.
- Stock options
- Paid parental leave
- Flex PTO