Data Engineer
We are looking for a Data Engineer to build and implement functional programs. You will work with other Developers and Product Managers throughout the software development life cycle. In this role, you should be a team player with a keen eye for detail and problem-solving skills. If you also have experience in Agile frameworks and popular coding languages we’d like to meet you.
- Be actively involved with the team to design and build new data solutions - OLAP and OLTP
- Develop a variety of data workflows, pipelines, and ETL processes using cloud platform products and Indeed’s internal infrastructure and tools
- Use Airflow or other scheduling tools to build workflows DAGs and schedule jobs
- Developing stream-processing systems, using frameworks such as Spark-Streaming or Kafka
- Develop data quality and governance automations to insure the accuracy and quality of the data through inspection, validation, processing, anomaly detection and auto-corrections
- Provide documentation, training, and consulting for our users
Requirements
- Programming (Python, Scala)
- Development in a Linux environment
- Big data platforms (Hadoop, GCP, AWS, Azure)
- Advanced SQL scripting
- Database Management Systems (for example, Oracle, MySQL or SQLServer)
- Data transformation tools
- Hands-on data processing and data modeling experience in a big data environment
- Knowledge of algorithms and data structures
- Understanding the basics of distributed systems
- Strong communication and collaboration skills
- Experience with Agile methodologies
- Bachelor’s degree or equivalent work experience in Computer Science
