Data Engineer
About the role:
We are searching high and low for our next Data Engineer to join our world-class team.
What will you be doing?
- You will be helping to build data-centric solutions for a Client's customers, applying engineering discipline to ensure high quality. Responsible for building data pipelines to bring together information from different source systems—to integrate, consolidate, cleanse and structure data.
- This isn’t a backroom role, and you can expect to spend time discussing design approaches and requirements with your colleagues and customers in addition to being engaged in development activities.
Experience:
- 5–10 years of experience
- Experience with varied types of data: tabular, graph, time-series, geospatial, image, etc.
- Practical knowledge of Different types of databases – relational; document; graph; columnar; key-value
- Different types of database – relational; document; graph; columnar; key-value
- Large-scale data processing platforms, typically based on Hadoop / Spark
- Business intelligence/analytics products or frameworks
- Data visualisation frameworks
- Knowledge of Data processing capabilities in Azure; AWS and GCP (2 out of three)
- Knowledge of data integration technologies
- Knowledge of distributed computing and information security
- Ability to write good quality code in a JVM language like Java or Scala, incorporating disciplines such as Test Driven Development and structured version control; familiarity with Python is a bonus