Job Description

Perform ongoing monitoring, automation and refinement of data engineering solutions * Build and meet project timelines and manage delivery commitments with proper communication to management * Collaborate and communicate with key business lines, technology partners, vendors and architects

Responsibilities

• Experience in NoSQL Databases and Big data technologies including Hadoop, MongoDB, Azure Cosmos DB
• Experience with API / RESTful data services
• Experience in Cloud platform (Azure eco-system)
• Experience working with different data storage options including Azure BLOB storage etc.
• Experience with Azure Data Factory and Azure Data Catalog is a big plus but not mandatory
• Strong development background creating pipelines and complex data transformations and manipulations using one of the languages Python, Java, R, or Scala with Databricks/Spark
• Understanding of different data formats including Parquet, Avro, CSV, ORC etc
• Past working experience on a fast paced and agile environment
• Experience working with an on-shore / off-shore model