Data Engineer – SQL Azure/ETL/Data Factory/Synapse
Location : Remote (India) #datastructures#datastructures
Job Timing : UK Shift time
Duration : 3 Months contract rolling
Joining an expanding and innovative organization who will give you the freedom to grow and with a clear career path;
We are looking for driven, talented, and highly motivated and curious engineers who are excited by data-driven solutions and thrive in fast-paced, early-stage growth environments.
Essential skills & experience for the Data Engineer:
Role Highlights :
Design, develop, and maintain data science and data analytics pipelines
Collaborate with data and engineering teams to take requirements from prototype to production
Data Warehousing Platforms – Azure SQL Warehouse / Azure Synapse
Build data validation testing frameworks to ensure high data quality and integrity
Excellent programming skills in Python, Kotlin, Java, or Scala. (Python preferred)
Experience with MS Azure cloud platform services, in particular Azure BLOB storage, CosmosDB, EventHub, Databricks, Azure Data Factory, Azure Data Lake Storage gen 2, Azure SQL DB and Azure Synapse Analytics (previously SQL Datawarehouse)
Write and maintain documentation on data pipelines and schemas
Create & document efficient data pipelines (ETL/ELT)
Write and optimize complex queries on large data sets
Transform data and map them to more valuable and understandable sets for consumption
Skills Required :
Expert in SQL, including advanced analytical queries, window functions, CTEs and query optimization
Proficiency in Python (data structures, algorithms, object-oriented programming, REST APIs)
Experience administering AWS cloud data warehouses
Knowledge of software engineering best practices across the development lifecycle, coding standards, code reviews, source management, build processes, testing, and operations
Knowledge of and experience implementing data security and governance best practices – preference given to those with healthcare-focused backgrounds
Experience with a data pipeline scheduling frameworks
Experience with schema design and dimensional data modelling.
Great problem solving and analytical skills combined with the ability to explain concepts to both technical and non-technical audiences
Curious and interested in learning about the latest in data warehouse technology.
Please share CV at Jaijeet@softnice.com for below position.