Job Description
About the position Responsibilities • Design, build, and maintain data pipelines using Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark. • Implement DataOps and MLOps best practices to optimize data system performance. • Enhance data pipelines for fault tolerance and performance improvement. • Drive process improvement through tracking, training, and sharing knowledge. • Mentor junior Azure Data Engineers. Requirements • Proven experience in data engineering, building and maintaining data pipelines, and ETL processes. • Proven experience building and maintaining data products within Databricks. • Hands-on experience with Databricks and its ecosystem. • Proficient in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib. • Skilled in programming languages such as Python, Scala, SQL, and Java. • Knowledge of relational and NoSQL databases, data modeling, and query optimization. Nice-to-haves • Databricks Certifications (beneficial but not required). • Cloud Certifications such as Azure or similar (advantageous). Benefits • Remote work options available. • Flexible working hours. Apply tot his job Apply tot his job Apply tot his job
Apply tot his job
Apply To this Job