Job Description
Note: The job is a remote job and is open to candidates in USA. Saransh Inc is seeking a Data Engineer to build scalable data architectures and delivery roadmaps. The role involves collaborating with stakeholders to implement lakehouse and data warehouse solutions while ensuring robust data governance and security.
- Responsibilities
- Partner with client stakeholders to translate business objectives into scalable Azure data architectures and delivery roadmaps
- Architect and implement lakehouse and data warehouse solutions using: Azure Databricks (Delta Lake, Unity Catalog), Databricks Bundle, Snowflake on Azure, dbt (Core / Cloud), ADLS Gen2, Medallion architecture patterns
- Design and build robust ingestion and transformation pipelines using: Azure Data Factory (ADF), Microsoft Fabric / Synapse pipelines
- Orchestrate ELT workflows using: Databricks Jobs, Delta Live Tables, dbt models
- Establish best practices for performance and cost optimization, including: Cluster sizing and autoscaling, Photon and SQL Warehouses, Snowflake virtual warehouses, Caching, file layout optimization, Z-ordering
- Drive observability and monitoring using: Azure Monitor, Log Analytics, Databricks metrics
- Implement robust data governance and security using: Azure Authentication, Unity Catalog, RBAC / ABAC, Managed identities, Private Endpoints and VNet injection, Azure Key Vault–backed secrets
- Lead code and design reviews, setting standards for: PySpark, SQL, and dbt, Unit and integration testing, Data quality checks (expectations and constraints)
- Implement CI/CD pipelines using Azure DevOps or GitHub Actions
- Guide multi-domain programs (Healthcare, Retail, BFSI, or similar)
- Mentor data engineers and ensure high-quality, production-ready deliverables
- Evangelize solutions through: Clear documentation, Reference architectures, Executive and stakeholder presentations
- Skills
- Active LinkedIn ID is a must and match with the resume
- Azure Databricks, Apache Spark, Snowflake, Data Governance, Unity Catalog, dBT, Microsoft Purview, Kafka, SQL, Python
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 10+ years of experience in data engineering / data architecture, with deep hands-on expertise in Microsoft Azure
- Expert-level experience with Azure Databricks and Apache Spark (PySpark, Spark SQL)
- Delta Lake
- Unity Catalog
- Job orchestration and performance tuning
- Strong experience with Snowflake on Azure, including schema and data model design, performance and cost optimization, RBAC, Streams, and Tasks
- DBT (Core or Cloud) expertise, including project structure and best practices, tests, exposures, macros
- Strong fundamentals in SQL and Python
- Proven experience building ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Synapse / Microsoft Fabric pipelines
- Familiarity with streaming platforms such as Event Hubs and/or Kafka
- Solid understanding of lakehouse and data warehousing architectures, dimensional modeling, medallion architecture patterns, data quality frameworks
- Strong knowledge of security and governance, including Microsoft Purview (catalog, lineage), data masking and PII handling, managed identities, private networking
- Excellent communication and documentation skills, with the ability to create architecture and design documents and present to both technical and business stakeholders
- Consulting / agency experience, with the ability to lead multiple concurrent projects
- Willingness to travel as required
- Experience with Azure ML, feature stores, or serving ML pipelines from Databricks or Snowflake
- Infrastructure as Code (IaC) using Terraform or Bicep
- Containerization experience with Docker
- Observability and data quality tooling, such as Great Expectations / Delta Expectations, Databricks Quality Flows, Monte Carlo, Datadog
- Databricks Certified Data Engineer Professional or Databricks Architect
- Microsoft Azure: DP-203 – Azure Data Engineer, Azure Solutions Architect Expert, Azure Security Engineer Associate
- Snowflake: SnowPro Core, SnowPro Advanced
- Company Overview
- We provide recruitment, consulting and IT services for our clients, which focus on maximizing their revenue generation, enhancing business productivity and improving cost management. It was founded in 2008, and is headquartered in Plainsboro, New Jersey, USA, with a workforce of 51-200 employees. Its website is https://saranshinc.com.
- Company H1B Sponsorship
- Saransh Inc has a track record of offering H1B sponsorships, with 35 in 2025, 51 in 2024, 45 in 2023, 30 in 2022, 22 in 2021, 39 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job
Apply To this Job