Job Description
Sr. Principal Consultant (Senior Data Engineer, Compliance Engineering & Technology) 3 resources Subcontracting roles Location: Remote & (US-PST time zone) Responsibilities Resources should have experience with AML & KYC. ⢠Work with engineering and product teams to design, develop, and manage scalable ETL pipelines to unblock new product launches. ⢠Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing, customer level, and process level data. ⢠Build monitoring to assess the health of the team's infrastructure as well as data quality and lineage. ⢠Participate in on-call rotation, monitor daily execution, diagnose and log issues, and fix business critical pipelines to ensure SLAs are met with internal stakeholders ⢠Work with non-technical partners and product teams to understand their needs, translate business requirements into applicable data requirements, and come up with automated end-to-end solutions. ⢠Standardize business and product metric definitions in curated and optimized datasets and develop data dictionaries and other related documentation. ⢠Teach and encourage others to self-serve by building tools that make it simpler and faster for them to do so. ⢠Should have experience working on below technology ⢠Snowflake ⢠Databricks ⢠Dbt ⢠Github ⢠Airflow ⢠Prefect ⢠Tableau Qualifications we seek in you! Minimum Qualifications / Skills ⢠B.E/B.TECH/ Any Graduation Equivalent Preferred Qualifications/ Skills ⢠A minimum of 8 years of related experience with a bachelor's degree; or 6 years and a master's degree; or equivalent experience. ⢠High proficiency in SQL ⢠Working experience with Python, and Terraform ⢠Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping, design, development, testing, deployment, and documentation ⢠Experience with ETL scheduling technologies with dependency checking, such as Airflow or Prefect, as well as schema design and dimensional data modeling ⢠Experience with setting up data quality and data lineage monitoring ⢠Experience with financial crimes compliance systems, technologies, and processes is a big plus ⢠Experience driving data-driven decisions for AI initiatives / agent building is a big plus Apply tot his job