Lead Data Engineer (Banking)

Role: Lead Data Engineer (Banking)

Must-have skills

Banking and domain

•                Production delivery of data pipelines inside banks.

•                Customer, account, transaction, payments and AML data.

•                Working within bank release, scheduling and change controls.

Core data engineering

•                Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.

•                Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.

•                Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.

•                ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.

•        &nbs