Senior Data & AI Platform Engineer

Overview of the Role

The Senior Data & AI Platform Engineer will own the end-to-end data pipelines supporting the business, bringing client data, documents, call transcripts, and other information into a centralized PostgreSQL platform on GCP. The role also involves supporting Document AI and LLM solutions that process over 90,000 client files. This is a hands-on Data Engineering position focused on building, operating, troubleshooting, and improving reliable production pipelines rather than data warehousing, big data, or ML model development.

Key Responsibilities:

• Own end-to-end production data pipelines, from design and development through deployment, monitoring, troubleshooting, and ongoing maintenance.
• Build and maintain Python-based data ingestion pipelines that pull information from third-party APIs and other sources such as client data, documents, and call transcripts.
• Consolidate data into a centralized PostgreSQL environment, ensuring data is reliable and accessible to downstream business systems.
• Design, develop, and maintain cloud-based data solutions using GCP and/or AWS, with GCP technologies including: Cloud Run, Cloud Functions, Cloud SQL, Pub/Sub, BigQuery, Cloud Scheduler, and Document AI
• Take primary responsibility for investigating and resolving production pipeline failures, data issues, and integration problems.
• Develop and maintain advanced Postg