Databricks Architect

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you have a passion for tackling business challenges through the use of both structured and unstructured data at scale, Tiger Analytics wants to connect with you. We are looking for a skilled and proactive Databricks Architect to take a pivotal role in designing and deploying resilient data solutions that address our clients' complex business issues.

Responsibilities

• Design and implement scalable, end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on the Databricks platform
• Provide technical leadership and strategic guidance on Databricks adoption, including developing reference architectures and best practices.
• Ensure optimal performance by tuning Spark jobs, optimizing data pipelines, and resolving complex technical issues.
• Architect, develop, and debug PySpark jobs and data models, integrating Databricks with cloud services such as AWS S3, EMR, and Lambda
• Implement and enforce data governance, security, and access control policies (e.g., encryption, auditing) on the Databricks environment

Requireme