Principal Data Engineer - II

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.
• Implement real-time data streaming and batch processing solutions to support diverse business needs.
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases.
• Ensure data systems and pipelines are scalable, secure, and performant.
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning.
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions.
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary.
• Troubleshoot and resolve data-related issues, ensuring minimal downtime.
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies.
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business
• Teams, to understand requirements and deliver data solutions.
• Provide technical expertise and guidance on data engineering best practices.
• Stay updated on emerging tools, technologies, and industry trends.
• Evaluate and recommend technologies to enhance data engineering capabilities

Requirements