Senior Python Developer

Responsibilities

• 5+ years of experience utilizing Python, PySpark/Scala for processing large data volumes

• Good knowledge of working with Databases (e.g., SQL, Oracle, Hive, Impala)

• Relevant experience with Pandas, NumPy, Scikit-learn, and other relevant Python libraries

• Google Cloud Platform (DataProc, AirFlow, Google Cloud Storage)

• Good knowledge of Unix/Linux environments

• Familiarity with Big Data and Hadoop Ecosystem: Spark (Spark SQL, Dataframes, PySpark, HUE, parquet files)

• Awareness about DevOps practices like CI/CD

• Proficient communication and English language skills (written/verbal)

Skills

• PySpark (Python, PySpark or Scala)

• Spark DataFrames

• ETL concepts

• Database and SQL knowledge (Hive/Impala)