Senior GCP Data Engineer

About the Role

We are seeking an experienced Senior GCP Data Engineer to join our team. The ideal candidate will have strong expertise in building scalable data pipelines, working with GCP Big Data services, and collaborating with data scientists and business stakeholders to deliver high-impact solutions.

Responsibilities

Collaborate with the Data Science and Analytics teams to design and implement scalable data solutions.

Build, maintain, and optimize data pipelines for cleaning, transforming, and aggregating large datasets.

Leverage GCP BigQuery, DataProc, and Composer (Airflow) to manage and orchestrate workflows.

Support ETL/ELT processes and ensure high data quality and availability.

Model front-end and back-end data sources to create a comprehensive view of user flows.

Contribute to predictive modeling and advanced analytics initiatives.

Partner with stakeholders to translate business requirements into technical solutions.

Must-Have Skills

Hands-on experience with GCP BigQuery, GCP Composer (Airflow), and GCP DataProc.

Strong programming experience with Python and PySpark.

Proficiency in SQL and query optimization.

Solid understanding of ETL/ELT processes and data pipeline design.

Experience with big data ecosystems (e.g., Spark, Hive, Hadoop).

Secondary Skills

Knowledge of CI/CD pipelines in GCP.

Experience with Linux / Shell scripting.

Exposure to Core Java for integration tasks.

Familiarity with data visualization tools (Tableau, R, etc.).

Understanding of NoSQL databases (e.g., Bigtable, MongoDB).

Exposure to other cloud platforms (AWS/Azure) is a plus.