GCP Data Engineer

Job Description

US citizens, Green Card Holders, and those authorized to work in the US are encouraged to apply. We are unable to sponsor H1b candidates at this time

Job Title: GCP Data Engineer

Location: Remote – EAST COAST

Duration: Full-time

Job Description:

* Work closely with data scientists, data architects, business analysts, and other disciplines to understand data requirements and deliver accurate data solutions.
* Analyze and document existing data system processes to identify opportunities for improvement.
* Develop detailed process maps that describe data flow and integration across multiple systems.
* Create a catalog of data fields and data structures across various databases and systems.
* Compare data fields and structures to identify inconsistencies and discrepancies
* Contribute towards gap analysis and recommend solutions for standardizing data fields and structures.
* Recommend data directories to organize and manage data assets effectively.
* Propose data standards and best practices.
Technical skills

* Proven experience (5+ years) in data engineering.
* Proficiency in database management systems (e.g., SQL, NoSQL databases).
* Experience with data warehousing and ETL (Extract, Transform, Load) processes.
* Hands-on experience working with cloud data platforms, with a strong preference for Google Cloud Platform (GCP) tools like Big Query, Cloud Functions, and Dataproc.
* Skilled in Python programming with working knowledge of Pyspark.
* Experience developing ELT processes within a medallion architecture (Bronze, Silver, Gold layers).
* Skilled in designing robust data validation and transformation processes to support downstream BI and analytics tools.
* Knowledge of data modeling, data architecture, and data integration techniques.
Analytical skills

* Strong problem-solving skills with attention to detail.
* Experience in process mapping and optimization.
* Understanding of data governance frameworks and practices.
* Excellent verbal/written communication and presentation skills, with the ability to successfully articulate your work and its intent to your team and your client
* A unique point of view. You are trusted to question approaches, processes, and strategy to better serve your team.
A reasonable, good faith estimate of the minimum and maximum for this position is $140K/year to $150K/year with benefits