REMOTE Position – Looking for Data Engineer(GCP)- Immediate Start – W2 position

Apply Now

Job Description

If this blog helped you, spread the word!

W2 Contract- H1B Sponsorship Provided!!

H1B Processing

Various EAD Support

Immediate GC And I140 Processing Job Description

Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of all parts of the pipeline to minimize labor in development and production – Experience in analyzing complex data, organizing raw data and integrating massive datasets from multiple data sources to build subject areas and reusable data products – Experience in working with architects to evaluate and productionalize appropriate GCP tools for data ingestion, integration, presentation, and reporting – Experience in working with all stakeholders to formulate business problems as technical data requirement, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management This includes designing and deploying a pipeline with automated data lineage. Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions. Test and compare competing solutions and report out a point of view on the best solution. Integration between GCP Data Catalog and Informatica EDC. Design and build production data engineering solutions to deliver pipeline patterns using Google Cloud Platform (GCP) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer, Cloud SQL, Compute Engine, Cloud Functions, and App Engine. Skills Preferred:

* Strong drive for results and ability to multi-task and work independently – Self-starter with proven innovation skills – Ability to communicate and work with cross-functional teams and all levels of management – Demonstrated commitment to quality and project timing – Demonstrated ability to document complex systems – Experience in creating and executing detailed test plans Experience Required:
* In-depth understanding of Google’s product technology (or other cloud platform) and underlying architectures – 5+ years of analytics application development experience required – 5+ years of SQL development experience – 3+ years of Cloud experience (GCP preferred) with solution designed and implemented at production scale – Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Terraform, Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc, Cloud Build, Airflow, Cloud Composer etc. – 2 + years professional development experience in Java or Python, and Apache Beam – Experience developing with micro service architecture from container orchestration framework – Extracting, Loading, Transforming, cleaning, and validating data – Designing pipelines and architectures for data processing – 1+ year of designing and building Tekton pipelines Experience Preferred:
* Experience in building solution architecture, provision infrastructure, secure and reliable data-centric services and application in GCP – Experience with DataPlex or Informatica EDC is preferred – Experience with development eco-system such as Git, Jenkins and CICD – Exceptional problem solving and communication skills – Experience in working with DBT/Dataform – Experience in working with Agile and Lean methodologies – Team player and attention to detail – Performance tuning experience Education Required:

Bachelor’s degree in computer science or related scientific field IT or related Associated topics: data architect, data center, data integrity, data manager, data management, data scientist, data warehousing, sql, sybase, Teradata Education Preferred:

GCP Professional Data Engineer Certified Master’s degree in computer science or related field 2+ years mentoring engineers In-depth software engineering knowledge

If this blog helped you, spread the word!