Databricks ETL Developer
Job Description
Reference #: ODID 70142_USPTO_Databricks ETL Developer
Request Type
Temp To Perm
(Temporary resources to be converted to permanent AFS/ASM W2 after 6 months of service with no placement fee; include annual salary expectations)
Subcontractor / MSA terms
You are requested to submit a competitive Time and Materials proposal to provide Support and Consultative services as described in the scope of work below.
Role Title
Databricks ETL Developer
Start Date for assignment
10/01/2024
End Date for assignment
06/30/2025
# of Resources Needed
1
Hours per Week
40
Job Description
This work is Sold Unsold
Specialization: NA
Technical Skills
Skill
Years/Level of Experience
ETL Pipelines
P3 – Advanced
Databricks Platform
P2 – Intermediate
SAP Data Services Development
P2 – Intermediate
P1 – Beginner (0-2 yrs experience)
P2 – Intermediate (3-5 yrs experience)
P3 – Advanced (7-10 yrs experience
P4 – Expert (10+ yrs experience)
Role Description
Our project to move a data warehouse from Oracle and SAP Data Services technologies to Databricks is in its early stages. This is an opportunity to become a key player in an important element of the agency’s cloud migration.
Responsibilities For This Role
* Work with product owners and internal and external teams to develop automated data pipelines from heterogeneous sources, including file and data validation, exception handling and reporting, and applying business rules in ETL to populate the data warehouse in alignment with agency standards and guidelines.
* Collaborate with data analysts, engineers, and stakeholders to understand data requirements and develop ETL solutions that meet business needs.
* Optimize ETL workflows for performance, scalability, and reliability, ensuring timely and accurate data delivery.
* Develop and maintain standards and documentation for ETL processes, including data mappings, transformations, and workflow diagrams.
* Monitor ETL jobs, troubleshoot issues, and implement enhancements to improve data quality and system efficiency.
* Ensure compliance with data governance policies and security standards throughout the ETL lifecycle.
Preferred Qualifications
* Bachelor’s degree in Computer Science, Information Systems, or a related field.
* Proven experience as an ETL Developer or Data Engineer, with a strong understanding of data warehousing concepts and ETL tools.
* Experience with cloud platforms (e.g., AWS) and big data technologies (e.g., Databricks, Spark)
* Experience with ETL tools such as Databricks, SAP Data Services including designing and deploying ETL workflows across a variety of data sources to include JSON and Parquet files.
* Proficiency in SQL and scripting languages (e.g., Python) for data manipulation and automation.
* Familiarity with relational databases (e.g., Oracle, SQL Server, PostgreSQL) and data modeling techniques.
* Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
Education Level
Bachelors
Work Location
On-site (Government / AFS Site): Washington, D.C.
On-site %: 0%
Off-site (Contractor Site): Remote
Special Requirements
Work Authorization
US Citizens
Dual Citizens
US Persons (Green Card)
Foreign Nationals (H1B etc.)
Clearance Required
Public Trust
Secret
Top Secret
TS/SCI
None (Background check validation per MSA)
Other______________
Dpas
Not Rated
Rated (Rating #____________)
TBD
NAICS Code and Size Standard for the Subcontract or Purchase Order is: (phone number removed) Computer Systems Design Services ($34M)
