Data Engineer – Snowflake (Investment Management)

Job Description

We are seeking a Senior Snowflake Developer. The ideal candidate will be responsible for designing, developing, testing, deploying, and maintaining enterprise-level applications using the Snowflake platform.

Location:

* Remote (EST hours)

Visa Status:

* Any visa is fine
* C2C/H1B is fine

Mandatory Qualifications:

* 10 years of experience in database development
* 4+ years of experience in Snowflake development – SQL/Python/Pyspark
* 3+ years of experience in investment domain

Responsibilities:

* Pipelines will be built using Snowpark libraries in python
* SQL queries will have to be written to retrieve existing data sets from joined tables in Snowflake
* Working form desktop prototypes, a new data model will have to be designed in Snowflake to store and maintain all inputs, outputs and metadata for every calculation
* All attempts must be made to reduce hard-coded if/then logic, instead using table-based data, to determine calculation variables and methods
* Data model must manage slowly changing dimensions following an SCD Type 2 methodology, and maintain an immutable audit trail of all data changes
* Dynamic SQL will be used to create reusable modules that leverage indirect references stored in tables
* Code must be built and managed according to client’s style guide, commented thoroughly, and delivered in accordance with client’s DevOps protocols
* Code must be written efficiently to allow for suitable processing times
* Code must be properly structured, organized, and modularized with verification of unit tests at each step
* The process will perform calculations, create flat files, and send those files to an FTP directory
* Files created from this process must conform to Bloomberg interface specifications
* Creation of an ingestion file template for users to add/edit calculation metadata, factors, and lookup references
* Email notifications should be generated by the pipeline to alert users of processing success and failures