Looking for Data Engineer - Sunnyvale, CA Hybrid/REMOTE
- *********W2 Only*************
Job Title: Data Engineer
Location: Sunnyvale, CA (preferably hybrid, but could be remote)
Duration: 6-12 Months
Description:
As a Data Engineer, you will collaborate with team in building data pipelines, orchestrate and manage Snowflake Datawarehouse. You will play a key role in ensuring that existing pipelines are meeting SLAs and integrate CI/CD practices in our operation.
- Responsibilities:
- Experience in Snowflake environment and setting up Role based access control roles and Users, setup warehouses and monitors.
- Experience developing Github CI/CD pipelines and deployment into dev and production nodes. Familiar with setting up CI/CD pipelines with Kubernetes, and Docker.
- Write and maintain scripts necessary for data ingestion with orchestration in Airflow
- Develop testing frameworks to validate data accuracy and data consistency at each layer.
- Required skills:
- Proficiency in programming languages such as Python.
- Strong analytical and problem-solving skills
- Familiarity with data modeling and ELT /ETL processes.
- Proficient in SQL.
- Familiar with setting up UDF Functions / Stored Procs
- Familiarity with data ingestion tools (Fivetran, HVR, Airbyte)
Apply Job!