Data Engineer - II

Job Description

***Cloud Data Engineer***
Location: San Francisco
Position type: Hybrid (2+ days in office)
Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle)
Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases
Experience with ETL tools (Informatica)
Ability to create quality ERD's (entity-relationship diagrams)
Excellent writing skills for writing user and system documentation
AWS Cloud Data Warehousing Technologies
Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda)
Development/modeling experience with Amazon Redshift
Experience using the AWS service APIs, AWS CLI, and SDKs to build applications
Proficiency in developing, deploying, and debugging cloud-based applications using AWS
Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro)
Ability to apply a basic understanding of cloud-native applications to write code
Proficiency writing code for serverless applications
Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
Ability to author, maintain, and debug code modules on AWS
Database: AWS Aurora Postgres
Data Access: AWS Athena
Data Analytics: AWS Quicksight
Familiarity working with or knowledge of Alteryx, Collibra, Immuta, Okta a plus.
Experience with visualization tools (Tableau)
Experience creating scripts with Python
Experience working on an Agile team
Understanding of application lifecycle management
Understanding of the use of containers in the development process

Qualifications
5 to 9+ years of experience in data engineering, data science, and software engineering.
Bachelor's degree in computer science, Information Systems, or another related field
Must be a US Citizen or a Green Card holder.

Responsibilities:
Designs, develops, modifies, tests and automation used to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems and tuning warehouse applications. Develops transition and implementation plans. Recommends changes in development, maintenance and standards.
Advanced analytical ability and technical skill as well as the ability to provide innovative solutions to technical needs and business requirements
Ability to exercise independent judgment in making complex business decisions
Acute attention to detail with a high level of data integrity and accuracy
Excellent verbal and written communication, with interpersonal skills to work with people at all levels of the organization
Ability to translate highly technical information into non-technical terms
Excellent computer skills including Microsoft Office along with various other software applications as needed for the role
Broad knowledge of the programming tools, concepts, practices, and principles including design, implementation, and testing
Position requires continuous visual concentration and manual dexterity to operate PC
Requires prolonged sitting and minimal standing/walking
Minor lifting and carrying, not likely to exceed ten pounds (laptop + charger)
May require extended work hours and/or schedule flexibility as unexpected situations and/or workflow dictate
May require on-call status
Rare domestic travel including overnight stays may be necessary
5 to 9+ years of relevant work experience
Bachelor's degree or equivalent experience
Contributes to the design, development, testing, implementation, and review of complex data warehouse and business intelligence solutions
Develops all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work of lower level programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs
Contributes to the design of technology infrastructure and configurations, recommends process improvements
Reviews complex patches and new versions of data warehouse applications. Implements complex software packages and deploys code
Key participant in cross-functional team initiatives and process improvement projects

Pay range is $79.38/hr - $84.38/hr - with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.

THE PROMISES WE MAKE:

At Crystal Equation, we empower people and advance technology initiatives by building trust. Your recruiter will prep you for the interview, obtain feedback, guide you through any necessary paperwork and provide everything you need for a successful start. We will serve to empower you along the way and provide the path for your professional journey.

For more information regarding our Privacy Policy, please visit crystalequation.com/privacy.

Meet Your Recruiter

Jordan Rogel

var isBannerImage = ''; // if isBannerImage is empty or undefined if(isBannerImage == ''){ jQuery('.jb-recruiter-profile-picture').css('left', '0'); jQuery('.jb-recruiter-profile-picture').css('bottom', '0'); }