Sr. Data Engineer
Apply NowCompany: Edmentum
Location: Young America, MN 55397
Description:
WHO WE ARE
Edmentum is a dynamic educator and student-focused company dedicated to tech-enabled learning solutions. Our goal is to ensure that all students have access to flexible learning environments and educators have the tools they need to support their students. We are on a mission to create innovative, proven learning technology, partnering with educators to ignite student potential. We are a Remote First organization with a strong commitment to excellence, innovation, and customer satisfaction.
WHAT IS THE POSITION
We're looking for an innovative, talented Engineering leader who has been working in data engineering at an enterprise level for more than 5+ years to join our team! This Engineering leader will drive development for our data lake, which is an integral part of our business and serves as our foundational data architecture for Data Science, Business Intelligence, and Learning Research.
As a Senior Data Engineer, you will be directly involved in the design, development, and implementation of data infrastructure, pipelines, and storage appliances. You'll work to ingest and process both streaming and batch data using leading-edge cloud tools from AWS, design and develop big-data stores that represent purpose-built architecture, and support operationalizing exciting data science models aligned to business value. This role will be a key leader in the Edmentum Data Science team, which is a highly collaborative Engineering group that solves big problems. We believe innovation comes from failing fast and learning faster.
WHAT YOU WILL DO
Design, develop, and implement data infrastructure and pipelines that collect, connect, centralize, and curate data from various internal and external data sources
Lead a development team to deliver best-in-class data pipelines supporting key data initiatives for the data lake in AWS.
Work in close collaboration with your data-minded colleagues focused on Back End Service Development, Business Intelligence, Machine Learning, and Artificial Intelligence.
WHAT IS REQUIRED
Bachelor of Science (B.S.) from a 4-year college or university in Computer Science, Information Management Systems, or equivalent experience
Expert level Python and SQL programming skills
Demonstrable experience and knowledge of Data Lake architecture patterns and associated problems.
5 or more years of experience working with relational databases such as SQL, RDBMS (SQL Server), PostgresSQL, AWS RDS, or RedShift
3 or more years of experience with streaming data processing tools such as Spark (PySpark or Scala), Kinesis, or cloud functions such as AWS Lambda
3 or more years of experience with batch data processing with ETL tools like Databricks ETL
3 or more years of experience with job administration and scheduling of complex data workloads using tools such as Apache Airflow
2 or more years of experience with AWS platform data tools such as: EMR, S3, Athena, DynamoDb, EC2, Glue, and ECS
Experience working in a modern DevOps-enabled environment with tools such as Github, Docker, and Terraform.
WHY JOIN EDMENTUM
Competitive compensation package and best in class Total Rewards offerings.
Opportunity to lead and shape the revenue generation strategy of a dynamic company.
Collaborative and inclusive Remote First work environment
Company culture that values innovation, growth, and impact.
Commitment to employee development and career advancement.
Edmentum is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)
Edmentum's notice regarding the collection of personal information from interested candidates is available here
Edmentum is a dynamic educator and student-focused company dedicated to tech-enabled learning solutions. Our goal is to ensure that all students have access to flexible learning environments and educators have the tools they need to support their students. We are on a mission to create innovative, proven learning technology, partnering with educators to ignite student potential. We are a Remote First organization with a strong commitment to excellence, innovation, and customer satisfaction.
WHAT IS THE POSITION
We're looking for an innovative, talented Engineering leader who has been working in data engineering at an enterprise level for more than 5+ years to join our team! This Engineering leader will drive development for our data lake, which is an integral part of our business and serves as our foundational data architecture for Data Science, Business Intelligence, and Learning Research.
As a Senior Data Engineer, you will be directly involved in the design, development, and implementation of data infrastructure, pipelines, and storage appliances. You'll work to ingest and process both streaming and batch data using leading-edge cloud tools from AWS, design and develop big-data stores that represent purpose-built architecture, and support operationalizing exciting data science models aligned to business value. This role will be a key leader in the Edmentum Data Science team, which is a highly collaborative Engineering group that solves big problems. We believe innovation comes from failing fast and learning faster.
WHAT YOU WILL DO
Design, develop, and implement data infrastructure and pipelines that collect, connect, centralize, and curate data from various internal and external data sources
Lead a development team to deliver best-in-class data pipelines supporting key data initiatives for the data lake in AWS.
Work in close collaboration with your data-minded colleagues focused on Back End Service Development, Business Intelligence, Machine Learning, and Artificial Intelligence.
WHAT IS REQUIRED
Bachelor of Science (B.S.) from a 4-year college or university in Computer Science, Information Management Systems, or equivalent experience
Expert level Python and SQL programming skills
Demonstrable experience and knowledge of Data Lake architecture patterns and associated problems.
5 or more years of experience working with relational databases such as SQL, RDBMS (SQL Server), PostgresSQL, AWS RDS, or RedShift
3 or more years of experience with streaming data processing tools such as Spark (PySpark or Scala), Kinesis, or cloud functions such as AWS Lambda
3 or more years of experience with batch data processing with ETL tools like Databricks ETL
3 or more years of experience with job administration and scheduling of complex data workloads using tools such as Apache Airflow
2 or more years of experience with AWS platform data tools such as: EMR, S3, Athena, DynamoDb, EC2, Glue, and ECS
Experience working in a modern DevOps-enabled environment with tools such as Github, Docker, and Terraform.
WHY JOIN EDMENTUM
Competitive compensation package and best in class Total Rewards offerings.
Opportunity to lead and shape the revenue generation strategy of a dynamic company.
Collaborative and inclusive Remote First work environment
Company culture that values innovation, growth, and impact.
Commitment to employee development and career advancement.
Edmentum is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)
Edmentum's notice regarding the collection of personal information from interested candidates is available here