Data Engineer

Job Overview

We are looking for a Software Engineer who has a love for data. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even redesigning our company’s data architecture to support our next generation of products and data initiatives.

Responsibilities for Data Engineer

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional and non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholders including the Executives, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Qualifications for Data Engineer

• Advanced working ETL process knowledge as well as working familiarity with SQL. Knowledge of NoSQL is a plus.
• Proficient in Python and/or JavaScript.
• Experience with ETL tools such as Airflow.
• Exposure to BI tools like BigQuery, GCP.
• Experience with scripting languages like Batch, Shell, etc.
• Experience building and optimizing big data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• We are looking for a candidate with 1 to 2 years of experience in a Data Engineer role.
• Must have attained a graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.