Senior Data Solutions Engineer

Job Description
We are looking for a senior data solutions engineer with extensive experience in the big data and data warehouse ecosystems.  The Epsilon Digital Data Organization builds and maintains MPP, HDFS and Elastic platforms to capture all data generated from the Ad Stack and external sources to support all aspects of the business.
The candidate must be proficient in SQL and Python, with the ability to be a key contributor in delivering critical business features.  The candidate must have expert SQL coding skills to ingest, transform and analyze client data delivered to the Epsilon Digital’s Data Organization.  Python coding skills are also required to ingestion, transform and analyze large datasets via complex SQL.  Ability to understand complex SQL and highly complex Python code is critical. Having knowledge of Linux commands (via command line interface) is also required.  Ability to develop and test code based on use case specifications with little supervision. In addition, be a key contributor in delivering critical business features with a passion for big data technologies.  Candidate should have 6-8 years’ experience on a development team manipulating data, and possess a bachelor’s degree or equivalent experience in technology development.
Key Duties, Tasks and Responsibilities
Fluent SQL with ability to ingest complex use cases
Analyze client files via Linux commands using command line interface(LCI)
Build and maintain data quality services with Python
Continuous improvement of our system, tests, and data quality indicators
Influence our technical decisions
Keep yourself informed and up-to-date with technologies
Interface with client integration engineers, account managers, analysts, and engineers to enable data oriented solutions
Build data expertise on subject matter and be able to speak to data warehouse constructs and data architecture
Ability to troubleshoot production issues and solve for performance bottlenecks
Expert level skills in Python or other language
Ability to analyze data and identify business possibilities for better operational processes and business opportunities
Excellent communication skills and ability to work with the internal analyst community
Ability to thrive in a collaborative team environment
You enjoy working with numerous programming languages, relational databases, and distributed systems. Our platform is ever evolving, but currently is a combination of SQL, Kafka, Flume, Spark, Scala, Java, Python, NoSQL (HBase, Cassandra and ScyllaDB), MPP RDBMS, Postgres, Hadoop, AWS, AirFlow, Docker, Kubernetes, and Elastic
Internet/Digital Advertising ecosystem knowledge is a plus