Data Engineer
Jupiter, FL, US
SUMMARY
The Data Engineer's task is to make data available by means of technical solutions such as infrastructure, systems and data pipelines. In most cases, the organically grown, fragmented and silo-ed data landscape is the reason why a data engineer is needed. Determining which data sources exist, what the contents are - in order to then request ad-hoc extracts or to build data pipelines themselves - i.e. scripts that transfer data from one system to another - are the focus of his/her work.
PRIMARY RESPONSIBILITIES (INCLUDE BUT NOT LIMITED TO):
Collaboration in the creation of a group-wide data strategy (incl. data governance)
Establishment and management of data infrastructure
Connection, cleansing and preparation of data sources (e.g. raw data, unformatted data, coded data)
Designing, building and maintaining data pipelines (using Java, python and SQL)
Extract-Transform-Load (ETL) logic and implementation from a variety of data sources (structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, data warehouses)
Automation of data transfer and data transformation processes
Develop robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end users to consume and analyze data faster and easier
Work with tools, languages, data processing frameworks, and databases such as R, Python, SQL, MongoDB, Redis, Hadoop, Spark, Hive, Scala, BigTable, Cassandra, Presto, Strom
Checking and improving data quality and define KPIs for data management
Coordination with data owners of connected data sources as well as IT and other stakeholders
Participation in cross-functional project teams for the realization of use cases
Evaluation and recommendation of tools and technologies for data infrastructure and processing.
Identification of data-based trends and forward-looking industry solutions and driving one’s own creative ideas
POSITION REQUIREMENTS:
Bachelor’s Degree in (Business) Informatics or a comparable qualification
Relevant professional experience in the field of data engineering
Ideal candidate will be fluent in English (knowledge of German is a plus)
Possess basic knowledge in statistics and machine learning
Proficient in Python/R, SQL, MongoDB, Redis, Hadoop, Spark, Hive, Scala, Big Table, Cassandra, Presto or Strom and experience with ERP Systems
Ideal candidate is characterized by a structured approach to project management and the ability to meet deadlines and demonstrate strong communication skills and a customer-oriented approach
US Citizenship or Qualified U.S. Worker
PHYSICAL REQUIREMENTS:
The physical requirements described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
While performing the duties of this job, the employee is occasionally required to stand; walk; sit; use of hands or fingers to handle, or feel objects, tools or controls and keyboarding; reach with hands and arms; climb stairs; balance; stoop, kneel, crouch or crawl; talk and hear; see and evaluate high resolution images.
The employee must occasionally lift and/or move up to 50 pounds
Nearest Major Market: Palm Beach
Nearest Secondary Market: Miami