Data Engineer

The Data Engineer is responsible for supporting and developing LocumTenens.com’s business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT’s data lake as needed to meet LT business and accounting needs. The DE is also responsible for data reporting & analytics activities with a focus on financial reporting and acts as part of an Agile team by participating in associated scrum ceremonies. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys analyzing and optimizing data systems and building them from the ground up.

KEY FUNCTIONS AND BASIC DUTIES:

Data Engineer – 100%

Creates and maintains optimal data pipeline architecture.

Assembles large, complex data sets that meet functional / non-functional business requirements.

Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure technologies.

Builds analytics tools that utilize the data pipeline to provide actionable insights into accounting operations, customer financials, and other key business performance metrics.

Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Keeps our data separated and secure through multiple data centers and Azure regions.

Work with data, product, & technology teams to strive for greater functionality in our data systems

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues

SECONDARY FUNCTIONS:

Assists accounting team and sales operations/data team as needed

May work on special data-related projects or other duties as assigned

SUPERVISORY/BUDGERTARY/EXTERNAL COMMUNICATION RESPONSIBILITY:

Communicates with external vendors and service providers as projects require

REQUIRED EXPERIENCE:

Bachelor’s degree in computer science or a related field or equivalent experience required

6+ years of related software development and architecture experience required

5+ years Azure Cloud experience required

2+ years of Salesforce integration experience working with APIs / SOQL queries

Prior experience in designing/building data warehouse, data lake, and/or data lake house patterns from the ground up

Previous Agile (Scrum/Kanban) experience required

Working knowledge of accounting and financial systems

Previous staffing industry a plus

KNOWLEDGE, SKILLS, AND ABILITIES:

Broad knowledge of the Microsoft Azure cloud platform and expertise in architecting, designing, and implementing data & analytics solutions on Azure.

Experience with cloud data warehouses and data lakes (Azure Synapse, Azure ADLS, Azure SQL DB, Azure Blob).

Solid understanding of advanced SQL techniques for querying, transformation, and performance optimization.

Data Modeling: Understanding best practices for data modeling, including star schemas, snowflake schemas, and data normalization techniques. Building the semantic layer to ensure effective translation of complex data from the data marts into business terms. This includes defining dimensions, measures, hierarchies, and business logic.

Proficiency in complex ETL / ELT activities for enterprise Data Integrations, including architecture design, standards establishment, and mapping documentation, with expertise in optimizing pipelines for large datasets and cloud integration (Azure tools).

Skilled in building and maintaining Data integration pipelines with cloud platforms like Azure Data Factory, while also developing and enhancing data pipelines to reduce costs and improve efficiency and SLAs.

Data Privacy: Knowledge of data privacy laws, including an understanding of PII data and other regulations to ensure compliance.

Data Visualization/Business Intelligence: Knowledge of tools like Microsoft PowerBI

Familiarity with Salesforce and Salesforce APIs (nice to have)

Experience owning processes at a detailed level, subject-matter expertise

Monitor and optimize the Data ETL Pipelines & performance of queries, ensuring fast response times and efficient data retrieval. This may involve indexing, partitioning, and tuning the underlying data models

Ability to adhere to and exhibit the Company Values at all times

Working knowledge of Microsoft Word, Excel, PowerPoint, Outlook, and Teams

Strong customer service mindset

Strong attention to detail

Ability to build relationships at all levels

Strong organizational and time management skills

Ability to work independently and collaboratively

Strong communication skills - both oral and written

Solid critical thinking and creative problem-solving skills

Ability to effectively manage multiple competing priorities in a fast-paced environment

Ability to work with sensitive information and maintain confidentiality

Ability to mentor, coach, and motivate others