Databricks Engineer

Techstra is seeking an experienced Databricks Engineer with a minimum of 4-7 years' experience (ex: Data warehouse design, business intelligence reporting, Customer Information Systems, Meter Data Management Systems and/or Outage Management Systems) or in lieu of experience, 6-9 years equivalent combination of education and work experience.

From the day you join, you will hit the ground running surrounded by amazing people. Here is a look of some of the expectations and responsibilities for this position:

Responsibilities:

Design, build, and manage scalable ETL/ELT/Data pipelines using Databricks

Integrate Databricks with cloud services

Ingest structured and unstructured data from multiple sources (e.g., Kafka, REST APIs, databases, cloud storage).

Write optimized Spark SQL or PySpark code for batch and streaming data transformations.

Implement data cleansing, validation, and enrichment processes.

Optimize jobs for performance, memory management, and cost-efficiency

Create Technical design documents

Solution code base

Develop Technical and procedural documentation, as required

Experience & Qualifications:

Bachelor’s degree in computer science or related discipline and 4-7 years' experience (ex: Data warehouse design, business intelligence reporting, Customer Information Systems, Meter Data Management Systems and/or Outage Management Systems) or in lieu of experience, 6-9 years equivalent combination of education and work experience

Strong knowledge of business practices, processes, data and applications

Strong problem solving and analysis ability

Excellent communications skills (written and verbal)

Possess expertise in cloud technologies

Databricks certification preferred

Proficient in the Azure cloud platform and its applications

Strong experience developing Databricks

Databricks notebooks and Databricks coding with

Experience in Databricks technologies with Databricks warehouse expertise

Experience with deploying/configuring Databricks from the start

Experience in ODI, IDMC, ADF, Synapse o Familiarity on Oracle Golden Gate, cosmos DB, Hyperscale DB

Proficient with big data technologies such as Spark, Python, Pyspark

Experienced in data cleaning, preprocessing, and transforming data into readable formats for analysis

Experience writing technical design specifications for data integrations and data transformations with structured and unstructured data.

Experience with Scrum development methodology

Experience with writing business cases. Experience in capturing, analyzing and translating business needs into functional IT requirements

Experience developing data integrations and data transformations with structured and unstructured data.

Application re-engineering, data modeling and performance tuning. Architecture and design for application disaster recovery and high availability: HP ALM, Microsoft Azure DevOps, Customer Information Systems (for example: CIMs, CC&B, SAP CRM&B),AMI Meter Data Management Systems (for example: Oracle Utilities MDM, Itron IEE), Geographic Information Systems (for example: GE Smallworld), Outage Management Systems, Itron/SSN UtilityIQ, Xylem/Sensus AMI, OSI Soft PI

Location: This position is a Hybrid in Office (3 day), Remote (2 days), located in Oakbrook Terrace, IL

At Techstra Solutions, we help top companies and brands achieve the business value of Digital and Talent Transformation. We believe there are three components in successful business transformation: Business Strategy, Technology and Talent. It is the coming together of these three disciplines that enables companies to take full advantage of opportunities. It differentiates us. Our approach is holistic and all encompassing. We consider the full picture as we guide our clients on this journey.

We are experts in transformation, business strategy, technology, innovation, and human capital management. We deliver our expertise through client consulting, innovative staffing solutions and software development. From strategy through implementation, we are dedicated to bringing our clients world-class business and talent solutions that fit strategic requirements and most importantly, deliver results.

Equal Employment Opportunity Statement

Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender,, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.