BI Data Engineer

Job Title: Data BI Engineer

Location: Charlotte, NC

Job Type: Contract

Job Summary:

We are seeking a skilled Data & BI Engineer to join our team. The ideal candidate will bring strong expertise in Python, Power BI, SQL Server, and ETL tools (preferably SSIS), along with working knowledge of Pyspark and Autosys JIL. Familiarity with Trade Surveillance domain and Gen AI tools is a plus. You will lead complex data initiatives, contribute to enterprise standards, and develop scalable, high-performance data solutions supporting surveillance and reporting capabilities.

Key Responsibilities:

Lead complex technology initiatives across data engineering and BI platforms within the Trade Surveillance domain.

Design, develop, test, debug, and document robust data pipelines and BI solutions.

Architect and implement ETL workflows using SSIS (preferred) to extract, transform, and load data from multiple sources including flat files, JSON, and Oracle.

Utilize Python and Pyspark to handle large-scale data processing and transformation tasks.

Create dynamic and visually engaging dashboards and reports using Power BI.

Work with Autosys JIL or equivalent scheduling tools to automate and manage batch processes.

Maintain accurate and up-to-date documentation for all systems and solutions, ensuring adherence to standards.

Analyze complex technical challenges and provide tactical and strategic solutions in alignment with business goals.

Participate in Agile development practices and collaborate across engineering, QA, and business teams.

Assist in test plan creation and implementation, ensuring the quality and reliability of deliverables.

Top Required Skills:

Primary:

Python (Advanced)

Power BI (Expert-level)

Secondary:

Pyspark

SQL Server

SSIS (Preferred ETL tool)

Autosys JIL (or similar scheduling tool)

Nice to Have:

Trade Surveillance domain knowledge

Exposure to Generative AI tools (e.g., OpenAI, Azure OpenAI, etc.)

Tableau (as an additional BI visualization tool)

Familiarity with secure data transfer protocols (FTP, NDM)

Qualifications:

5+ years of experience in Data Engineering, BI development, or a related technical field.

Strong understanding of ETL concepts, data warehousing, and data modeling principles.

Proven ability to work on complex, enterprise-scale systems with multiple stakeholders.