EXOedge - Senior Data Engineer - Azure Data Factory

EXO Edge is looking for an experienced Data Engineer to join our Data Engineering team.

As a Data Engineer, you will design, develop, evaluate, and test data infrastructures.

Source system analysis, data modeling, business measure development, and report/visualization formatting.

Ensure compliance with policies and procedures, safety, state, and federal laws, regulations, and standards.

In your journey as a Data Engineer, you will be : Primarily focused on: Process of consolidating separate data and reporting suites Ensure business users are enabled with carefully curated data visualizations with accurate, reliable and consistent data to monitor contract performance and assist in decision making.

Determining reporting needs, developing, and building reports, training users and establishing reporting cadences and processes.

Fulfilling the below roles and responsibilities : Translate logical designs into physical designs, taking account of business requirements, target environments, processes, performance requirements, existing systems and services, and any potential safety-related aspects.

Analyze and organize raw data.

Build data systems and pipelines.

Evaluate business needs and objectives.

Interpret trends and patterns.

Conduct complex data analysis and report on results.

Prepare data for prescriptive and predictive modeling.

Build algorithms and prototypes.

Combine raw information from different sources.

Explore ways to enhance data quality and reliability.

Identify opportunities for data acquisition.

Develop analytical tools and programs.

Collaborate with data scientists and architects on multiple projects technologies.

Bringing in the below technical experience : 5 years of hands-on experience in MS SQL Server writing complex T-SQL queries, stores procedures, functions etc.

5 years of ETL development using Azure Data Factory (experience with SSIS a plus) 5 years of experience with building data pipelines and analytics solution to stream and process datasets at low latencies.

5 years of experience with complex data modelling, ELT/ETL design, and using large databases in a business environment.

Experience ingesting data from various source formats viz.

Parquet, csv, SQL databases, SharePoint, APIs etc.

to Azure SQL databases.

3 years of experience with SSAS (SQL Analysis Services) Tabular and Multi-Dimensional cubes/models.

Experience writing DAX expressions a plus.

Expertise in ELT/ETL optimization, designing, coding, and tuning big data processes using Azure Data Factory.

Advanced experience in SQL Server relational database management systems Strong Knowledge of data warehousing frameworks and methodologies.

Knowledge of Data Engineering and Data Operational Excellence using standard methodologies.

Knowledge & experience with CI/CD processes.

Knowledge & experience with Azure DevOps.

Knowledge of QA tools (manual and automated) Experience in data mining, profiling, and analysis.

Experience with usage of source control within a team environment (Git, TFS etc.) A strong understanding of database design best practices Experience with Azure - setting up and monitoring databases, users & access rights.

Experience with Yardi system is a big plus.

Based at : Mohali, Punjab Details : No of working days : 5 Shift timings : 4pm to 1am (Needs to be flexible) Job Location : Mohali (No WFH) (ref:hirist.tech)