KQL Architect & Lead Developer (Azure Fabric Migration)
East / Central USA
24+ Months Contract
Pay rate: Call to discuss
Remote - EST and CST hours
Project Overview: We are seeking an exceptionally skilled and highly motivated KQL Architect & Lead Developer to spearhead a critical migration project. Our goal is to transition an existing on-premise custom time-series database and its associated 80+ reports into Azure Fabric within an aggressive 4-6 week timeframe. This role demands a unique blend of deep technical expertise in KQL, Azure Data Explorer (ADX), Real-Time Intelligence (RTI), and Power BI, coupled with strong architectural vision, leadership, and rapid execution capabilities.
Role Summary: As the KQL Architect & Lead Developer, you will be responsible for designing, developing, and implementing the end-to-end solution for migrating our time-series data and reports to Azure Fabric. You will act as the primary technical lead, providing architectural guidance, hands-on development, and ensuring the successful and timely completion of this high-impact project.
Key Responsibilities:
Architectural Design: Design the optimal Azure Fabric architecture for ingesting, storing, and querying time-series data, leveraging Azure Data Explorer (ADX) and Real-Time Intelligence (RTI) capabilities.
KQL Development: Develop complex and highly optimized Kusto Query Language (KQL) queries for data ingestion, transformation, analysis, and reporting within ADX/RTI.
Data Migration Strategy: Define and execute a robust strategy for migrating historical time-series data from the on-premise database to Azure Fabric, ensuring data integrity and minimal downtime.
Power BI Integration: Design and implement efficient Power BI solutions, connecting to ADX/RTI for interactive dashboards and reports, replicating and enhancing the functionality of the existing reports.
Performance Optimization: Identify and implement performance optimizations across the entire data pipeline, from ingestion to querying and reporting, ensuring sub-second response times where applicable.
Technical Leadership: Provide technical leadership and mentorship, guiding best practices in KQL, ADX, RTI, and Power BI development.
Problem Solving: Proactively identify and resolve complex technical challenges related to data integration, query performance, and reporting accuracy.
Documentation: Create clear and concise technical documentation for the new architecture, data models, and key KQL queries.
Rapid Delivery: Drive the project with a strong sense of urgency and accountability to meet the aggressive 4-6 week deadline.
Must-Have Skills (Technical):
Kusto Query Language (KQL) Mastery: Expert-level proficiency in KQL, including advanced query writing, performance tuning, data modeling, and understanding of KQL query engine internals.
Azure Data Explorer (ADX): Extensive hands-on experience with ADX, including cluster provisioning, database design, table schema definition, ingestion methods (Event Hubs, Blob Storage, etc.), and security.
Azure Real-Time Intelligence (RTI): Proven experience utilizing Azure Real-Time Intelligence for streaming analytics and real-time data processing.
Power BI Expert: Advanced proficiency in Power BI development, including data modeling (DAX), report design, performance optimization, and connecting to ADX/RTI.
Time-Series Data Management: Deep understanding of time-series data concepts, challenges, and best practices for storage, querying, and analysis.
Data Migration Strategies: Solid experience in planning and executing complex data migrations from on-premise systems to Azure.
Azure Ecosystem: Strong understanding of related Azure services such as Azure Data Lake Storage, Azure Event Hubs, Azure Stream Analytics, and Azure Functions.
Must-Have Skills (Personal/Architectural):
Architectural Vision & Design: Proven ability to design scalable, performant, and cost-effective data architectures within Azure.
Lead Developer Experience: Demonstrated experience leading technical projects from conception to completion, including hands-on development.
Problem-Solving Acumen: Exceptional analytical and problem-solving skills, with the ability to quickly diagnose and resolve complex technical issues.
Rapid Execution & Delivery Focus: A strong track record of delivering high-quality solutions under tight deadlines and high-pressure environments.
Independent & Proactive: Ability to work independently with minimal supervision, taking initiative and ownership of the project.
Communication & Collaboration: Excellent verbal and written communication skills, with the ability to articulate complex technical concepts clearly to both technical and non-technical stakeholders.
Nice-to-Have Skills:
Experience with other data visualization tools beyond Power BI (e.g., Grafana, Tableau) for time-series data.
Familiarity with CI/CD pipelines for deploying Azure resources and Power BI reports.
Experience with Python or C# for scripting automation and data integration tasks.
Prior experience migrating custom time-series databases.
Certifications in Azure Data Engineering or related fields.
Education & Experience:
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
12+ years of experience in data engineering, data architecture, or a similar role, with a significant focus on KQL and Azure data services (atleast 3-5 time-series project preferably on Azure).
Sr Recruiter - Madhumita Das
Contact no- 6096080528