Big Data and Artificial Intelligence Policy Director (Analyst VI)

Department Information

Hybrid Workplace Arrangement:

Although this position will be designated under the department’s hybrid workplace program, it will still be required to report to the department office on a scheduled basis and at the discretion of the supervisor, based on business needs.

This announcement may be used to fill multiple vacancies.

The Department of Regulatory Agencies (DORA) is dedicated to preserving the integrity of the marketplace and is committed to promoting a fair and competitive business environment in Colorado.

Consumer protection is our mission.

DORA values and promotes diversity, supporting a workplace that is inclusive of people from different backgrounds and experiences; creating an environment that is reflective of our communities; promoting positive relationships; and putting forth unique perspectives to fulfill our mission.

Employer-sponsored RTD EcoPass, with offices located at Civic Center Plaza, above the RTD Civic Center station and just a few blocks from RTD light rail.

Extensive work-life programs such as flexible schedules, training and professional development opportunities on a wide variety of subjects, and more!

Employee wellness programs, including the Colorado State Employee Assistance Program (CSEAP), which provides free, confidential counseling services.

Bike-to-work programs, including access to storage lockers and bike racks.

Flexible retirement benefits, including a choice of the PERA Defined Benefit Plan or the PERA Defined Contribution Plan, plus optional 401K and 457 plans.

Medical and Dental Health Insurance for employees and optional coverage for their dependents.

Life Insurance for employees, and optional coverage for their dependents.

Paid Time Off, including 11 paid holidays.

Short- and long-term disability coverage.

Tuition assistance program.

Check out our excellent benefits package!

Description of Job

The Colorado Division of Insurance (DOI) regulates the insurance industry in Colorado by helping consumers by answering their questions, investigating their complaints, and helping them understand their insurance. The Division regulates and monitors the insurance companies in Colorado, as well as insurance agents, ensuring all are following the law.

The property and casualty work unit implements a first-in-the nation effort to address the insurance industry’s use of big data and artificial intelligence through the implementation of the Colorado Senate Bill 21-169: Restrict Insurers' Use of External Consumer Data. The senate bill prohibits insurers from unfairly discriminating against individuals based on their race, color, national or ethnic origin, religion, sex, sexual orientation, disability, gender identity, or gender expression in insurance practice, and it prohibits the use of external consumer data and information source, algorithm, or predictive model (external data source) in regard to insurance practice that unfairly discriminates against an individual to ensure they are not unfairly discriminating against consumers on the basis of a protected class.

This work unit’s responsibilities include engaging with multiple stakeholder communities, drafting regulations and regulatory guidance, reviewing insurers’ filings for compliance, monitoring the development of regulatory frameworks related to the governance and quantitative testing of big data and artificial intelligence systems, and collaborating with other state insurance regulators through the National Association of Insurance Commissioners. The Senate Bill directs the Insurance Commissioner to work with stakeholders before adopting rules on how the companies should test and demonstrate to the Division that their use of big data is not unfairly discriminating against consumers.

Position: SFA 4311

This position develops strategic and programmatic concepts to ensure that insurers’ use of big data, algorithms, and predictive models are not unfairly discriminating against protected classes of consumers. This position oversees the development of a leading-edge regulatory framework for the use of big data and artificial intelligence systems in underwriting, pricing, claims handling, and other insurance practices. Specifically, SB21-169, Restrict Insurers' Use Of External Consumer Data, addresses potential unfairly discriminatory outcomes resulting from the use of big data, algorithms, and predictive models in certain insurance practices on the basis of race, color, national or ethnic origin, religion, sex, sexual orientation, disability, gender identity, or gender expression. The result, once the program is successfully implemented, is to ensure equitable access to insurance, and the financial security it provides to all Coloradans regardless of race, ethnicity, sexual orientation, or other protected characteristics.

Duties include, but are not limited to:

Developing a regulatory program to regulate insurers’ use of big data, algorithms, and predictive models to ensure their use does not result in unfair discrimination;

Advising, serving as a resource, and coordinating across the division, including working with the actuarial, rates and forms, consumer services, and market conduct teams in such a capacity to implement the program;

Coordination with other teams to regulate insurers' use of big data, algorithms, and predictive models;

Analyzing current carrier practices regarding the use of big data, algorithms, and predictive models;

Performing and/or directing policy research and developing policies, procedures, and regulations in compliance with state law;

Developing a plan to collect and evaluate carrier-reported data on their use of big data, algorithms, and predictive models and testing for unfairly discriminatory outcomes;

Directing and conducting stakeholder outreach and engagement with carriers, producers, consumers, consumer advocates, and other interested parties;

Evaluating carrier compliance and coordinating, as appropriate, enforcement activities;

Preparing reports and presenting to the General Assembly as part of State Measurement for Accountable, Responsive, and Transparent (SMART) Act hearings;

Participating in the work of the National Association of Insurance Commissioners (NAIC) and coordinating with other states to address issues as necessary;

Identifying gaps in enforcement, evaluating the effectiveness of implementation, and making adjustments to the program as data and tools in this area evolve.

Minimum Qualifications, Substitutions, Conditions of Employment & Appeal Rights

MINIMUM QUALIFICATIONS (MQs):

There are two ways to qualify for this position: 1) Experience OR 2) A Combination of Education and Experience

Option 1: Experience

Nine (9) years of full-time professional* work experience in at least one (1) of the following three (3) areas:

Developing or administering risk management and/or governance systems and frameworks for the use of predictive models, machine learning technologies, and big data;

Performing quantitative and qualitative analysis, including conducting audits and/or examinations related to data collection and privacy, cybersecurity, algorithmic accountability, risk assessment and remediation, data ethics, and compliance;

Developing, evaluating, and validating predictive models, machine learning algorithms, and big data predictive analytics with the ability to assess their accuracy, fairness, and transparency.

Option 2: A Combination of Education AND Experience

Associate’s Degree and Experience: Graduation from an accredited college or university with an associate’s degree in public policy, quantitative social science, mathematics, statistics, law, data science, computer science, risk management, or in a field of study related to the work assignment; AND

Seven (7) years of full-time professional* work experience in at least one (1) of the following three (3) areas:

Developing or administering risk management and/or governance systems and frameworks for the use of predictive models, machine learning technologies, and big data;

Performing quantitative and qualitative analysis, including conducting audits and/or examinations related to data collection and privacy, cybersecurity, algorithmic accountability, risk assessment and remediation, data ethics, and compliance;

Developing, evaluating, and validating predictive models, machine learning algorithms, and big data predictive analytics with the ability to assess their accuracy, fairness, and transparency.

OR

Bachelor’s Degree and Experience: Graduation from an accredited college or university with a bachelor's degree in public policy, quantitative social science, mathematics, statistics, law, data science, computer science, risk management, or in a field of study related to the work assignment; AND

Five (5) years of full-time professional* work experience in at least one (1) of the following three (3) areas:

Developing or administering risk management and/or governance systems and frameworks for the use of predictive models, machine learning technologies, and big data;

Performing quantitative and qualitative analysis, including conducting audits and/or examinations related to data collection and privacy, cybersecurity, algorithmic accountability, risk assessment and remediation, data ethics, and/or insurance compliance;

Developing, evaluating, and validating predictive models, machine learning algorithms, and big data predictive analytics with the ability to assess their accuracy, fairness, and transparency.

Document this experience in your application IN DETAIL, as your experience will not be inferred or assumed. Part-time experience will be prorated.

SUBSTITUTIONS:

Partial credit toward the degree requirement will be given for completed college/university coursework that did not result in a degree. A master's or doctorate degree from an accredited college or university in a field of study related to the work assignment will substitute for the bachelor's degree requirement.

*Professional work involves exercising discretion, analytical skill, judgment and personal accountability and responsibility for creating, developing, integrating, applying, and sharing an organized body of knowledge that characteristically is: uniquely acquired through an intense education or training regimen at a recognized college or university; equivalent to the curriculum requirements for a bachelor's or higher degree with major study in or pertinent to the specialized field; and continuously studied to explore, extend, and use additional discoveries, interpretations, and application and to improve data, materials, equipment, applications and methods.

Preferred Qualifications:

Demonstrated professional* experience working in a state government agency, in the insurance industry, or in the Colorado Division of Insurance;

Master’s or Doctorate degree in public policy, quantitative social science, mathematics, statistics, law, data science, computer science, risk management, or in a field of study directly related to the work assignment;

Demonstrated professional* experience working with and knowledge of how predictive models, machine learning algorithms, and big data are utilized within insurance processes such as underwriting, pricing, and claims management, including the identification of potential biases and unintended consequences;

Demonstrated knowledge of statistical methods and professional* experience in utilizing statistical software and programming languages such as R, Python, or SAS to analyze and interpret complex datasets;

Demonstrated professional* experience in communicating complex technical issues to non-technical internal and external stakeholders, and engaging effectively with policymakers, industry representatives, and consumer advocates to develop and implement regulatory frameworks;

Demonstrated professional* experience working in the financial or insurance industries related to implementing policies and practices to address unfair discrimination;

Demonstrated knowledge, understanding, and professional* experience to ensure equitable access to insurance for all Coloradans regardless of race, ethnicity, sexual orientation, or other protected characteristics;

Demonstrated professional* experience working in the insurance industry with a focus on enterprise risk management, and/or actuarial or quantitative analysis;

Demonstrated professional* experience in overseeing policy development related to insurance under both state and federal laws, including drafting regulations;

Demonstrated professional* experience in promoting the efficient use of policy and regulatory levers to address barriers and create opportunities to advance insurance industry transformation efforts.

Required Competencies: The following knowledge, skills, abilities, and personal characteristics are required competencies and may be considered during the selection process (including examination and/or interview):

Demonstrated written communication skills, including the ability to convey information to various stakeholders in a clear, accurate, and concise written manner;

Demonstrated verbal communication skills, including the ability to effectively convey information to audiences in a concise manner;

Demonstrated attention to detail in order to analyze and revise documents;

Sound judgment and the confidence to make decisions on a routine basis;

Demonstrated critical thinking and analytical skills, including having the ability to evaluate evidence and applicable information in order to apply knowledge and to decide on the most appropriate course of action;

Program/project management skills, including planning, prioritization, organizing tasks, and time management skills in order to meet deadlines;

Relationship management skills and customer service skills, to establish strong working relationships with stakeholders to ensure collaboration, data exchange, and joint development of performance improvement strategies;

Strategic thinking, including the ability to identify emerging issues, anticipate trends, and provide recommendations on strategies to minimize risk impacts;

Demonstrated ability to conduct research and gather pertinent information;

Demonstrated understanding of how to effectively function in state government, along with the ability to build consensus in a complex and high-pressured, politically-charged environment;

Flexibility and adaptability with regard to change management, including the ability to adhere to changes in work processes, adapt to changing priorities, and maintain a willingness to comply with and support organizational change(s);

Stakeholder engagement and outreach skills, including the ability to develop meeting plans and identify shareable information;

Proven ability to communicate complex technical issues to non-technical internal and external stakeholders, and engage effectively with policymakers, industry representatives, and consumer advocates to develop and implement regulatory frameworks;

Demonstrated ability to read, understand, interpret, apply, and explain laws, rules, policies, and procedures;

Ability to represent the department and the Division of Insurance in a positive, professional and objective manner, and support a positive workplace environment;

Knowledge of the insurance industry and big data and risk management systems as they relate to the insurance industry;

Knowledge of and the ability to facilitate the rulemaking processes;

Demonstrated ability to understand and abide by workplace principles, practices, and behaviors as internally identified and defined by the division and department;

Demonstrated political acumen;

Ability to travel independently, including work in-office, as required by business needs and scheduled by the supervisor;

Integrity and high ethical standards;

Accountability, reliability, including attendance;

Ability to