Job Description
PLEASE ATTACH THE ADDITIONAL REQUIREMENTS LISTED AT THE BOTTOM OF THIS PAGE Job ID: 31722
Agency: Bureau of Information & Technology
Location:Statewide within the state of South Dakota. Salary: $73,063.30 - $95,000 Annual Salary, depending on qualifications
Pay Grade: 07
Closing Date: Open Until Filled
This is a Full-Time 40 Hour Weekly position with the Bureau of Information & Technology. For more information on the Bureau of Information & Technology, please visit https://www.sd.gov/bit .
The State of South Dakota Bureau of Information and Technology (BIT) is seeking a highly qualified and motivated data engineer. This position designs, implements, and maintains scalable data pipelines and storage solutions on Microsoft Azure to support data-driven state government initiatives. This role focuses on assembling and transforming large datasets from diverse sources, ensuring data architecture is secure, reliable, and aligned with stakeholder needs. The Data Engineer works with architects and analysts to deliver cloud-based data solutions that enable reporting, analytics, and decision-making.
Specific responsibilities will include:
- Designing, implementing, and maintaining scalable data pipelines for data warehouses that support the ingestion, transformation, and delivery of structured and unstructured data.
- Supporting the implementation of layered data architecture patterns to enable progressive data refinement and ensure quality, traceability, and reusability across ingestion, transformation, and consumption layers.
- Applying and maintaining data governance practices by managing metadata, classifications, lineage, sensitivity labels, and access controls in collaboration with governance and compliance stakeholders, ensuring alignment with organizational and regulatory requirements.
- Developing ETL processes to extract data from multiple sources, apply necessary transformations, and load it into target systems. Leverage Azure services to streamline and schedule these workflows for consistency and reliability. Experience with Azure function development, developing application program interfaces (API) and similar cloud-based solutions.
- Configuring and optimizing data storage components (databases, data warehouses, and data lakes) on Azure. Monitor system performance, troubleshoot issues, and tune infrastructure for reliability and scalability. Skills with both Azure and enterprise MS SQL preferred.
- Implementing data validation checks and documentation standards to maintain accuracy and consistency. Automate these validation regimens when possible. Enforce data access controls and security in accordance with best practices.
- Working closely with data analysts, IT staff, and other business stakeholders to understand requirements and translate them into technical specifications. Provide end-user support and guidance on data solutions, ensuring the solutions meet reporting and analytics needs.
- Developing SQL queries, stored procedures, and Azure Data Factory pipelines to feed data into specialty user interfaces developed by vendor partners, Power BI and/or other web interfaces and dashboards. Assist teams in accessing and interpreting data requirements to help business deliver actionable insights.
- Writing and maintaining technical designs, workflows, and operational procedures for data processes. Share knowledge and provide guidance to team members and stakeholders to promote consistency and understanding across the organization.
The Ideal Candidate Will Have: - a bachelor's degree in computer science, information systems, engineering, or a related field is preferred.
- 3+ years of professional experience in data engineering or a related IT role.
- Government or public sector IT experience is preferred.
Technical Skills:
- proficiency with Microsoft Azure data services, especially Azure Data Factory, Azure Data Lake, Azure SQL Database, Azure Databricks and Microsoft Purview;
- strong SQL skills (T-SQL or equivalent) and hands-on experience with relational databases;
- familiarity with big data technologies and frameworks on Azure, such as Azure Synapse Analytics, Apache Spark, and Hive;
- solid understanding of data modeling, schema design, and working with large datasets;
- write and leverage computer languages (DAX, Java, HTML/CSS, Python, R, .NET, C Sharp);
- ability to perform report development for common reporting products such as PowerBI.
Soft Skills:
- excellent problem-solving, analytical, and communication skills with a proven ability to independently draft, revise, and adhering to iterative processes, such as development code, procedures, etc.
- ability to work effectively in cross-functional teams, manage multiple tasks, and adapt to evolving priorities and technologies while updating superiors and stakeholders on progress, barriers encountered, etc.
Additional Requirements: To be considered, please attach your resume. This position is eligible for Veterans' Preference per ARSD 55:10:02:08.
Successful applicant(s) will be required to undergo a background investigation. An arrest/conviction record will not necessarily bar employment.
NCRC: If you possess a National Career Readiness Certificate, please submit the certificate with your application. For more information on how to acquire a National Career Readiness Certificate contact a South Dakota Department of Labor and Regulation Job Service Office. A certificate is not necessary to be considered.
The State of South Dakota does not sponsor work visas for new or existing employees. All persons hired will be required to verify identity and eligibility to work in the United States and complete an Employment Eligibility Verification, Form I-9. The State of South Dakota as an employer will be using E-Verify to complete employment eligibility verification upon hire.
The State of South Dakota offers $0 premium employee health insurance option plus eleven paid holidays, generous vacation and sick leave accrual, dental, vision, and other insurance options, and retirement benefits. You can view our benefits information at https://bhr.sd.gov/job-seekers/work-for-state-government/ . This position is a member of Class A retirement under SDRS.
Must apply online: https://gen-stateofsouthdako-trn.inforcloudsuite.com/hcm/xmlhttp/shorturl.do?key=1QZ
You must apply online, emailed resumes or submissions will not be accepted.
South Dakota Bureau of Human Resources
Telephone: 605.773.3148 Email: careers@state.sd.us
http://bhr.sd.gov/workforus
"An Equal Opportunity Employer"
#LI-Onsite