Note: The job is a remote job and is open to candidates in USA. Stage 4 Solutions is seeking a Senior Data Engineer to support the Small Business Administration Office of Inspector General. The role involves providing expertise on data engineering methods, designing and maintaining data architecture, and optimizing data processes to support various data products.
Responsibilities
- Develop new datasets to support fraud identification, audits, and investigations
- Optimizes the performance of common queries in the database
- Creates and implements data models to improve the efficiency and utility of the database
- Proposes and implements architectural improvements to reduce cloud costs
- Develops, optimizes, and maintains ELT/ETL pipelines
- Monitors pipelines to ensure performance and regular updating of datasets
- Works with a Cloud Architect to develop new ways of accessing and transporting data
- Aids in the development of dashboards or reports to visualize data and storytelling
- Assists in ingestion, transformation, and configuration of data in cloud-based data lake or data warehouse
- Assists with exploration, structuring, and analysis of unstructured and semi-structured data from SQL and data lake environments
- In collaboration with data architecture staff, authors SOPs governing creation, maintenance, and monitoring of all assets in Azure environment
Skills
- 5+ years of experience maintaining SQL databases and conducting advanced operations in SQL and T-SQL
- 5+ years of experience designing, implementing, and maintaining ELT/ETL processes in cloud-based data analytics environments
- 3+ years of experience working in Azure Synapse and Azure Machine Learning, with the modern data stack
- 3+ years of experience manipulating data in Python. Pandas required
- Must be a U.S. citizen and able to successfully complete a Public Trust background investigation
- Bachelors degree
- Experience with PySpark/Polars and developing reusable, modular code
- Experience implementing pipelines and infrastructure using code-first approaches (Python SDK, CLI, REST APIs, or IaC tooling), implementing source control and CI/CD workflows and AI coding assistants and LLM integration patterns
- Microsoft Azure certifications
Benefits
- Health benefits and 401(k) are offered.
- This is a W2 role with Stage 4 Solutions.
Company Overview