Sr. Data engineer
Sr. Data engineer
Location: Reston, VA
Duration: long term
Mandatory need: Candidate have to be ex-Fannie Mae, and they have to be able to work out of Reston, VA on a hybrid basis.
Must Haves:
- Experience with Python for data engineering and ETL development.
- Strong experience in SQL for data manipulation and complex query building.
- Hands-on experience with AWS Lambda for serverless data processing.
- Experience building ETL pipelines using AWS Glue.
- Experience working with data warehouse solutions (e.g., Redshift, BigQuery, etc.).
- Experience with Snowflake as a cloud data warehouse.
- Experience using Apache Airflow for workflow orchestration.
- Experience with Spark or PySpark for large-scale data processing.
- Experience using Apache Airflow for workflow orchestration
Key Responsibilities:
- Design, build, and maintain scalable and reliable data pipelines using Python and SQL
- Develop ETL processes using AWS Glue, AWS Lambda, and other AWS services.
- Build and maintain data integrations between internal systems and external data sources.
- Work with Data Warehouses to model and manage large-scale datasets for analytics and reporting.
- Ensure data quality, integrity, and security across the data pipeline.
- Collaborate with data scientists, analysts, and other engineers to deliver business-critical data solutions.
- Monitor data pipelines and troubleshoot issues proactively.
- Experience with Fannie Mae's data governance frameworks (e.g., DataHub, BCAP).
- Knowledge of GSE-specific regulations (FHFA, Dodd-Frank).
- Certifications: Azure Data Engineer (DP-203), Databricks, or AWS.
- Experience with real-time data streaming (Kafka, Event Hubs).
Recommended Jobs
Server
Job Description Job Description Position Description: Welcome to Volas Dockside Grill, a hidden gem on Alexandrias riverfront offering stunning, unobstructed views of the Potomac River. Our all-d…
Glass and Glazing Estimator
The job will require all stages of bidding on projects, including but not limited to: determining bid schedules; reviewing job specifications; visiting job sites; attending pre-construction meetings…
SAAS Functional Team Lead
This position is contingent upon contract award. Candidates must have an active Secret clearance and verify, before applying, that you meet the minimum requirements of the position. The Journey…
Locum Tenens Emergency Medicine Job VA
Weatherby Healthcare is currently seeking a Emergency Physician in VA If you are seeking a new opportunity or would simply like to learn more about locum tenens, give Weatherby a call today for det…
Preschool Teacher
Job Description Job Description We are looking for a passionate, energetic, and caring Staff to join the CWLC family. Creative World Learning Center is a family-owned business that started in …
Machine Operator 7PM-7AM
Job Description Job Description Description: To operate extrusion, pultrusion, or back lines in compliance with established company production processes and policies to achieve output needed to …
IT Operations Manager
Job Description Job Description Position Title: Information Technology Operations Manager Virginia Tech Foundation, Inc. (VTF) is a nonstock corporation established in 1948 for the sole purpos…
Optometrist Job - Hampton, VA - Join Ophthalmology Practice
Thriving ophthalmology practice is looking to add a full time optometrist; medically oriented doctor; in a thriving clinical based practice. See approximately 18 patients per day. Strong tech support.…
Dispatcher
Job Description Job Description We are looking for an experienced Dispatcher to join our team on a long-term contract basis in Newport News, Virginia. In this role, you will manage service calls,…
Sterile Processing Technician - Concert
Sterile Processing Technician Location: Virginia Beach, VA (Concert Dr.) Department: Production & Logistics Job Type: Full-Time Shift: Mon-Fri 5:45AM-2:30PM; OT & On-Call as needed; Essenti…