Data Engineer
Job Description
Job Description
Closure Technologies is seeking a Data Engineer that will leverage their development skills and experience, to support the successful designing, ingesting, cleansing, transformation, loading, and display of significant amounts of data.
Clearance Requirement: TS/SCI with Polygraph
Key Responsibilities:
- Designing, implementing, and optimizing data extraction, cleansing, transformation, loading, replication/distribution, and large-scale ingest systems in a Big Data environment
- Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
- Developing custom solutions/code to ingest and exploit new and existing data sources
- Developing data profiling, deduping logic, and matching logic for analysis
- Organizing and maintaining Data Layer documentation, so others are able to understand and use it. Also, work closely with data scientists to craft data pipelines which serve the development of modern AI/ML workflows
- Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods
- Effectively articulating the risks and constraints associated with software solutions, based on environment
Required Qualifications:
- 2+ years of relevant software development/programming experience.
- Demonstrated data analysis, parsing, and programming language experience (e.g. Python, Java) coupled with significant SQL/database experience.
- Experience with the full data lifecycle, from ingest through display, in a Big Data environment.
- Hands-on experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs.
- Experience with data pipelining systems (e.g. Apache Airflow) and developing/performing ETL tasks in a Linux environment.
Preferred Qualifications:
- Experience deploying systems that leverage AI/ML technology
- Experience publishing results in BI dashboards.
Recommended Jobs
Payroll Specialist
Job Description Job Description Our growing manufacturing organization is seeking a detail-oriented Payroll Representative to join our Shared Services team in Charlottesville, VA. This role is id…
Software Engineer (Senior)
Job Description Job Description Who We’re Looking For (Position Overview) Spry Methods is seeking a Software Engineer to support a federal customer in Quantico, VA. The ideal candidate will …
General Manager Restaurant
Job Description Job Description Deli Italiano , a group of family restaurants specializing in pizza, subs, and fantastic customer service, needs an energetic manager ready to grow with our busin…
Dispatcher
Job Description Job Description Job Summary - We are seeking a highly organized and detail-oriented Dispatcher to coordinate the daily scheduling and dispatch of drivers, equipment, and crews a…
Physical Therapist - Travel Contract
Looking for a change of scenery and a chance to help others. Join as a traveling Physical Therapist in Woodstock, VA at a hospital-affiliated outpatient clinic where you will help patients recover fr…
Low Voltage Security Technician
Job Details: Low Voltage Security Technician Position Overview We are seeking a skilled and motivated Low Voltage Security Technician to install, maintain, and service electronic security sy…
Driver, Local Shuttle (Class CDL- A)
DSV - Global transport and logistics In 1976, ten independent hauliers joined forces and founded DSV in Denmark. Since then, DSV has evolved to become the world's 3rd largest supplier of global so…
Doorperson
Description Crescent Hotels & Resorts is honored to announce an exciting opportunity for a talented Doorperson for the JW Marriott Reston Station Residences! Experience a new level of luxury a…
Performance Marketing Manager
Overview Performance Marketing Manager Capital One’s Small Business Bank (“SBB”) is entering an exciting time of national growth powered by the national rollout of digital account opening. The…
Staff Accountant
About MultiState MultiState is a full-service state and local government relations firm. We exist to make the extraordinary expected so our clients can act with confidence to achieve their goals. Ser…