Databricks Subject Matter Expert (SME) U.S. Citizenship Required
Description
Ready to Ignite your career and work alongside some of the brightest and most innovative professionals in cutting-edge data and cloud technologies? Join us and unleash your potential in an Agile, mission-driven environment supporting the men and women dedicated to safeguarding the American people and enhancing the Nation’s safety, security, and prosperity.
As a Databricks Subject Matter Expert, you will lead modernization efforts across enterprise data platforms, migrating legacy environments into scalable cloud-native architectures. You will design, build, and optimize advanced data pipelines and analytics solutions using Databricks, PySpark, and modern cloud tools—driving real-time insights and powering mission-critical applications. This role blends strategic architecture, hands-on engineering, and collaboration across cross-functional teams to deliver high-impact outcomes for national security missions.
Your Role
- Modernize the data warehouse environment by migrating the platform to Databricks.
- Work with database developers and administrators across multiple product teams.
- Serve as a data and technology expert across a broad and diverse set of mission critical applications.
- Design, develop, and maintain robust and scalable data warehouse architectures and ETL/ELT data pipelines using Databricks, PySpark, Python, SQL.
- Automate ETL/ELT data pipelines using Continuous integration, Continuous Deployment (CI/CD) tools and technologies.
- Evaluating existing data sets and reporting architectures to identify strategic gaps and apply modern technologies to creatively achieve superior mission outcomes.
- Analyze project-related problems and create innovative solutions involving technology, analytic methodologies, and advanced solution components.
- Optimize and troubleshoot data pipelines and warehouse performance to ensure efficient and reliable data processing.
- Actively participate in Agile Scrum sprint planning, artifact creation, sprint testing, regression testing, demonstrations, retrospectives and solution releases.
Must be a U.S. Citizen with the ability to pass CBP background investigation, criteria includes but is not limited to:
- 3 year check for felony convictions
- 1 year check for illegal drug use
- 1 year check for misconduct such as theft or fraud
- 7+ years of professional experience working on complex data challenges in the areas of data architecture and engineering
- 3–5 years of Databricks experience.
- Alternative/equivalent technologies such as Snowflake, Google BigQuery, or Microsoft Azure Synapse Analytics will also be considered.
- Proven expertise with Databricks, including extensive hands-on experience with PySpark, Python, SQL, Kafka, and Databricks notebooks.
- Strong experience with data modeling techniques (e.g., dimensional modeling, data vault) and database design.
- Experience building and optimizing data pipelines for batch and/or streaming data.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage and processing (e.g., S3, ADLS).
- Experience automating ELT data pipelines using Continuous Integration, Continuous Deployment (CI/CD) tools and technologies.
- Strong software development background using Agile or DevOps methods and deep familiarity with cloud-native technologies.
- Candidates with one or more of the above skillsets are encouraged to apply.
Desired:
- 5–10 years of DHS, DoD, or IC experience working in complex data environments, including the architecture and optimization of data schemas, terabyte-scale ETL, etc.
- 5–10 years of experience applying a range of analytical techniques including statistical, geospatial, link, temporal, and predictive analysis, for DHS, DoD, or IC agencies.
- 3–5 years of experience building and implementing artificial intelligence, neural networks, deep learning, or machine learning capabilities in software applications in a national security or academic environment.
- Exposure to implementing or migrating to Cloud environments like Amazon Web Services (AWS) or Microsoft Azure.
- Previous experience as an Enterprise-level Data Architect, Data Engineer, Data Scientist, or Data Analyst.
- Ability to apply advanced principles, theories, and concepts, and contribute to the development of innovative principles and ideas.
Ignite IT offers a comprehensive salary and benefits package to include Medical, Dental, and Vision; Short Term/Long Term/Life Insurance; 401K with matching and fully Vested 100%; PTO; Holiday; Training; and much more…
Ignite IT is an Equal Employment Opportunity/Affirmative Action Employer. We evaluate qualified applicants without regard to race, color, religion, sex, national origin, disability, Veteran status, sexual orientation, or other protected characteristic. In accordance with EO 13665 Final Rule, Ignite IT will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.
Applicants selected must be able to possess and maintain a government clearance as required for access to classified information.
US CITIZENSHIP REQUIRED
**If located within 40 miles of Ashburn, VA, candidate is expected to work 1 day per week in-office**
- 401(k)
- 401(k) matching
- Dental insurance
- Employee assistance program
- Flexible schedule
- Flexible spending account
- Health insurance
- Health savings account
- Life insurance
- Paid time off
- Professional development assistance
- Referral program
- Retirement plan
- Tuition reimbursement
- Vision insurance
Recommended Jobs
Document Control Support 3 (Clearance)
Job description: **The schedule for the role will be 2nd or 3rd shift (2:00 pm – 10:00 pm or 9:30 pm – 5:30 am)*** Confidential clearance required Job Description Performs operational dutie…
Consultant, Business Analyst/Project Manager
Consultant, Business Analyst / Project Manager About Infinitive Infinitive is a data and AI consultancy that enables its clients to modernize and operationalize their data to create lasting and s…
Speech Pathologist
Job Description Job Description Description: If Caring is at Your Core, You Belong at Lucy Corr! At Lucy Corr, exceptional caring is not just what we do – it’s at the core of who we are. We …
Neurology Physician - Williamsburg Ambulatory Clinic
Sentara Neurology Specialists in beautiful Williamsburg, Virginia is a thriving, growing practice seeking a Board-Certified or Board-Eligible general Neurologist to join a dynamic, patient-centered t…
Customer Service Representative
Job Description Job Description Description: A third generation, family-owned business, EE Wine, Inc., now trading as Wine Energy, employs more than 150 service-conscious individuals and operate…
Account Manager
Job Description Job Description Salary: $65,000 - $80,000 based on experience Sway Creative Labs is seeking a dynamic, detail-oriented Account Manager who excels in a fast-paced creative envir…
Housekeeping
he Room Attendant is responsible for maintaining clean and attractive guestrooms while providing attentive, courteous and efficient service to all guests. Physical Requirements Flexible an…
ECT198 Cloud Systems Administrator - Mid Level
Cloud Systems Administrator - Mid Level Location: Reston, VA (on-site) Security Clearance Requirement: Active TS/SCI with CI Poly (or ability to obtain poly) Responsibilities: Management …
Automotive Technician / Mechanic
DARCARS of Fairfax is now hiring for Automotive Technician / Mechanic! Potential Earning Based on Experience of $30 - $50 an hour + Seniority Bonus As an Automotive Technician / Mechanic you …
RN Clinical Supervisor (Fairfax)
Position: Clinical Supervisor (RN) Join a Company That Puts People First! Aveanna Healthcare is one of the largest private-duty nursing companies in the nation, with a growing presence and an…