Enterprise - Senior Data Engineer - Python, SQL, Spark

Erias Ventures was founded to serve its customers with an entrepreneurial mindset. We value creative problem-solving , open communication , and empowering our employees to make decisions and put forth new ideas.

Our staff includes technical experts working across multiple disciplines, bringing diverse perspectives to every project. We are seeking engineers who wish to grow their careers and want to become part of a technically strong and growth-oriented company focused on bringing innovative solutions to the difficult mission problems facing our customers.

Description

Develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Activities include the following tasks: Movement of structure and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions.

• Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers
• Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
• Clean and preprocess data to enable access for advanced analytics
• Collaborate with enterprise working groups to advance the state of data standards
• Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
• Collaborate with software engineers to update, configure, and maintain data services based on the requirements
• Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines
• Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms

Clearance
A current Top-Secret/SCI with polygraph security clearance is required. Candidates cannot be sponsored or nominated for a government security clearance under this position.

Experience Required skills:

• Data lifecycle engineering
• Development and maintenance of extract, transform and load (ETL) tools and services
• Cloud and on-prem data storage and processing solutions
• Python, SQL, Spark and other data engineering programming
• COTS and open source data engineering tools such as ElasticSearch and NiFi
• Processing data within the Agile Lifecycle

Desired skills:

• Experience using AI/LLMs to accelerate the processing and transformation of data

Benefits
Erias Ventures provides a complete package of wealth, health, and happiness benefits. The expected salary range for this position, depending on education and years of experience is $150,000 - $265,000.

Wealth Benefits:

• Above Market Hourly Pay
• 11% Roth or Traditional 401k with Immediate Vesting and Deposit
• Spot Bonuses for Assisting with Business Development and Company Growth
• Professional Development Bonuses for Certificates and Degrees

Health Benefits:

• Company subsidized Medical Coverage
• 100% Company Paid Vision and Dental Coverage
• 100% Company Paid Long Term Disability , Short Term Disability , and Group Life Insurance
• Monthly Wellness Reimbursement

Happiness Benefits:

• Paid Time Off with Flexible Work Schedules and Birthday Off
• Amazon Prime Membership and Monthly Internet Reimbursement
• Technology and Productivity Allowance for Equipment and Supplies
• Morale Building and Company Events to Celebrate our Successes and Build our Community
• Onboarding and Annual Swag
• Company Paid Professional Development and Training

At Erias Ventures, we are dedicated to fostering a diverse and inclusive workplace. As an equal opportunity employer, we ensure that all qualified applicants are considered for employment based on merit, without discrimination. We welcome individuals regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Referrals & Inquiries
Do you know a cleared professional seeking to advance their career? Interested in earning some extra cash? If so, refer them to us with their name and contact details, and you could be eligible for a referral bonus of up to $10,000 for each successful hire.

Not seeing the right position right now? Reach out to us, and we’ll notify you as new contracts and opportunities become available!

Please send referrals and inquiries to:
[email protected]

To learn more about our company visit our webpage or LinkedIn .